Data Governance Databricks Consultant

Requirements:

• 5 or more years of experience working with Databricks in cloud environments such as Azure, AWS or Google Cloud Platform.
• Proficient in Databricks Unity Catalog and its data governance functionalities.
• Strong understanding of data governance frameworks, metadata management, and data lineage.
• Experience with cloud storage solutions, specifically Azure is required.
• Solid understanding of Python, SQL, and Spark SQL for data processing and transformation tasks.
• Knowledge of data privacy regulations and data security best practices.
• Experience with REST APIs and databricks CLI for automation and integration.
• Strong problem-solving skills, with the ability to troubleshoot complex data issues.

Responsibilities:

• Design and implement data governance solutions using Databricks Unity Catalog.
• Manage and enforce data security, access controls, and privacy policies within the Databricks platform.
• Collaborate with data engineering and analytics teams to develop data catalogs and data lineage frameworks.
• Configure and maintain data access roles, permissions, and audit capabilities in Unity Catalog.
• Ensure compliance with regulatory standards such as GDPR, HIPAA, and others related to data security and privacy.
• Monitor and maintain the health of the Unity Catalog infrastructure, including performance tuning and troubleshooting issues.
• Assist in automating data governance processes using Databricks and Python/Scala scripting.
• Stay up-to-date with latest features and releases in the Databricks platform and Unity Catalog.
• Optimize data storage and compute resources.

Founded in 1999, Resource soft, Inc. is a leading Technology Consulting and Professional Services organization. Headquartered in Marlborough, MA, the company serves the technology needs of its clients nationwide. Resource soft has often been recognized by prominent rating agencies for its exemplary growth and stability. With over two decades of industry experience, the Company has evolved as a front runner in enabling project optimization. We partner with leading organizations to provide technology solutions within the financial, insurance, education, government, publishing, healthcare and pharmaceutical domains. We take pride in mentoring a workforce that is well positioned to respond to the emerging IT trends and needs. With the employees at the crux of every business endeavor, our success is driven by our expertise in pairing the right talent with the best jobs in the technology sector. We forge long term, personalized relationships with our employees to advance their career to the next level. We engage them in technology centric client projects that provide opportunities for them to evolve, innovate and deliver world class products and services. Our career opportunities offer challenging assignments and exposure to emerging and cutting-edge technologies. We are committed to providing our employees with the tools necessary to accelerate their career progression, while maintaining a healthy, work-life balance. We are deeply committed to providing a workplace ambience that is both challenging and fulfilling.

Resource soft is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

For more information about Resourcesoft and our services, please visit our website.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.