Lead Azure Databricks Data Engineer

Lead scalable data engineering at Gore Mutual using Azure Databricks, Python, and Spark to strengthen enterprise data infrastructure and delivery.

As Lead Data Engineer, you will design, develop, and maintain the Databricks lakehouse as the enterprise single source of truth. You will provide technical leadership while collaborating with data scientists, data product owners, IT, and business stakeholders. Your work supports policy, billing, claims, and finance data for reporting, pricing, and analytics.

Key Responsibilities:

• Develop scalable, reliable, and resilient data infrastructure systems
• Build configuration-driven pipelines spanning policy, billing, claims, and finance
• Implement data quality checks within incoming data pipelines
• Automate data management processes and handle data security
• Optimize, test, monitor, and maintain production data platforms

Requirements:

• Bachelor’s or Master’s degree in a related field
• Five to eight years of relevant data engineering experience
• Hands-on Azure Databricks and Microsoft Azure services knowledge
• Proficiency in Python, Spark, distributed systems, and SQL
• Experience mentoring engineers and owning initiatives end to end

Apply your Azure Databricks, Python, Spark, and technical leadership expertise to Gore Mutual’s enterprise data platform.