Senior Azure Databricks Developer

Develop Azure and Databricks data transformations as a Senior Software Developer ETL consultant working hybrid, onsite three days weekly. Use PySpark, SQL, and Power BI.

This senior assignment focuses on data engineering and quality assurance across analytics infrastructure. You will create pipelines, apply Medallion Architecture practices, support release management, and improve validation. Collaboration includes data engineers and DevOps teams.

Key Responsibilities:

• Implement data pipelines and transformations across the technology stack
• Apply Medallion Architecture across staging, Bronze, Silver, and Gold layers
• Manage DevOps practices using Azure DevOps and Git
• Document test cases, validation rules, and QA processes
• Participate in sprint planning and Agile retrospectives

Requirements:

• Five-plus years of public-sector professional experience
• Five-plus years designing and implementing data engineering pipelines
• Strong hands-on knowledge of PySpark and SQL
• Power BI data preparation, modelling, and visualization experience
• Experience with CI/CD, Azure DevOps, Git, and Visual Studio Code

Apply Azure, Databricks, PySpark, SQL, Power BI, and DevOps skills to senior ETL delivery and data engineering.