IT & Software

Databricks Data Engineer

Tria Recruitment

London · Greater London · United Kingdom

Overview

In this role you will design and maintain data ingestion pipelines in a modern Azure/Databricks environment. You will connect to multiple sources, build robust pipelines, and ensure scalable, reliable data flows for the organization. You’ll implement ingestion strategies, develop ETL/ELT processes, and apply transformation modeling to enable data-driven decisions. This contract role focuses on practical data ingestion and engineering, collaborating with cross-functional teams to support analytics and data platforms. The opportunity offers hands-on work with Databricks, Azure services, and contemporary data architectures to shape data pipelines at scale.

Responsibilities
  • Build and maintain data ingestion pipelines using Databricks
  • Connect to multiple data sources including SQL databases, APIs and Azure services
  • Develop pipelines using Azure Data Factory and Databricks Lakeflow
  • Implement ingestion strategies including incremental and batch loads
  • Develop ETL/ELT processes using Databricks Medallion Architecture
  • Write and maintain Python data engineering code
  • Use dbt for data transformation and modelling
  • Ensure pipelines are scalable, reliable and maintainable
Key requirements
  • Strong commercial Databricks experience
  • Proven data ingestion experience
  • Azure Data Factory
  • Databricks Lakeflow
  • SQL and API integration
  • Medallion Architecture
  • Strong Python
  • dbt
  • Experience with incremental/batch data ingestion
  • Databricks
  • Azure Data Factory
  • Databricks Lakeflow
  • SQL
  • APIs
  • Medallion Architecture

Reference: WJ-747_30172712

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.