Databricks Data Engineer (Contract)
Harnham
In this Data Platform Engineer role, you’ll evolve the core data platform to enable trusted, scalable data access across the business. You’ll work within a collaborative engineering culture to improve data quality, observability, and governance, adopting a platform-as-a-product mindset. The role supports data-driven decision making and experimentation that touches millions of users daily. This six-month, remote, UK-based position emphasizes autonomy, technical excellence, and continuous improvement, with a strong focus on impactful platform work.
Responsibilities- Build and maintain data infrastructure including microservices, pipelines, and backend systems for analytics and ML initiatives
- Design and implement scalable, secure data services using Terraform, Docker, and AWS
- Enhance data governance, lineage, contracts, monitoring, and cataloguing tooling
- Lead automation, monitoring, and incident response to ensure platform reliability
- Collaborate with data scientists, ML engineers, analysts, and product teams to meet data needs
- Mentor peers and promote engineering best practices
- Strong experience in Python and software engineering practices (testing, CI/CD, automation)
- Proven track record designing, building, and scaling data platforms in production
- Hands-on with Airflow, DBT, Databricks, and data catalogue/observability tools (Monte Carlo, Atlan, Datahub)
- Cloud infrastructure knowledge (AWS or GCP) including S3, RDS, EMR, ECS, IAM
- Experience with DevOps tooling, especially Terraform and CI/CD pipelines (Jenkins)
- Proactive, growth-oriented mindset with passion for modern data and platform tech
- Cross-functional collaboration
- Mentorship and knowledge sharing
- Proactivity and continuous learning
- Python
- Airflow
- DBT
Reference: WJ-747_30154114