Lead Data Engineer

Lead Data Engineer | London | 2 days a month in office

I’m working with a leading UK business that is investing heavily in its data and technology capabilities, and they’re looking for a Lead Data Engineer to join the team.

This is a technical leadership role where you’ll specialise in Databricks and manage a team of 4 Data Engineers , while providing technical direction across the wider data engineering function.

The role

• Manage, mentor and develop a team of 4 Data Engineers
• Provide technical leadership across data engineering projects
• Design and deliver scalable data products and pipelines
• Work closely with Data Scientists, Analysts, Architects and Product teams
• Drive engineering standards around coding, testing and data quality
• Oversee batch and real-time data integrations
• Help shape the evolution of a modern cloud data platform
• Improve engineering processes and ways of working across the wider data community
• Provide hands-on technical guidance where required
• Support wider data, ML and AI initiatives

What they’re looking for

• Strong commercial Data Engineering experience
• Previous experience leading, mentoring or managing Data Engineers
• Strong Python and SQL skills
• Experience with Databricks on AWS
• Strong Spark and Airflow experience
• Experience building scalable data pipelines and integrations
• Good understanding of CI/CD and Git
• Experience with Terraform or similar IaC tools
• Strong understanding of data modelling and data quality
• A genuine interest in developing people as well as technology

If you’re a Data Engineer who has moved into technical leadership or people management and want to lead a team while staying close to the technology, get in touch.