Lead Data Engineer

Lead Data Engineer REMOTE - Public Sector (SC Cleared)

Want to be the technical anchor on a data engineering team that's shaping how a major public sector programme handles data at scale? This is that role.

We're looking for an experienced Lead Data Engineer to drive delivery on a high-profile, remote-first Lakehouse programme — owning quality, mentoring the team, and setting the standard for how pipelines get built.

Up to £440/day (inside IR35)

Remote — work from anywhere in the UK

Active SC Clearance required

️ Immediate start

What you'll be doing:

Leading data engineering delivery across source connectivity & transformation — accountable for sprint output and quality

Designing complex pipeline patterns for large and XL-complexity feeds, including CDC and parallel load

Governing pattern reusability and correctness before feed supplier handover — your standards, applied across the team

Mentoring Data Engineers, running design reviews, and enforcing data engineering standards across the board

Tech stack: AWS Glue, S3, MWAA, Apache Iceberg, Python, PySpark, Terraform

Must-have: Active SC Clearance + proven leadership in data pipeline design

This isn't a \"build what you're told\" role — you'll be setting the technical direction and mentoring engineers on one of the most complex data feeds programmes in the public sector right now.

Ready to lead? Drop me a message or send your CV over — let's talk.

#LeadDataEngineer #DataEngineering #AWS #CDC #SCCleared #ContractJobs #PublicSector