IT & Software

Lead Data Engineer

Lorien Resourcing

London · Greater London · United Kingdom

Overview

In this senior, hands-on role you will anchor data engineering work for an enterprise platform, driving end-to-end delivery of robust data pipelines and services. You’ll operate across legacy and cloud environments to improve real-world data systems, guiding teammates through design decisions and technical delivery. The role emphasizes practical problem-solving, data quality, and governance in a fast-paced, complex setting. You’ll work closely with stakeholders to translate operational challenges into scalable solutions and help raise engineering standards.

Responsibilities
  • Design, build, and enhance enterprise-scale data pipelines, platforms, and data services
  • Lead end-to-end data engineering work from problem definition to operational use
  • Collaborate with technical and non-technical stakeholders to translate problems into data solutions
  • Analyse and synthesize data from multiple sources to shape structure, validation, and consumption
  • Provide technical leadership through design decisions, code, and delivery support
  • Improve data sharing, onboarding of new sources, and interoperability across teams
  • Evaluate and adopt tools and patterns that provide genuine value while balancing pragmatism
  • Develop robust, production-grade solutions and address metadata, lineage, and data quality as core concerns
  • Diagnose and resolve complex data and platform issues in constrained environments
  • Contribute to an inclusive engineering culture with high technical standards
Key requirements
  • Hands-on experience as a Senior or Lead Data Engineer on complex, real-world systems
  • Strong Python and Spark skills, with production data pipelines experience
  • Deep understanding of the full data engineering lifecycle (ingestion, transformation, storage, serving, reuse)
  • Experience designing data integrations with diverse sources and legacy systems
  • Ability to design data models for analysis, operational use, and maintainability
  • Knowledge of data security, compliance, and governance integrated into systems
  • Experience with established data development practices (version control, testing, deployment, change management)
  • Clear communication between technical and non-technical stakeholders
  • Persistence tackling messy data and organizational complexity
  • Clear communication with technical and non-technical stakeholders
  • Persistence and resilience in challenging environments
  • Collaboration and teamwork
  • Python
  • Apache Spark
  • End-to-end data pipeline development

Reference: WJ-747_30157033

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.