Lead Data engineer (Lead II - Data Engineering)

Role Description

Location:West Yorkshire- multiple locations(Hybrid- 3 days working from onsite-Mandatory)

Immediate start

Permanent/ Contract inside IR35/ Fixed term contract

We're looking for a Lead Data Engineer to join UST Data Team. As the most senior engineer working across a number of squads, you'll blend hands-on engineering with providing technical leadership and mentorship to data engineers.

You will work closely with Product Managers, Visualisation Engineers, Data Analysts, Data Architects, and other stakeholders to deliver reliable, high-quality data products that drive client's strategic objectives. Additionally, you'll play a central role in championing best practices and fostering continuous improvement, actively contributing within our Agile community of practice.

Your Role (Key Responsibilities)

• Provide technical mentorship and direction to data engineers, helping to elevate team capability and maintain engineering standards, but also maximise their potential and promote career growth.
• Foster a DevOps culture of "you build it, you run it, you own it", promoting autonomy and ownership across the engineering organisation.
• Lead best practices in data engineering, code reviews, and development activities, ensuring the highest quality standards.
• Contributing to the Lead Engineer & Agile communities of practice. Ensuring data quality and integrity.
• Work with structured, semi-structured, and unstructured data with varying latencies, from batch through to real-time.
• Ensure engineering solutions comply with architectural frameworks and best practices defined by Data Architects.
• Collaborate with Product Managers and Data Analysts to ensure business requirements are translated into scalable, performant data solutions.
• Evaluate and recommend new technologies and tools to enhance data engineering capabilities.
• Balance hands-on engineering responsibilities with technical leadership to drive high-quality delivery.

About You (Experience & Qualifications)

• Proven experience building and maintaining high-quality, secure data solutions.
• Skilled in operating scalable and high-performance applications in production environments.
• Prepare to be tenacious and collaborate to drive the right solutions forward.
• Have a good understanding of Microsoft Azure tooling including Azure Databricks, preferably with hands-on experience.
• Strong understanding of data modelling and architectures (e.g. data vaults, data warehousing, data lakes etc.)
• Experience with Azure based solutions such as Azure Data Factory.
• Extensive experience with languages such as Python, SQL and, preferably, PySpark.
• Version control and best practices using Github.
• Experience in working with Agile frameworks such as Scrum, Kanban, Lean.
• Excellent communication skills, with the ability to clearly explain technical concepts to non-technical business stakeholders.
• Demonstrated experience leading and mentoring data engineers.

#UST

Skills

SQL, Python, Microsoft Azure, Azure Data Factory, Databricks