Data Engineering Lead

Salary: £61,000 - 101,000 per year

Requirements:

• Experience implementing data processes for data warehouse and production systems.


• Strong experience with big data technologies such as Hadoop and Spark.


• Programming experience in modern languages such as Scala and Python.


• Strong delivery engineering tooling experience with Git/GitHub, Jenkins, Ansible, and JIRA for requirement and backlog management.


• Strong understanding of software development methodologies, including Agile approaches such as Scrum and Kanban, and modern engineering practices such as CI/CD and automated testing.

Responsibilities:

• Technically lead the team and liaise with business stakeholders to ensure business requirements are fully understood before design and development.


• Write hands-on code and help team members solve technical problems, providing technical SME knowledge and guidance.


• Understand and design the application, and own changes required for new requirements while ensuring compliance with department standards.


• Evaluate new technologies and accessibility requirements.


• Guide developers in implementing best-of-breed technical solutions based on agreed technical design, using industry-standard development patterns and methodologies.


• Ensure implemented solutions have sufficient and appropriate automated testing before User Acceptance Testing.


• Manage continual service improvement, including incremental improvements, corrective measures to recover service performance, and eventual service retirement when no longer required.


• Lead end-to-end delivery of software from analysis through release to production and support.


• Deliver each change to production before moving on to the next.

Technologies:

• Ansible


• Big Data


• CI/CD


• Data Warehouse


• Git


• GitHub


• Hadoop


• Support


• JIRA


• Jenkins


• Kanban


• Network


• Python


• Scala


• Spark


• Matrix

More:

We are HSBC, one of the largest banking and financial services organisations in the world, with a network spanning more than 50 countries and territories. We are seeking a Data Engineering Lead to join our Wholesale Data & Analytics team, part of our Group Data Strategy to transform how we govern, manage, and use data across HSBC. This role offers visibility, impact, a fast learning curve, tailored professional development opportunities, and fantastic benefits. We are committed to diversity, inclusion, and accessibility, and we pride ourselves on creating a workplace where people can thrive.

last updated 40 week of 2026