Lead Data Engineer
Kainos
As Lead Data Engineer at Kainos, you design and build data processing and persistence components for scalable solutions. You provide hands-on leadership in agile teams, ensuring code quality and alignment with user needs. You’ll shape non-functional aspects of ETL/ELT pipelines and drive testing, deployment, and operational readiness. You’ll collaborate with architects, security, and customers to estimate effort and impact, contributing to technical proposals and delivery. This role combines hands-on engineering with team leadership to deliver data-driven outcomes at scale.
Responsibilities- Lead development of entire components or subsystems within a team, including design, code, tests, and defect resolution
- Hands-on design and development using open source and commercial platforms
- Define and enforce development best practices and coach team members
- Own non-functional aspects of ETL/ELT pipelines (robustness, performance)
- Oversee unit/integration testing standards and execution within the team
- Ensure software product due diligence and integration quality
- Lead troubleshooting and performance tuning activities
- Coordinate with Operations to ensure operational readiness
- Collaborate with Security Architects to ensure compliance with legal and security requirements
- Advise customers and stakeholders on effort estimates and technical implications of user stories
- Contribute to technical proposals in the sales process
- Manage, coach, and develop a small team with a focus on performance and career growth
- Experience leading a team of engineers on data-intensive components
- Experience applying design, development, and deployment standards
- Proficient in Java, Scala, or Python
- Experience with data-processing platforms (Informatica, Azure Databricks) or relevant ETL tools
- Expert in SQL or SQL extensions for analytics
- Strong understanding of distributed data stores and data processing frameworks
- Clear written and verbal technical communication skills
- Proficient in designing analytical and operational data models
- Keen interest in AI technologies
- strong communication
- coaching and mentoring
- problem solving
- Java/Scala/Python
- Informatica
- Azure Databricks
Reference: WJ-747_30153124