Data Engineering Lead
DAC Beachcroft
In this role you will lead the design and delivery of an enterprise, AI-ready data platform on Azure, enabling advanced analytics, reporting and data-powered products. You’ll work with Data Architecture, Analytics and business teams to build robust pipelines, ensure trusted data, and support a data-driven, AI-enabled organization. You’ll combine hands-on delivery with leadership, setting engineering best practices and driving continuous improvement. This is a pivotal, strategically important role with impact on governance, security and cross-functional data initiatives.
Pay / Benefits- flexible work life balance
- private medical insurance
- income protection insurance
- discounted gym membership
- professional funding for growth
- in-person and remote social events
- Design, develop and maintain enterprise ETL/ELT pipelines from case management, finance, CRM and third-party systems into a central data platform
- Lead the cloud data platform development on Azure, ensuring scalability, reliability and cost-effectiveness
- Build and maintain datasets to support reporting, analytics, dashboards and data-enabled products
- Establish and promote engineering best practices, including CI/CD, automated testing, monitoring and alerting for pipelines
- Collaborate with Data Architects on target-state data models and modern data engineering principles
- Partner with data scientists and analysts to operationalize advanced analytics and predictive models
- Manage integrations with insurer portals and external data providers ensuring timely, secure data flows
- Support the organisation’s shift towards a data-driven and AI-enabled culture
- Senior Data Engineering or Lead Data Engineer experience
- Strong hands-on experience with Azure data technologies (Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, Azure Data Lake)
- Advanced SQL development skills
- Proficiency in Python and data pipeline orchestration tools with monitoring/automation
- Proven track record of production-grade, monitored data pipelines
- Experience integrating data from multiple business-critical applications and legacy systems
- Good understanding of data security, protection and access control in cloud platforms
- Comfort in regulated environments with sensitive data
- Excellent stakeholder management and communication skills
- stakeholder management
- communication
- collaboration
- Azure Data Factory
- Azure Synapse Analytics
- Microsoft Fabric
Reference: WJ-747_30230732