IT & Software

Data Engineering Lead

DAC Beachcroft

London · Greater London · United Kingdom

Overview

In this role you will lead the design and delivery of a scalable, secure, AI-ready enterprise data platform. You will collaborate with Data Architecture, Analytics and business teams to build robust data pipelines and trusted data sources for analytics, dashboards and AI-enabled processes. You’ll drive modern data engineering practices in a cloud-first environment and mentor teams while shaping data-driven and AI-enabled capabilities. The position offers impact across claims management and related domains with cutting-edge Azure technologies.

Pay / Benefits
  • private medical insurance
  • income protection insurance
  • discounted gym membership
  • professional funding
  • remote social events
  • ESG involvement
Responsibilities
  • Design, develop and maintain enterprise ETL/ELT pipelines integrating data from case management, financial, CRM and third-party systems into a central data platform
  • Lead the development and continuous improvement of the cloud-based data platform within Azure
  • Ensure pipelines are scalable, reliable, cost-effective and resilient
  • Build and maintain datasets supporting reporting, analytics, dashboards and data-enabled products
  • Establish engineering best practices including CI/CD, automated testing, version control, and monitoring/alerting
  • Collaborate with Data Architects to implement target-state data models and modern data engineering principles
  • Partner with data scientists and analysts to operationalise advanced analytics and predictive models
  • Manage integrations with insurer portals and external data providers ensuring high-quality, timely, secure data flows
  • Support the organisation’s shift to being data-driven and AI-enabled
Key requirements
  • Senior Data Engineering or Lead Data Engineer experience
  • Hands-on experience with Microsoft Azure data technologies (Azure Data Factory, Synapse Analytics, Microsoft Fabric, Azure Data Lake)
  • Advanced SQL development
  • Python and modern data pipeline orchestration tools with monitoring/automation
  • Proven track record of production-grade data pipelines
  • Experience integrating data from multiple business-critical applications and legacy systems
  • Understanding of data security, protection and access control in cloud platforms
  • Comfort working in regulated data environments with sensitive personal and litigation data
  • Excellent stakeholder management and communication skills
  • stakeholder management
  • communication
  • leadership
  • Azure Data Factory
  • Azure Synapse Analytics
  • Microsoft Fabric

Reference: WJ-747_30233176

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.