Data & Analytics Engineer
JCB
In this role you will own the design, build and optimization of reliable data pipelines and well-governed analytical datasets on the Databricks Lakehouse. You will transform raw data into BI-ready models, ensure data quality and lineage, and enable fast, secure analytics for stakeholders. You’ll work with business partners and SI counterparts to deliver scalable, value-adding data solutions that support the company’s data capabilities transformation. This is a hands-on, cross-functional role with a strong emphasis on governance, performance, and collaboration to drive data-enabled decision making.
Pay / Benefits- 33 days’ holiday
- company pension
- onsite gym
- in-house doctor and dentist
- ULEV car scheme
- Cycle to Work Scheme
- Design and implement batch and streaming pipelines across bronze, silver and gold layers using PySpark, Spark SQL, DLT and Auto Loader
- Implement CDC patterns, incremental loads, optimize partitioning, Z Order and perform OPTIMIZE/VACUUM
- Build robust tests, data quality checks, observability (alerts/metrics) and runbooks
- Orchestrate workloads with Databricks Jobs
- Collaborate on CI/CD with Platform teams (Repos, Git, Terraform, deployment pipelines)
- Model curated gold datasets and semantic layers for BI (Tableau/PowerBI)
- Optimize SQL Warehouses for performance, concurrency and cost; maintain versioned metrics
- Document tables with catalog cards (ownership, lineage, SLA, data contracts); enhance discoverability
- Implement access controls via Unity Catalog; follow naming and tagging conventions; participate in access reviews and privacy/compliance processes
- Attention to detail and high standards for accuracy and consistency
- Customer-focused with ability to build client relationships
- Strong stakeholder communication and ability to translate business needs into data models/pipelines
- Documentation mindset (runbooks, catalog cards, README)
- Experience in a multinational business and complex systems landscape
- Flexible attitude and positive stance towards change
- Team player who thrives in collaborative environments
- Attention to detail
- Customer-focused
- Stakeholder communication
- PySpark / Spark SQL
- Databricks Lakehouse experience
- Delta Live Tables (DLT)
Reference: WJ-747_30149597