IT & Software

Manager, Senior Databricks Data & AI Engineer/Technical Lead/Databricks Architect (Solution Engineering | AI/ML), Engineering, AI & Data, Technology & Transformation

Deloitte

London · Greater London · United Kingdom

Overview

As a Senior Databricks Data & AI Engineer / Technical Lead, you will steer engineering delivery and shape solution architectures for enterprise Databricks programs. You’ll lead onshore and offshore teams, ensure scalable, secure platforms, and deliver data, ML, and Generative AI solutions at scale. You’ll work with cross-functional stakeholders to translate needs into robust technical designs and governance. This role offers impact across large Transformation programmes and the opportunity to shape modern data platforms at Deloitte.

Pay / Benefits
  • hybrid working
  • London based with flexible remote option
  • career development opportunities
  • collaborative culture
  • support for wellbeing
  • involvement in high-impact transformation projects
Responsibilities
  • Lead technical delivery and/or solution architecture for enterprise-scale Databricks Data & AI implementations from design to production
  • Act as design authority across multiple workstreams to ensure quality, scalability, security, and best practices
  • Mentor onshore and offshore engineering teams to foster technical excellence
  • Drive delivery by setting standards, reviewing designs, managing risks, and aligning with project objectives
  • Conduct code reviews and promote clean, maintainable engineering practices
  • Optimise Spark workloads, Delta Lake, data pipelines, storage, and compute for scalability and cost efficiency
  • Design and deliver enterprise ML, Generative AI, and Agentic AI solutions on the Databricks platform
  • Partner with architects, product owners, and stakeholders to translate requirements into scalable solutions
  • Coach and develop engineers, establish reusable frameworks, and share knowledge
  • Define enterprise architectures on Databricks, produce reference architectures and blueprints
  • Support solutioning and pre-sales by shaping proposals and advising on architecture strategy and roadmaps
Key requirements
  • Proven experience leading enterprise-scale Databricks implementation programmes
  • Extensive experience as Technical Lead, Engineering Lead, Solution/Platform Architect, or Design Authority
  • Experience leading offshore engineering teams
  • Strong hands-on Python, PySpark, and SQL
  • Experience delivering Generative AI & Agentic AI solutions including AI Agents, RAG, Vector Search, LLM orchestration and governance
  • Production-grade ML solutions delivery, MLflow and MLOps expertise
  • CI/CD, automated testing, and Infrastructure as Code for Databricks
  • Modern DevOps practices and Agile delivery
  • Databricks platform expertise including Spark, Delta Lake, Unity Catalog, Databricks SQL, Workflows, Lakeflow, Mosaic AI, Agent Bricks
  • Cloud experience in Azure, AWS, or GCP
  • Excellent communication and stakeholder management
  • Excellent communication
  • Stakeholder management
  • Mentoring and coaching
  • Databricks Data Intelligence Platform
  • Delta Lake
  • Unity Catalog

Reference: WJ-747_30168495

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.