IT & Software

Databricks Data Engineer

NTT DATA

London · Greater London · United Kingdom

Overview

As a Databricks Data Engineer in NTT DATA's Data & AI practice, you will build scalable data pipelines and optimize Lakehouse architectures to enable advanced analytics and AI use cases for clients. You’ll design robust ETL/ELT workflows, integrate real-time and batch data sources, and ensure governed data products. You’ll work in a collaborative, client-facing environment, driving data solutions from conception to delivery. This role offers the chance to shape modern data ecosystems at scale and contribute to innovative client outcomes.

Responsibilities
  • Client engagement & delivery
  • Data pipeline development (batch and streaming)
  • Databricks & Lakehouse architectures
  • Data modelling & optimisation (Delta Lake, Medallion architecture)
  • Collaboration & best practices
  • Quality, governance & security
Key requirements
  • Proven data engineering and pipeline development on Databricks and cloud-native platforms
  • Strong consulting values with client-facing collaboration
  • Hands-on experience across ingestion, transformation, modelling, governance, and consumption
  • Strong problem-solving, analytical, and communication skills
  • Experience leading or mentoring teams of engineers to deliver scalable data solutions
  • Deep expertise with Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow)
  • Proficiency in ETL/ELT tools such as DBT, Matillion, Talend
  • Strong SQL and Python skills
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Familiarity with Databricks Workflows and orchestration tools
  • Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon)
  • Familiarity with medallion architectures, data lakehouse concepts and distributed processing
  • Experience with GitHub, Bitbucket and CI/CD pipelines
  • Understanding of data governance, security, and compliance frameworks
  • Exposure to AI/ML workloads desirable
  • Consulting mindset and client-facing collaboration
  • Strong problem-solving and analytical abilities
  • Excellent communication skills
  • Databricks platform (Spark/PySpark/Scala)
  • Delta Lake
  • Unity Catalog

Reference: WJ-747_30193320

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.