Data Engineer

Senior Data Engineer – London-UK, Spain, Germany & Portugal

Remote

Role Overview

We are looking for a Senior Data Engineer with strong expertise in Python, SQL, Data Engineering, and AI/ML to design, build, and deliver scalable data and AI solutions.

The role involves owning technical workstreams end-to-end, contributing to Generative AI and Agentic AI solutions , and applying modern data engineering, MLOps, and LLMOps practices across enterprise environments.

Key Responsibilities

• Design, develop, and maintain scalable data engineering and AI solutions .
• Lead technical workstreams and mentor junior engineers while promoting strong software engineering practices.
• Build Generative AI, Agentic AI, Machine Learning, and Business Intelligence solutions .
• Work with technologies such as Spark, LangChain, Databricks, Dask, Airflow, Dagster, and Kedro .
• Develop AI capabilities using prompt engineering, RAG, embeddings, vector databases, and context engineering .
• Own AI feature delivery from development through production, including evaluation, reliability, guardrails, and performance optimisation .
• Implement data security and governance , including PII/PHI protection, authentication, and RBAC.
• Establish and maintain MLOps and LLMOps pipelines , including CI/CD and automated AI/agent evaluation.
• Use tools such as LangSmith, Opik, Langfuse, and Terraform across AWS, Azure, and GCP environments.
• Work effectively in polyglot enterprise environments involving Python, SQL, Scala, and Java .
• Independently manage technical deliverables, priorities, and timelines.
• Collaborate effectively with technical and business stakeholders.
• Travel occasionally when required.

Required Skills & Experience

• Degree in Computer Science, Engineering , or equivalent professional experience.
• 5+ years of relevant experience in Data Engineering.
• Strong experience leading technical initiatives, mentoring engineers, and driving engineering best practices.
• Expert-level Python and SQL skills.
• Hands-on experience with Generative AI, Agentic AI, Machine Learning, and BI solutions.
• Strong knowledge of RAG, embeddings, vector databases, prompt engineering, and context construction .
• Experience with modern frameworks and platforms such as Spark, Databricks, LangChain, Airflow, Dagster, Dask, or Kedro .
• Experience with MLOps/LLMOps, CI/CD, AI evaluation, and production AI systems .
• Knowledge of LangSmith, Opik, Langfuse , or similar AI evaluation/observability tools.
• Experience with Terraform and cloud environments such as AWS, Azure, and GCP .
• Understanding of data security, governance, PII/PHI, authentication, and RBAC .
• Strong English communication skills and proficiency in the relevant local language.
• Ability to work independently with strong ownership, organisation, and time-management skills .

Nice to Have

• Experience using AI coding assistants/agents such as Cursor, Claude Code, or Codex .
• Experience working with Scala and Java in enterprise environments.
• Willingness to travel when required.

Location: Spain, Germany or Portugal, UK