IT & Software

Senior Data Engineer

Mirai Tech Recruitment

Manchester · Greater Manchester · United Kingdom

Overview

As a Senior Data Engineer in a disruptive FinTech, you will help build and evolve a Databricks-native data platform that supports large-scale data processing and data science workflows. You will work in a cross-functional team to deliver reliable, scalable ingestion, transformation, and platform capabilities, enabling data science and automated workflows. The role focuses on production engineering, platform reliability, and governance within Azure, with opportunities to shape the data foundation for ML and agentic processes. You’ll operate in an output-driven, collaborative environment with autonomy and continuous learning.

Responsibilities
  • Develop and evolve Databricks-based data pipelines and platform capabilities
  • Handle high-volume data ingestion and transformation across the stack
  • Build production ETL/ELT pipelines
  • Implement APIs, SFTP/FTPS data retrieval
  • Contribute to CI/CD, automated testing and deployment processes
  • Ensure platform reliability, monitoring and troubleshooting
  • Manage Azure infrastructure, security and governance
  • Support Data Science, ML, and agentic workflows
  • Work within a cross-functional team to move toward a Databricks-native environment
Key requirements
  • Databricks experience (essential)
  • strong Python, SQL/Spark and ETL/ELT能力
  • good knowledge of databases and data warehousing, incl. dimensional/Kimball
  • understanding of platform, DevOps and systems engineering
  • genuine technical curiosity
  • STEM background beneficial but not essential
  • collaboration
  • curiosity
  • autonomy
  • Databricks
  • Python
  • SQL

Reference: WJ-747_30170417

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.