IT & Software

Data Engineer - AWS, Spark & AI

Datatech Analytics

London · Greater London · United Kingdom

Overview

In this Data Engineer role, you will design and optimize scalable data pipelines and ETL/ELT processes for a fast-growing tech startup in London. You’ll leverage Python, SQL, Spark and AWS data services to handle large, complex datasets and deliver reliable data solutions. You’ll work with AI-assisted development tools to accelerate coding and problem-solving, collaborating across engineering, analytics and data science teams. This is a hands-on role with measurable impact from day one, offering freedom to experiment and shape the data platform as the business scales.

Pay / Benefits
  • hybrid working (3 days in office, 2 days remote)
  • competitive salary (60,000-75,000 depending on experience)
  • opportunity to influence data platform as the business scales
  • work with cutting-edge data and AI technologies
  • fast-growing technology start-up environment
  • recognised industry recruitment partner with events like Women in Data
Responsibilities
  • Design, build and optimise scalable data pipelines and ETL/ELT processes
  • Develop and maintain data engineering solutions using Python, SQL and Spark
  • Work with large and complex datasets ensuring data quality, reliability and performance
  • Use AI-assisted development tools to support coding, problem solving and delivery
  • Collaborate with engineering, analytics and data science teams to develop effective data solutions
  • Identify opportunities to automate processes and improve scalability and efficiency of data workflows
Key requirements
  • Strong hands-on data engineering experience
  • Strong coding fundamentals across Python and SQL
  • Hands-on experience with Spark for large-scale data processing
  • Hands-on experience with AWS data services
  • Experience designing and developing scalable data pipelines and ETL/ELT processes
  • Practical experience using AI-assisted development tools such as Claude
  • Strong communication skills and ability to work in a fast-moving, collaborative environment
  • Strong communication
  • Collaborative mindset
  • Ability to work in a fast-moving environment
  • Python
  • SQL
  • Spark

Reference: WJ-747_30134124

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.