Software Engineer, Data Ingestion

In this role you will own and improve the ingestion data flows that power Wayve’s autonomous-driving platform. You’ll work within the Ingestion Systems Team to ensure high-volume data is processed reliably for annotation, model training and evaluation. You will diagnose data issues, optimize Spark-based pipelines, and design resilient flows that prevent data problems from blocking downstream work. You’ll contribute to monitoring, error handling and the technical direction of the ingestion platform. This is a growth-focused, hands-on role with meaningful impact on data quality and system efficiency.

• relocation support and visa sponsorship
• hybrid working
• learning and development budgets
• health insurance
• dental
• enhanced maternity and paternity leave (leave policies) or retirement/pension where applicable

• Debug and unblock failing ingestion pipelines, stalled jobs and processing queues
• Investigate corrupt, malformed or unexpected data from a variety of sources
• Optimize Spark jobs and batch-processing pipelines for throughput, reliability and compute efficiency
• Design and implement more resilient pipelines so individual bad data segments do not block wider workflows
• Improve monitoring, retries and failure recovery across multi-step ingestion workflows
• Help prioritise and unblock important datasets for downstream annotation, data science and model-training teams, and contribute to the technical direction of Wayve's ingestion platform.

• Strong production experience with Apache Spark and Python
• Built, operated or debugged large-scale ingestion, ETL or distributed data-processing pipelines
• Comfortable diagnosing production failures involving corrupt data, stalled queues, retries and complex dependencies
• Understanding of optimizing high-throughput systems for reliability, performance and cost
• Ability to learn an existing system quickly, work independently and deliver practical improvements in a fast-moving environment
• Experience with Airflow, Flyte, Databricks, Delta Lake, Scala or Java would be an advantage

• strong problem-solving abilities
• fast learner and self-motivated
• ability to work independently in a fast-moving environment
• Apache Spark
• Python
• Airflow