IT & Software

Senior Software Engineer, Data

wayve

London · Greater London · United Kingdom

Overview

In this role you will help build Wayve's Data Transfer Hub, a mission-critical data exchange layer that scales to petabytes of sensor data daily from partners. You will work in a small, autonomous team on a globally distributed hub-and-spoke system, collaborating with partners like Uber, Stellantis and Nissan to enable scalable model training. You will shape data pipelines, observability and cloud infrastructure to support data-driven AI development. This is a fast-paced, impact-driven position at a company advancing autonomous driving and data capabilities.

Pay / Benefits
  • hybrid working policy
Responsibilities
  • Build and operate PB-scale data transfer pipelines for video, LiDAR and sensor data from global partners
  • Contribute to the Data Transfer Hub design, balancing UX, reliability, throughput, cost, and partner constraints
  • Develop parallel data transfer pipelines with Flyte, Kafka and Azure-based storage/transfer infra
  • Implement a globally distributed hub-and-spoke data transfer model for scale with partners
  • Write infrastructure-as-code in Terraform and pipeline logic in Python
  • Establish reliable operational foundations: retries, backfills, data integrity checks, lifecycle tracking, dashboards and alerts
  • Work on cloud networking with Azure as primary cloud platform
  • Participate in on-call rotation after establishment
  • Collaborate with product, commercial and partner teams to deliver customer-focused solutions
  • Adapt to fast-changing requirements while maintaining high engineering standards
Key requirements
  • Experience building and operating large-scale data transfer or processing pipelines at multi-TB/PB scale
  • Strong software engineering skills and production-system experience
  • Experience with workflow orchestration for parallel jobs (Flyte preferred; Airflow/Prefect also relevant)
  • Experience building observable data systems with retries, backfills, data integrity checks and alerting
  • Strong cloud platform skills (Azure preferred; AWS/GCP a plus)
  • Proficiency in Python and Terraform
  • Experience with blob/object storage, large-scale file movement, networking or cloud-to-cloud data transfer
  • Product mindset with customer-focused problem solving
  • Comfort in fast-changing environments and strong ownership
  • Ownership and accountability
  • Clear communication
  • Customer-focused/problem-solving mindset
  • Python
  • Terraform
  • Flyte

Reference: WJ-747_30161122

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.