IT & Software

GCP Data Engineer

Involved Solutions

London · England · United Kingdom

Salary: £68,000 - 108,000 per year

Requirements:

  • Strong experience as a Data Engineer within GCP environments
  • Hands-on experience with BigQuery, Dataflow and Spanner
  • Strong programming capability in Python, Java or Scala
  • Experience with Apache Beam / Dataflow and distributed processing frameworks
  • Experience designing and managing ETL / ELT pipelines
  • Solid understanding of data modelling and database design
  • Experience with workflow orchestration tools such as Apache Airflow
  • Strong understanding of data governance, security and scalability
  • Experience with Pub/Sub, Cloud Composer or Cloud Data Fusion
  • Exposure to CI/CD, DevOps and Infrastructure as Code
  • Experience with real-time streaming architectures
  • Knowledge of modern data governance frameworks

Responsibilities:

  • Design and build scalable data pipelines, ETL/ELT workflows and cloud data architectures on GCP
  • Develop solutions using services such as BigQuery, Dataflow, Spanner and Cloud Storage
  • Build and maintain code using Python, Java or Scala for data transformation and processing
  • Optimise data pipelines, queries and workloads for performance and scalability
  • Implement data quality, validation and governance controls
  • Collaborate with cross-functional teams to deliver end-to-end data solutions
  • Ensure alignment with security, privacy and compliance standards
  • Troubleshoot issues across pipelines and processing workflows
  • Maintain documentation across data flows, platforms and architectures

Technologies:

  • Airflow
  • BigQuery
  • CI/CD
  • Cloud
  • Composer
  • DevOps
  • ETL
  • GCP
  • Java
  • Python
  • Scala
  • Security
  • Support

More:

We are a globally established organisation offering a permanent GCP Data Engineer position based in London on a hybrid basis, with 3 days per week onsite. This full-time role offers a salary of up to 85,000 plus bonus and benefits. You will help build modern, scalable cloud data platforms within a complex enterprise environment, with strong exposure to cloud transformation and enterprise-scale data delivery.

#J-18808-Ljbffr

Reference: WJ-766_21911843

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.