IT & Software

Data Engineer - Spark & Scala

GIOS Technology

Glasgow · Scotland · United Kingdom

We are hiring: Data Engineer – Spark & Scala

Location: Glasgow, UK – Hybrid (2–3 days onsite)

  • Strong hands-on experience with Apache Spark and Scala for processing, transforming and validating large-scale datasets.
  • Experience developing and maintaining data pipelines and orchestration workflows using Apache Airflow .
  • Proficiency in Python, SQL and PostgreSQL for data processing, validation, reconciliation and troubleshooting.
  • Experience with production support , investigating failed workflows, data mismatches, missing files and pipeline failures.
  • Familiarity with GitLab, CI/CD, Docker and controlled software release practices.
  • Understanding of data quality, monitoring, logging, auditability and operational resilience.
  • Experience with Starburst/Trino, AWS S3, Kubernetes or OpenShift would be an advantage.

Key Skills: Apache Spark / Scala / Python / Apache Airflow / SQL / PostgreSQL / Starburst / Trino / GitLab / CI/CD / Docker / Data Engineering / Production Support

#J-18808-Ljbffr

Reference: WJ-766_23773555

Apply now

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.