Data Engineer

Data Engineer

Key Responsibilities

• Design, build and maintain scalable data pipelines.
• Transform and standardise data across different data models.
• Develop reusable, maintainable solutions using Python and software engineering best practices.
• Work with cloud platforms, distributed processing technologies and modern data architectures.
• Collaborate with engineers and stakeholders in an Agile environment.

Key Skills & Experience

• Proven Data Engineering experience in complex, large-scale environments.
• Strong Python skills and experience building data pipelines.
• Experience with data modelling and transforming data between different formats.
• Knowledge of cloud platforms, ideally Azure, alongside Spark and Databricks.
• Familiarity with data storage technologies such as Parquet and Delta Lake.
• Experience with Docker, Kubernetes, Git/GitHub and Linux/Unix environments.
• Ability to contribute to shared codebases and collaborative development teams.