Data Engineer

Synergize Consulting are now hiring for a Data Engineer to work at a leading consultancy client on a contract basis.

The successful candidate will support the development of secure, scalable and reliable data engineering solutions within a complex operational environment on behalf of a public sector body, working on pipelines that enable data to be securely processed, mapped and made available for downstream analysis and intelligence use.

Responsibilities include:

• Designing, developing and maintaining data ingestion and ETL/ELT pipelines.
• Profiling, transforming and validating structured and semi-structured data.
• Working with XML and JSON data and developing schema mapping and transformation processes.
• Implementing data conversion and integration routes to support the movement of data between systems.
• Developing and supporting data pipelines within secure environments.
• Developing synthetic data to support testing, development and integration activities.
• Building automation to improve data processing and engineering workflows.
• Supporting the testing and validation of data pipelines and integrations.

Experience required:

• A solid background in data engineering and pipeline development.
• Experience developing ETL/ELT, ingestion or data integration pipelines.
• Experience with data transformation, including XML and JSON.
• Experience with Elasticsearch and/or Kibana.
• Previous experience of working within a highly regulated environment, for example the public sector or areas of law enforcement.
• Understanding of data profiling, validation and quality.
• Experience implementing data ingestion, conversion and integration processes.
• Experience supporting testing and development through synthetic data generation.
• Ability to work effectively across technical and operational teams.
• Strong communication skills, both written and verbal
• Due to the nature of the client, it would be an advantage for candidates to hold, or be eligible and willing to undergo, a certain level of security clearance (SC / NPPV3)