Data Engineer
Matchtech
Overview
In this permanent role you design and maintain scalable Azure data platforms and build robust data pipelines. You will enable data-driven solutions across the business, collaborating with analysts and developers to ensure data quality and security. You’ll work on modern cloud data platforms at scale, shaping how data supports decision-making. This opportunity combines hands-on engineering with governance and deployment automation to drive impactful data solutions.
Pay / Benefits- permanent role
- professional development
- Microsoft Azure training opportunities
- modern cloud data platforms
- collaborative working environment
- Design, develop and maintain scalable data pipelines and integration solutions using Azure
- Build and optimise ETL and ELT processes with Azure Data Factory, Databricks and Synapse Analytics
- Manage and enhance data lakes, data warehouses and storage solutions (Azure Data Lake Storage)
- Develop and optimise SQL queries, data models and database objects for performance and scalability
- Ensure data quality, security, governance and compliance with organisational standards
- Implement CI/CD practices and support deployment automation through Azure DevOps or GitHub
- Monitor, troubleshoot and resolve data platform and pipeline issues
- Collaborate with stakeholders, analysts and developers while maintaining documentation and data dictionaries
- Experience in Data Engineering, database development or data integration with hands-on knowledge of Microsoft Azure data services
- Strong experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics and Azure Data Lake Storage
- Advanced SQL development and performance tuning (Azure SQL Database and SQL Server)
- Proficiency in Python, PySpark, Scala and Spark for data processing
- Understanding of data warehousing, dimensional modelling and ETL/ELT frameworks
- Knowledge of data quality, governance, metadata management and data security principles
- Experience with CI/CD pipelines using Azure DevOps or GitHub
- Bachelor's degree in related field; Azure certifications advantageous
- Collaboration
- Communication
- Problem-solving
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
Reference: WJ-747_30202587