Data Engineer
Oscar Technology
Data Engineer £450-£500p/day (Inside IR35) London (Hybrid, 1-2 days per week on site) Energy/highly regulated environments Azure/Microsoft Fabric
Our client is looking for an experienced Data Engineer to support the ongoing maintenance, enhancement and development of their operational data platform within a highly regulated Energy from Waste (EfW) environment.
We're looking for someone who will manage and improve the flow of operational, plant and asset data from on-premises systems into the Microsoft Azure ecosystem enabling effective reporting and compliance.
The role is split roughly 60% business-as-usual (platform maintenance, support and enhancement) and 40% strategic projects.
Key Responsibilities:
- Design, maintain and optimise data pipelines that ingest data from operational and business systems into Azure and Microsoft Fabric
- Support the ongoing operation and enhancement of Azure-based data platforms, including Azure Synapse Analytics, Azure Storage and Logic Apps
- Manage and improve ingestion of operational plant data, including weighbridge systems, asset monitoring systems and real-time data feeds
- Support the development and maintenance of data warehousing and lakehouse solutions within Microsoft Fabric
- Configure and support access controls, security groups and user permissions in Microsoft Fabric and Microsoft Entra ID
Essential Skills & Experience:
- Strong Python development skills
- Experience integrating data from on-premises SQL Server environments into cloud platforms
- Good understanding of APIs, system integrations and data exchange mechanisms
Proven experience with Microsoft Azure data technologies, including:
- Azure Synapse Analytics
- Azure Storage
- Azure Logic Apps
- Azure data integration services
Strong experience with Microsoft Fabric, including:
- Data warehousing
- Lakehouse architecture
- Data pipelines
- Security and access management
Data Engineer £450-£500p/day (Inside IR35) London (Hybrid, 1-2 days per week on site) Energy/highly regulated environments Azure/Microsoft Fabric
To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website.
#J-18808-LjbffrReference: WJ-766_22552970