Data Engineer

***SC CLEARED***

Data Engineer

6 Month contract initially + Extensions

Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield

Rate: £400 - £450 p/d - (via Umbrella company)

We have a great opportunity with a world leading organisation where you will be provided with all of the support and development to succeed. A progressive organisation where you can really make a difference. We have a great opportunity for a number of Data Engineer's to join the team.

Key Responsibilities - BI:

• Develop, maintain, and enhance Power BI reports, dashboards, and data visualizations.
• Design and implement robust data models using Power BI Desktop.
• Create efficient DAX measures, calculated columns, and KPIs.
• Connect Power BI to various data sources including SQL Server, Excel, SharePoint, APIs, and cloud platforms.
• Develop and optimize ETL processes using Power Query and other data integration tools.
• Perform data validation, testing, and troubleshooting to ensure report accuracy and reliability.
• Collaborate with business stakeholders to gather and analyze reporting requirements.
• Optimize report performance and manage dataset refresh schedules.
• Implement security controls using Row-Level Security (RLS).
• Monitor and support Power BI Service workspaces, gateways, and deployments.
• Create technical documentation and provide end-user support and training.
• Follow data governance, security, and best practices for BI development.

Key Responsibilities - ETL:

• Develop, maintain, and enhance ETL solutions using Informatica BDM/DEI, including mappings, workflows, applications, transformations, and reusable components.
• Support the migration of data assets, ETL pipelines, and workloads from the Cloudera Hadoop platform (HDFS, Hive, Impala, Spark) to AWS Cloud.
• Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift.
• Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes.
• Integrate and support data services including AWS Glue Data Catalog, Athena, Redshift Spectrum, EMR Spark
• Perform data migration, testing, reconciliation, and unit testing activities to ensure data integrity and successful platform migration.
• Create and maintain Unix/Linux shell scripts supporting ETL processing, automation, and operational activities.
• Work closely with architects, business analysts, and stakeholders to understand data requirements and deliver scalable data solutions.
• Investigate and resolve ETL failures, data quality issues, and production incidents through root cause analysis and problem solving.
• Support workflow scheduling and orchestration using Informatica Scheduler, Informatica DEI Scheduler, and AWS Step Functions.
• Monitor and support data platform performance using tools such as CloudWatch, ensuring reliability and operational stability.
• Create technical documentation and provide knowledge transfer and support to operational teams.

Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take a minimum 10 weeks.

LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market leader in the delivery of Security Cleared talent to organisations that demand the very highest levels of security, compliance and assurance.

An award-winning organisation, having secured the prestigious Queens Award for Enterprise: International Trade over multiple years. We are committed to fostering an inclusive, equitable and accessible workplace where everyone feels valued and supported. We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply. If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience.

Please Note: If a high volume of applications is received, only candidates shortlisted will be contacted.