Data Platform Engineer
SCC
Data Platform Engineer - London / Bracknell / Birmingham / Leeds / Manchester / Livingston - Hybrid - SCC Flex Contract
We are seeking an experienced Data Platform Engineer to support high-profile transformation and technology initiatives across a complex enterprise environment. This is an exciting opportunity for a Data Platform Engineer to join a dynamic client programme, driving the design, implementation and optimisation of modern enterprise data platforms. The successful Data Platform Engineer will play a key role in enabling data-driven decision-making by delivering scalable, secure and resilient data platform capabilities that support analytics, AI, business intelligence and digital transformation objectives across the organisation.
Your responsibilities as the Data Platform Engineer:
- Design, build and maintain enterprise-scale data platforms that support business-critical workloads and data services.
- Develop and manage cloud-based and hybrid data platform environments across Azure, AWS and/or GCP.
- Implement and support data storage, processing and integration solutions including data lakes, data warehouses and lakehouse architectures.
- Configure, maintain and optimise platform infrastructure to ensure reliability, scalability, security and performance.
- Collaborate with data engineers, architects, developers, analysts and business stakeholders to deliver robust platform capabilities.
- Design and automate platform deployment, configuration and management processes using Infrastructure as Code (IaC) and DevOps best practices.
- Support the implementation of modern data platform services including Databricks, Snowflake, Synapse Analytics, Redshift, BigQuery and related technologies.
- Monitor platform health, performance and availability, proactively identifying opportunities for optimisation and improvement.
- Ensure all platform solutions comply with security, governance, regulatory and data management standards.
- Support data transformation programmes and cloud migration initiatives through the adoption of modern platform engineering practices.
- Troubleshoot complex platform issues and provide technical expertise to resolve incidents and minimise service disruption.
- Contribute to technical roadmaps, architecture reviews and strategic data platform initiatives.
- Provide technical leadership and best-practice guidance across platform engineering technologies, processes and methodologies.
As a successful Data Platform Engineer, you will have:
- Proven experience working as a Data Platform Engineer, Platform Engineer or similar role within large-scale enterprise environments.
- Strong experience designing, implementing and supporting enterprise data platforms in cloud and hybrid environments.
- Expertise in cloud technologies including Microsoft Azure, AWS and/or Google Cloud Platform.
- Strong knowledge of data platform services such as Azure Synapse Analytics, Azure Data Lake, Databricks, Snowflake, Amazon Redshift, BigQuery or equivalent technologies.
- Experience building and managing data lakes, lakehouse architectures, data warehouses and analytics platforms.
- Strong understanding of platform engineering principles, cloud infrastructure and distributed systems.
- Experience with Infrastructure as Code technologies such as Terraform, Bicep, ARM Templates or CloudFormation.
- Knowledge of DevOps methodologies, CI/CD pipelines and automation tooling.
- Experience with containerisation and orchestration technologies such as Docker and Kubernetes.
- Good understanding of data integration, ETL/ELT processes and data engineering concepts.
- Familiarity with scripting and automation using Python, PowerShell, Bash or similar languages.
- Strong understanding of security, governance, compliance and operational best practices within enterprise data environments.
- Excellent stakeholder management, communication and collaboration skills.
- Strong analytical, troubleshooting and problem-solving abilities.
- Experience delivering enterprise-scale technology solutions within complex and highly regulated environments.
- Relevant cloud, platform or data certifications are highly desirable.
NOTE: At SCC, we take the privacy and security of your information very seriously. Any information we hold will be handled in accordance with current data protection legislation. Upon submitting your application, SCC will process your information in line with our privacy policy, which can be found on our website under Legal Privacy Notice Flexible Resourcing.
#J-18808-LjbffrReference: WJ-766_22158485