IT & Software

Senior Enterprise Technology Engineer

BP

London · Greater London · United Kingdom

Overview

As Senior Enterprise Tech Engineer, you will establish and lead a global data engineering squad within TA&I to build enterprise-scale data pipelines. You’ll mentor 8–10 engineers while shaping the data platform strategy across trading functions. Expect to integrate Python/SQL-based pipelines with Airflow on AWS, and to explore Generative AI capabilities to advance trading analytics. This role combines hands-on engineering leadership with cross-functional collaboration and a focus on reliable, scalable data solutions.

Pay / Benefits
  • flexible working options
  • generous paid parental leave
  • excellent retirement benefits
  • reasonable accommodation for disabilities
Responsibilities
  • Establish and lead a global data engineering squad and set technical direction
  • Design and implement scalable data pipelines using Python, SQL, and Apache Airflow
  • Lead ETL of large time-series datasets from diverse sources
  • Apply Generative AI techniques to deliver new capabilities for trading analytics
  • Leverage AWS services (S3, Redshift, EC2, Lambda) for secure, cost-effective pipelines
  • Coach and mentor 8–10 engineers, fostering knowledge sharing and career growth
  • Drive Agile practices using Kanban/Scrum and Azure DevOps to manage work
  • Create data visualisations with Tableau/Power BI for diverse audiences
  • Champion automation and maintain code under source control with CI/CD
  • Document data pipelines and procedures for maintainability and transfer
  • Promote continuous improvement through retros and RCA-driven investments
  • Collaborate effectively with global, cross-functional teams
  • Communicate complex concepts clearly to technical and non-technical stakeholders
  • Foster high-performing teams and a culture of innovation
Key requirements
  • 10+ years as a Data Engineer with leadership and mentoring experience
  • Experience building market data solutions in trading/financial services
  • Deep Python (Pandas, Selenium/BeautifulSoup/Requests, ML libraries) expertise
  • Generative AI techniques (agents, RAG, prompt engineering, AI SDLC)
  • Advanced SQL and PostgreSQL (data modeling/design)
  • Large-scale data pipelines for time-series data
  • Apache Airflow for orchestration at scale
  • AWS cloud skills (S3, Redshift, EC2, Lambda)
  • SDLC design and execution with Git and CI/CD (ADO or Jenkins)
  • Linux experience and strong Git proficiency
  • Excellent written and verbal communication; global collaboration
  • Passion for building teams and continuous learning
  • leadership
  • mentoring
  • collaboration
  • Python (Pandas, web scraping libraries), SQL (advanced optimization)
  • Apache Airflow
  • AWS (S3, Redshift, EC2, Lambda)

Reference: WJ-747_30146811

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.