IT & Software

Lead Software Engineer - Python, Databricks, AWS

JP Morgan Chase

Glasgow · Glasgow City · United Kingdom

Overview

As Lead Software Engineer in the ERFC/Strategic Data team at JPMorgan Chase, you will design and maintain scalable data processing solutions to turn large financial datasets into actionable insights. You will work with cross‑functional teams to align data platforms with business objectives and regulatory needs. You will tackle complex data engineering challenges, build reliable pipelines, and mentor associates to elevate delivery standards. This role offers impact through cloud and AI‑assisted development to advance data-driven decision making at scale in financial services.

Responsibilities
  • Design, develop, and maintain scalable data pipelines and processing workflows on AWS using Python, PySpark, SQL, and Databricks
  • Develop fact and dimension data models for reporting and analytics
  • Ensure data quality, security, and lineage across processing stages with monitoring and alerting
  • Lead data migration and modernization initiatives from legacy to cloud-based data warehouses
  • Lead communities of practice to promote adoption of new technologies and foster knowledge sharing
  • Mentor Associate-level engineers and ensure consistent delivery standards
  • Collaborate with business stakeholders to translate data into insights for strategic decisions
  • Document data flows, logic, and transformation rules
  • Participate in all SDLC phases from requirements to maintenance
  • Identify and automate recurring remediation to improve operational stability (Production/SRE)
Key requirements
  • Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing
  • Proficiency in SQL, Python, and PySpark with performance tuning experience
  • Hands-on experience with Databricks, Apache Spark, or similar data lake platforms
  • Experience with AWS services (S3, ECS, SNS/SQS, Lambda)
  • Strong understanding of data quality, security, and lineage best practices
  • Experience with cloud-based data warehouse migration and modernization
  • CI/CD and Agile methodologies (Jules/Jenkins, Spinnaker, Sonar)
  • In-depth knowledge of financial services IT systems
  • Excellent problem-solving, troubleshooting, and analytical skills
  • Strong communication and documentation abilities for stakeholder collaboration
  • excellentcommunication
  • collaboration
  • mentoring
  • SQL
  • Python
  • PySpark

Reference: WJ-747_30168944

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.