IT & Software

Software Developer – Risk Data Pipelines

Ncounter

London · Greater London · United Kingdom

Overview

As a Software Developer in Risk Data Pipelines, you will build and maintain production-grade data workflows that feed risk analytics with fast, accurate, and fresh real-time data. You’ll work in the engineering team to ingest, transform, store, and deliver market, position, and reference data for risk systems. You’ll focus on reliability, observability, and performance to ensure risk calculations are meaningful in a high-stakes trading environment. This is a practical, impact-driven role for someone who loves solving data engineering challenges at scale.

Responsibilities
  • Develop and maintain production data pipelines supporting risk analytics platforms
  • Build reliable, recoverable, and observable data workflows
  • Improve the quality, freshness, and completeness of critical risk data
  • Engineer performant Python applications for data processing and transformation
  • Optimise large-scale analytical data stores and query performance
  • Contribute to monitoring, alerting, and operational reliability across data services
Key requirements
  • Experience building and operating production data pipelines
  • Strong Python development skills with maintainable, performant applications
  • Experience with workflow orchestration tools such as Airflow, Dagster, or Prefect
  • Understanding of retries, dependency management, idempotency, backfills, and operational recovery
  • Experience with analytical or columnar databases such as ClickHouse or similar technologies
  • Knowledge of partitioning, materialised views, and query optimisation techniques
  • Experience with numerical and data processing libraries including NumPy, pandas, Polars, or Arrow
  • Understanding of performance optimisation, memory usage, multiprocessing, or asynchronous Python
  • hands-on approach
  • focus on data reliability
  • problem-solving mindset
  • Python
  • Airflow/Dagster/Prefect
  • ClickHouse or similar databases

Reference: WJ-747_31178116

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.