Senior Data Engineer
Octopus Energy
In this role you will help establish and lead the Flexibility team’s data capability within a greenfield AWS environment. You will steer data engineering direction, mentor backend engineers, and build scalable data processing and warehousing to support energy flexibility initiatives. You’ll improve data platforms for reliability and efficiency and drive cross-team data initiatives across the organization. This is a chance to shape data tooling that powers large-scale energy services for millions of customers.
Responsibilities- Establish and guide the data engineering direction for the Flexibility team
- Upskill backend engineers and act as the team’s data expert
- Set up greenfield data systems in a newly established AWS environment
- Provide a robust data processing and warehousing foundation for current and future projects
- Maintain and improve data applications, focusing on long-term scalability and reliability
- Lead data platform improvements to boost cross-team capabilities and system stability
- Strong aptitude with SQL, Python and AWS data stack
- Experience building efficient, scalable databases and APIs (e.g. Django, FastAPI) a plus
- Experience with Kubernetes, Docker, Spark and monitoring tools (DataDog, Grafana, Prometheus) for DataOps a plus
- Experience with Airflow a plus
- Experience with dbt for pipeline modelling beneficial
- Ability to translate needs into solid requirements and design scalable solutions
- Quickly grasp new domains and visualize data effectively
- Team player with ownership mindset and commitment to knowledge sharing
- team collaboration
- ownership
- knowledge sharing
- SQL
- Python
- AWS data stack
Reference: WJ-747_30174020