Senior Data Engineer
Intercontinental Exchange
As a Senior Data Engineer at ICE you will design and optimize Snowflake-based data warehouses and pipelines to enable AI-driven analytics and real-time/batch processing. You will work closely with data engineers, analysts, and product owners to translate requirements into scalable data solutions that support ICE Derivatives and ICE Mortgage. You’ll modernize legacy applications, improve data retrieval performance, and mentor junior engineers while staying current with cloud data platform trends. This role offers impact by shaping data infrastructure that underpins risk management and decision-making at a global scale.
Responsibilities- Design and develop Snowflake-based data warehouses for new data integration and legacy migrations
- Build data transformation logic using SQL, Snowflake stored procedures, and Python-based ETL/ELT scripts
- Create and maintain Snowflake objects (tables, views, streams, tasks, file formats, external stages)
- Develop robust data pipelines for reporting and analytics
- Participate in technical requirement discussions with data engineers, analysts, and product owners
- Produce technical design documentation and unit tests for SQL scripts and pipelines
- Document deployment, handover, and monitoring procedures
- Mentor junior developers and data engineers
- Enable real-time and batch processing architectures for AI analytics, forecasting, and automation
- Optimize cloud data platforms for AI scalability (data lakehouse, semantic layers, high-performance retrieval)
- Stay current with Snowflake features and best practices
- Perform additional related duties as assigned
- 5+ years of experience in data engineering or database development
- Strong hands-on SQL queries and stored procedures
- Experience with database objects (functions, views, schema design) and features (Streams, Tasks, Time Travel, Cloning)
- Performance tuning and optimization (clustering, sizing, caching)
- Experience configuring external stages to integrate cloud storage (AWS S3, Azure Blob)
- Python and Shell scripting for data processing
- Deep Snowflake expertise; Snowflake with Tidal is a plus
- Git proficiency and Agile/Scrum SDLC experience
- SDLC familiarity with Agile principles
- Strong analytical, decision-making, and problem-solving skills
- Excellent communication for technical and non-technical audiences
- Bachelor’s degree in computer science, Engineering, or related field (or equivalent experience)
- Analytical mindset
- Problem-solving
- Multitasking in fast-paced environments
- Snowflake (including stored procedures, streams, tasks, Time Travel, cloning)
- SQL and database design
- Python and Shell scripting
Reference: WJ-747_30393843