IT & Software

Senior Big Data Platform Engineer Role

HCLTech

Toronto · On · Canada

Join us as a Senior Big Data Platform Engineer, focusing on Netezza and AWS. This role emphasizes the development and support of advanced data pipelines in a high-energy enterprise setting.

We are seeking a Senior Engineer with deep expertise in Big Data technologies, including Netezza, Kafka, and Spark Streaming. This position involves leading data migrations to AWS and supporting data architecture modernization efforts. You will collaborate closely with teams to implement ETL processes and maintain optimal data workflows.

Key Responsibilities: • Design and support scalable data pipelines leveraging AWS technologies • Spearhead migration projects transitioning from On-Prem to AWS • Implement ETL processes using tools such as SSIS • Manage AWS services, focusing on EMR, S3, and Airflow • Build real-time data workflows using Spark Streaming

Requirements: • Extensive experience with Netezza, Airflow, and AWS EMR • Strong competency in Big Data tools and architectures • Skilled in data ingestion and SQL optimization • Ability to troubleshoot and ensure system reliability • Experience working in cross-functional teams

Apply your skills in data engineering and cloud technology to help us innovate. #J-18808-Ljbffr

Reference: WJ-3875_13061565

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.