Big Data Lead

Work Arrangement: Hybrid: 3 Days/Week WFO

Domain: BFSI

Application Deadline: October 15th, 2026

About the Role

We are looking for an experienced Big Data Lead to design, develop, and maintain scalable data solutions using PySpark, Spark SQL, Python, and distributed computing technologies .

Job Description: -

Required Skills & Experience

• 8+ years of experience in Big Data / Data Engineering .
• Strong hands-on experience with PySpark and Apache Spark .
• Strong programming skills in Python .
• Excellent knowledge of Spark SQL and distributed data processing.
• Experience designing and developing ETL/ELT data pipelines .
• Strong understanding of distributed computing and big data concepts.
• Experience working with Hadoop/HDFS, Hive, cloud storage, or data lake platforms .
• Strong understanding of Spark performance tuning, including partitioning, caching, joins, shuffles, and resource optimization.
• Experience writing unit tests and data validation frameworks .
• Strong SQL skills and experience working with large datasets.
• Experience with data pipeline monitoring, troubleshooting, and production support.

EEOC Compliance:

We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.

DISCLAIMER

AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.