Senior Consultant_ Scala Spark
Infosys Technologies
Overview
In this role, you will design and implement large-scale data processing solutions using Spark and Scala to support client data initiatives. You will work within a global delivery context, collaborating with cross-functional teams to translate requirements into robust technical solutions. The role focuses on building maintainable pipelines, troubleshooting data issues, and delivering high-quality software in an agile environment. You will stay current with new technologies and contribute to a mission-driven digital transformation effort.
Responsibilities- Design and develop large-scale Spark-based data pipelines (Spark Core, Spark SQL, Spark Streaming)
- Translate requirements into technical solutions that meet quality standards
- Collaborate with cross-functional teams to identify and resolve data issues
- Contribute to agile ceremonies (standups, planning, retrospectives) and maintain project progress
- Troubleshoot, optimize, and maintain data processing workflows in a global delivery setup
- Work with AWS (Glue/EMR) and other Big Data tools as needed
- Scala programming proficiency
- 5+ years of experience with distributed data processing using Apache Spark
- Experience with Python, Hadoop, HDFS, Hive
- Strong SQL/NoSQL concepts
- Knowledge of ETL concepts and data warehousing
- Experience in agile environments and SDLC activities
- Excellent communication skills
- Ability to work in diverse, global teams
- strong analytical thinking
- initiative and flexibility
- customer orientation
- Scala
- Apache Spark (Core/SQL/Streaming)
- Python
Reference: WJ-747_31005691