Big Data Spark Engineer

Develop high-performance big data solutions using Apache Spark, Java, and distributed computing for large datasets and demanding workloads.

This Spark Developer position centers on data processing applications, pipeline development, and production performance. You will work across Spark Core, Spark SQL, DataFrames, Dataset APIs, HDFS, Hive, and Hadoop Ecosystem. Collaboration supports requirements gathering and delivery of scalable solutions.

Key Responsibilities:

• Maintain scalable applications for large-scale data processing
• Build batch and near real-time processing pipelines
• Troubleshoot production issues and recommend performance tuning
• Implement coding, testing, deployment, and monitoring practices
• Participate in reviews and technical design discussions

Requirements:

• Hands-on Apache Spark experience across core APIs
• Core Java programming experience with Java 8 or above
• Understanding of distributed data processing frameworks
• Experience with data ingestion and transformation frameworks
• Familiarity with Linux or Unix environments

Bring Spark, Java, and big data engineering skills to reliable applications, optimized pipelines, and scalable processing solutions.