Senior Software Engineer, Data Platform

Overview

In this role you will design and build core data storage, streaming, caching, and indexing platforms to support AI data workflows. You’ll partner with stakeholders to refine requirements and deliver reliable, scalable data infrastructure. You will drive improvements in development practices and clearly communicate technical concepts to non-technical teams. This position sits at the heart of Scale’s AI data initiatives, enabling safe and effective RLHF-driven systems.

Responsibilities

• Design, implement, and maintain foundational data platforms and systems (storage, streaming, caching, indexing)
• Collaborate with cross-functional teams to define requirements and deliver features
• Identify and drive improvements to programming practices, tooling, and processes
• Present technical information to stakeholders and guide development decisions

• 5+ years of full-time engineering experience in back-end systems for large-scale data storage, streaming, and warehousing
• Experience with MongoDB, Postgres; streaming/processing (Kinesis, Flink, Spark)
• Experience with indexing/caching (ElasticSearch, Redis) and data query engines (Trino, Presto, Snowflake)
• Proven track record mentoring and leading teams in successful projects
• Excellent communication and collaboration skills with the ability to translate technical concepts for non-technical stakeholders
• Experience with containerization and deployment (Kubernetes) and public cloud offerings
• Extensive experience in software development, distributed systems, and cloud/data platforms

• communication
• collaboration
• mentoring
• MongoDB
• Postgres
• Kinesis