Staff Software Engineer, Platform

Overview

In this role you will help scale Scale GP, an enterprise AI platform delivering AI-powered knowledge retrieval, inference, and evaluation. You’ll own large areas of the product, working across backend, frontend, and LLM/ML model integration to deliver reliable features at scale. You will tackle hard problems in scalability and reliability within distributed systems and data pipelines. You’ll collaborate with product, ML, and infrastructure teams to drive rapid experimentation and customer-focused improvements. This is a hands-on, cross-functional role at the core of Scale’s mission to enable trustworthy AI applications.

Responsibilities

• Own large new areas of the product from design to production
• Collaborate across backend, frontend, and LLM/ML model interfaces
• Develop reliable Python backend services with distributed systems, data pipelines, and ML/LLM components
• Integrate with LLMs, vector databases, and AI infrastructure to power product experiences
• Deliver experiments and new features quickly with high quality and customer feedback loops
• Work with product, ML, and infrastructure teams to shape product direction
• Adapt to new technologies and tools across the stack

• 4+ years of full-time engineering experience
• Strong experience in Python or Javascript/Typescript
• Experience scaling or shipping products at high-growth startups
• Familiarity with LLMs, vector databases, embeddings, or other AI tooling (tinkering or production)
• Proficiency with SQL and modern API development
• Experience with Kubernetes, containerization, and microservice architectures
• Experience with at least one major cloud provider (AWS, GCP, or Azure)

• collaboration across cross-functional teams
• ability to learn new technologies quickly
• problem-solving mindset in fast-paced environments
• Python
• Javascript/Typescript
• SQL