At Scale, we're looking for a Product Manager to lead the development of our evaluation capabilities for public sector GenAI applications. As a high-horsepower technical leader, you'll define the vision and roadmap for our evaluation tech stack, traversing multiple engineering organisations across Scale. You'll identify bottlenecks, distill technical friction into actionable plans, and drive execution.
Key objectives include refining the tech stack that allows ML teams to hillclimb, and surfacing critical performance information to stakeholders. You'll work across Scale's commercial and public sector teams to define requirements, ensuring our evaluation services are robust enough for the most demanding government use cases.
Minimum Qualifications:
- 3+ years of experience in software engineering, systems architecture, or highly technical program management
- Proven experience designing, owning the roadmap for, or operating the infrastructure required to continuously measure, improve, and show the performance of AI applications
- Demonstrated experience taking a vaguely defined problem and delivering a technical roadmap, resource requirements, and measurable success metrics within a narrow time window
- Proven track record of taking a project from 'stalled/undefined' to 'shipped' in a high-pressure environment
- Experience using technical project management frameworks to provide consistent weekly reporting on delivery velocity and blockers to executive stakeholders
Preferred Qualifications:
- Active Secret, Top Secret, or TS/SCI clearance
- Practical experience developing or evaluating features built specifically on LLMs, RAG, or autonomous agent workflows
- Advanced degree in Computer Science, Engineering, or a related field
- 2+ years of experience working with DoD, IC, or Civil agencies on mission-critical software deployments
Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training.
You'll also receive benefits including comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend.
XML job scraping automation by YubHub
