Opening. This role exists to design and implement evaluation systems that help our customers understand model performance across their specific use cases.
What you'll do
You will design and implement comprehensive evaluation frameworks to measure LLM capabilities across diverse customer use cases, including text generation, reasoning, code, and domain-specific applications.
- Design and implement comprehensive evaluation frameworks to measure LLM capabilities across diverse customer use cases, including text generation, reasoning, code, and domain-specific applications
- Build scalable evaluation infrastructure and pipelines that enable rapid, reproducible assessment of model performance
What you need
- 3+ years of experience in ML evaluation, benchmarking for LLM or agentic systems
- Deep understanding of concepts and algorithms underlying machine learning and LLMs
- Strong technical coding skills in Python
