We are seeking a Data Scientist to join our team in London, Belgrade, Berlin, or San Francisco. As a Data Scientist, you will build specialized evals to improve answer quality across Perplexity, covering search-based LLM answers and other scenarios popular with our users.
What you'll do
- Architect and maintain automated evaluation pipelines to assess answer quality across Perplexity's products, ensuring high standards for accuracy and helpfulness
- Design evaluation sets and methods specifically to measure the impact of tool calls (particularly web search retrieval) on the final answer's quality
What you need
- PhD or MS in a technical field or equivalent experience
- 4+ years of experience in data science or machine learning