Skip to content
Houtini.
Contact
Mistral AI
Mistral AI

Model Behaviour Architect- Multilingual

Paris Engineering Senior Posted 15d ago

Apply at source. Mistral AI handles the application directly; Houtini doesn't take a fee from candidates or companies. We curate which companies appear; the listings come from yubhub.

Role description

What the team is looking for.

As a Model Behaviour Architect in the Multilingual team at Mistral AI, you define and measure what good model behaviour looks like across languages.

The company develops a comprehensive AI platform with offerings including Le Chat, La Plateforme, Mistral Code and Mistral Compute.

Your role involves working with the Science team to define what 'good' means for multilingual behaviour, including language adherence, naturalness, cultural alignment, and consistent capability across languages.

Responsibilities:

  • Interact with models across languages to identify areas for improvement
  • Gather internal and external feedback to scope areas for improvement
  • Define what high-quality behavior means per language
  • Design and implement evals, data guidelines, data generation, and synthetic testing environments for multilingual settings
  • Shape how models reflect the cultural context of users and regions
  • Identify and fix edge-case behaviors through rigorous cross-language testing
  • Develop robust evaluation pipelines for model candidates
  • Work collaboratively with AI Scientists

Requirements:

  • Expertise in building robust evaluations
  • Strong understanding of linguistics, language, and translation, or LLM agents at work
  • Experience thriving in dynamic and technically complex environments
  • Track record of delivering innovative solutions to address real-world constraints

Benefits:

  • Competitive cash salary and equity
  • Daily lunch vouchers with 10.83€ per worked day
  • Discounted access to gyms and fitness studios through EGYM Wellpass partnership
  • Monthly contribution to a mobility pass
  • Full health insurance for you and your family
  • Generous parental leave policy
  • Visa sponsorship
Skills mentioned
  • linguistics
  • language
  • translation
  • LLM agents
  • model evaluation
  • policy writing
  • eval pipelines
  • multilingual NLP