We are seeking engineers and researchers to join our Pretraining Text Data team, where we are building the next generation of foundation large language models. If you are passionate about designing and curating high-quality datasets to power frontier AI models, this role is for you.
In this role, you’ll work at the intersection of data and innovation—collaborating with scientists, engineers, and annotators to curate, analyze, and evaluate diverse text datasets critical to model development. You will lead efforts to:
- Develop novel data collection strategies
- Improve dataset quality and integrity
- Understand data-driven model behaviors
- Train models to understand the impact of data and data mixes
- Align datasets with ethical and societal values
This is a cross-disciplinary, high-impact role ideal for engineers and researchers who want to push the boundaries of what AI can learn from data.
Microsoft Superintelligence Team
The MAIST is a startup-like team inside Microsoft AI, created to push the boundaries of AI toward Humanist Superintelligence—ultra-capable systems that remain controllable, safety-aligned, and anchored to human values. Our mission is to create AI that amplifies human potential while ensuring humanity remains firmly in control.
Responsibilities
- Create high-quality datasets for training and evaluation; run experiments on new datasets (data ablations) to assess their impact and determine the most effective data.
- Develop and maintain scalable data pipelines for text data ingestion, preprocessing, filtering, and annotation.
- Analyze real-world text datasets to assess quality, diversity, relevance, and identify areas for improvement.
- Build lightweight tools and workflows for dataset auditing, visualization, and versioning.
- Collaborate with Safety, Ethics, and Governance teams to ensure datasets meet standards for quality, privacy, and responsible AI practices.
Embody our culture and values.
Qualifications
- Bachelor’s Degree in AI, Computer Science, Data Science, Statistics, Physics, Engineering, or related technical discipline AND 4+ years technical engineering experience with coding in languages including, but not limited to, Python and common data libraries (Pandas, NumPy, etc.) OR equivalent experience.
- 2+ years of experience in data analysis or data engineering, including work with large-scale datasets that are unstructured or semi-structured.
- Proficiency in statistics and exploratory data analysis methods.
- Familiarity with data processing frameworks such as Spark, Ray, or Apache Beam.
- Ability to communicate technical findings clearly to research and product teams.
Software Engineering IC4
- The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year.
Software Engineering IC5
- The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
XML job scraping automation by YubHub