Summary
Microsoft AI are looking for a talented Member of Technical Staff, Evaluations Engineer to help build the next wave of capabilities of our personalized AI assistant, Copilot. We're looking for someone who will bring an abundance of positive energy, empathy, and kindness to the team every day, in addition to being highly effective.
About the Role
We're looking for someone who will contribute to the development of AI models that are powering our innovative products. You will actively contribute to the development of AI models that are powering our innovative products. You will wear multiple hats and work on engineering, research, and everything in between. Your contributions will span model architecture, data curation, training and inference infrastructures, evaluation protocols, alignment and reinforcement learning from human feedback (RLHF), and many other exciting topics at the cutting edge of AI.
Accountabilities
- Develop and tune the pretraining scalable software for Nvidia GB200 72NVL CX8 and AMD MIxxx architectures.
- Benchmark GB200 and AMD MIxxx GPU clusters.
- Gather data and insights to develop the pretraining compute roadmap.
The Candidate we're looking for
Experience:
- Bachelor’s Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Technical skills:
- Experience with generative AI.
- Experience with distributed computing.
Personal attributes:
- Enjoy working in a fast-paced, design-driven, product development cycle.
Benefits
- Software Engineering IC5 – The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year.
- Starting January 26, 2026, MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location.
