We are looking for a Member of Technical Staff – Full Stack Software Engineer to help build the next wave of capabilities for our personalized AI assistant, Copilot.
At Microsoft AI, we deliver exceptional products and services that empower users to be more productive and efficient.
In this role, you will work across all four stages of our evaluation platform: data sampling, AI data collection and processing, data analysis and evaluation, and insight generation.
You will contribute across the full stack—from backend databases and middle-tier services to browser automation, statistical analysis, and dashboard creation.
Expect to dive into prompt engineering and leverage cutting-edge AI tools to drive meaningful impact.
This engineering position offers exposure to a wide range of technologies and surfaces, including desktop, web, and mobile.
You will collaborate closely with teams across Microsoft AI to assess Copilot’s relevance, performance, trustworthiness, and visual appeal.
Our platform supports desktop and mobile automation and UX studies—enabling scenarios like multi-turn conversations with voice input on iOS and Android apps.
The possibilities are endless.
Responsibilities:
-
Expertise in experimentation methodologies, including A/B evaluation, data sampling, measurement techniques, evaluation design, and data analysis.
-
Demonstrating strategic vision by understanding organizational goals, translating metrics into actionable insights, and enhancing product quality.
-
Designing pipeline architecture to ensure rapid iteration and scalability.
-
Conducting post-analysis of labeled data and developing dashboards to visualize insights.
-
Collaborating closely with the product team to enhance quality and address gaps.
Qualifications:
-
Bachelor’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to C#, Java, or Python OR equivalent experience.
-
2+ years’ experience with SQL, PostgreSQL or MySQL
-
2+ years’ experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP.
-
Extensive use datastores like RDBMS, key-value stores, etc.
-
Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code
-
HTML, CSS, JavaScript, ASP.NET, REST, jQuery
-
Familiarity with browser automation tools like Selenium, Puppeteer or Playwright
-
Familiarity with mobile automation tools like Appium
-
Familiarity with LLMs and AI ChatBots Prompt Engineering
-
Azure DevOps, GIT
-
Azure Open AI, Azure Foundry
-
Experience in leading technical projects and supporting architectural decisions with data.
Software Engineering IC4 – The typical base pay range for this role across the U.S. is USD $119,800 – $234,700 per year.
There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 – $258,000 per year.
Certain roles may be eligible for benefits and other compensation.
Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
XML job scraping automation by YubHub
