Summary
Microsoft are looking for a talented Principal Software Engineer at their Beijing office. This role sits at the heart of AI infrastructure development, driving innovation in large-scale AI infrastructure. You will be instrumental in designing and implementing high-performance, massively scalable infrastructure required to deploy frontier LLM models.
About the Role
As a Principal Software Engineer on the AI Infrastructure team, you will be responsible for designing and implementing innovative system optimization solutions for internal LLM workloads. You will optimize LLM inference workloads through innovative kernel, algorithm, scheduling, and parallelization technologies. You will also continuously develop and maintain internal LLM inference infrastructure, discovering new LLM system optimization needs and innovations.
Accountabilities
- Keep up to date with and utilize the latest developments in LLM system optimization.
- Take the lead in designing innovative system optimization solutions for internal LLM workloads.
- Optimize LLM inference workloads through innovative kernel, algorithm, scheduling, and parallelization technologies.
- Continuously develop and maintain internal LLM inference infrastructure.
- Discover new LLM system optimization needs and innovations.
The Candidate we're looking for
Experience:
- A bachelor's degree or higher in computer science, engineering, or a related field, PhD is preferred.
Technical skills:
- Strong programming skills in Python and C/C++.
- 5+ years of experience in machine learning system development and optimization.
Personal attributes:
- A growth mindset and a passion for learning new things.
Benefits
- Competitive salary and benefits package.
- Opportunities for professional growth and development.
- Collaborative and dynamic work environment.
- Access to cutting-edge technology and resources.
