Summary
Microsoft are looking for a talented Senior Software Engineer at their Beijing office. This role sits at the heart of AI Infrastructure development, driving innovation in large-scale AI infrastructure. You will be instrumental in designing and implementing high-performance, massively scalable infrastructure required to deploy frontier LLM models.
About the Role
We are seeking brilliant and passionate engineers to work with us on the most interesting and challenging problems of AI Infrastructure development. As a Senior Software Engineer, you will be responsible for designing and implementing the high-performance, massively scalable infrastructure required to deploy frontier LLM models through innovative GPU kernel, compression, scheduling and parallelization optimizations.
Accountabilities
- Keep up to date with and utilize the latest developments in LLM system optimization.
- Discover/solve impactful technical problems, advance state-of-the-art LLM technologies, and translate ideas into production.
- Optimize LLM inference workloads through innovative kernel, algorithm, scheduling, and parallelization technologies.
- Continuously maintain internal LLM inference infrastructure.
The Candidate we're looking for
Experience:
- A bachelor's degree or higher in computer science, engineering, or a related field, PhD is preferred.
Technical skills:
- Strong programming skills in Python and C/C++.
- 2+ years of experience in machine learning system development and optimization.
Personal attributes:
- A growth mindset and a passion for learning new things.
Benefits
- Competitive salary and benefits package.
- Opportunities for professional growth and development.
- Collaborative and dynamic work environment.
