Full-Time

Senior Software Architect – Data Center Systems at NVIDIA

Company NVIDIA
How You'll Work remote
Level senior
Sector Technology
Posted Posted on March 9, 2026

Job Description

We are building innovative server systems for GPU accelerated applications, such as Deep Learning. Data Center SW team architects and develops the end to end software and firmware stack for these systems. We are looking for a Senior Software Architect who has deep expertise in designing server platforms and has added understanding of application use cases in Deep Learning workloads. You will work with world class engineering teams, product management, Operations and Customer support to build systems that will truly delight our customers.

What you'll be doing:

  • You will lead software activities for NVIDIA's deep learning server platforms, from design through production; collaborating with teams across company to deliver software solutions
  • Drive the system architecture for a complex server platform in a multi-functional environment
  • Partner across application software, libraries, system software and firmware teams to design complete software solutions for new server platforms
  • Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap
  • Work with business partners and vendors to shape their products to meet NVIDIA’s needs
  • Develop a roadmap of new technologies and protocols and drive their design and adoption
  • Mentor architects and engineering teams to grow them into future leaders
  • Make key technical decisions for designs involving complex inter-component dependencies

What we need to see:

  • Deep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface
  • Understanding of HPC or Deep learning workloads and use of accelerated computing platforms
  • Expertise in Out of Band and In-band management architectures
  • Knowledge of server system architecture and implications of architecture decisions on overall performance of end applications
  • Demonstrable experience in implementing left shift strategy to de-risk program execution
  • Excellent written and verbal communication skills
  • BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience
  • 10+ years in the area of System architecture and design

Ways to stand out from the crowd:

  • Knowledge of cloud and cluster level deployment and management systems
  • Strong background of device management protocols such as Redfish, IPMI, MCTP, PLDM and RDE
  • Knowledge in storage and networking technologies

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come, join our Data center server systems team and help build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until March 12, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

XML job scraping automation by YubHub

Similar Jobs

Full-Time

Senior Infrastructure Engineer

Replit
Foster City, CA
More Info
Full-Time

Staff Infrastructure Engineer

Replit
Foster City, CA
More Info
Full-Time

Commercial and Privacy Counsel – EMEA

Constructor
Sweden
More Info
Full-Time

Reliability Maintenance Engineering Technician

Amazon
More Info
Full-Time

Software Development Engineer

Amazon
More Info

Receive the latest articles in your inbox

Join the Houtini Newsletter

Practical AI tools, local LLM updates, and MCP workflows straight to your inbox.