Full-Time

Director, System Software Engineering – Metropolis Accelerated and Inferencing Software at NVIDIA

Company NVIDIA
Location Santa Clara
How You'll Work onsite
Level executive
Sector Technology
Posted Posted on March 9, 2026

Job Description

Director, System Software Engineering – Metropolis Accelerated and Inferencing Software

We are looking for an engineering leader who is hands-on with deep learning—comfortable reading/modeling code, not just running it. You will lead, encourage, and develop world-class engineering and data teams distributed across Europe, Asia and the United States.

Key Responsibilities:

  • Architect and operationalize NVIDIA’s end-to-end data Inference Acceleration strategy, powering Inferencing and continuous performance improvements.
  • Drive Strategic Implementations of TensorRT, VLLM and other accelerated frameworks for inference solutions for Edge and Enterprise devices: Lead Accelerated Computing efforts and solutions for key Metropolis verticals. Set up Proofs of Readiness (PORs) and guide their implementations.
  • Leading customer solutions: Collaborate with major Metropolis OEMs and Partners to architect highly accelerated and optimized custom deep learning models and inference pipelines for their specific requirements. Offer direct customer support, including debugging, technical education, and handling customer inquiries for our Metropolis partner and customers. Responsible for drafting and finalizing SOWs with internal customers and partners.
  • Performance Benchmarking: Orchestrate efforts to achieve leading performance results on industry benchmarks like MLPerf on various edge and Enterprise devices.
  • Technical Leadership & Influence: Function as a technical leader for deep learning across multiple teams, giving oversight and build support. Apply customer insights to influence the composition and structure of upcoming SOC / GPU deep learning hardware.
  • Scaling the team: Strategically hiring to meet new demands while also mentoring and adjusting existing teams to new deep learning challenges.
  • Representing Nvidia Deep learning solutions in webinars, conferences and partner events

Requirements:

  • Masters in Computer Science/Electrical Engineering or equivalent experience.
  • A minimum of 8 years of meaningful involvement in machine learning/deep learning research or practical experience, coupled with 7+ years of leadership background and overall 15+ years of industry experience.
  • Over 10 years of validated expertise in the embedded software sector, holding technical leadership positions accountable for delivering outstanding production software within a multifaceted setting.
  • Deep Knowledge of GPU, CPU and dedicated deep learning architecture fundamentals and low-level performance optimizations using heterogeneous computing.
  • Hands-on experience with VLMs, LLMs, or multimodal AI systems applied to perception, data triage, or automated labeling.
  • Strong expertise in large-scale data processing, systems build, or machine learning pipelines.
  • Strong communication, careful planning, and technical leadership capabilities.

Benefits:

  • Competitive salary package and benefits
  • Eligible for equity

How to Apply:

Applications for this job will be accepted at least until March 13, 2026.

XML job scraping automation by YubHub

Similar Jobs

Full-Time

Tech Lead/Manager, Machine Learning Research Scientist- LLM Evals

Scale
San Francisco, CA; Seattle, WA; New York, NY
More Info
Full-Time

Full Stack Engineer

Microsoft AI
Mountain View
More Info
Full-Time

Senior Director, Design – Model Experience

Microsoft AI
Redmond
More Info
Full-Time

Software Engineering IC4

Microsoft
New York
More Info
Full-Time

Revenue Partnerships – Middle East

ElevenLabs
UAE
More Info
Full-Time

Product Manager, Claude Code

Anthropic
San Francisco, CA | Seattle, WA
More Info

Receive the latest articles in your inbox

Join the Houtini Newsletter

Practical AI tools, local LLM updates, and MCP workflows straight to your inbox.