NVIDIA is hiring a Manager, Software Engineering - Dynamo

NVIDIA is hiring a Manager, Software Engineering - Dynamo to lead the development for the Dynamo engineering team, NVIDIA’s high-performance, low-latency inference platform for serving generative AI and reasoning workloads at scale. You will accelerate deployment of cutting-edge models across diverse engines and architectures.

What You'll Do

• Mentor, grow, and develop the Dynamo engineering team.
• Be responsible for planning and execution of projects and workflows.
• Work across several teams and orgs to build platforms that use the latest developments in LLM inferencing.
• Collaborate with research and development teams and serve a large user base (software teams both internal and external to NVIDIA).
• Align priorities across collaborators and define metrics for measuring the success of the product/team.
• Stay updated with the latest trends in AI, ML, and infrastructure, proactively seeking opportunities to integrate advancements into NVIDIA's LLM and AI infrastructure solutions.

What We're Looking For

• Masters or PhD or equivalent experience in Computer Science, computer architecture, or related field.
• 10+ years of overall experience in developing large distributed systems.
• 2+ years of experience managing AI and SW development teams.
• Experience in developing and maintaining LLM or GenAI infrastructure.
• Excellent communication, collaboration and problem-solving skills, with a dedication to encouraging an inclusive and diverse workplace.
• Hands-on experience developing large-scale distributed systems.

Nice to Have

• Strong technical background in cloud/distributed systems.
• Experience working in a globally distributed organization.
• Good knowledge of CPU and/or GPU hardware architecture.
• Background in developing LLM inference systems.
• Experience with LLM frameworks like vLLM & TRT-LLM.

Technical Stack

• vLLM
• TRT-LLM

Benefits & Compensation

• Compensation: $224,000 USD - $356,500 USD + equity. Equity eligible.
• Equity

Work Mode

This role operates on a hybrid work model.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.