NVIDIA is looking for a Senior Math Libraries Engineer - Sparsity in AI to design and develop libraries and tools that simplify and accelerate computing for unstructured sparsity in Deep Learning and High-Performance Computing on NVIDIA GPUs. You will enable these systems in languages and frameworks like Python and PyTorch, and evaluate their performance on real-life applications.
What You'll Do
- Design and develop a C++-based system to simplify and accelerate computing for unstructured sparsity in DL and HPC on NVIDIA GPUs
- Enable the system in languages and frameworks that are more commonly used in DL, such as Python and PyTorch
- Evaluate and improve the performance of the system on real-life applications
- Realize opportunities to improve library quality, performance and maintainability by writing effective and well-tested code for production use
- Work closely with product management and other internal and external partners to understand feature and performance requirements and contribute to technical roadmaps
What We're Looking For
- BS, MS or PhD degree in Computer Science, Applied Math, or related field (or equivalent experience)
- 6+ years of overall experience in developing, debugging and optimizing high-performance software using C++ and parallel programming
- Experience with domain-specific language design and compiler optimizations, in particular sparse compilers (MLIR or TACO)
- Excellent C++, Python, and CUDA programming skills
- Strong collaboration, communication, and documentation habits
Nice to Have
- Experience developing software ideally for sparse linear algebra applications and using CUDA, MPI, OpenMP, or equivalent technologies
- Ideally experience with working in a globally distributed organization
- Strong understanding of sparse computations, in particular sparsity in AI and HPC
- Good understanding of LLMs, Deep Learning methods and frameworks
- Experience with low-level GPU performance optimization
- Understanding of numerical linear algebra methods like direct and iterative solvers
- Experience with adopting and advancing software development practices such as CI/CD systems and project management tools such as JIRA
Technical Stack
- C++
- Python
- CUDA
- PyTorch
- MLIR
- TACO
- MPI
- OpenMP
Team & Environment
Work together with other developers on the team.
Benefits & Compensation
- Equity
- Benefits
- Compensation: $184,000 USD - $287,500 USD for Level 4, and $224,000 USD - $356,500 USD for Level 5 + equity: Eligible
Work Mode
This is a global role.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
