Math Libraries Engineer - Sparsity in AI

Job Description

Job Title: Senior Math Libraries Engineer - Sparsity in AI. Location: Santa Clara, CA, USA (Remote - US)

Responsibilities:

• Design and develop C++-based systems to accelerate unstructured sparsity computations for deep learning (DL) and high-performance computing (HPC) on GPUs.
• Enable system functionality in commonly used DL frameworks and languages such as Python and PyTorch.
• Evaluate and optimize system performance on real-world applications;
• Write high-quality, well-tested production code to improve library performance, reliability, and maintainability.
• Collaborate with product management and internal and external partners to define feature requirements and contribute to technical roadmaps.
• Develop solutions involving sparse tensor computations, domain-specific language (DSL) design, and on-demand code generation.

Qualifications:

• Bachelor’s, Master’s, or PhD in Computer Science, Applied Mathematics, or a related field.
• 6+ years of experience developing, debugging, and optimizing high-performance software using C++ and parallel programming.
• Experience with sparse linear algebra and parallel computing technologies such as CUDA, MPI, or OpenMP.
• Strong programming skills in C++, Python, and CUDA;
• Experience with domain-specific language design and compiler optimizations (e.g., MLIR or TACO).
• Strong collaboration, communication, and documentation skills.

Preferred:

• Strong understanding of sparse computations in AI and HPC.
• Familiarity with deep learning frameworks and large language models (LLMs).
• Experience with low-level GPU performance optimization;
• Knowledge of numerical linear algebra methods, including direct and iterative solvers.
• Experience with software development practices such as CI/CD and tools like JIRA.

Benefits and Compensation:

• Base salary range:
  • Level 4: $184,000 – $287,500 per year
  • Level 5: $224,000 – $356,500 per year
• Eligibility for equity and comprehensive benefits.
• Opportunity to work on cutting-edge AI, HPC, and accelerated computing technologies.

Other Information:

• NVIDIA uses AI tools in parts of the hiring process.
• Equal opportunity employer committed to diversity and inclusion;
• Work with globally distributed teams at the forefront of AI and accelerated computing innovation.