Software Architect, AI Systems & Networking

Job Description

Job Title: Senior Software Architect, AI Systems and Networking. Location: Santa Clara, CA, USA (also Austin, TX, USA and Remote – USA)

Responsibilities:

• Architect and implement high-performance communication and memory management libraries for distributed AI systems.
• Drive hardware-software co-optimization across GPUs, DPUs, NICs, and switches using technologies such as GPUDirect RDMA and NVLink.
• Profile and optimize data movement across GPU memory, system DRAM, NVMe storage, and network fabrics.
• Integrate networking capabilities into AI serving frameworks such as vLLM, SGLang, and TensorRT-LLM.
• Lead end-to-end project ownership, from research scoping to production deployment;
• Contribute to and maintain open-source projects.
• Mentor engineers, conduct design reviews, and prototype experimental technologies.
• Explore emerging domains including quantum computing interconnects.

Qualifications:

• 8+ years of experience in systems software and/or networking with ownership of complex projects.
• MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or related field.
• Strong understanding of high-performance networking technologies such as InfiniBand, RoCE, RDMA, NVLink, and GPUDirect.
• Proficiency in C, C++, or Rust for systems programming.
• Experience with performance profiling and low-level debugging;
• Understanding of machine learning systems, including transformer architectures, distributed training, and inference patterns.

Preferred:

• Experience with ML inference frameworks such as vLLM, SGLang, and TensorRT-LLM.
• Knowledge of storage networking technologies such as NVMe-oF, GPUDirect Storage, and S3.
• Background in reinforcement learning systems.

Benefits and Compensation:

• Base salary range:
  • Level 4: $184,000 – $287,500 per year
  • Level 5: $224,000 – $356,500 per year
• Eligibility for equity and comprehensive benefits package;
• Opportunity to work in a leading technology company with high-impact projects.

Other Information:

• NVIDIA uses AI tools in parts of the recruitment process;
• Equal opportunity employer committed to diversity and inclusion.
• Role sits at the intersection of applied research and production engineering, including emerging work in quantum computing interconnects.