← Back to jobsJob ID col-cmwpejh6v0bs2d8hadsny4233

NVIDIAPosted 1 day ago

Senior Software Architect, AI Systems and NetworkingNew

Full-time
On-site
12+ years
$224K – $356K/yr
Posted 1 day ago

NVIDIA’s Networking Systems & Software Architecture group is hiring a Senior Architect to lead applied research and production engineering for AI infrastructure software. The role owns projects end-to-end, from defining research questions and prototyping approaches to delivering high-performance communication and memory management systems.

Posted
1 day ago
Source
nvidia.wd5.myworkdayjobs.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Architecting and implementing high-performance communication and memory management libraries for distributed AI
  • Driving hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects
  • Profiling and optimizing data movement across GPU memory, system DRAM, NVMe, and network fabrics
  • Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM
  • Contributing to and maintaining open-source projects, mentoring engineers, conducting design reviews, and prototyping experimental technologies to evaluate their viability

Qualifications

  • 12+ years in systems software and/or networking with demonstrated ownership of complex projects
  • MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field
  • Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect
  • Strong C/C++/Rust systems programming with comfort in performance profiling and low-level debugging
  • Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns

Preferred

  • Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements
  • Knowledge of storage networking (NVMe-oF, GPUDirect Storage, S3)
  • Background of Reinforcement Learning systems
  • NVMe-oF

Required skills

CC++GPUDirectHigh-Performance NetworkingInfiniBandML SystemsNVLinkPerformance ProfilingRDMARoCERustSystems Programming

Full job description

NVIDIA’s Networking Systems & Software Architecture group is hiring a Senior Architect to lead applied research and production engineering for AI infrastructure software. The role owns projects end-to-end, from defining research questions and prototyping approaches to delivering high-performance communication and memory management systems.

Responsibilities

  • Architecting and implementing high-performance communication and memory management libraries for distributed AI
  • Driving hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects
  • Profiling and optimizing data movement across GPU memory, system DRAM, NVMe, and network fabrics
  • Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM
  • Contributing to and maintaining open-source projects, mentoring engineers, conducting design reviews, and prototyping experimental technologies to evaluate their viability

Preferred

  • Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements
  • Knowledge of storage networking (NVMe-oF, GPUDirect Storage, S3)
  • Background of Reinforcement Learning systems
  • ML Inference Frameworks
  • vLLM
  • SGLang
  • TensorRT-LLM
  • Inference Communication Requirements
  • NVMe-oF
  • GPUDirect Storage
  • S3
  • Reinforcement Learning Systems

Benefits

  • Eligible for equity

Company

  • Accelerated computing platforms for AI and compute-intensive workloads
  • Santa Clara, California, USA
  • https://www.nvidia.com/
  • Founded in 1993
  • 10001+ employees

Qualifications

  • 12+ years in systems software and/or networking with demonstrated ownership of complex projects
  • MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field
  • Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect
  • Strong C/C++/Rust systems programming with comfort in performance profiling and low-level debugging
  • Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns
  • Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements
  • Knowledge of storage networking (NVMe-oF, GPUDirect Storage, S3)
  • Background of Reinforcement Learning systems
  • 12+ years in systems software and/or networking with demonstrated ownership of complex projects.

Required skills

  • C, C++, GPUDirect, High-Performance Networking, InfiniBand, ML Systems, NVLink, Performance Profiling, RDMA, RoCE, Rust, Systems Programming

Preferred skills

  • Background of Reinforcement Learning systems

Experience

  • 12+ years

Job details

Employment type

Full-time

Seniority level

12+ years

Date posted

Nov 20, 2026

Work mode

On-site

Job source

nvidia.wd5.myworkdayjobs.com

Company

NVIDIA

Information Technology & AI

Accelerated computing platforms for AI and compute-intensive workloads

See all 24 jobs from NVIDIA →
  • Santa Clara, California, USA
  • Information Technology & AI
  • 10001+ employees
  • Founded 1993
  • nvidia.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Software Architect jobs in Austin

Dice

1d ago

New

Senior AI Data Architect

Full-timeOn-siteDallas, TXCompetitive

R Systems is seeking a Senior AI Data Architect to design, develop, and implement scalable data architectures for AI, machine learning, and generative AI initiatives.

Why similarSame roleDallas

Photon

1d ago

New

Enterprise Architect

Full-timeOn-siteDallas, TXCompetitive

Photon is seeking a senior Enterprise / Solution Architect to assess a complex digital commerce ecosystem and define its future-state architecture.

Why similarSame roleDallas

ServiceNow

1d ago

New

PS, Solution Architect /Forward Deployment Engineer ( Armis/ Veza)

Full-timeRemoteUnited StatesCompetitive

ServiceNow is hiring a Forward Deployment Engineer to implement, configure, and optimize Application Security solutions in customer environments.

Why similarSame roleRemote

Get new Software Architect jobs in Austin by email

Create job alert

Senior Software Architect, AI Systems and Networking

NVIDIA · $224K – $356K/yr

Apply on company site