← Back to jobsJob ID col-cmwf9iemp0f1489hqoqobuj18

NVIDIAPosted 7 days ago

Senior DGX Cloud AI Infrastructure Software Engineer

Full-time
Remote
8+ years
$184K – $288K/yr
Posted 7 days ago

NVIDIA is seeking a Senior DGX Cloud AI Infrastructure Software Engineer for its DGX Cloud AI Efficiency Team. The role focuses on building and optimizing infrastructure software for large-scale AI training and inference, improving system reliability and resiliency, and diagnosing failures across software and hardware.

Posted
7 days ago
Source
nvidia.wd5.myworkdayjobs.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Develop infrastructure software and tools for large-scale pre-training, post-training, and inference
  • Develop and optimize tools and libraries to improve infrastructure efficiency and resiliency
  • Co-design and implement APIs for integration with NVIDIA's resiliency stacks
  • Enhance infrastructure and products underpinning NVIDIA's AI platforms
  • Define meaningful and actionable reliability metrics to track and improve system and service reliability
  • Root cause and analyze and triage failures from the application level to the hardware level

Qualifications

  • Minimum of 8+ years of experience in developing software infrastructure for large scale AI systems
  • Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience)
  • Strong debugging skills and experience in analyzing and triaging AI applications from the application level to the hardware level
  • Experience with observability platforms for monitoring and logging (e.g., ELK, Prometheus, Loki)
  • Proven track record in building and scaling large-scale distributed systems
  • Experience with AI training and inferencing infrastructure services
  • Proficiency in programming languages such as Python, C/C++, script languages
  • Experience in quality software engineering practices, including test development, defensive programming, version control, and CI
  • Excellent communication and collaboration skills

Preferred

  • Background in working with the large scale clusters
  • Experience in defining and building observability and telemetry software stack
  • Experience with RDMA software stack (NCCL, IB verbs, ucx, libfabrics)
  • Experience and root cause analysis of failures and datacenter scale
  • Good understanding on DL frameworks internal PyTorch, TensorFlow, JAX, and Ray
  • Deep Learning Framework Internals

Required skills

C/C++DebuggingDistributed SystemsELKLokiPrometheusPythonRoot Cause AnalysisScripting LanguagesSoftware Testing

Full job description

NVIDIA is seeking a Senior DGX Cloud AI Infrastructure Software Engineer for its DGX Cloud AI Efficiency Team. The role focuses on building and optimizing infrastructure software for large-scale AI training and inference, improving system reliability and resiliency, and diagnosing failures across software and hardware.

Responsibilities

  • Develop infrastructure software and tools for large-scale pre-training, post-training, and inference
  • Develop and optimize tools and libraries to improve infrastructure efficiency and resiliency
  • Co-design and implement APIs for integration with NVIDIA's resiliency stacks
  • Enhance infrastructure and products underpinning NVIDIA's AI platforms
  • Define meaningful and actionable reliability metrics to track and improve system and service reliability
  • Root cause and analyze and triage failures from the application level to the hardware level

Preferred

  • Background in working with the large scale clusters
  • Experience in defining and building observability and telemetry software stack
  • Experience with RDMA software stack (NCCL, IB verbs, ucx, libfabrics)
  • Experience and root cause analysis of failures and datacenter scale
  • Good understanding on DL frameworks internal PyTorch, TensorFlow, JAX, and Ray
  • Large-Scale Clusters
  • Observability
  • Telemetry Software Stacks
  • Software Stack Design
  • RDMA Software Stacks
  • NCCL
  • InfiniBand Verbs
  • UCX
  • libfabric
  • Root Cause Analysis
  • Datacenter-Scale Failure Analysis
  • Deep Learning Framework Internals
  • PyTorch
  • TensorFlow
  • JAX
  • Ray

Benefits

  • Eligible for equity

Company

  • Accelerated computing platforms for AI and compute-intensive workloads
  • Santa Clara, California, USA
  • https://www.nvidia.com/
  • Founded in 1993
  • 10001+ employees

Qualifications

  • Minimum of 8+ years of experience in developing software infrastructure for large scale AI systems
  • Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience)
  • Strong debugging skills and experience in analyzing and triaging AI applications from the application level to the hardware level
  • Experience with observability platforms for monitoring and logging (e.g., ELK, Prometheus, Loki)
  • Proven track record in building and scaling large-scale distributed systems
  • Experience with AI training and inferencing infrastructure services
  • Proficiency in programming languages such as Python, C/C++, script languages
  • Experience in quality software engineering practices, including test development, defensive programming, version control, and CI
  • Excellent communication and collaboration skills
  • Background in working with the large scale clusters
  • Experience in defining and building observability and telemetry software stack
  • Experience with RDMA software stack (NCCL, IB verbs, ucx, libfabrics)
  • Experience and root cause analysis of failures and datacenter scale
  • Good understanding on DL frameworks internal PyTorch, TensorFlow, JAX, and Ray
  • Minimum of 8+ years of experience in developing software infrastructure for large scale AI systems.

Required skills

  • AI Infrastructure Software Development, AI Training and Inference Infrastructure, C/C++, Debugging, Distributed Systems, ELK, Loki, Prometheus, Python, Root Cause Analysis, Scripting Languages, Software Testing

Preferred skills

  • Background in working with the large scale clusters

Experience

  • 8+ years

Job details

Employment type

Full-time

Seniority level

8+ years

Date posted

Nov 13, 2026

Work mode

Remote

Job source

nvidia.wd5.myworkdayjobs.com

Company

NVIDIA

Information Technology & AI

Accelerated computing platforms for AI and compute-intensive workloads

See all 11 jobs from NVIDIA →
  • Santa Clara, California, USA
  • Information Technology & AI
  • 10001+ employees
  • Founded 1993
  • nvidia.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

Veeam Software

Today

New

Finance AI Engineer

Full-timeRemoteUnited StatesCompetitive

Veeam Software is seeking a Finance AI Engineer to design, build, and deploy reliable AI solutions across Finance functions including Controllership, FP&A, Revenue, Tax, and Treasury.

Why similarSame rolePython

Khan Academy

1d ago

New

Senior Search & AI Discoverability Engineer (12 month contract, 40 hours/week, $85/hour)

Full-timeRemoteUnited StatesCompetitive

Khan Academy is hiring a Senior Search & AI Discoverability Engineer for its Marketing and Acquisition team.

Why similarSame role

SUPPLY

3d ago

AI & Marketing Technology Specialist

Full-timeRemoteUnited States$75K – $100K/yr

SUPPLY is an independent media agency hiring an AI & Marketing Technology Specialist to improve agency operations and develop technology-driven capabilities for its teams and clients.

Why similarSame rolePython

Get new AI Engineer jobs by email

Create job alert

Senior DGX Cloud AI Infrastructure Software Engineer

NVIDIA · $184K – $288K/yr

Apply on company site