← Back to jobsJob ID col-cmwpeempf0bpmd8hahsmhaprh

NVIDIAPosted 1 day ago

Senior Solutions Architect, First Time Deployment Validation - NVISNew

Full-time
On-site
6+ years
$148K – $236K/yr
Posted 1 day ago

NVIDIA is hiring a Senior Solutions Architect to validate AI factories from initial rack power-on through customer handoff. The role runs and troubleshoots AI/LLM workloads and benchmarks, improves observability and automation, and coordinates with internal teams and customers to prepare deployments for launch.

Posted
1 day ago
Source
nvidia.wd5.myworkdayjobs.com
Sector
Electrical Engineering

Opens the employer's application page in a new tab

Responsibilities

  • Set up, adjust, and verify AI factory environments across multi-GPU and multi-node Linux clusters
  • Ensure configurations align with guidelines for NCCL, collectives, and distributed training frameworks
  • Own the execution of key AI/LLM benchmarks, including setup, orchestration, result collection, and analysis
  • Investigate and resolve issues when training jobs or benchmarks fail, hang, or underperform
  • Build and improve observability for AI factories (metrics, logs, traces, dashboards) to understand workload behavior and system health
  • Develop automation (Python, Shell) for running benchmarks, collecting results, and performing regression checks
  • Examine communication patterns and NCCL usage for AI/LLM workloads, concentrating on collectives such as AllReduce and AllToAll
  • Recommend changes to job configuration, parallelism strategies, and cluster settings to improve throughput, latency, and scaling efficiency
  • Work closely with hardware, software, networking, datacenter, and product teams to prepare AI factories for customer use
  • Contribute to documentation, guidelines, and readiness collateral that support internal collaborators and customer-facing teams

Qualifications

  • Bachelor's degree or equivalent experience in Computer Science, Mathematics, Engineering, Physics, or related field
  • More than 6+ years of experience managing Linux-based systems in HPC, distributed systems, or extensive AI/ML settings
  • Hands-on experience running AI/ML workloads on multi-GPU and/or multi-node clusters, with practical knowledge of NCCL
  • Solid grasp of collective communication patterns, particularly AllReduce and AllToAll, and how they are applied in contemporary ML/LLM training
  • Familiarity with LLM training and/or inference workflows using frameworks such as PyTorch or TensorFlow
  • Proficiency with Python and Shell/Bash for scripting, automation, and tooling
  • Experience with benchmarking (crafting, executing, and interpreting performance benchmarks)
  • Comfortable working with observability data (metrics, logs, dashboards) to troubleshoot and optimize complex distributed workloads
  • Strong communication skills and the ability to work effectively with cross-functional teams

Preferred

  • Experience with AI factory or large-scale AI infrastructure build, deployment, or operations
  • Background in HPC performance engineering, SRE, or systems performance analysis for GPU-accelerated environments
  • Familiarity with observability stacks (e.g., metrics/monitoring, logging, tracing systems) used for large distributed systems
  • Experience building automation and CI-style pipelines for running and validating benchmarks at scale
  • Demonstrated desire to use AI to solve practical problems, improve workflows, and guide data-driven decisions

Required skills

Collective Communication AllReduceCollective Communication AllToAllDistributed SystemsHigh-Performance Computing (HPC)LLM Training and InferenceLinux Systems AdministrationNCCLPerformance BenchmarkingPyTorchPythonShell/BashTensorFlow

Full job description

NVIDIA is hiring a Senior Solutions Architect to validate AI factories from initial rack power-on through customer handoff. The role runs and troubleshoots AI/LLM workloads and benchmarks, improves observability and automation, and coordinates with internal teams and customers to prepare deployments for launch.

Responsibilities

  • Set up, adjust, and verify AI factory environments across multi-GPU and multi-node Linux clusters
  • Ensure configurations align with guidelines for NCCL, collectives, and distributed training frameworks
  • Own the execution of key AI/LLM benchmarks, including setup, orchestration, result collection, and analysis
  • Investigate and resolve issues when training jobs or benchmarks fail, hang, or underperform
  • Build and improve observability for AI factories (metrics, logs, traces, dashboards) to understand workload behavior and system health
  • Develop automation (Python, Shell) for running benchmarks, collecting results, and performing regression checks
  • Examine communication patterns and NCCL usage for AI/LLM workloads, concentrating on collectives such as AllReduce and AllToAll
  • Recommend changes to job configuration, parallelism strategies, and cluster settings to improve throughput, latency, and scaling efficiency
  • Work closely with hardware, software, networking, datacenter, and product teams to prepare AI factories for customer use
  • Contribute to documentation, guidelines, and readiness collateral that support internal collaborators and customer-facing teams

Preferred

  • Experience with AI factory or large-scale AI infrastructure build, deployment, or operations
  • Background in HPC performance engineering, SRE, or systems performance analysis for GPU-accelerated environments
  • Familiarity with observability stacks (e.g., metrics/monitoring, logging, tracing systems) used for large distributed systems
  • Experience building automation and CI-style pipelines for running and validating benchmarks at scale
  • Demonstrated desire to use AI to solve practical problems, improve workflows, and guide data-driven decisions
  • AI infrastructure deployment
  • AI infrastructure operations
  • HPC performance engineering
  • Site reliability engineering
  • Systems performance analysis
  • GPU-accelerated computing
  • Observability systems
  • Metrics
  • monitoring
  • Logging systems
  • Distributed tracing
  • CI pipelines
  • Benchmark execution
  • Benchmark validation
  • AI problem-solving
  • Workflow improvement
  • Data-driven decision-making

Benefits

  • Eligible for equity

Company

  • Accelerated computing platforms for AI and compute-intensive workloads
  • Santa Clara, California, USA
  • https://www.nvidia.com/
  • Founded in 1993
  • 10001+ employees

Qualifications

  • Bachelor's degree or equivalent experience in Computer Science, Mathematics, Engineering, Physics, or related field
  • More than 6+ years of experience managing Linux-based systems in HPC, distributed systems, or extensive AI/ML settings
  • Hands-on experience running AI/ML workloads on multi-GPU and/or multi-node clusters, with practical knowledge of NCCL
  • Solid grasp of collective communication patterns, particularly AllReduce and AllToAll, and how they are applied in contemporary ML/LLM training
  • Familiarity with LLM training and/or inference workflows using frameworks such as PyTorch or TensorFlow
  • Proficiency with Python and Shell/Bash for scripting, automation, and tooling
  • Experience with benchmarking (crafting, executing, and interpreting performance benchmarks)
  • Comfortable working with observability data (metrics, logs, dashboards) to troubleshoot and optimize complex distributed workloads
  • Strong communication skills and the ability to work effectively with cross-functional teams
  • Experience with AI factory or large-scale AI infrastructure build, deployment, or operations
  • Background in HPC performance engineering, SRE, or systems performance analysis for GPU-accelerated environments
  • Familiarity with observability stacks (e.g., metrics/monitoring, logging, tracing systems) used for large distributed systems
  • Experience building automation and CI-style pipelines for running and validating benchmarks at scale
  • Demonstrated desire to use AI to solve practical problems, improve workflows, and guide data-driven decisions
  • More than 6+ years of experience managing Linux-based systems in HPC, distributed systems, or extensive AI/ML settings.

Required skills

  • AI/ML Workloads on GPU Clusters, Collective Communication AllReduce, Collective Communication AllToAll, Distributed Systems, High-Performance Computing (HPC), LLM Training and Inference, Linux Systems Administration, NCCL, Performance Benchmarking, PyTorch, Python, Shell/Bash, TensorFlow

Experience

  • 6+ years

Job details

Employment type

Full-time

Seniority level

6+ years

Date posted

Nov 20, 2026

Work mode

On-site

Job source

nvidia.wd5.myworkdayjobs.com

Company

NVIDIA

Electrical Engineering

Accelerated computing platforms for AI and compute-intensive workloads

See all 24 jobs from NVIDIA →
  • Santa Clara, California, USA
  • Electrical Engineering
  • 10001+ employees
  • Founded 1993
  • nvidia.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Solutions Architect jobs in Santa Clara

Databricks

3d ago

Senior Solutions Architect - DNB Named B2B accounts

Full-timeOn-siteSan Francisco, CA$219K – $301K/yr

Databricks is hiring a Senior Solutions Architect to lead complex customer engagements and drive platform adoption and consumption strategy.

Why similarSame roleDistributed SystemsSan Francisco

NVIDIA

1d ago

New

Senior Solutions Architect, First Time Deployment Networking InfiniBand - NVIS

Full-timeOn-siteSanta Clara, CA$148K – $236K/yr

NVIDIA is hiring a Senior Solutions Architect to deploy, manage, and validate AI/HPC infrastructure in Linux-based environments, including first-of-kind NVIDIA hardware.

Why similarSame roleSanta Clara

MongoDB

1d ago

New

Senior Solutions Architect - Application Modernization

Full-timeRemoteUnited States$104K – $204K/yr

MongoDB is seeking a Senior Solutions Architect to support the sales and delivery of application modernization engagements. The role helps customers modernize legacy applications and databases for MongoDB using modernization methodologies and tools.

Why similarSame roleDistributed SystemsRemote

Get new Solutions Architect jobs in Santa Clara by email

Create job alert

Senior Solutions Architect, First Time Deployment Validation - NVIS

NVIDIA · $148K – $236K/yr

Apply on company site