← Back to jobsJob ID col-cmwp6ic7706s0d8ha1immuqkm

LumaPosted 1 day ago

Research Scientist / Engineer – Training InfrastructureNew

Full-time
Hybrid
$195K – $395K/yr
Posted 1 day ago

Luma is hiring a Research Scientist / Engineer to build and optimize distributed systems for training large-scale multimodal models across thousands of GPUs. The role focuses on advanced parallelization, training stability, cluster utilization, and monitoring and debugging tools.

Posted
1 day ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, implement, and optimize efficient distributed training systems for models across thousands of GPUs
  • Research and implement advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel)
  • Build monitoring, visualization, and debugging tools for large-scale training runs
  • Optimize training stability, convergence, and resource utilization across massive clusters

Qualifications

  • Extensive distributed PyTorch training and parallelisms in foundation-model training
  • Deep understanding of GPU clusters, networking, and storage systems
  • Familiarity with communication libraries (NCCL, MPI) and distributed-system optimization

Preferred

  • Strong Linux systems administration and scripting
  • Experience managing training runs across 100+ GPUs
  • Experience with containerization, orchestration, and cloud infrastructure
  • GPU Training Run Management

Required skills

Distributed PyTorch TrainingDistributed SystemsExpert ParallelismFSDPFoundation Model TrainingGPU ClustersLinux Systems AdministrationMPINCCLPipeline ParallelismTensor Parallelism

Full job description

Luma is hiring a Research Scientist / Engineer to build and optimize distributed systems for training large-scale multimodal models across thousands of GPUs. The role focuses on advanced parallelization, training stability, cluster utilization, and monitoring and debugging tools.

Responsibilities

  • Design, implement, and optimize efficient distributed training systems for models across thousands of GPUs
  • Research and implement advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel)
  • Build monitoring, visualization, and debugging tools for large-scale training runs
  • Optimize training stability, convergence, and resource utilization across massive clusters

Preferred

  • Strong Linux systems administration and scripting
  • Experience managing training runs across 100+ GPUs
  • Experience with containerization, orchestration, and cloud infrastructure
  • Linux Systems Administration
  • Scripting
  • GPU Training Run Management
  • Containerization
  • Orchestration
  • Cloud Infrastructure

Benefits

  • Offers Equity
  • Hybrid work arrangement

Company

  • Creative AI platform for video and image generation
  • Palo Alto, California, USA
  • https://lumalabs.ai/
  • Founded in 2021
  • 51-200 employees

Qualifications

  • Extensive distributed PyTorch training and parallelisms in foundation-model training
  • Deep understanding of GPU clusters, networking, and storage systems
  • Familiarity with communication libraries (NCCL, MPI) and distributed-system optimization
  • Strong Linux systems administration and scripting
  • Experience managing training runs across 100+ GPUs
  • Experience with containerization, orchestration, and cloud infrastructure

Required skills

  • Distributed PyTorch Training, Distributed Systems, Expert Parallelism, FSDP, Foundation Model Training, GPU Clusters, Linux Systems Administration, MPI, NCCL, Pipeline Parallelism, Tensor Parallelism

Preferred skills

  • Experience managing training runs across 100+ GPUs, Strong Linux systems administration and scripting

Job details

Employment type

Full-time

Seniority level

Not stated

Date posted

Nov 20, 2026

Work mode

Hybrid

Job source

jobs.ashbyhq.com

Company

Luma

Information Technology & AI

Creative AI platform for video and image generation

See all 2 jobs from Luma →
  • Palo Alto, California, USA
  • Information Technology & AI
  • 51-200 employees
  • Founded 2021
  • lumalabs.ai

Similar jobs

Matched on role, skills and location · live jobs only

See more Systems Engineer jobs in Seattle

Allyis

1d ago

New

Software Engineer (Systems)

Full-timeOn-siteKirkland, WACompetitive

Allyis is hiring a Software Engineer (Systems) to design, develop, troubleshoot, and maintain software systems and tools supporting infrastructure, platforms, and product development.

Why similarSame roleKirkland

Nutanix

1d ago

New

Sr. Systems Sales Engineer

Full-timeRemoteUnited States$207K – $311K/yr

Nutanix provides enterprise cloud technology solutions and is seeking a Sr. Systems Sales Engineer to support its Systems Engineering and Solution Sales team.

Why similarSame roleRemote

PwC

1d ago

New

GenAI Python Systems Engineer – Senior Associate

Full-timeHybridSacramento, CA$77K – $202K/yr

PwC is hiring a GenAI Python Systems Engineer – Senior Associate in its Advisory practice to build production-ready generative AI systems that turn client data and models into useful decisions and more efficient processes.

Why similarSame role

Get new Systems Engineer jobs in Seattle by email

Create job alert

Research Scientist / Engineer – Training Infrastructure

Luma · $195K – $395K/yr

Apply on company site