← Back to jobsJob ID col-cmwpbjfe809jnd8hax7vdlp5y

AbridgePosted 1 day ago

Member of Technical Staff, Machine Learning PlatformNew

Full-time
Hybrid
5+ years
$221K – $260K/yr
Posted 1 day ago

Abridge is hiring for its machine learning platform team to build and optimize the inference infrastructure powering its machine learning models. The role partners with Infrastructure, Research, ML, and product teams to deploy and scale models, improve performance and compute efficiency, and plan for infrastructure growth.

Posted
1 day ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, deploy and maintain scalable Kubernetes clusters for AI model inference and training
  • Develop, optimize, and maintain ML model serving infrastructure, ensuring high-performance and low-latency
  • Collaborate with ML and product teams to scale backend infrastructure for AI-driven products, focusing on model deployment, throughput optimization, and compute efficiency
  • Optimize compute-heavy workflows and enhance GPU utilization for ML workloads
  • Build a robust model API orchestration system
  • Collaborate with leadership to define and implement strategies for scaling infrastructure as the company grows, ensuring long-term efficiency and performance

Qualifications

  • 5+ years of experience in building and deploying machine learning models in production environments
  • Deep understanding of container orchestration and distributed systems architecture
  • Expertise in Kubernetes administration, including custom resource definitions, operators, and cluster management
  • Experience developing APIs and managing distributed systems for both batch and real-time workloads
  • Excellent communication skills, with the ability to interface between research and product engineering

Preferred

  • Expertise with model serving frameworks such as NVIDIA Triton Server, VLLM, TRT-LLM and so on
  • Expertise with ML toolchains such as PyTorch, Tensorflow or distributed training and inference libraries
  • Familiarity with GPU cluster management and CUDA optimization
  • Knowledge of infrastructure as code (Terraform, Ansible) and GitOps practices
  • Experience with container registries, image optimization, and multi-stage builds for ML workloads
  • Experience orchestrating across ASR models or LLM models for building various GenAI applications

Required skills

API DevelopmentAnsibleCUDA OptimizationDistributed Systems ArchitectureKubernetes AdministrationMachine Learning Model DeploymentNVIDIA Triton Inference ServerPyTorchTensorFlowTensorRT-LLMTerraformvLLM

Full job description

Abridge is hiring for its machine learning platform team to build and optimize the inference infrastructure powering its machine learning models. The role partners with Infrastructure, Research, ML, and product teams to deploy and scale models, improve performance and compute efficiency, and plan for infrastructure growth.

Responsibilities

  • Design, deploy and maintain scalable Kubernetes clusters for AI model inference and training
  • Develop, optimize, and maintain ML model serving infrastructure, ensuring high-performance and low-latency
  • Collaborate with ML and product teams to scale backend infrastructure for AI-driven products, focusing on model deployment, throughput optimization, and compute efficiency
  • Optimize compute-heavy workflows and enhance GPU utilization for ML workloads
  • Build a robust model API orchestration system
  • Collaborate with leadership to define and implement strategies for scaling infrastructure as the company grows, ensuring long-term efficiency and performance

Preferred

  • Expertise with model serving frameworks such as NVIDIA Triton Server, VLLM, TRT-LLM and so on
  • Expertise with ML toolchains such as PyTorch, Tensorflow or distributed training and inference libraries
  • Familiarity with GPU cluster management and CUDA optimization
  • Knowledge of infrastructure as code (Terraform, Ansible) and GitOps practices
  • Experience with container registries, image optimization, and multi-stage builds for ML workloads
  • Experience orchestrating across ASR models or LLM models for building various GenAI applications
  • NVIDIA Triton Server
  • vLLM
  • TensorRT-LLM
  • PyTorch
  • TensorFlow
  • Distributed Training
  • Inference Libraries
  • GPU Cluster Management
  • CUDA Optimization
  • Infrastructure as Code
  • Terraform
  • Ansible
  • GitOps
  • Container Registries
  • Image Optimization
  • Multi-Stage Builds
  • ML Workload Containers
  • ASR Model Orchestration
  • LLM Orchestration
  • Generative AI Applications

Benefits

  • 14 paid holidays
  • Flexible PTO for salaried employees
  • Accrued time off for hourly employees
  • Medical, Dental, and Vision coverage for all full-time employees and their families
  • Monthly HSA contributions if you choose a High Deductible Health Plan
  • Generous paid parental leave for all full-time employees
  • Family Forming Benefits: Resources and financial support to help you build your family
  • 401(k) matching
  • Tax-free funds for personal device usage
  • Access to Flexible Spending Accounts (FSA) and Commuter Benefits
  • Monthly Lifestyle Wallet contributions for fitness, professional development, coworking, and more
  • Dedicated access to therapy and coaching
  • Paid Sabbatical Leave after 5 years of employment
  • Equity grants for full-time employees
  • Flexible work hours
  • Ongoing learning opportunities

Company

  • AI platform for clinical conversation documentation in healthcare
  • San Francisco, California, USA
  • https://www.abridge.com/
  • Founded in 2018
  • 501-1000 employees

Qualifications

  • 5+ years of experience in building and deploying machine learning models in production environments
  • Deep understanding of container orchestration and distributed systems architecture
  • Expertise in Kubernetes administration, including custom resource definitions, operators, and cluster management
  • Experience developing APIs and managing distributed systems for both batch and real-time workloads
  • Excellent communication skills, with the ability to interface between research and product engineering
  • Expertise with model serving frameworks such as NVIDIA Triton Server, VLLM, TRT-LLM and so on
  • Expertise with ML toolchains such as PyTorch, Tensorflow or distributed training and inference libraries
  • Familiarity with GPU cluster management and CUDA optimization
  • Knowledge of infrastructure as code (Terraform, Ansible) and GitOps practices
  • Experience with container registries, image optimization, and multi-stage builds for ML workloads
  • Experience orchestrating across ASR models or LLM models for building various GenAI applications
  • 5+ years of experience in building and deploying machine learning models in production environments.

Required skills

  • API Development, Ansible, CUDA Optimization, Distributed Systems Architecture, Kubernetes Administration, Machine Learning Model Deployment, NVIDIA Triton Inference Server, PyTorch, TensorFlow, TensorRT-LLM, Terraform, vLLM

Experience

  • 5+ years

Job details

Employment type

Full-time

Seniority level

5+ years

Date posted

Nov 20, 2026

Work mode

Hybrid

Job source

jobs.ashbyhq.com

Company

Abridge

Information Technology & AI

AI platform for clinical conversation documentation in healthcare

See all 3 jobs from Abridge →
  • San Francisco, California, USA
  • Information Technology & AI
  • 501-1000 employees
  • Founded 2018
  • abridge.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Machine Learning Engineer jobs in San Francisco

Uber

1d ago

New

Sr Machine Learning Engineer

Full-timeHybridSan Francisco, CA$202K – $224K/yr

Uber is a global technology company operating mobility, delivery, and membership services through products such as Uber and Uber Eats.

Why similarSame rolePyTorchSan Francisco

Bright Vision Technologies

1d ago

New

Machine Learning Engineer

Full-timeRemoteUnited States$115K – $165K/yr

Bright Vision Technologies is seeking a Machine Learning Engineer to develop, evaluate, and operationalize predictive and classification models for production applications.

Why similarSame rolePyTorchRemote

Social Media

1d ago

New

Machine Learning Engineer

Full-timeRemoteUnited States$186K – $260K/yr

Reddit is hiring a Machine Learning Engineer to build and operate production machine learning systems across its platform.

Why similarSame rolePyTorchRemote

Get new Machine Learning Engineer jobs in San Francisco by email

Create job alert

Member of Technical Staff, Machine Learning Platform

Abridge · $221K – $260K/yr

Apply on company site