← Back to jobsJob ID col-cmvv47bgr03oy42b9mn6je4r8

MercorPosted 30+ days ago

Software Engineer, Systems & Platform Applied AI

Full-time
On-site
2–5 years
$220K – $500K/yr
Posted 30+ days ago

Mercor is hiring a Software Engineer for its Applied AI backend systems. The role builds and operates services, data models, APIs, and pipelines that power workflows for generating training data for frontier AI models, with end-to-end ownership of production systems.

Posted
30+ Days Ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, build, and operate backend services in the Applied AI stack including APIs, data models, background jobs, and the pipelines that connect them
  • Own features end to end: scope the problem, write the design, ship the code, instrument it, and keep it healthy in production
  • Build and tune high-throughput data and job pipelines: queuing, batching, idempotency, retries, and backpressure
  • Make the system fast and reliable by adding failure recovery in pipelines, profile hot spots, Agent token and cost attribution, caching issues, and set latency, error, cost budgets you actually hold to
  • Instrument what you ship: observability, metrics, logging, tracing, and alerts that proactively catch problems
  • Work on modern cutting edge tools, libraries and frameworks
  • Manage and launch 10s of 1000s of containers, sandbox environments, manage resource allocation and system health
  • Manage infrastructure as code using Terraform
  • Participate in on-call for the systems you own, debug production incidents, and write up what you learn in RCCA
  • Write clear design docs and give useful code review, we make technical decisions in writing and expect everyone to take part
  • Work directly with product, operations, and research partners to turn ambiguous requirements into systems that ship

Qualifications

  • 2–5 years of professional backend engineering experience building and operating production systems
  • Strong fundamentals in backend engineering: data structures, algorithms, concurrency, and writing code that's clear enough for the next person to change
  • Hands-on experience with API design - REST, gRPC, or GraphQL, and an understanding of versioning, contracts, and backward compatibility
  • Solid database skills: relational data modeling, indexing, query performance, transactions and isolation, and safe migrations
  • Familiarity with at least one NoSQL or key-value store and when it's the right choice
  • Practical experience with distributed systems basics: queues and event streams, caching, idempotency, rate limiting, and designing for partial failure
  • Experience with Data Orchestration and workflow management systems like Airflow, Temporal, Dagster
  • Be able to roll your sleeves up and dig deeper into the lower level infrastructure issues container, permissions, logs, traces and find the needle in the haystack
  • Experience running services in production: containers, CI/CD, monitoring and alerting, and debugging issues under real traffic
  • Comfort with ambiguity you can take a loosely defined problem, ask the right questions, and come back with a plan
  • Genuine excitement for agentic development and new technology, fluency with modern AI dev tools (e.g. Claude Code, Cursor, Copilot), and a real passion for writing good code
  • Clear written and verbal communication
  • High ownership, pragmatism, and a bias toward shipping

Preferred

  • Experience building or integrating with LLM-backed services in production (evaluation, orchestration, or serving)
  • Familiarity with AI infrastructure providers like Modal, Fireworks, Baseten, Temporal

Required skills

API DesignAirflowBackend EngineeringBasetenCI/CDCachingClaude CodeContainersCursorDagsterDatabase MigrationsDatabase Transactions and IsolationDistributed SystemsFireworks

Nice to have

Written and Verbal Communication

Full job description

Mercor is hiring a Software Engineer for its Applied AI backend systems. The role builds and operates services, data models, APIs, and pipelines that power workflows for generating training data for frontier AI models, with end-to-end ownership of production systems.

Responsibilities

  • Design, build, and operate backend services in the Applied AI stack including APIs, data models, background jobs, and the pipelines that connect them
  • Own features end to end: scope the problem, write the design, ship the code, instrument it, and keep it healthy in production
  • Build and tune high-throughput data and job pipelines: queuing, batching, idempotency, retries, and backpressure
  • Make the system fast and reliable by adding failure recovery in pipelines, profile hot spots, Agent token and cost attribution, caching issues, and set latency, error, cost budgets you actually hold to
  • Instrument what you ship: observability, metrics, logging, tracing, and alerts that proactively catch problems
  • Work on modern cutting edge tools, libraries and frameworks
  • Manage and launch 10s of 1000s of containers, sandbox environments, manage resource allocation and system health
  • Manage infrastructure as code using Terraform
  • Participate in on-call for the systems you own, debug production incidents, and write up what you learn in RCCA
  • Write clear design docs and give useful code review, we make technical decisions in writing and expect everyone to take part
  • Work directly with product, operations, and research partners to turn ambiguous requirements into systems that ship

Preferred

  • Experience building or integrating with LLM-backed services in production (evaluation, orchestration, or serving)
  • Familiarity with AI infrastructure providers like Modal, Fireworks, Baseten, Temporal
  • Production LLM Services
  • LLM Evaluation
  • LLM Orchestration
  • LLM Serving
  • AI Infrastructure
  • Modal
  • Fireworks
  • Baseten

Benefits

  • Bi-annual performance bonus structure
  • Generous equity grant vested over 4 years
  • Up to $15k Relocation bonus
  • $10K housing bonus (if you live within 0.5 miles of our office)
  • $1.5K monthly stipend for meals
  • Free Equinox membership
  • $200 monthly laundry reimbursement
  • $200 monthly personal wellness reimbursement
  • Health, Dental, Vision insurance

Company

  • Expert staffing and frontier model training for enterprises
  • San Francisco, California, USA
  • https://mercor.com/
  • Founded in 2023
  • 201-500 employees

Qualifications

  • 2–5 years of professional backend engineering experience building and operating production systems
  • Strong fundamentals in backend engineering: data structures, algorithms, concurrency, and writing code that's clear enough for the next person to change
  • Hands-on experience with API design - REST, gRPC, or GraphQL, and an understanding of versioning, contracts, and backward compatibility
  • Solid database skills: relational data modeling, indexing, query performance, transactions and isolation, and safe migrations
  • Familiarity with at least one NoSQL or key-value store and when it's the right choice
  • Practical experience with distributed systems basics: queues and event streams, caching, idempotency, rate limiting, and designing for partial failure
  • Experience with Data Orchestration and workflow management systems like Airflow, Temporal, Dagster
  • Be able to roll your sleeves up and dig deeper into the lower level infrastructure issues container, permissions, logs, traces and find the needle in the haystack
  • Experience running services in production: containers, CI/CD, monitoring and alerting, and debugging issues under real traffic
  • Comfort with ambiguity you can take a loosely defined problem, ask the right questions, and come back with a plan
  • Genuine excitement for agentic development and new technology, fluency with modern AI dev tools (e.g. Claude Code, Cursor, Copilot), and a real passion for writing good code
  • Clear written and verbal communication
  • High ownership, pragmatism, and a bias toward shipping
  • Experience building or integrating with LLM-backed services in production (evaluation, orchestration, or serving)
  • Familiarity with AI infrastructure providers like Modal, Fireworks, Baseten, Temporal
  • 2–5 years of professional backend engineering experience building and operating production systems.

Required skills

  • API Design, Airflow, Backend Engineering, Baseten, CI/CD, Caching, Claude Code, Containers, Cursor, Dagster, Database Indexing and Query Performance, Database Migrations, Database Transactions and Isolation, Distributed Systems, Fireworks, GitHub Copilot, GraphQL, Idempotency, LLM-Backed Services, Modal, Monitoring and Alerting, Queues and Event Streams, REST, Rate Limiting, Relational Data Modeling, gRPC

Preferred skills

  • Written and Verbal Communication

Experience

  • 2-5 years

Job details

Employment type

Full-time

Seniority level

2–5 years

Date posted

Sep 24, 2026

Work mode

On-site

Job source

jobs.ashbyhq.com

Company

Mercor

Information Technology & AI

Expert staffing and frontier model training for enterprises

See all 43 jobs from Mercor →
  • San Francisco, California, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 2023
  • mercor.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Systems Engineer jobs in New York

Movable Ink

1d ago

New

Senior Data Engineer, AI Systems

Full-timeOn-siteUnited States$165K – $215K/yr

Movable Ink is a company that scales content personalization for marketers through data-activated content generation and AI decisioning.

Why similarSame roleCI/CD

Nutanix

1d ago

New

Sr. Systems Sales Engineer

Full-timeRemoteUnited States$207K – $311K/yr

Nutanix provides enterprise cloud technology solutions and is seeking a Sr. Systems Sales Engineer to support its Systems Engineering and Solution Sales team.

Why similarSame roleRemote

Allyis

1d ago

New

Software Engineer (Systems)

Full-timeOn-siteKirkland, WACompetitive

Allyis is hiring a Software Engineer (Systems) to design, develop, troubleshoot, and maintain software systems and tools supporting infrastructure, platforms, and product development.

Why similarSame role

Get new Systems Engineer jobs in New York by email

Create job alert

Software Engineer, Systems & Platform Applied AI

Mercor · $220K – $500K/yr

Apply on company site