← Back to jobsJob ID col-cmvv47jgm03p842b9kzwikg47

MercorPosted 30+ days ago

Tech Lead, Systems & Platform Applied AI

Full-time
On-site
8+ years
$250K – $500K/yr
Posted 30+ days ago

Mercor is hiring a Tech Lead for its Applied AI backend systems. The role owns architecture and delivery of backend services, data models, orchestration systems, and pipelines, while setting technical direction, mentoring engineers, and ensuring reliable production operations.

Posted
30+ Days Ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Own the architecture of the Applied AI backend domain; core services, data models, orchestration systems and the pipeline execution layer that the product and ops team in the org depends on
  • Set the technical direction, then stay hands-on enough to build the hardest parts yourself
  • You'll take problems that arrive undefined, decide what's worth building, and own the outcome - the scoping is part of the job, write the design, ship the code, instrument it, and keep it healthy in production
  • Build and tune high-throughput data and job pipelines: queuing, batching, idempotency, retries, and backpressure. Make the system fast and reliable by adding failure recovery in pipelines, profile hot spots, Agent token and cost attribution, caching issues, and set latency, error, cost budgets you actually hold to
  • Own the design review bar for backend work across the org. Mentor senior engineers, make the technical tradeoffs legible to leadership in writing, and raise the standard for how we build
  • Provision and manage infrastructure as code using Terraform and at scale. Manage and launch 10s of 1000s of containers, sandbox environments, manage resource allocation and system health
  • Participate in on-call for the systems you own, debug production incidents, and write up what you learn in RCCA
  • Drive XFN alignment across teams through technical judgment and work directly with product, operations, and research partners to turn ambiguous requirements into systems that ship

Qualifications

  • 8+ years of professional backend engineering experience building and operating production systems with a track record of owning architecture across multiple teams and of decisions that aged well
  • Experience mentoring senior engineers, not just junior ones
  • Strong fundamentals in backend engineering: data structures, algorithms, concurrency, and writing code that's clear enough for the next person to change
  • Hands-on experience with API design - REST, gRPC, or GraphQL, and an understanding of versioning, contracts, and backward compatibility
  • Solid database skills: relational data modeling, indexing, query performance, transactions and isolation, and safe migrations
  • Familiarity with at least one NoSQL or key-value store and when it's the right choice
  • Deep, hands-on expertise in distributed systems: queues and event streams, caching, idempotency, rate limiting, and designing for partial failure
  • Experience with Data Orchestration and workflow management systems like Airflow, Temporal, Dagster
  • Be able to roll your sleeves up and dig deeper into the lower level infrastructure issues container, permissions, logs, traces and find the needle in the haystack
  • Experience running services in production: containers, CI/CD, monitoring and alerting, and debugging issues under real traffic
  • Comfort with ambiguity you can take a loosely defined problem, ask the right questions, and come back with a plan
  • Genuine excitement for agentic development and new technology, fluency with modern AI dev tools (e.g. Claude Code, Cursor, Copilot), and a real passion for writing good code
  • Clear written and verbal communication
  • High ownership, pragmatism, and a bias toward shipping

Preferred

  • Experience building or integrating with LLM-backed services in production (evaluation, orchestration, or serving)
  • Familiarity with AI infrastructure providers like Modal, Fireworks, Baseten, Temporal

Required skills

API Design GraphQLAPI Design RESTAPI Design gRPCBackend EngineeringConcurrencyContainers and CI/CDData Structures and AlgorithmsDistributed SystemsRelational Data ModelingTerraformWorkflow Orchestration AirflowWorkflow Orchestration DagsterWorkflow Orchestration Temporal

Nice to have

Written and Verbal Communication

Full job description

Mercor is hiring a Tech Lead for its Applied AI backend systems. The role owns architecture and delivery of backend services, data models, orchestration systems, and pipelines, while setting technical direction, mentoring engineers, and ensuring reliable production operations.

Responsibilities

  • Own the architecture of the Applied AI backend domain; core services, data models, orchestration systems and the pipeline execution layer that the product and ops team in the org depends on
  • Set the technical direction, then stay hands-on enough to build the hardest parts yourself
  • You'll take problems that arrive undefined, decide what's worth building, and own the outcome - the scoping is part of the job, write the design, ship the code, instrument it, and keep it healthy in production
  • Build and tune high-throughput data and job pipelines: queuing, batching, idempotency, retries, and backpressure. Make the system fast and reliable by adding failure recovery in pipelines, profile hot spots, Agent token and cost attribution, caching issues, and set latency, error, cost budgets you actually hold to
  • Own the design review bar for backend work across the org. Mentor senior engineers, make the technical tradeoffs legible to leadership in writing, and raise the standard for how we build
  • Provision and manage infrastructure as code using Terraform and at scale. Manage and launch 10s of 1000s of containers, sandbox environments, manage resource allocation and system health
  • Participate in on-call for the systems you own, debug production incidents, and write up what you learn in RCCA
  • Drive XFN alignment across teams through technical judgment and work directly with product, operations, and research partners to turn ambiguous requirements into systems that ship

Preferred

  • Experience building or integrating with LLM-backed services in production (evaluation, orchestration, or serving)
  • Familiarity with AI infrastructure providers like Modal, Fireworks, Baseten, Temporal
  • Production LLM Services
  • LLM Evaluation
  • LLM Orchestration
  • LLM Serving
  • AI Infrastructure
  • Modal
  • Fireworks
  • Baseten

Benefits

  • Bi-annual performance bonus structure
  • Generous equity grant vested over 4 years
  • Up to $15k Relocation bonus
  • $10K housing bonus (if you live within 0.5 miles of our office)
  • $1.5K monthly stipend for meals
  • Free Equinox membership
  • $200 monthly laundry reimbursement
  • $200 monthly personal wellness reimbursement
  • Health, Dental, Vision insurance

Company

  • Expert staffing and frontier model training for enterprises
  • San Francisco, California, USA
  • https://mercor.com/
  • Founded in 2023
  • 201-500 employees

Qualifications

  • 8+ years of professional backend engineering experience building and operating production systems with a track record of owning architecture across multiple teams and of decisions that aged well
  • Experience mentoring senior engineers, not just junior ones
  • Strong fundamentals in backend engineering: data structures, algorithms, concurrency, and writing code that's clear enough for the next person to change
  • Hands-on experience with API design - REST, gRPC, or GraphQL, and an understanding of versioning, contracts, and backward compatibility
  • Solid database skills: relational data modeling, indexing, query performance, transactions and isolation, and safe migrations
  • Familiarity with at least one NoSQL or key-value store and when it's the right choice
  • Deep, hands-on expertise in distributed systems: queues and event streams, caching, idempotency, rate limiting, and designing for partial failure
  • Experience with Data Orchestration and workflow management systems like Airflow, Temporal, Dagster
  • Be able to roll your sleeves up and dig deeper into the lower level infrastructure issues container, permissions, logs, traces and find the needle in the haystack
  • Experience running services in production: containers, CI/CD, monitoring and alerting, and debugging issues under real traffic
  • Comfort with ambiguity you can take a loosely defined problem, ask the right questions, and come back with a plan
  • Genuine excitement for agentic development and new technology, fluency with modern AI dev tools (e.g. Claude Code, Cursor, Copilot), and a real passion for writing good code
  • Clear written and verbal communication
  • High ownership, pragmatism, and a bias toward shipping
  • Experience building or integrating with LLM-backed services in production (evaluation, orchestration, or serving)
  • Familiarity with AI infrastructure providers like Modal, Fireworks, Baseten, Temporal
  • 8+ years of professional backend engineering experience building and operating production systems with a track record of owning architecture across multiple teams and of decisions that aged well.

Required skills

  • API Design GraphQL, API Design REST, API Design gRPC, Backend Engineering, Concurrency, Containers and CI/CD, Data Structures and Algorithms, Distributed Systems, Production Monitoring and Incident Debugging, Relational Data Modeling, Terraform, Workflow Orchestration Airflow, Workflow Orchestration Dagster, Workflow Orchestration Temporal

Preferred skills

  • Written and Verbal Communication

Experience

  • 8+ years

Job details

Employment type

Full-time

Seniority level

8+ years

Date posted

Sep 24, 2026

Work mode

On-site

Job source

jobs.ashbyhq.com

Company

Mercor

Information Technology & AI

Expert staffing and frontier model training for enterprises

See all 43 jobs from Mercor →
  • San Francisco, California, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 2023
  • mercor.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs in New York

WTW

1d ago

New

AI Solutions Engineer

Full-timeHybridNew York, NYCompetitive

WTW is hiring an AI Solutions Engineer for its Willis Neuron Technology team, supporting the Risk & Analytics consulting practices of Willis, a WTW business.

Why similarSame roleNew York

just now

1d ago

New

Gen AI Engineer

Full-timeHybridNew York, NYCompetitive

Suntek Corporations Inc is seeking a Gen AI Engineer to design, develop, and productionize enterprise AI applications and workflows.

Why similarSame roleNew York

Envision Technology Solutions

1d ago

New

Anthropic Claude AI Engineer/Developer

TemporaryHybridNew York, NYCompetitive

Envision Technology Solutions is seeking an Anthropic Claude AI Engineer/Developer to build applications, tools, and agentic workflows using the Claude ecosystem.

Why similarSame roleNew York

Get new AI Engineer jobs in New York by email

Create job alert

Tech Lead, Systems & Platform Applied AI

Mercor · $250K – $500K/yr

Apply on company site