← Back to jobsJob ID col-cmwpbkww609l3d8hai8drpvut

AnyspherePosted 1 day ago

Software Engineer, Pretraining DataNew

Full-time
On-site
3+ years
$160K – $250K/yr
Posted 1 day ago

SpaceXSI is building the Super Intelligence stack, including frontier models and the infrastructure that supports them. The Software Engineer, Pretraining Data builds large-scale data platforms, quality systems, and crawling infrastructure that turn raw data into reliable training datasets and help researchers iterate quickly.

Posted
1 day ago
Source
cursor.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Build the platform that turns raw web, code, multimodal, and acquired data into training-ready datasets for frontier pretraining runs
  • Own the pipelines, orchestration, and tooling that make pretraining data iteration fast, reliable, observable, and reproducible at scale
  • Create clear signals for data quality, lineage, freshness, and pipeline health so researchers can trust what goes into each run
  • Partner with initial training, crawling, data quality, and acquisition teams to turn new data ideas into measurable improvements in loss, evals, and model capability
  • Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data with end-to-end traceability. If something breaks or drifts, your systems will tell us before the training run does
  • Train and ship models that classify, rank, filter, clean, and identify data at extreme throughput. These models have to be both accurate and fast enough to sit in the critical path without becoming the bottleneck
  • Design and run scaling-ladder experiments on data-mixture, repeatability, and quality depth that turn "this dataset feels good" into hard evidence the training team can trust
  • Partner tightly with Data Acquisition to hunt down missing or low-quality sources, and with the training teams to close the loop on what actually moves loss and downstream evals
  • Treat data quality as a systems problem and a research problem. You will write performance-critical code one week and design careful experiments the next
  • Build and scale the web crawling systems that discover, schedule, fetch, and parse high-quality documents across the open web for initial training
  • Improve URL seeding, scoring, and fair host scheduling so crawl capacity lands on the hosts and pages that matter most for model quality
  • Raise crawl success and parsing quality, defeating antibot failures, improving extractors, and capturing content we previously could not get cleanly
  • Debug and harden complex crawl infrastructure end-to-end for availability, recovery, and ingestion lag, and automate delivery of crawl datasets into the data pipeline
  • Work independently (and alongside AI agents) and partner with Data Quality and Data Platform so new coverage shows up as better tokens in training runs

Qualifications

  • Minimum of 3 years of software engineering experience
  • Software engineering experience building distributed systems and/or large-scale data infrastructure

Preferred

  • High-slope engineer who has moved unusually fast (e.g., staff-level ownership within a few years) or brings relevant domain experience
  • Able to architect and ship end-to-end with high ownership, debug complex systems independently, and work alongside AI agents
  • Strong intuitions about large-scale distributed systems
  • Excited to learn how pre-training data shapes model quality, and want the ownership and visibility that comes with building systems that feed frontier training runs
  • Relevant Domain Experience
  • End-to-End System Architecture
  • End-to-End Product Delivery
  • Collaboration with AI Agents

Required skills

Distributed Systems

Full job description

SpaceXSI is building the Super Intelligence stack, including frontier models and the infrastructure that supports them. The Software Engineer, Pretraining Data builds large-scale data platforms, quality systems, and crawling infrastructure that turn raw data into reliable training datasets and help researchers iterate quickly.

Responsibilities

  • Build the platform that turns raw web, code, multimodal, and acquired data into training-ready datasets for frontier pretraining runs
  • Own the pipelines, orchestration, and tooling that make pretraining data iteration fast, reliable, observable, and reproducible at scale
  • Create clear signals for data quality, lineage, freshness, and pipeline health so researchers can trust what goes into each run
  • Partner with initial training, crawling, data quality, and acquisition teams to turn new data ideas into measurable improvements in loss, evals, and model capability
  • Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data with end-to-end traceability. If something breaks or drifts, your systems will tell us before the training run does
  • Train and ship models that classify, rank, filter, clean, and identify data at extreme throughput. These models have to be both accurate and fast enough to sit in the critical path without becoming the bottleneck
  • Design and run scaling-ladder experiments on data-mixture, repeatability, and quality depth that turn "this dataset feels good" into hard evidence the training team can trust
  • Partner tightly with Data Acquisition to hunt down missing or low-quality sources, and with the training teams to close the loop on what actually moves loss and downstream evals
  • Treat data quality as a systems problem and a research problem. You will write performance-critical code one week and design careful experiments the next
  • Build and scale the web crawling systems that discover, schedule, fetch, and parse high-quality documents across the open web for initial training
  • Improve URL seeding, scoring, and fair host scheduling so crawl capacity lands on the hosts and pages that matter most for model quality
  • Raise crawl success and parsing quality, defeating antibot failures, improving extractors, and capturing content we previously could not get cleanly
  • Debug and harden complex crawl infrastructure end-to-end for availability, recovery, and ingestion lag, and automate delivery of crawl datasets into the data pipeline
  • Work independently (and alongside AI agents) and partner with Data Quality and Data Platform so new coverage shows up as better tokens in training runs

Preferred

  • High-slope engineer who has moved unusually fast (e.g., staff-level ownership within a few years) or brings relevant domain experience
  • Able to architect and ship end-to-end with high ownership, debug complex systems independently, and work alongside AI agents
  • Strong intuitions about large-scale distributed systems
  • Excited to learn how pre-training data shapes model quality, and want the ownership and visibility that comes with building systems that feed frontier training runs
  • Relevant Domain Experience
  • End-to-End System Architecture
  • End-to-End Product Delivery
  • Complex Systems Debugging
  • Large-Scale Distributed Systems
  • Pre-Training Data Expertise
  • Model Quality
  • Training Data Systems
  • Frontier Model Training
  • Rapid Learning
  • High Ownership
  • Independent Problem-Solving
  • Collaboration with AI Agents

Benefits

  • Equity
  • Comprehensive medical, vision, and dental coverage
  • Access to a 401(k) retirement plan
  • Short- and long-term disability insurance
  • Life insurance
  • Various other discounts and perks

Company

  • AI coding agent for software development
  • http://www.anysphere.co/
  • Founded in 2022
  • 51-200 employees

Qualifications

  • Minimum of 3 years of software engineering experience
  • Software engineering experience building distributed systems and/or large-scale data infrastructure
  • High-slope engineer who has moved unusually fast (e.g., staff-level ownership within a few years) or brings relevant domain experience
  • Able to architect and ship end-to-end with high ownership, debug complex systems independently, and work alongside AI agents
  • Strong intuitions about large-scale distributed systems
  • Excited to learn how pre-training data shapes model quality, and want the ownership and visibility that comes with building systems that feed frontier training runs

Required skills

  • Distributed Systems

Preferred skills

  • Strong intuitions about large-scale distributed systems

Experience

  • 3+ years

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Nov 20, 2026

Work mode

On-site

Job source

cursor.com

Company

Anysphere

Information Technology & AI

AI coding agent for software development

  • Palo Alto, CA
  • Information Technology & AI
  • 51-200 employees
  • Founded 2022
  • anysphere.co

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Palo Alto

Zipline

1d ago

New

AI Tooling Software Engineer - Data Platform, Autonomy

Full-timeOn-siteSouth San Francisco, CA$180K – $250K/yr

Zipline is hiring an AI Tooling Software Engineer for its Autonomy team. The role builds data triage and visualization tools, backend APIs, and data pipelines to help teams investigate autonomy issues and improve model, hardware, and operational performance.

Why similarSame roleSouth San Francisco

just now

1d ago

New

Data Engineer, Palo Alto

Full-timeOn-sitePalo Alto, CA$110K – $180K/yr

Rhombus Power, Inc. develops AI-powered predictive intelligence for defense and national security organizations.

Why similarSame rolePalo Alto

Coinbase

1d ago

New

Senior Software Engineer - Data Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer to build and operate systems that centralize internal and third-party data.

Why similarSame roleRemote

Get new Data Engineer jobs in Palo Alto by email

Create job alert

Software Engineer, Pretraining Data

Anysphere · $160K – $250K/yr

Apply on company site