← Back to jobsJob ID col-cmvv3xfvo03cc42b9waus2t9a

BasetenPosted 30+ days ago

Software Engineer - AI Developer Productivity

Full-time
Hybrid
4+ years
Competitive
Posted 30+ days ago

Baseten is hiring a Software Engineer to build and operate its internal AI developer platform. The role focuses on AI coding tools, agent infrastructure, evaluation, developer experience, and safety controls that help engineering teams use AI effectively across the software development lifecycle.

Posted
30+ Days Ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Own the internal AI developer platform end to end — architecture, build, rollout, operation, measurement
  • Evaluate and integrate third-party AI coding tools (Claude Code, Cursor, Codex, and whatever ships next quarter), and build the context layer that makes them work against our monorepo
  • Build frameworks that let other engineers create their own agents without deep LLM expertise
  • Establish the evaluation practice for AI-assisted development at Baseten, and use it to drive investment decisions
  • Drive adoption through developer experience — good defaults, clear docs, low friction — not mandate
  • Embed with teams to find where AI genuinely unblocks them, then generalize those wins into platform capabilities
  • Own the safety layer: permissions, secrets handling, audit trails, cost management

Qualifications

  • Have 4+ years of relevant industry experience building and enabling AI native SDLC
  • Strong proficiency in Python and/or Go, building tools other engineers depend on daily
  • Hands-on experience with LLMs and agent frameworks — tool calling, MCP, context management, orchestration, failure handling. You've shipped something agentic that real people used, not just prototyped
  • Deep personal fluency with AI coding tools and well-formed opinions about where they break down
  • Platform mindset: you build for adoption and self-service, treat internal engineers as customers, and would rather ship a good default than write a style guide
  • Developer tooling, CI/CD, and Kubernetes/Docker fundamentals
  • Comfort with ambiguity — this space invalidates its own best practices every few months
  • Excellent written communication. Much of your leverage is docs, templates, and examples that scale beyond conversations you're in

Required skills

AI Coding Tools CodexAI Coding Tools CursorAI-Native SDLCAgent OrchestrationContext ManagementDockerGoKubernetesLarge Language Models (LLMs)MCPPythonTool Calling

Full job description

Baseten is hiring a Software Engineer to build and operate its internal AI developer platform. The role focuses on AI coding tools, agent infrastructure, evaluation, developer experience, and safety controls that help engineering teams use AI effectively across the software development lifecycle.

Responsibilities

  • Own the internal AI developer platform end to end — architecture, build, rollout, operation, measurement
  • Evaluate and integrate third-party AI coding tools (Claude Code, Cursor, Codex, and whatever ships next quarter), and build the context layer that makes them work against our monorepo
  • Build frameworks that let other engineers create their own agents without deep LLM expertise
  • Establish the evaluation practice for AI-assisted development at Baseten, and use it to drive investment decisions
  • Drive adoption through developer experience — good defaults, clear docs, low friction — not mandate
  • Embed with teams to find where AI genuinely unblocks them, then generalize those wins into platform capabilities
  • Own the safety layer: permissions, secrets handling, audit trails, cost management

Benefits

  • Meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy, including company-wide Winter Break (offices are closed from Christmas Eve to New Year's Day)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering learning and networking opportunities
  • Hybrid work arrangement

Company

  • AI model inference platform for deploying and scaling production models
  • San Francisco, California, USA
  • https://www.baseten.co/
  • Founded in 2019
  • 201-500 employees

Qualifications

  • Have 4+ years of relevant industry experience building and enabling AI native SDLC
  • Strong proficiency in Python and/or Go, building tools other engineers depend on daily
  • Hands-on experience with LLMs and agent frameworks — tool calling, MCP, context management, orchestration, failure handling. You've shipped something agentic that real people used, not just prototyped
  • Deep personal fluency with AI coding tools and well-formed opinions about where they break down
  • Platform mindset: you build for adoption and self-service, treat internal engineers as customers, and would rather ship a good default than write a style guide
  • Developer tooling, CI/CD, and Kubernetes/Docker fundamentals
  • Comfort with ambiguity — this space invalidates its own best practices every few months
  • Excellent written communication. Much of your leverage is docs, templates, and examples that scale beyond conversations you're in

Required skills

  • AI Coding Tools Claude Code, AI Coding Tools Codex, AI Coding Tools Cursor, AI-Native SDLC, Agent Orchestration, Context Management, Docker, Go, Kubernetes, Large Language Models (LLMs), MCP, Python, Tool Calling

Experience

  • 4+ years

Job details

Employment type

Full-time

Seniority level

4+ years

Date posted

Oct 11, 2026

Work mode

Hybrid

Job source

jobs.ashbyhq.com

Company

Baseten

Information Technology & AI

AI model inference platform for deploying and scaling production models

See all 2 jobs from Baseten →
  • San Francisco, California, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 2019
  • baseten.co

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs in New York

WTW

1d ago

New

AI Solutions Engineer

Full-timeHybridNew York, NYCompetitive

WTW is hiring an AI Solutions Engineer for its Willis Neuron Technology team, supporting the Risk & Analytics consulting practices of Willis, a WTW business.

Why similarSame roleDockerNew York

Envision Technology Solutions

1d ago

New

Anthropic Claude AI Engineer/Developer

TemporaryHybridNew York, NYCompetitive

Envision Technology Solutions is seeking an Anthropic Claude AI Engineer/Developer to build applications, tools, and agentic workflows using the Claude ecosystem.

Why similarSame rolePythonNew York

EVERSANA

1d ago

New

Sr. AI Developer, Engineering

Full-timeRemoteUnited States$122K – $200K/yr

EVERSANA is hiring a Senior AI Developer to design, build, and deploy enterprise-grade AI solutions for pharmaceutical and healthcare marketing operations.

Why similarSame roleAgent OrchestrationRemote

Get new AI Engineer jobs in New York by email

Create job alert

Software Engineer - AI Developer Productivity

Baseten · Competitive

Apply on company site