← Back to jobsJob ID col-cmwf8vfiw0eaq89hq6e23minl

GleanPosted 8 days ago

AI Engineer - Quality and Post-Training

Full-time
Hybrid
5+ years
$200K – $280K/yr
Posted 8 days ago

Glean is hiring an AI Engineer to improve the quality of its enterprise AI assistants and autonomous agents. The role uses evaluations, post-training, and production learnings to improve models, agent systems, and enterprise workflows in collaboration with product, platform, and research teams.

Posted
8 days ago
Source
job-boards.greenhouse.io
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Use eval results and production traces to improve the entire stack, including the agent harness, model routing, prompts, and retrieval, while weighing quality against latency and cost
  • Work on post-training models with supervised fine-tuning (SFT) and preference- or reward-based optimization (e.g., DPO, PPO, GRPO), including generating the data for training
  • Build RL environments for simulating enterprise workflows, including relevant evalsets, harness support, and LLM-based verifiers for hill-climbing and for internal and external benchmarking
  • Improve the quality of representative evalsets, LLM judges and agentic verifiers, and calibrate them against human graders so the scores can be trusted in release decisions and model training
  • Work with product, platform, and research teams across Glean to land quality improvements in production

Qualifications

  • 5+ years of industry experience in AI or Machine Learning Engineering
  • Hands-on experience post-training LLMs including adapting open-weight models to specialized tasks
  • Experience building evals for AI assistant and agent systems, including generating evalsets, LLM-as-a-judge verifiers, calibrating offline and online signals coupled with good judgment about when a metric reflects quality improvements
  • Strong coding skills in Python and/or Go (TypeScript is a plus), proficiency in your ML framework of choice, and a track record of shipping production ML systems
  • Product-minded, able to turn a vague problem into a concrete experiment, and thrive in a tight-knit, cross-functional team

Required skills

LLM Post-TrainingOpen-Weight Model AdaptationProduction ML Systems

Full job description

Glean is hiring an AI Engineer to improve the quality of its enterprise AI assistants and autonomous agents. The role uses evaluations, post-training, and production learnings to improve models, agent systems, and enterprise workflows in collaboration with product, platform, and research teams.

Responsibilities

  • Use eval results and production traces to improve the entire stack, including the agent harness, model routing, prompts, and retrieval, while weighing quality against latency and cost
  • Work on post-training models with supervised fine-tuning (SFT) and preference- or reward-based optimization (e.g., DPO, PPO, GRPO), including generating the data for training
  • Build RL environments for simulating enterprise workflows, including relevant evalsets, harness support, and LLM-based verifiers for hill-climbing and for internal and external benchmarking
  • Improve the quality of representative evalsets, LLM judges and agentic verifiers, and calibrate them against human graders so the scores can be trusted in release decisions and model training
  • Work with product, platform, and research teams across Glean to land quality improvements in production

Benefits

  • Hybrid (4 days a week in the Mountain View or San Francisco office)
  • Medical, Vision, and Dental coverage
  • Generous time-off policy
  • Opportunity to contribute to your 401k plan
  • Home office improvement stipend
  • Annual education and wellness stipends
  • Regular events
  • Healthy lunches daily

Company

  • Work AI platform connecting enterprise data for search and automation
  • San Francisco, California, USA
  • https://www.glean.com/
  • Founded in 2019
  • 501-1000 employees

Qualifications

  • 5+ years of industry experience in AI or Machine Learning Engineering
  • Hands-on experience post-training LLMs including adapting open-weight models to specialized tasks
  • Experience building evals for AI assistant and agent systems, including generating evalsets, LLM-as-a-judge verifiers, calibrating offline and online signals coupled with good judgment about when a metric reflects quality improvements
  • Strong coding skills in Python and/or Go (TypeScript is a plus), proficiency in your ML framework of choice, and a track record of shipping production ML systems
  • Product-minded, able to turn a vague problem into a concrete experiment, and thrive in a tight-knit, cross-functional team
  • 5+ years of industry experience in AI or Machine Learning Engineering.

Required skills

  • AI Assistant and Agent Evaluation, LLM Post-Training, Open-Weight Model Adaptation, Production ML Systems

Experience

  • 5+ years

Job details

Employment type

Full-time

Seniority level

5+ years

Date posted

Nov 13, 2026

Work mode

Hybrid

Job source

job-boards.greenhouse.io

Company

Glean

Information Technology & AI

Work AI platform connecting enterprise data for search and automation

See all 4 jobs from Glean →
  • San Francisco, California, USA
  • Information Technology & AI
  • 501-1000 employees
  • Founded 2019
  • glean.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs in Mountain View

Greylock Partners

1d ago

New

AI Engineer, Model Fine-Tuning and Infrastructure

Full-timeHybridSan Mateo, CACompetitive

An unnamed Greylock Partners investment is hiring an AI Engineer to fine-tune the decision and text models that power its product. The role combines model development with building infrastructure for training, serving, and collecting production data.

Why similarSame roleSan Mateo

Hinge Health

1d ago

New

AI Engineer II

Full-timeHybridSan Francisco, CA$135K – $200K/yr

Hinge Health is hiring an AI Engineer II to build and operate backend systems that bring AI-powered product capabilities to members.

Why similarSame roleSan Francisco

Cisco

1d ago

New

AI Engineer - CX

Full-timeHybridSan Jose, CA$203K – $259K/yr

Cisco is hiring an AI & Agentic Systems Engineer to build and deploy production-grade multi-agent systems and foundational AI services for enterprise network operations, delivery intelligence, and edge automation.

Why similarSame roleSan Jose

Get new AI Engineer jobs in Mountain View by email

Create job alert

AI Engineer - Quality and Post-Training

Glean · $200K – $280K/yr

Apply on company site