← Back to jobsJob ID col-cmwp991bk08p4d8hackehw32j

OpenAIPosted 1 day ago

Data Scientist, IntegrityNew

Full-time
Hybrid
Mid level
Competitive
Posted 1 day ago

OpenAI’s Integrity team protects users and businesses from fraud, abuse, and harmful misuse across its products. The Data Scientist investigates emerging abuse, measures the impact of detection and enforcement decisions, and works with cross-functional teams to improve controls and evaluate their outcomes.

Posted
1 day ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Investigate anomalous activity across products. Estimate how common a problem is, who is affected, and what it costs users or the business. Use that evidence to recommend where to focus
  • Define outcome metrics and guardrails, establish baselines, and build monitoring that surfaces changes in abuse, customer friction, and operational performance
  • Help build and evaluate detection rules, classifiers, and human review workflows. Use labeled samples and review outcomes to understand what the systems miss, where they flag legitimate activity, and how those errors vary across users and products
  • Design randomized holdouts and use quasi-experimental or observational methods when randomization is impractical. Estimate harm or fraud losses prevented alongside effects on legitimate users, revenue, compute costs, and review workload. Recommend whether to launch, expand, adjust, or retire a control
  • Trace where signals, review decisions, or enforcement actions break down. Work with partners to close gaps and build reusable datasets, analyses, and investigation tools

Qualifications

  • You use AI tools to investigate large, messy datasets, test hypotheses quickly, and automate recurring analyses
  • You're fluent in SQL and Python and can verify AI-generated queries, code, and conclusions against the underlying data
  • You have strong statistical judgment and experience with experimentation, causal inference, or observational analysis
  • You can reason from incomplete or biased labels and explain how uncertainty affects a decision
  • You take ownership of open-ended problems, from deciding what to measure through recommending an action and checking whether it worked
  • You communicate clearly with technical and nontechnical partners and can explain the tradeoffs behind a recommendation

Preferred

  • Experience in integrity, trust and safety, fraud or risk analytics, security analytics, or applied ML evaluation is helpful
  • Experience evaluating detection systems, human review, or LLM-based classifiers is a plus
  • Integrity Experience

Required skills

Applied ML EvaluationCausal InferenceFraud AnalyticsLLM-Based Classifier EvaluationObservational AnalysisPythonRisk AnalyticsSQLSecurity AnalyticsStatisticsTrust and Safety

Full job description

OpenAI’s Integrity team protects users and businesses from fraud, abuse, and harmful misuse across its products. The Data Scientist investigates emerging abuse, measures the impact of detection and enforcement decisions, and works with cross-functional teams to improve controls and evaluate their outcomes.

Responsibilities

  • Investigate anomalous activity across products. Estimate how common a problem is, who is affected, and what it costs users or the business. Use that evidence to recommend where to focus
  • Define outcome metrics and guardrails, establish baselines, and build monitoring that surfaces changes in abuse, customer friction, and operational performance
  • Help build and evaluate detection rules, classifiers, and human review workflows. Use labeled samples and review outcomes to understand what the systems miss, where they flag legitimate activity, and how those errors vary across users and products
  • Design randomized holdouts and use quasi-experimental or observational methods when randomization is impractical. Estimate harm or fraud losses prevented alongside effects on legitimate users, revenue, compute costs, and review workload. Recommend whether to launch, expand, adjust, or retire a control
  • Trace where signals, review decisions, or enforcement actions break down. Work with partners to close gaps and build reusable datasets, analyses, and investigation tools

Preferred

  • Experience in integrity, trust and safety, fraud or risk analytics, security analytics, or applied ML evaluation is helpful
  • Experience evaluating detection systems, human review, or LLM-based classifiers is a plus
  • Integrity Experience
  • Fraud Analytics
  • Risk Analytics
  • Security Analytics
  • Applied ML Evaluation
  • Detection System Evaluation
  • Human Review
  • LLM-Based Classifiers

Benefits

  • Hybrid work arrangement

Company

  • General-purpose AI research, models, products, and APIs
  • San Francisco, California, USA
  • https://openai.com/
  • Founded in 2015
  • 1001-5000 employees

Qualifications

  • You use AI tools to investigate large, messy datasets, test hypotheses quickly, and automate recurring analyses
  • You're fluent in SQL and Python and can verify AI-generated queries, code, and conclusions against the underlying data
  • You have strong statistical judgment and experience with experimentation, causal inference, or observational analysis
  • You can reason from incomplete or biased labels and explain how uncertainty affects a decision
  • You take ownership of open-ended problems, from deciding what to measure through recommending an action and checking whether it worked
  • You communicate clearly with technical and nontechnical partners and can explain the tradeoffs behind a recommendation
  • Experience in integrity, trust and safety, fraud or risk analytics, security analytics, or applied ML evaluation is helpful
  • Experience evaluating detection systems, human review, or LLM-based classifiers is a plus

Required skills

  • Applied ML Evaluation, Causal Inference, Fraud Analytics, LLM-Based Classifier Evaluation, Observational Analysis, Python, Risk Analytics, SQL, Security Analytics, Statistics, Trust and Safety

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Nov 20, 2026

Work mode

Hybrid

Job source

jobs.ashbyhq.com

Company

OpenAI

Information Technology & AI

General-purpose AI research, models, products, and APIs

See all 18 jobs from OpenAI →
  • San Francisco, California, USA
  • Information Technology & AI
  • 1001-5000 employees
  • Founded 2015
  • openai.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Scientist jobs in San Francisco

StubHub

1d ago

New

Senior Data Scientist

Full-timeHybridNew York, NY$200K – $250K/yr

StubHub is hiring a Senior Data Scientist for its Data Science team, focused on direct marketing and personalization.

Why similarSame roleCausal InferencePython

Dice

1d ago

New

Data Scientist

Full-timeOn-siteSan Francisco, CA$140K – $150K/yr

The hiring company is not identified in the posting. The Data Scientist role focuses on prompt engineering, multimodal inference, and model optimization to improve detection accuracy, with work spanning AWS-based pipelines and production deployment.

Why similarSame rolePythonSan Francisco

Cloud Computing

1d ago

New

Senior Data Scientist – o9 DP

Full-timeRemoteUnited StatesCompetitive

360 Technology is seeking a Senior Data Scientist to support and enhance enterprise supply chain planning capabilities.

Why similarSame rolePythonRemote

Get new Data Scientist jobs in San Francisco by email

Create job alert

Data Scientist, Integrity

OpenAI · Competitive

Apply on company site