← Back to jobsJob ID col-cmwf7qgx50cfn89hqt2y3tdzi

KikoffPosted 8 days ago

Senior Data Scientist

Full-time
On-site
$226K – $254K/yr
Posted 8 days ago

Kikoff is hiring a Senior Data Scientist to lead data work for a core credit-building product area and guide product decisions through measurement, experimentation, and modeling. The role also helps set data science practices across Kikoff, including evaluation of AI products and workflows.

Posted
8 days ago
Source
job-boards.greenhouse.io
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Lead the data work for a core Kikoff product area: set the questions worth answering, build the evidence, and drive what happens next. Sometimes the right call is not to act on a finding, and you'll make that case too
  • Define and maintain the measurement system for your area across the whole customer journey (activation, engagement, credit outcomes, retention, revenue, unit economics), and contribute to the Kikoff-wide measurement framework alongside the other data scientists on the team. Where acquisition intersects with what you own, you'll work it jointly with Marketing DS rather than around them
  • Own product experimentation for your area: design, guardrails, analysis, and the recommendation on rollouts, including the cases where a holdout isn't clean or the effect you care about (a customer's score) moves on its own schedule
  • For AI product surfaces, own evaluation: decide what "good" means in checkable terms, build and validate automated scorers against human judgment, and turn what you find in real conversations into regression tests so the product can't quietly get worse. Keep the loop between error analysis and the eval set closed
  • Build and evaluate models where they're the right tool: proof-of-concept and challenger models, offline evaluation, threshold decisions, and production monitoring with engineering. Production model lifecycle sits with engineering today; how we divide that work is still evolving and you'll have a voice in it
  • Partner with product, engineering, design, and lifecycle marketing leads on roadmap and objectives: which bets, what a win looks like, and what we'd need to see to stop
  • Raise the bar for the people around you: review work, onboard new teammates, and take on an intern or early-career data scientist when the timing fits

Qualifications

  • Experience partnering with product, engineering, and marketing peers across the whole arc of the work: strategy, goal setting, approach, and execution, not just the analysis at the end
  • A track record of defining metrics from scratch and getting a team to run on them, including for products where success was hard to pin down
  • Designed and ran experimentation programs, including changes where clean randomization wasn't available
  • Comfortable with quasi-experimental and causal inference methods, and clear about their limits
  • Hands-on with production-quality SQL and Python
  • You build pipelines, analyses, and models yourself
  • Experience building or working closely with models that drive decisions in a product, in any domain: ranking, fraud, forecasting, personalization, underwriting, detection, LLM applications
  • We care about the judgment, not the vertical
  • AI tools are a core part of your daily analytical work and you can show how they changed the speed and quality of what you ship
  • You drive decisions with data in front of senior audiences, including when the data doesn't support the plan

Preferred

  • Built or ran an evaluation program for an LLM-based product: judge design, validation against human labels, test-case construction from real failures
  • Consumer fintech experience, especially products that expand access for un- and under-banked customers
  • Built an experimentation or causal inference practice in an org that didn't have one
  • Have taken a model from proof of concept to production, or shipped test and challenger models that changed a product decision
  • Have mentored, onboarded, or managed the work of other data scientists
  • Consumer fintech experience
  • Proof-of-concept to production

Required skills

Causal InferenceConsumer FintechLLM EvaluationMetric DesignProduct Decision ModelingProduct Experimentation

Full job description

Kikoff is hiring a Senior Data Scientist to lead data work for a core credit-building product area and guide product decisions through measurement, experimentation, and modeling. The role also helps set data science practices across Kikoff, including evaluation of AI products and workflows.

Responsibilities

  • Lead the data work for a core Kikoff product area: set the questions worth answering, build the evidence, and drive what happens next. Sometimes the right call is not to act on a finding, and you'll make that case too
  • Define and maintain the measurement system for your area across the whole customer journey (activation, engagement, credit outcomes, retention, revenue, unit economics), and contribute to the Kikoff-wide measurement framework alongside the other data scientists on the team. Where acquisition intersects with what you own, you'll work it jointly with Marketing DS rather than around them
  • Own product experimentation for your area: design, guardrails, analysis, and the recommendation on rollouts, including the cases where a holdout isn't clean or the effect you care about (a customer's score) moves on its own schedule
  • For AI product surfaces, own evaluation: decide what "good" means in checkable terms, build and validate automated scorers against human judgment, and turn what you find in real conversations into regression tests so the product can't quietly get worse. Keep the loop between error analysis and the eval set closed
  • Build and evaluate models where they're the right tool: proof-of-concept and challenger models, offline evaluation, threshold decisions, and production monitoring with engineering. Production model lifecycle sits with engineering today; how we divide that work is still evolving and you'll have a voice in it
  • Partner with product, engineering, design, and lifecycle marketing leads on roadmap and objectives: which bets, what a win looks like, and what we'd need to see to stop
  • Raise the bar for the people around you: review work, onboard new teammates, and take on an intern or early-career data scientist when the timing fits

Preferred

  • Built or ran an evaluation program for an LLM-based product: judge design, validation against human labels, test-case construction from real failures
  • Consumer fintech experience, especially products that expand access for un- and under-banked customers
  • Built an experimentation or causal inference practice in an org that didn't have one
  • Have taken a model from proof of concept to production, or shipped test and challenger models that changed a product decision
  • Have mentored, onboarded, or managed the work of other data scientists
  • LLM product evaluation
  • LLM judge design
  • Human-label validation
  • Failure-based test-case design
  • Consumer fintech experience
  • Financial inclusion products
  • Experimentation practice development
  • Proof-of-concept to production
  • Test model deployment
  • Challenger model deployment
  • Product decision testing
  • Data science
  • Mentoring
  • Onboarding
  • Team management

Company

  • Credit-building app with reporting and debt negotiation tools
  • San Francisco, California, USA
  • https://kikoff.com/
  • Founded in 2019
  • 201-500 employees

Qualifications

  • Experience partnering with product, engineering, and marketing peers across the whole arc of the work: strategy, goal setting, approach, and execution, not just the analysis at the end
  • A track record of defining metrics from scratch and getting a team to run on them, including for products where success was hard to pin down
  • Designed and ran experimentation programs, including changes where clean randomization wasn't available
  • Comfortable with quasi-experimental and causal inference methods, and clear about their limits
  • Hands-on with production-quality SQL and Python
  • You build pipelines, analyses, and models yourself
  • Experience building or working closely with models that drive decisions in a product, in any domain: ranking, fraud, forecasting, personalization, underwriting, detection, LLM applications
  • We care about the judgment, not the vertical
  • AI tools are a core part of your daily analytical work and you can show how they changed the speed and quality of what you ship
  • You drive decisions with data in front of senior audiences, including when the data doesn't support the plan
  • Built or ran an evaluation program for an LLM-based product: judge design, validation against human labels, test-case construction from real failures
  • Consumer fintech experience, especially products that expand access for un- and under-banked customers
  • Built an experimentation or causal inference practice in an org that didn't have one
  • Have taken a model from proof of concept to production, or shipped test and challenger models that changed a product decision
  • Have mentored, onboarded, or managed the work of other data scientists

Required skills

  • Causal Inference, Consumer Fintech, LLM Evaluation, Metric Design, Product Decision Modeling, Product Experimentation

Job details

Employment type

Full-time

Seniority level

Not stated

Date posted

Nov 13, 2026

Work mode

On-site

Job source

job-boards.greenhouse.io

Company

Kikoff

Information Technology & AI

Credit-building app with reporting and debt negotiation tools

See all 3 jobs from Kikoff →
  • San Francisco, California, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 2019
  • kikoff.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Scientist jobs in San Francisco

Dice

1d ago

New

Data Scientist

Full-timeOn-siteSan Francisco, CA$140K – $150K/yr

The hiring company is not identified in the posting. The Data Scientist role focuses on prompt engineering, multimodal inference, and model optimization to improve detection accuracy, with work spanning AWS-based pipelines and production deployment.

Why similarSame roleSan Francisco

Artificial Intelligence (AI)

1d ago

New

Data Scientist

Full-timeOn-siteRedwood City, CA$150K – $180K/yr

HammerheadAI, Inc. is hiring a Data Scientist to build forecasting, scenario modeling, and optimization for determining how much additional AI capacity data centers can safely support.

Why similarSame roleRedwood City

StubHub

1d ago

New

Senior Data Scientist

Full-timeHybridNew York, NY$200K – $250K/yr

StubHub is hiring a Senior Data Scientist for its Data Science team, focused on direct marketing and personalization.

Why similarSame roleCausal Inference

Get new Data Scientist jobs in San Francisco by email

Create job alert

Senior Data Scientist

Kikoff · $226K – $254K/yr

Apply on company site