← Back to jobsJob ID col-cmwf87ck60d9989hq982sei1t

KaiPosted 8 days ago

Sr/Staff ML Engineer

Full-time
On-site
4+ years
Competitive
Posted 8 days ago

Kai is building an AI-powered cybersecurity platform to help enterprises manage vulnerabilities at scale. The Senior/Staff ML Engineer will make the AI team’s services reliable, maintainable, and production-ready, owning testing, code quality, CI/CD, and service reliability while collaborating with AI scientists.

Posted
8 days ago
Source
job-boards.greenhouse.io
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Build the test suite from the ground up. You'll design the test infrastructure — unit tests with mocked LLM responses, integration tests against staging environments, and fixtures that make testing fast and reliable. You'll wire this into CI so nothing ships without passing tests
  • Harden production services. Audit and fix security issues. Implement structured logging. Add health checks, metrics, and traces
  • Improve the CI/CD pipeline. You'll add quality gates so the team catches issues before they reach production
  • Refactor for maintainability. Extract shared patterns into reusable modules. Break apart oversized classes and reduce code duplication across services
  • Fix dependency management. Introduce lock files for reproducible builds, remove unused dependencies, and resolve version inconsistencies across services
  • Own the reliability and performance of our AI service fleet (Python/FastAPI microservices)
  • Build out observability — distributed tracing, latency dashboards, alerting on error rates and SLA breaches
  • Design and implement caching strategies, rate limiting, and circuit breakers for external API calls (Anthropic, Azure ML, package registries)
  • Collaborate with AI scientists on prompt engineering and output parsing, bringing engineering rigor to LLM integration patterns
  • Mentor mid-level engineers as the team grows

Qualifications

  • 4+ years of professional software engineering experience with a strong backend focus
  • M.S. in Computer Science, AI, Machine Learning, or a related field
  • Deep Python expertise — not scripting, but well-structured production code. You understand when to use dataclasses vs Pydantic, how async/await actually works, and why global variables make testing painful
  • Testing as a core discipline. You've built test suites for services with external dependencies. You're comfortable with pytest, mocking, fixtures, and know how to test code that calls third-party APIs without calling them
  • FastAPI or equivalent modern Python web framework experience (Django REST Framework, Flask with production patterns). You've designed and maintained REST APIs that other teams depend on
  • Azure or equivalent cloud platform experience. You've worked with managed container services, Kubernetes, managed databases, identity/auth systems, and CI/CD in a cloud environment
  • CI/CD pipeline engineering. You've added test gates, lint checks, and automated quality enforcement to build pipelines. Experience with Azure DevOps Pipelines, GitHub Actions, or GitLab CI
  • Docker and containerization. You've written production Dockerfiles, understand multi-stage builds, and have debugged container networking and configuration issues
  • Strong code review and collaboration skills. You'll be working with AI scientists who are strong in their domain but still developing engineering practices. You need to raise the bar without creating friction

Preferred

  • Experience working with LLM provider APIs (Anthropic, OpenAI, Azure OpenAI) — understanding token limits, prompt design, structured output parsing, and retry patterns
  • Experience with structured logging (structlog), observability tools (OpenTelemetry, Prometheus, Grafana), or APM platforms
  • Exposure to cybersecurity, vulnerability management, or compliance-sensitive environments
  • Experience on a small engineering team at a startup, where you owned services end-to-end
  • Familiarity with RAG patterns, embedding pipelines, or vector databases (not required, but a plus for growth)
  • Startup Engineering Experience
  • End-to-End Service Ownership

Required skills

AzureAzure DevOps PipelinesCI/CD Pipeline EngineeringCybersecurityDockerEmbedding PipelinesFastAPIGitHub ActionsGitLab CIGrafanaKubernetesLLM Provider APIsMockingOpenTelemetry

Nice to have

PhD

Full job description

Kai is building an AI-powered cybersecurity platform to help enterprises manage vulnerabilities at scale. The Senior/Staff ML Engineer will make the AI team’s services reliable, maintainable, and production-ready, owning testing, code quality, CI/CD, and service reliability while collaborating with AI scientists.

Responsibilities

  • Build the test suite from the ground up. You'll design the test infrastructure — unit tests with mocked LLM responses, integration tests against staging environments, and fixtures that make testing fast and reliable. You'll wire this into CI so nothing ships without passing tests
  • Harden production services. Audit and fix security issues. Implement structured logging. Add health checks, metrics, and traces
  • Improve the CI/CD pipeline. You'll add quality gates so the team catches issues before they reach production
  • Refactor for maintainability. Extract shared patterns into reusable modules. Break apart oversized classes and reduce code duplication across services
  • Fix dependency management. Introduce lock files for reproducible builds, remove unused dependencies, and resolve version inconsistencies across services
  • Own the reliability and performance of our AI service fleet (Python/FastAPI microservices)
  • Build out observability — distributed tracing, latency dashboards, alerting on error rates and SLA breaches
  • Design and implement caching strategies, rate limiting, and circuit breakers for external API calls (Anthropic, Azure ML, package registries)
  • Collaborate with AI scientists on prompt engineering and output parsing, bringing engineering rigor to LLM integration patterns
  • Mentor mid-level engineers as the team grows

Preferred

  • PhD
  • Azure
  • Experience working with LLM provider APIs (Anthropic, OpenAI, Azure OpenAI) — understanding token limits, prompt design, structured output parsing, and retry patterns
  • Experience with structured logging (structlog), observability tools (OpenTelemetry, Prometheus, Grafana), or APM platforms
  • Exposure to cybersecurity, vulnerability management, or compliance-sensitive environments
  • Experience on a small engineering team at a startup, where you owned services end-to-end
  • Familiarity with RAG patterns, embedding pipelines, or vector databases (not required, but a plus for growth)
  • LLM Provider APIs
  • Token Limit Management
  • Prompt Design
  • Structured Output Parsing
  • Retry Patterns
  • Structured Logging
  • Structlog
  • OpenTelemetry
  • Prometheus
  • Grafana
  • APM Platforms
  • Cybersecurity
  • Vulnerability Management
  • Compliance-Sensitive Environments
  • Startup Engineering Experience
  • End-to-End Service Ownership
  • RAG Patterns
  • Embedding Pipelines
  • Vector Databases

Benefits

  • Equity options
  • Medical, dental and vision coverage
  • 401(k)
  • We'll invest in your development.
  • Our Heads of AI, Engineering, and Product bring ... top-tier mentorship

Company

  • Agentic AI cybersecurity platform automating security work
  • San Francisco, California, USA
  • https://www.kai.security/
  • Founded in 2024
  • 51-200 employees

Qualifications

  • 4+ years of professional software engineering experience with a strong backend focus
  • M.S. in Computer Science, AI, Machine Learning, or a related field
  • Deep Python expertise — not scripting, but well-structured production code. You understand when to use dataclasses vs Pydantic, how async/await actually works, and why global variables make testing painful
  • Testing as a core discipline. You've built test suites for services with external dependencies. You're comfortable with pytest, mocking, fixtures, and know how to test code that calls third-party APIs without calling them
  • FastAPI or equivalent modern Python web framework experience (Django REST Framework, Flask with production patterns). You've designed and maintained REST APIs that other teams depend on
  • Azure or equivalent cloud platform experience. You've worked with managed container services, Kubernetes, managed databases, identity/auth systems, and CI/CD in a cloud environment
  • CI/CD pipeline engineering. You've added test gates, lint checks, and automated quality enforcement to build pipelines. Experience with Azure DevOps Pipelines, GitHub Actions, or GitLab CI
  • Docker and containerization. You've written production Dockerfiles, understand multi-stage builds, and have debugged container networking and configuration issues
  • Strong code review and collaboration skills. You'll be working with AI scientists who are strong in their domain but still developing engineering practices. You need to raise the bar without creating friction
  • PhD
  • Azure
  • Experience working with LLM provider APIs (Anthropic, OpenAI, Azure OpenAI) — understanding token limits, prompt design, structured output parsing, and retry patterns
  • Experience with structured logging (structlog), observability tools (OpenTelemetry, Prometheus, Grafana), or APM platforms
  • Exposure to cybersecurity, vulnerability management, or compliance-sensitive environments
  • Experience on a small engineering team at a startup, where you owned services end-to-end
  • Familiarity with RAG patterns, embedding pipelines, or vector databases (not required, but a plus for growth)

Required skills

  • Azure, Azure DevOps Pipelines, CI/CD Pipeline Engineering, Cybersecurity, Docker, Embedding Pipelines, FastAPI, GitHub Actions, GitLab CI, Grafana, Kubernetes, LLM Provider APIs, Mocking, OpenTelemetry, Prometheus, Prompt Engineering, Python, RAG, REST API Design, Structured Output Parsing, Test Fixtures, Vector Databases, Vulnerability Management, pytest, structlog

Preferred skills

  • PhD

Experience

  • 4+ years

Job details

Employment type

Full-time

Seniority level

4+ years

Date posted

Nov 13, 2026

Work mode

On-site

Job source

job-boards.greenhouse.io

Company

Kai

Information Technology & AI

Agentic AI cybersecurity platform automating security work

See all 3 jobs from Kai →
  • San Francisco, California, USA
  • Information Technology & AI
  • 51-200 employees
  • Founded 2024
  • kai.security

Similar jobs

Matched on role, skills and location · live jobs only

See more Machine Learning Engineer jobs in San Jose

LPL Financial

1d ago

New

Senior Full Stack AI/ML Engineer

Full-timeOn-siteCharlotte, NC$96K – $160K/yr

LPL Financial is hiring a Senior Full Stack AI/ML Engineer to design, develop, deploy, and support cloud-native applications incorporating AI/ML and Generative AI.

Why similarSame roleDockerKubernetes

Cardinal Health

1d ago

New

AI/ML Engineer

Full-timeOn-siteUnited States$96K – $124K/yr

Cardinal Health is seeking a product-oriented AI/ML Engineer to design and deliver enterprise-scale Generative AI solutions.

Why similarSame roleDockerKubernetes

Apple

1d ago

New

ML Data Operations Engineer

Full-timeOn-siteCupertino, CA$150K – $225K/yr

Apple is hiring an ML Data Operations Engineer to support internal data collection efforts for consumer machine learning features.

Why similarSame roleCupertino

Get new Machine Learning Engineer jobs in San Jose by email

Create job alert

Sr/Staff ML Engineer

Kai · Competitive

Apply on company site