← Back to jobsJob ID col-cmvv3aa3d02go42b96csbi4it

PrizePicksPosted 27 days ago

Staff Software Engineer, Applied AI (IC)

Full-time
Remote
6+ years
$220K – $250K/yr
Posted 27 days ago

PrizePicks is hiring a Staff Software Engineer on its Applied AI team to build reliable, scalable AI capabilities, including an agent platform and internal tooling. The role will operationalize AI across the software development lifecycle, deliver AI features from prototype to production, and establish engineering standards while mentoring colleagues.

Posted
27 days ago
Source
job-boards.greenhouse.io
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design and implement primitives like orchestration, tool/function calling, evaluation harnesses, prompt/version management, tracing/observability, and safety/guardrails
  • Support patterns like retrieval-augmented generation (RAG), structured extraction, and production inference workflows
  • Work with application engineering teams to embed AI into day-to-day engineering workflows (code review assist, test generation, incident support, developer copilots), with clear quality gates and measurable impact
  • Own the judgment call of what to delegate to agents vs. keep as human work — scope tasks so agents are set up to succeed, and adapt that boundary as team skill levels and tooling maturity vary
  • Given an agent run, diagnose whether it did its job well from the trace itself — not just the final diff. Debug agent behavior the way you'd debug a distributed system: inputs, intermediate steps, failure points
  • Treat AI output as a claim to verify, not a result to trust — including tests the agent writes for its own code
  • Own projects from prototype → production: data needs, system design, model/vendor selection, rollout plans, monitoring, and iteration
  • Partner closely with product, design, and data/ML stakeholders to deliver customer-facing outcomes (not just demos)
  • Assess where AI adoption is working and where it isn't — identify bottlenecks and failure modes across teams, not just within your own code
  • Build what's missing, teach what's already built, and make the case for adoption to skeptical or hesitant engineers
  • Establish best practices for reliability, evaluation, incident response, privacy/security, and "how we build AI here."
  • Coach other engineers through design reviews, pairing, and pragmatic technical leadership — including how to critically review AI-generated code rather than rubber-stamp it

Qualifications

  • 6+ years of professional software engineering experience (or equivalent), including shipping production systems
  • Direct experience on an Applied AI / product AI team building LLM- or ML-powered features
  • Demonstrated judgment in agent-driven development: knowing what to delegate, how to scope/context an agent, and how to verify its output before trusting it
  • Strong backend/system design skills: APIs, distributed systems, queues/workflows, observability, and performance
  • Comfort navigating ambiguity and driving outcomes with cross-functional partners (product, design, data/ML, platform)
  • Track record of mentoring peers and leveling up engineering quality — including helping others build critical judgment around AI-assisted output, not just AI literacy
  • You must be authorized to work for any employer in the U.S
  • We are unable to sponsor or take over sponsorship of an employment Visa at this time

Preferred

  • Experience building "platform" capabilities for other engineers (SDKs, internal frameworks, developer tooling)
  • Practical experience with embeddings, search/retrieval, evaluation methodologies, and model monitoring (offline + online)
  • Experience building AI-powered tooling/products like agents and assistants at scale
  • Familiarity with inference constraints (latency, cost, caching), vendor/model tradeoffs, and deployment patterns

Required skills

AI AgentsAI Evaluation MethodologiesAPI DesignApplied AIBackend EngineeringDistributed SystemsEmbeddings and Search/ RetrievalLarge Language Models (LLMs)Machine LearningModel MonitoringQueue and Workflow SystemsRetrieval-Augmented Generation (RAG)

Nice to have

agents/tooling strongly preferred

Full job description

PrizePicks is hiring a Staff Software Engineer on its Applied AI team to build reliable, scalable AI capabilities, including an agent platform and internal tooling. The role will operationalize AI across the software development lifecycle, deliver AI features from prototype to production, and establish engineering standards while mentoring colleagues.

Responsibilities

  • Design and implement primitives like orchestration, tool/function calling, evaluation harnesses, prompt/version management, tracing/observability, and safety/guardrails
  • Support patterns like retrieval-augmented generation (RAG), structured extraction, and production inference workflows
  • Work with application engineering teams to embed AI into day-to-day engineering workflows (code review assist, test generation, incident support, developer copilots), with clear quality gates and measurable impact
  • Own the judgment call of what to delegate to agents vs. keep as human work — scope tasks so agents are set up to succeed, and adapt that boundary as team skill levels and tooling maturity vary
  • Given an agent run, diagnose whether it did its job well from the trace itself — not just the final diff. Debug agent behavior the way you'd debug a distributed system: inputs, intermediate steps, failure points
  • Treat AI output as a claim to verify, not a result to trust — including tests the agent writes for its own code
  • Own projects from prototype → production: data needs, system design, model/vendor selection, rollout plans, monitoring, and iteration
  • Partner closely with product, design, and data/ML stakeholders to deliver customer-facing outcomes (not just demos)
  • Assess where AI adoption is working and where it isn't — identify bottlenecks and failure modes across teams, not just within your own code
  • Build what's missing, teach what's already built, and make the case for adoption to skeptical or hesitant engineers
  • Establish best practices for reliability, evaluation, incident response, privacy/security, and "how we build AI here."
  • Coach other engineers through design reviews, pairing, and pragmatic technical leadership — including how to critically review AI-generated code rather than rubber-stamp it

Preferred

  • agents/tooling strongly preferred
  • Experience building "platform" capabilities for other engineers (SDKs, internal frameworks, developer tooling)
  • Practical experience with embeddings, search/retrieval, evaluation methodologies, and model monitoring (offline + online)
  • Experience building AI-powered tooling/products like agents and assistants at scale
  • Familiarity with inference constraints (latency, cost, caching), vendor/model tradeoffs, and deployment patterns
  • AI agents
  • Platform engineering
  • SDK development
  • Internal frameworks
  • Developer tooling
  • Embeddings
  • retrieval
  • Evaluation methodologies
  • Model monitoring
  • AI product development
  • Scaling AI systems
  • Inference optimization
  • Latency management
  • Cost optimization
  • Caching
  • Vendor
  • model tradeoffs
  • Deployment patterns

Benefits

  • Company-subsidized medical, dental, & vision plans
  • 401(k) plan with company match
  • Annual bonus
  • Flexible PTO to encourage a healthy work/life balance (2 weeks STRONGLY encouraged!)
  • Generous paid leave programs, including 16-week paid parental leave and disability benefits
  • Workplace flexibility and modern work schedules focused on getting the job done, not hours clocked
  • Company-wide in-person events and team outings
  • Lifestyle enhancement program
  • Company equipment provided (Windows & Mac options)
  • Annual performance reviews with opportunities for growth and career development

Company

  • Daily fantasy sports picks app for real-money player selections
  • Atlanta, Georgia, USA
  • https://prizepicks.com/
  • Founded in 2015
  • 501-1000 employees

Qualifications

  • 6+ years of professional software engineering experience (or equivalent), including shipping production systems
  • Direct experience on an Applied AI / product AI team building LLM- or ML-powered features
  • Demonstrated judgment in agent-driven development: knowing what to delegate, how to scope/context an agent, and how to verify its output before trusting it
  • Strong backend/system design skills: APIs, distributed systems, queues/workflows, observability, and performance
  • Comfort navigating ambiguity and driving outcomes with cross-functional partners (product, design, data/ML, platform)
  • Track record of mentoring peers and leveling up engineering quality — including helping others build critical judgment around AI-assisted output, not just AI literacy
  • You must be authorized to work for any employer in the U.S
  • We are unable to sponsor or take over sponsorship of an employment Visa at this time
  • Agents/tooling strongly preferred
  • Experience building "platform" capabilities for other engineers (SDKs, internal frameworks, developer tooling)
  • Practical experience with embeddings, search/retrieval, evaluation methodologies, and model monitoring (offline + online)
  • Experience building AI-powered tooling/products like agents and assistants at scale
  • Familiarity with inference constraints (latency, cost, caching), vendor/model tradeoffs, and deployment patterns
  • 6+ years of professional software engineering experience (or equivalent), including shipping production systems.

Required skills

  • AI Agents, AI Evaluation Methodologies, API Design, Applied AI, Backend Engineering, Distributed Systems, Embeddings and Search/ Retrieval, Large Language Models (LLMs), Machine Learning, Model Monitoring, Queue and Workflow Systems, Retrieval-Augmented Generation (RAG)

Preferred skills

  • agents/tooling strongly preferred

Experience

  • 6+ years

Job details

Employment type

Full-time

Seniority level

6+ years

Date posted

Oct 24, 2026

Work mode

Remote

Job source

job-boards.greenhouse.io

Company

PrizePicks

Information Technology & AI

Daily fantasy sports picks app for real-money player selections

See all 2 jobs from PrizePicks →
  • Atlanta, Georgia, USA
  • Information Technology & AI
  • 501-1000 employees
  • Founded 2015
  • prizepicks.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

Veeam Software

Today

New

Finance AI Engineer

Full-timeRemoteUnited StatesCompetitive

Veeam Software is seeking a Finance AI Engineer to design, build, and deploy reliable AI solutions across Finance functions including Controllership, FP&A, Revenue, Tax, and Treasury.

Why similarSame role

Khan Academy

1d ago

New

Senior Search & AI Discoverability Engineer (12 month contract, 40 hours/week, $85/hour)

Full-timeRemoteUnited StatesCompetitive

Khan Academy is hiring a Senior Search & AI Discoverability Engineer for its Marketing and Acquisition team.

Why similarSame role

SUPPLY

3d ago

AI & Marketing Technology Specialist

Full-timeRemoteUnited States$75K – $100K/yr

SUPPLY is an independent media agency hiring an AI & Marketing Technology Specialist to improve agency operations and develop technology-driven capabilities for its teams and clients.

Why similarSame role

Get new AI Engineer jobs by email

Create job alert

Staff Software Engineer, Applied AI (IC)

PrizePicks · $220K – $250K/yr

Apply on company site