Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Requ

Parallel Partners is recruiting for a Senior Technical Product Manager to turn AI capabilities into reliable product behavior. The role defines AI system requirements and evaluation frameworks, partners with engineering teams on system design and iteration, and owns product quality and user trust end to end.

Responsibilities

• Research and define end-to-end Artificial Intelligence (AI) system requirements from capability to behavior to user impact
• Translate model capabilities, data constraints, and evaluation results into clear product and system decisions
• Make hard trade-offs across quality, latency, cost, reliability, and User Experience (UX)
• Work closely with Machine Learning (ML), backend, and mobile engineers on system design, evaluation, and iteration
• Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback
• Drive execution with clear specs, strong judgment, and disciplined prioritization
• Ensure systems ship quickly, safely, and reliably, with strong feedback loops
• Own product quality end-to-end, including correctness, predictability, and user trust

Preferred

• Experience shipping AI-heavy consumer products
• Background as an engineer or highly technical product manager
• Experience defining evaluation metrics for Machine Learning (ML) systems
• Strong intuition for Artificial Intelligence (AI) User Experience (UX) patterns and failure handling
• Prior experience in zero-to-one product environments
• AI Product Development
• Consumer Product Shipping
• ML Evaluation Metrics
• AI UX Patterns
• AI Failure Handling
• Zero-to-One Product Development
• Product Intuition

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• Savings Plan Options
• PTO
• 100% remote work

Company

• IT recruiting and staffing for financial services and trading
• Naperville, Illinois, USA
• https://parallelpartners.com/
• Founded in 1995
• 2-10 employees

Qualifications

• Artificial Intelligence (AI) and Machine Learning (ML) experience are required for this position
• Strong grounding in computer science fundamentals, including algorithms, data structures, and system design
• Solid understanding of Machine Learning (ML) fundamentals and how modern Artificial Intelligence (AI) systems behave in production
• Comfort reading, reviewing, and discussing technical design documents
• Hands-on exposure to AI-powered products, including Large Language Model (LLM)-based systems
• Experience working with model evaluation, prompt or pipeline iteration, and feedback loops
• Strong intuition for model limitations, hallucinations, bias, and drift
• Significant experience owning complex, technical products end-to-end
• Proven ability to work closely with senior engineers and Machine Learning (ML) teams
• Strong judgment and decision-making ability in ambiguous, fast-moving environments
• Ability to balance ambition with technical and operational reality
• Experience shipping AI-heavy consumer products
• Background as an engineer or highly technical product manager
• Experience defining evaluation metrics for Machine Learning (ML) systems
• Strong intuition for Artificial Intelligence (AI) User Experience (UX) patterns and failure handling
• Prior experience in zero-to-one product environments

Required skills

• AI User Experience, Algorithms, Artificial Intelligence, Data Structures, Large Language Models (LLMs), Machine Learning, Model Evaluation, Prompt and Pipeline Iteration, System Design, Technical Product Management

Preferred skills

• Experience shipping AI-heavy consumer products, Prior experience in zero-to-one product environments