Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home

Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home

Senior Level

• $165K/yr - $200K/yr
• Human Resources
• Information Technology

Responsibilities

• Research and define end-to-end Artificial Intelligence (AI) system requirements from capability to behavior to user impact
• Translate model capabilities, data constraints, and evaluation results into clear product and system decisions
• Make hard trade-offs across quality, latency, cost, reliability, and User Experience (UX)
• Work closely with Machine Learning (ML), backend, and mobile engineers on system design, evaluation, and iteration
• Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback
• Drive execution with clear specs, strong judgment, and disciplined prioritization
• Ensure systems ship quickly, safely, and reliably, with strong feedback loops
• Own product quality end-to-end, including correctness, predictability, and user trust

Preferred

• Experience shipping AI-heavy consumer products
• Background as an engineer or highly technical product manager
• Experience defining evaluation metrics for Machine Learning (ML) systems
• Strong intuition for Artificial Intelligence (AI) User Experience (UX) patterns and failure handling
• Prior experience in zero-to-one product environments

Benefits

• Medical insurance
• Dental
• Vision
• Savings Plan Options
• PTO
• 100% Remote
• IT recruiting and staffing for financial services and trading.
• Naperville, Illinois, USA
• https://parallelpartners.com
• Leadership Team
• Saven Bellarmino
• President
• Company data provided by
• AI Tools
• Customize Your Resume
• Maximize your interview chances
• Build Cover Letter
• Make your application stand out
• Analyze How Well You Fit
• Understand your strength & weakness

Qualifications

• Artificial Intelligence (AI) and Machine Learning (ML) experience are required for this position
• Strong grounding in computer science fundamentals, including algorithms, data structures, and system design
• Solid understanding of Machine Learning (ML) fundamentals and how modern Artificial Intelligence (AI) systems behave in production
• Comfort reading, reviewing, and discussing technical design documents
• Hands-on exposure to AI-powered products, including Large Language Model (LLM)-based systems
• Experience working with model evaluation, prompt or pipeline iteration, and feedback loops
• Strong intuition for model limitations, hallucinations, bias, and drift
• Significant experience owning complex, technical products end-to-end
• Proven ability to work closely with senior engineers and Machine Learning (ML) teams
• Strong judgment and decision-making ability in ambiguous, fast-moving environments
• Ability to balance ambition with technical and operational reality
• Experience shipping AI-heavy consumer products
• Background as an engineer or highly technical product manager
• Experience defining evaluation metrics for Machine Learning (ML) systems
• Strong intuition for Artificial Intelligence (AI) User Experience (UX) patterns and failure handling
• Prior experience in zero-to-one product environments

Required skills

• AI Product Development, AI User Experience, Algorithms, Data Structures, Evaluation Metrics for Machine Learning Systems, Large Language Models (LLMs), Machine Learning, Model Evaluation, Prompt Iteration, System Design

Preferred skills

• Experience shipping AI-heavy consumer products, Prior experience in zero-to-one product environments