← Back to jobsJob ID col-cmwpb6gmx0995d8haac746j2k

One CallPosted 1 day ago

Sr AI EngineerNew

Full-time
Remote
5+ years
$120K – $193K/yr
Posted 1 day ago

One Call is seeking a Senior AI Engineer to build scalable, production-ready agentic AI services that support workers’ compensation and improve patient outcomes. The role translates product specifications into AI architectures and develops LLM, multi-agent, and RAG systems, evaluation frameworks, and reliable deployments in a governed environment.

Posted
1 day ago
Source
onecall.avature.net
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Translate product specifications into AI service architectures – decompose business intent into agent workflows, data source integrations, and scalable service designs
  • Build agentic AI workflows using Azure AI Foundry Agent Service and Microsoft Agent Framework, including multi-agent coordination, tool integrations. And agent lifecycle management
  • Develop and iterate on LLM-based solutions including prompt engineering, model selection, cost/token optimization, and RAG pipline design
  • Build evaluation systems including rubrics, goeldn datasets, and judge agents to validate agent correctness and safety before production deployment
  • Build and contribute to agentic systems applying sound engineering principles around separation of concerns, memory architecture, and tool integration
  • Contribute across the full stack: model experimentation, evaluation design, and production system deployment
  • Build and maintain APIs, microservices, CI/CD pipelines, and cloud-native deployments with attention to observability and reliability
  • Support and help build GenAIOps processes for automated testing, regression evaluation, latency monitoring, and continual improvement
  • Balance performance, safety, responsible AI principles, and cost across system design:
  • Implement guardrails, fallbacks, red-teaming strategies, and human-in-the-loop (HITL) workflows
  • Partner with legal/ethics teams to ensure alignment with OneCall’s Responsible AO standards and work in ahighly governed PHI space
  • Buid automated evaluation suites integrating user signals, continual learning cycles, and ongoing model updates
  • Design and implement evaluation frameworks covering:
  • Hallucination rate and factual consistency
  • Relevance and precision/recall
  • Latency, throughput, and system-level performance
  • Cost tracking and efficiency
  • Partner closely with product, engineering, data science, security ethics, and infrastructure teams to build robust, compliant AI systems
  • Contribute technical insights and communicate findings clearly to cross-functional stakeholders and, where relevant, clients
  • Share knowledge with peers and support a culture of technical learning around RAG, agents, prompt engineering, and AI safety

Qualifications

  • 5+ years in software engineering, traditional ML engineering, or applied AI roles with hands-on building responsibilities
  • Demonstrated experience shipping generative AI features or systems end-to-end, from prototyping though production
  • Working knowledge of evaluation, design, experimentation frameworks, and data labeling strategies for LLM applications
  • RAG architectures (vector-based retrieval; exposure to hybrid or graph-based approaches is a plus)
  • Agentic patterns (tool use, routing, memory management
  • ReAct, RLAIF, and other HITL + feedback loops
  • AI-specific Tools & Frameworks- Orchestration frameworks, Vector and graph databases and Model +API ecosystems
  • Strong background in system design, architecture, and production-grade deployment
  • Familiarity with Azure cloud services, logging, monitoring, and observability patterns
  • Solid prompt engineering and context engineering skills; familiarity with conversation design principles
  • Clear communication skills with the ability to explain technical concepts to non-technical collaborators and stakeholders
  • Demonstrated ability to collaborate effectively across engineering, product, and data science teams
  • Familiarity with cost and latency tradeoffs when working with LLM workloads
  • Comfort operating in high-ambiguity environments with collaborative cross-functional teams
  • Eagerness to grow into a technical leadership role and support junior team members
  • Ability to work in an environment that aligns with the company's diversity, equity, inclusion and belonging standards
  • Ability to work both independently and in a team environment

Preferred

  • multi-agent systems experience is a plus)
  • Experience in healthcare, workers compensation, claims processing, or regulated industries, preferred
  • some experience supporting or informally mentoring peers is a plus
  • Experience in client-facing consulting or enterprise transformation environments is a strong plus

Required skills

GenAIOpsHealthcare and Workers’ CompensationLLM Application DevelopmentLLM Evaluation FrameworksMicrosoft Agent FrameworkPrompt and Context EngineeringReAct and RLAIFRetrieval-Augmented Generation (RAG)

Full job description

One Call is seeking a Senior AI Engineer to build scalable, production-ready agentic AI services that support workers’ compensation and improve patient outcomes. The role translates product specifications into AI architectures and develops LLM, multi-agent, and RAG systems, evaluation frameworks, and reliable deployments in a governed environment.

Responsibilities

  • Translate product specifications into AI service architectures – decompose business intent into agent workflows, data source integrations, and scalable service designs
  • Build agentic AI workflows using Azure AI Foundry Agent Service and Microsoft Agent Framework, including multi-agent coordination, tool integrations. And agent lifecycle management
  • Develop and iterate on LLM-based solutions including prompt engineering, model selection, cost/token optimization, and RAG pipline design
  • Build evaluation systems including rubrics, goeldn datasets, and judge agents to validate agent correctness and safety before production deployment
  • Build and contribute to agentic systems applying sound engineering principles around separation of concerns, memory architecture, and tool integration
  • Contribute across the full stack: model experimentation, evaluation design, and production system deployment
  • Build and maintain APIs, microservices, CI/CD pipelines, and cloud-native deployments with attention to observability and reliability
  • Support and help build GenAIOps processes for automated testing, regression evaluation, latency monitoring, and continual improvement
  • Balance performance, safety, responsible AI principles, and cost across system design:
  • Implement guardrails, fallbacks, red-teaming strategies, and human-in-the-loop (HITL) workflows
  • Partner with legal/ethics teams to ensure alignment with OneCall’s Responsible AO standards and work in ahighly governed PHI space
  • Buid automated evaluation suites integrating user signals, continual learning cycles, and ongoing model updates
  • Design and implement evaluation frameworks covering:
  • Hallucination rate and factual consistency
  • Relevance and precision/recall
  • Latency, throughput, and system-level performance
  • Cost tracking and efficiency
  • Partner closely with product, engineering, data science, security ethics, and infrastructure teams to build robust, compliant AI systems
  • Contribute technical insights and communicate findings clearly to cross-functional stakeholders and, where relevant, clients
  • Share knowledge with peers and support a culture of technical learning around RAG, agents, prompt engineering, and AI safety

Preferred

  • multi-agent systems experience is a plus)
  • Experience in healthcare, workers compensation, claims processing, or regulated industries, preferred
  • some experience supporting or informally mentoring peers is a plus
  • Experience in client-facing consulting or enterprise transformation environments is a strong plus
  • Multi-Agent Systems
  • Healthcare Industry
  • Workers' Compensation
  • Claims Processing
  • Client-Facing Consulting
  • Enterprise Transformation
  • Peer Mentoring

Benefits

  • Remote work: One Call is a remote-first company, and almost all positions receive the flexibility of working from home.
  • 8 company holidays and 2 personal days every year.
  • A minimum of 18 days of paid time off for all colleagues.
  • Medical, dental, vision, and pet insurance.
  • 401(k) matching program.
  • Company-paid life insurance and short- and long-term disability coverage.
  • Colleague Assistance Program providing free counseling and financial services.
  • One Call Foundation financial assistance for colleagues during times of unexpected hardships.

Company

  • Workers' compensation ancillary care coordination platform
  • Jacksonville, Florida, USA
  • https://onecallcm.com/
  • Founded in 1985
  • 1001-5000 employees

Qualifications

  • 5+ years in software engineering, traditional ML engineering, or applied AI roles with hands-on building responsibilities
  • Demonstrated experience shipping generative AI features or systems end-to-end, from prototyping though production
  • Working knowledge of evaluation, design, experimentation frameworks, and data labeling strategies for LLM applications
  • RAG architectures (vector-based retrieval; exposure to hybrid or graph-based approaches is a plus)
  • Agentic patterns (tool use, routing, memory management
  • ReAct, RLAIF, and other HITL + feedback loops
  • AI-specific Tools & Frameworks- Orchestration frameworks, Vector and graph databases and Model +API ecosystems
  • Strong background in system design, architecture, and production-grade deployment
  • Familiarity with Azure cloud services, logging, monitoring, and observability patterns
  • Solid prompt engineering and context engineering skills; familiarity with conversation design principles
  • Clear communication skills with the ability to explain technical concepts to non-technical collaborators and stakeholders
  • Demonstrated ability to collaborate effectively across engineering, product, and data science teams
  • Familiarity with cost and latency tradeoffs when working with LLM workloads
  • Comfort operating in high-ambiguity environments with collaborative cross-functional teams
  • Eagerness to grow into a technical leadership role and support junior team members
  • Ability to work in an environment that aligns with the company's diversity, equity, inclusion and belonging standards
  • Ability to work both independently and in a team environment
  • Multi-agent systems experience is a plus)
  • Experience in healthcare, workers compensation, claims processing, or regulated industries, preferred
  • Some experience supporting or informally mentoring peers is a plus
  • Experience in client-facing consulting or enterprise transformation environments is a strong plus
  • 5+ years in software engineering, traditional ML engineering, or applied AI roles with hands-on building responsibilities.

Required skills

  • Agentic AI and Multi-Agent Systems, Azure AI Foundry Agent Service, GenAIOps, Healthcare and Workers’ Compensation, LLM Application Development, LLM Evaluation Frameworks, Microsoft Agent Framework, Prompt and Context Engineering, ReAct and RLAIF, Retrieval-Augmented Generation (RAG)

Preferred skills

  • multi-agent systems experience is a plus)

Experience

  • 5+ years

Job details

Employment type

Full-time

Seniority level

5+ years

Date posted

Nov 20, 2026

Work mode

Remote

Job source

onecall.avature.net

Company

One Call

Information Technology & AI

Workers' compensation ancillary care coordination platform

  • Jacksonville, Florida, USA
  • Information Technology & AI
  • 1001-5000 employees
  • Founded 1985
  • onecallcm.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

Harris Computer

1d ago

New

AI Solutions Engineer

Full-timeRemoteUnited States$110K – $150K/yr

MEDHOST, Inc. is hiring an AI Solutions Engineer to design, implement, and improve AI capabilities in its products and internal tools.

Why similarSame rolePrompt and Context Engineering

YA Group

1d ago

New

AI Solutions Engineer

Full-timeRemoteUnited StatesCompetitive

YA Group is an international professional services organization seeking an AI Solutions Engineer to build and maintain internal AI-enabled tools, agents, workflow automations, and integrations.

Why similarSame role

SPECTRAFORCE

1d ago

New

AI Engineer/Architect

Full-timeRemoteUnited StatesCompetitive

SPECTRAFORCE is seeking an AI Engineer/Architect for a seven-month remote role. The role focuses on developing AI models and implementing AI-based NLP and APIs, as well as integrating and deploying AI models with UI platforms.

Why similarSame role

Get new AI Engineer jobs by email

Create job alert

Sr AI Engineer

One Call · $120K – $193K/yr

Apply on company site