← Back to jobsJob ID col-cmvv2xfi901zz42b9xdpr9njr

iHerbPosted 22 days ago

Sr. Software Engineer II - AI

Full-time
Remote
10+ years
$187K – $235K/yr
Posted 22 days ago

iHerb is a global online health and wellness retailer focused on innovation and improving the online shopping experience. The Sr. Software Engineer II - AI will lead the development and operation of GenAI-powered product experiences and shared AI platform infrastructure, including RAG pipelines, LLM personalization, conversational agents, evaluation frameworks, and MLOps capabilities.

Posted
22 days ago
Source
iherb.wd5.myworkdayjobs.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation
  • Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability
  • Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces
  • Evaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using data
  • Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code
  • Coordinate with the Personalization team to align GenAI product features with existing ML personalization signals
  • Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base
  • Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents

Qualifications

  • AI-driven SDLC : hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor. The bar is not awareness; it is daily use in delivering real software
  • Full-stack awareness: comfortable contributing across layers of the stack when needed; purely single-layer specialists are not the target profile
  • Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoff
  • Code quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CD
  • Fully autonomous; drives technical decisions within the team; mentors junior engineers
  • Python proficiency; comfortable building and operating production LLM applications
  • Hands-on experience with at least one specialization: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM-based workflow automation
  • Understanding of prompt engineering, context window management, and LLM output quality tradeoffs
  • Familiarity with vector databases, embedding models, or semantic search
  • High degree of accuracy and attention to detail
  • Excellent organization skills and ability to multi-task
  • Generally requires a minimum of 10+ years of software engineering experience
  • Able to identify, troubleshoot and resolve problems quickly using sound judgment, poise and diplomacy. Ability to use judgment and reasoning skills, and determine when to escalate issues, as required, in a timely manner
  • The physical demands described here are representative of those that must be met by a Team Member to successfully perform the essential functions of this job. While performing the duties of this job, the Team Member is regularly required to talk and hear. The Team Member is frequently required to sit, walk, climb stairs, use hands and fingers, bend, stoop and reach with hands and arms. Reaching above shoulder heights, below the waist or lifting as required to file documents or store materials throughout the work day. The Team Member may occasionally lift or move office products and supplies up to 25 pounds. Proper lifting techniques required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions
  • The noise in the work environment is usually moderate. Other factors are: Hectic, fast-paced with multi-level distractions; Professional, yet casual work environment; Office / Warehouse environment; Ability to work extended hours as required

Preferred

  • Exposure to MLOps tooling or model deployment pipelines
  • Contributions to internal developer tooling, golden path standards, or SDLC process improvements
  • Experience with e-commerce platforms, product catalogs, or high-traffic consumer applications
  • Experience working in globally distributed teams
  • Track record of documenting architectural decisions, writing RFCs, or contributing to engineering wikis
  • Bachelor's Degree in Computer Science or related field preferred, or a combination of education and equivalent work experience
  • Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred
  • Bachelor's Degree in Computer Science

Required skills

Agentic Frameworks LangChainAgentic Frameworks LlamaIndexAutomated TestingEmbedding ModelsLLM EvaluationPrompt EngineeringPythonRetrieval-Augmented Generation (RAG)Semantic SearchSoftware Design Principles

Full job description

iHerb is a global online health and wellness retailer focused on innovation and improving the online shopping experience. The Sr. Software Engineer II - AI will lead the development and operation of GenAI-powered product experiences and shared AI platform infrastructure, including RAG pipelines, LLM personalization, conversational agents, evaluation frameworks, and MLOps capabilities.

Responsibilities

  • Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation
  • Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability
  • Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces
  • Evaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using data
  • Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code
  • Coordinate with the Personalization team to align GenAI product features with existing ML personalization signals
  • Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base
  • Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents

Preferred

  • Exposure to MLOps tooling or model deployment pipelines
  • Contributions to internal developer tooling, golden path standards, or SDLC process improvements
  • Experience with e-commerce platforms, product catalogs, or high-traffic consumer applications
  • Experience working in globally distributed teams
  • Track record of documenting architectural decisions, writing RFCs, or contributing to engineering wikis
  • Bachelor's Degree in Computer Science or related field preferred, or a combination of education and equivalent work experience
  • Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred
  • MLOps tooling
  • Model deployment pipelines
  • Developer tooling
  • SDLC process improvements
  • E-commerce platforms
  • Product catalogs
  • High-traffic applications
  • Globally distributed teams
  • Architectural documentation
  • RFC writing
  • Engineering wikis
  • Bachelor's Degree in Computer Science
  • Google Business Suite

Benefits

  • Remote work

Company

  • Online retailer of health and wellness products
  • Irvine, California, USA
  • http://www.iherb.com/
  • Founded in 1996
  • 1001-5000 employees

Qualifications

  • AI-driven SDLC : hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor. The bar is not awareness; it is daily use in delivering real software
  • Full-stack awareness: comfortable contributing across layers of the stack when needed; purely single-layer specialists are not the target profile
  • Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoff
  • Code quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CD
  • Fully autonomous; drives technical decisions within the team; mentors junior engineers
  • Python proficiency; comfortable building and operating production LLM applications
  • Hands-on experience with at least one specialization: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM-based workflow automation
  • Understanding of prompt engineering, context window management, and LLM output quality tradeoffs
  • Familiarity with vector databases, embedding models, or semantic search
  • High degree of accuracy and attention to detail
  • Excellent organization skills and ability to multi-task
  • Generally requires a minimum of 10+ years of software engineering experience
  • Able to identify, troubleshoot and resolve problems quickly using sound judgment, poise and diplomacy. Ability to use judgment and reasoning skills, and determine when to escalate issues, as required, in a timely manner
  • The physical demands described here are representative of those that must be met by a Team Member to successfully perform the essential functions of this job. While performing the duties of this job, the Team Member is regularly required to talk and hear. The Team Member is frequently required to sit, walk, climb stairs, use hands and fingers, bend, stoop and reach with hands and arms. Reaching above shoulder heights, below the waist or lifting as required to file documents or store materials throughout the work day. The Team Member may occasionally lift or move office products and supplies up to 25 pounds. Proper lifting techniques required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions
  • The noise in the work environment is usually moderate. Other factors are: Hectic, fast-paced with multi-level distractions; Professional, yet casual work environment; Office / Warehouse environment; Ability to work extended hours as required
  • Exposure to MLOps tooling or model deployment pipelines
  • Contributions to internal developer tooling, golden path standards, or SDLC process improvements
  • Experience with e-commerce platforms, product catalogs, or high-traffic consumer applications
  • Experience working in globally distributed teams
  • Track record of documenting architectural decisions, writing RFCs, or contributing to engineering wikis
  • Bachelor's Degree in Computer Science or related field preferred, or a combination of education and equivalent work experience
  • Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred
  • Generally requires a minimum of 10+ years of software engineering experience.

Required skills

  • Agentic Frameworks LangChain, Agentic Frameworks LlamaIndex, Automated Testing, Embedding Models, LLM Evaluation, Production LLM Application Development, Prompt Engineering, Python, Retrieval-Augmented Generation (RAG), Semantic Search, Software Design Principles

Preferred skills

  • Experience working in globally distributed teams, Exposure to MLOps tooling or model deployment pipelines

Experience

  • 10+ years

Job details

Employment type

Full-time

Seniority level

10+ years

Date posted

Oct 29, 2026

Work mode

Remote

Job source

iherb.wd5.myworkdayjobs.com

Company

iHerb

Information Technology & AI

Online retailer of health and wellness products

  • Irvine, California, USA
  • Information Technology & AI
  • 1001-5000 employees
  • Founded 1996
  • iherb.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

Veeam Software

Today

New

Finance AI Engineer

Full-timeRemoteUnited StatesCompetitive

Veeam Software is seeking a Finance AI Engineer to design, build, and deploy reliable AI solutions across Finance functions including Controllership, FP&A, Revenue, Tax, and Treasury.

Why similarSame rolePython

Khan Academy

1d ago

New

Senior Search & AI Discoverability Engineer (12 month contract, 40 hours/week, $85/hour)

Full-timeRemoteUnited StatesCompetitive

Khan Academy is hiring a Senior Search & AI Discoverability Engineer for its Marketing and Acquisition team.

Why similarSame role

SUPPLY

3d ago

AI & Marketing Technology Specialist

Full-timeRemoteUnited States$75K – $100K/yr

SUPPLY is an independent media agency hiring an AI & Marketing Technology Specialist to improve agency operations and develop technology-driven capabilities for its teams and clients.

Why similarSame rolePython

Get new AI Engineer jobs by email

Create job alert

Sr. Software Engineer II - AI

iHerb · $187K – $235K/yr

Apply on company site