← Back to jobsJob ID col-cmwf7r5oe0cg389hqze0a70m8

Trend Health PartnersPosted 9 days ago

AI Test Engineer II

Full-time
Remote
Mid level
Competitive
Posted 9 days ago

TREND Health Partners is hiring an AI Test Engineer II to validate the quality, reliability, and safety of AI-powered systems across its platform. The role builds automated tests, validates APIs and data integrations, performs security and performance testing, and collaborates with cross-functional teams on quality processes.

Posted
9 days ago
Source
jobs.lever.co
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, build, and maintain automated test suites across API, UI, security, and performance/load testing
  • Develop end-to-end and integration tests using Playwright (or equivalent modern frameworks)
  • Author API tests for REST/GraphQL services, validating contracts, error handling, and edge cases
  • Build and maintain UI automation that is stable, maintainable, and resistant to flakiness
  • Integrate all test suites into CI/CD pipelines for continuous, automated validation
  • Use AI-based coding and testing tools (Claude Code, Copilot, and similar) to generate, refactor, and scale tests
  • Establish patterns and best practices for using AI assistants effectively and safely in the testing workflow
  • Continuously evaluate emerging AI testing tools and bring the useful ones into the team's toolchain
  • Perform security-focused testing (authn/authz, input validation, common OWASP risks) as part of the release process
  • Design and run load and performance tests to validate scalability, latency, and resilience under stress
  • Identify bottlenecks and failure points and partner with Engineering on remediation
  • Validate data integrity across APIs, pipelines, and integrations using strong SQL and data-validation techniques
  • Test interactions between services, APIs, and downstream systems in distributed environments
  • Detect anomalies, regressions, and gaps across end-to-end workflows
  • Work cross-functionally with Engineering, QA, Product, and Operations
  • Participate in sprint planning, backlog refinement, and release validation
  • Contribute to testing standards, best practices, and documentation
  • Support root cause analysis for defects and production issues

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
  • Experience in QA automation, test engineering, or a related software engineering role
  • Experience testing APIs, distributed systems, and data pipelines
  • Strong understanding of software testing principles and test automation design
  • Strong SQL and data-validation skills
  • Experience integrating tests into CI/CD pipelines
  • Experience working in an Agile development environment
  • Ability to analyze system behavior and identify root causes

Preferred

  • Hands-on experience with a modern test automation framework (Playwright strongly preferred; Cypress, Selenium, or similar acceptable)
  • Experience with cloud-based systems, preferably AWS
  • Experience testing AI/ML models or data-driven systems
  • Experience validating AI-generated outputs or prompt-based systems
  • Familiarity with LLMs, agent workflows, or AI-assisted coding tools
  • Healthcare or regulated data environment experience (HIPAA, compliance)
  • Experience working with CI/CD and DevOps pipelines
  • Experience using AI-assisted coding/testing tools (Claude Code, Copilot, or similar) in a real testing workflow
  • Experience with security testing and/or performance/load testing tools (e.g., k6, JMeter, OWASP ZAP)
  • Experience with CI/CD and DevOps pipelines• Healthcare or regulated-data environment experience, including HIPAA and compliance
  • Familiarity with AI/ML concepts (useful context, not the core focus of the role)

Required skills

AI/ML TestingAPI TestingAWSAgile DevelopmentCI/CD PipelinesClaude CodeData PipelinesData ValidationDistributed SystemsGitHub CopilotHIPAAJMeterLLMsOWASP ZAP

Full job description

TREND Health Partners is hiring an AI Test Engineer II to validate the quality, reliability, and safety of AI-powered systems across its platform. The role builds automated tests, validates APIs and data integrations, performs security and performance testing, and collaborates with cross-functional teams on quality processes.

Responsibilities

  • Design, build, and maintain automated test suites across API, UI, security, and performance/load testing
  • Develop end-to-end and integration tests using Playwright (or equivalent modern frameworks)
  • Author API tests for REST/GraphQL services, validating contracts, error handling, and edge cases
  • Build and maintain UI automation that is stable, maintainable, and resistant to flakiness
  • Integrate all test suites into CI/CD pipelines for continuous, automated validation
  • Use AI-based coding and testing tools (Claude Code, Copilot, and similar) to generate, refactor, and scale tests
  • Establish patterns and best practices for using AI assistants effectively and safely in the testing workflow
  • Continuously evaluate emerging AI testing tools and bring the useful ones into the team's toolchain
  • Perform security-focused testing (authn/authz, input validation, common OWASP risks) as part of the release process
  • Design and run load and performance tests to validate scalability, latency, and resilience under stress
  • Identify bottlenecks and failure points and partner with Engineering on remediation
  • Validate data integrity across APIs, pipelines, and integrations using strong SQL and data-validation techniques
  • Test interactions between services, APIs, and downstream systems in distributed environments
  • Detect anomalies, regressions, and gaps across end-to-end workflows
  • Work cross-functionally with Engineering, QA, Product, and Operations
  • Participate in sprint planning, backlog refinement, and release validation
  • Contribute to testing standards, best practices, and documentation
  • Support root cause analysis for defects and production issues

Preferred

  • Hands-on experience with a modern test automation framework (Playwright strongly preferred; Cypress, Selenium, or similar acceptable)
  • Experience with cloud-based systems, preferably AWS
  • Experience testing AI/ML models or data-driven systems
  • Experience validating AI-generated outputs or prompt-based systems
  • Familiarity with LLMs, agent workflows, or AI-assisted coding tools
  • Healthcare or regulated data environment experience (HIPAA, compliance)
  • Experience working with CI/CD and DevOps pipelines
  • Experience using AI-assisted coding/testing tools (Claude Code, Copilot, or similar) in a real testing workflow
  • Experience with security testing and/or performance/load testing tools (e.g., k6, JMeter, OWASP ZAP)
  • Experience with CI/CD and DevOps pipelines• Healthcare or regulated-data environment experience, including HIPAA and compliance
  • Familiarity with AI/ML concepts (useful context, not the core focus of the role)
  • Test Automation Frameworks
  • Cypress
  • Selenium
  • Cloud-Based Systems
  • AWS
  • AI/ML Model Testing
  • Data-Driven Systems Testing
  • AI Output Validation
  • Prompt-Based Systems Testing
  • LLMs
  • Agent Workflows
  • AI-Assisted Coding Tools
  • Claude Code
  • GitHub Copilot
  • Healthcare Data Environments
  • Regulated Data Environments
  • HIPAA
  • Compliance
  • DevOps
  • Security Testing
  • Performance Testing
  • Load Testing
  • k6
  • JMeter
  • OWASP ZAP
  • AI/ML Concepts

Benefits

  • Highly valued health insurance
  • A 401(k) plan with employer match
  • Paid parental leave
  • Remote work in the United States

Company

  • Payment integrity and revenue recovery for healthcare payers and providers
  • Hunt Valley, Maryland, USA
  • https://www.trendhealthpartners.com/
  • Founded in 2018
  • 201-500 employees

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
  • Experience in QA automation, test engineering, or a related software engineering role
  • Experience testing APIs, distributed systems, and data pipelines
  • Strong understanding of software testing principles and test automation design
  • Strong SQL and data-validation skills
  • Experience integrating tests into CI/CD pipelines
  • Experience working in an Agile development environment
  • Ability to analyze system behavior and identify root causes
  • Hands-on experience with a modern test automation framework (Playwright strongly preferred; Cypress, Selenium, or similar acceptable)
  • Experience with cloud-based systems, preferably AWS
  • Experience testing AI/ML models or data-driven systems
  • Experience validating AI-generated outputs or prompt-based systems
  • Familiarity with LLMs, agent workflows, or AI-assisted coding tools
  • Healthcare or regulated data environment experience (HIPAA, compliance)
  • Experience working with CI/CD and DevOps pipelines
  • Experience using AI-assisted coding/testing tools (Claude Code, Copilot, or similar) in a real testing workflow
  • Experience with security testing and/or performance/load testing tools (e.g., k6, JMeter, OWASP ZAP)
  • Experience with CI/CD and DevOps pipelines• Healthcare or regulated-data environment experience, including HIPAA and compliance
  • Familiarity with AI/ML concepts (useful context, not the core focus of the role)

Required skills

  • AI/ML Testing, API Testing, AWS, Agile Development, CI/CD Pipelines, Claude Code, Data Pipelines, Data Validation, Distributed Systems, GitHub Copilot, HIPAA, JMeter, LLMs, OWASP ZAP, Performance Testing, QA Automation, SQL, Security Testing, k6

Preferred skills

  • Experience testing AI/ML models or data-driven systems, Experience with cloud-based systems, preferably AWS, Experience working with CI/CD and DevOps pipelines

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Nov 12, 2026

Work mode

Remote

Job source

jobs.lever.co

Company

Trend Health Partners

Information Technology & AI

Payment integrity and revenue recovery for healthcare payers and providers

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

YA Group

1d ago

New

AI Solutions Engineer

Full-timeRemoteUnited StatesCompetitive

YA Group is an international professional services organization seeking an AI Solutions Engineer to build and maintain internal AI-enabled tools, agents, workflow automations, and integrations.

Why similarSame roleClaude CodeData Pipelines

Harris Computer

1d ago

New

AI Solutions Engineer

Full-timeRemoteUnited States$110K – $150K/yr

MEDHOST, Inc. is hiring an AI Solutions Engineer to design, implement, and improve AI capabilities in its products and internal tools.

Why similarSame roleClaude CodeHIPAA

CCC Intelligent Solutions

1d ago

New

Senior AI Engineer

Full-timeRemoteUnited States$180K – $225K/yr

CCC Intelligent Solutions develops technology for the insurance, claims, and repair industries. The Senior AI Engineer owns LLM-powered systems and agentic workflows end to end, including delivery, evaluation, security, and production operation.

Why similarSame roleAWS

Get new AI Engineer jobs by email

Create job alert

AI Test Engineer II

Trend Health Partners · Competitive

Apply on company site