← Back to jobsJob ID col-cmwp84l8907rrd8hacl4vpyer

SynechronPosted 2 days ago

AI Testing - Automation QA Engineer (Selenium)New

Full-time
On-site
Mid level
$90K – $100K/yr
Posted 2 days ago

Synechron is seeking an AI Testing – QA Engineer to test AI applications, RAG systems, APIs, and data platforms. The role focuses on validating model behavior, ensuring accuracy and reliability, and supporting governance, reporting, and documentation.

Posted
2 days ago
Source
ziprecruiter.com
Sector
Electrical Engineering

Opens the employer's application page in a new tab

Responsibilities

  • Own testing governance and reporting for AI applications, RAG systems, APIs, and data platforms
  • Design and execute functional, regression, integration, and performance test cases
  • Validate model outputs for accuracy, relevance, consistency, bias, and hallucinations
  • Test AI workflows, data pipelines, APIs, and model integrations
  • Develop and maintain automation frameworks using Selenium
  • Document test results, defects, evidence, metrics, and dashboards
  • Collaborate with development, data science, and product teams to resolve issues
  • Support AI testing governance and continuous improvement initiatives

Qualifications

  • Strong experience in AI testing and QA governance
  • The role combines strong hands-on skill in Java, Selenium, Playwright, API automation, SQL, automation frameworks and CI/CD with practical use of Generative AI and LLM-based tools
  • Proficiency in test automation using Selenium and Playwright
  • Hands-on experience testing AI applications, RAG systems, APIs, and data platforms
  • Experience with model testing , prompt testing, and evidence-based validation
  • Experience with defect tracking and exception management
  • Knowledge of regression testing, functional testing, integration testing, and API testing
  • Strong documentation, reporting, and analytical skills

Preferred

  • Experience with Python and test automation frameworks
  • Familiarity with PyTest
  • Experience with tools such as LangSmith, Galileo, or similar AI testing platforms
  • Knowledge of performance/load testing and security testing
  • Experience with Azure and Java is a plus

Required skills

AI TestingAPI AutomationCI/CDGenerative AI and LLMsJavaModel and Prompt TestingPythonQA GovernanceRAG SystemsSQLSelenium

Full job description

Synechron is seeking an AI Testing – QA Engineer to test AI applications, RAG systems, APIs, and data platforms. The role focuses on validating model behavior, ensuring accuracy and reliability, and supporting governance, reporting, and documentation.

Responsibilities

  • Own testing governance and reporting for AI applications, RAG systems, APIs, and data platforms
  • Design and execute functional, regression, integration, and performance test cases
  • Validate model outputs for accuracy, relevance, consistency, bias, and hallucinations
  • Test AI workflows, data pipelines, APIs, and model integrations
  • Develop and maintain automation frameworks using Selenium
  • Document test results, defects, evidence, metrics, and dashboards
  • Collaborate with development, data science, and product teams to resolve issues
  • Support AI testing governance and continuous improvement initiatives

Preferred

  • Experience with Python and test automation frameworks
  • Familiarity with PyTest
  • Experience with tools such as LangSmith, Galileo, or similar AI testing platforms
  • Knowledge of performance/load testing and security testing
  • Experience with Azure and Java is a plus
  • Python
  • Test Automation Frameworks
  • PyTest
  • AI Testing Platforms
  • Performance Testing
  • Load Testing
  • Security Testing
  • Azure

Benefits

  • Possibility to work abroad
  • 10 days of paid annual leave (plus sick leave and national holidays)
  • Maternity & paternity leave plans
  • A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region)
  • Retirement savings plans
  • A higher education certification policy
  • Commuter benefits (varies by region)
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups
  • A flat and approachable organization
  • A truly diverse, fun-loving, and global work culture
  • Flexible workplace arrangements
  • Mentoring
  • Internal mobility
  • Learning and development programs

Company

  • Digital consulting for financial services and technology firms
  • New York, New York, USA
  • http://www.synechron.com/
  • Founded in 2001
  • 10001+ employees

Qualifications

  • Strong experience in AI testing and QA governance
  • The role combines strong hands-on skill in Java, Selenium, Playwright, API automation, SQL, automation frameworks and CI/CD with practical use of Generative AI and LLM-based tools
  • Proficiency in test automation using Selenium and Playwright
  • Hands-on experience testing AI applications, RAG systems, APIs, and data platforms
  • Experience with model testing , prompt testing, and evidence-based validation
  • Experience with defect tracking and exception management
  • Knowledge of regression testing, functional testing, integration testing, and API testing
  • Strong documentation, reporting, and analytical skills
  • Experience with Python and test automation frameworks
  • Familiarity with PyTest
  • Experience with tools such as LangSmith, Galileo, or similar AI testing platforms
  • Knowledge of performance/load testing and security testing
  • Experience with Azure and Java is a plus

Required skills

  • AI Testing, API Automation, CI/CD, Generative AI and LLMs, Java, Model and Prompt Testing, Python, QA Governance, RAG Systems, SQL, Selenium

Preferred skills

  • Experience with Azure and Java is a plus, Experience with Python and test automation frameworks, Familiarity with PyTest, Knowledge of performance/load testing and security testing

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Nov 19, 2026

Work mode

On-site

Job source

ziprecruiter.com

Company

Synechron

Electrical Engineering

Digital consulting for financial services and technology firms

See all 14 jobs from Synechron →
  • New York, New York, USA
  • Electrical Engineering
  • 10001+ employees
  • Founded 2001
  • synechron.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Automation Engineer jobs in Charlotte

Impiricus

1w ago

QA Automation Engineer

Full-timeRemoteUnited States$100K – $130K/yr

Responsibilities Develop and maintain automation frameworks, pipelines, and automated tests (unit, API, integration, E2E) Write and execute automated and manual tests; analyze logs, metrics, and defects Collaborate with cross‑functional teams to refine…

Why similarSame roleCI/CDRemote

MasterApp Labs

3d ago

Senior QA Automation Engineer

TemporaryRemoteUnited StatesCompetitive

MasterApp Labs is hiring a Senior QA Automation Engineer to provide software testing services alongside project development teams.

Why similarSame roleJavaRemote

Artificial Intelligence (AI)

1w ago

Senior QA Automation Engineer

Full-timeHybridFarmington Hills, MICompetitive

Software Guidance & Assistance, Inc. (SGA) is recruiting for an unnamed banking client. The Senior QA Automation Engineer will ensure the quality, reliability, security, and functional accuracy of enterprise Wealth & Asset Management applications through…

Why similarSame roleCI/CDJava

Get new Automation Engineer jobs in Charlotte by email

Create job alert

AI Testing - Automation QA Engineer (Selenium)

Synechron · $90K – $100K/yr

Apply on company site