Quality Assurance and Data Tester

Seneca Holdings' Great Waters Federal supports mission-critical federal government contracting needs for civilian, defense, and intelligence customers. The Quality Assurance / Data Tester will design, execute, and document testing for data pipelines, integration workflows, migrations, analytics outputs, and AI agent use cases across the Halo enterprise cloud platform. The role also involves defect tracking, SQL-based data validation, cross-functional collaboration, and maintaining audit-ready test documentation in a FISMA High environment.

Responsibilities

• Support the design, validation, and quality assurance of data pipelines and integration workflows across the Halo enterprise cloud platform
• Validate data onboarding processes to ensure new data sources are ingested, transformed, and made available accurately and reliably for downstream use cases
• Support the development and testing of Halo use cases, ensuring data is properly prepared and fit for purpose for required analytics
• Verify the integrity, accuracy, and reliability of data migrated from legacy on-premises systems to cloud-based architectures
• Validate that advanced analytics outputs meet defined functional, technical, and business requirements
• Test and validate AI agent use cases operating across a complex, matrixed federal environment, confirming that outputs are accurate, consistent, and aligned with intended behavior
• Create clear, thorough, and traceable test cases and test scripts derived from requirements, source-to-target mappings, and use-case documentation
• Execute functional testing to confirm that pipelines, transformations, and platform features perform as designed
• Perform integration testing across interconnected systems, services, and data flows to validate end-to-end behavior
• Conduct regression testing to ensure new releases, pipeline changes, or platform updates do not introduce defects into existing functionality
• Perform backend and data-level testing, including SQL-based validation of tables, transformations, and aggregations within Delta Lake and Databricks
• Identify, document, and track defects with clear reproduction steps, prioritizing early detection to reduce downstream rework and risk
• Collaborate with data engineers, developers, and business stakeholders to clarify requirements, resolve defects, and continuously improve test coverage
• Maintain test documentation, traceability matrices, and evidence of test execution to support audit and compliance needs within a FISMA High environment
• Participate in Agile ceremonies, contributing to sprint planning, backlog refinement, and iterative test cycles

Preferred

• Experience testing or validating AI/ML model outputs or AI agent-based use cases
• Familiarity with medallion architecture, including Bronze, Silver, and Gold layers, and modern data lakehouse design
• Experience with test automation tools and frameworks for data or API testing
• Experience operating within FISMA High, FedRAMP, or other regulated, multi-tenant federal environments
• Familiarity with defect-tracking and test-management tools, such as Jira, Azure DevOps, or TestRail
• AI/ML model validation
• AI agent testing
• Medallion architecture
• Data lakehouse design
• Test automation
• API testing
• FISMA High environments
• FedRAMP environments
• Regulated federal environments
• Multi-tenant environments
• Jira
• Azure DevOps
• TestRail
• Defect tracking
• Test management

Benefits

• Medical, dental, vision, life, and disability benefits
• Voluntary benefit programs, including critical illness, hospital, and accident coverage
• Health savings and flexible spending accounts
• Retirement 401K plan
• Flexible work-life balance
• Professional development opportunities
• Performance and recognition programs
• Full-time employees working at least 30 hours a week on a regular basis are eligible to participate in paid leave programs

Company

• Investment holding company supporting the Seneca Nation
• Salamanca, New York, USA
• http://www.senecaholdings.com/
• Founded in 2009
• 501-1000 employees

Qualifications

• Proven, hands-on experience in software or data quality assurance testing, including test case design and execution
• Strong experience with functional testing, integration testing, regression testing, and backend/data testing
• Solid SQL skills for validating backend data, including complex queries, joins, and aggregations
• Demonstrated ability to identify defects early in the development lifecycle and communicate them clearly to technical teams
• Experience testing data pipelines, ETL/ELT processes, or data migration efforts from legacy systems to cloud platforms
• Familiarity with cloud data platforms such as Databricks and AWS, including exposure to Delta tables and data lakehouse concepts
• Experience developing and maintaining test cases, test plans, and traceability documentation
• Strong analytical and problem-solving skills, with close attention to data accuracy, consistency, and edge cases
• Experience working within Agile/Scrum project methodologies
• Excellent written and verbal communication skills, with the ability to work across cross-functional, matrixed teams
• Experience testing or validating AI/ML model outputs or AI agent-based use cases
• Familiarity with medallion architecture, including Bronze, Silver, and Gold layers, and modern data lakehouse design
• Experience with test automation tools and frameworks for data or API testing
• Experience operating within FISMA High, FedRAMP, or other regulated, multi-tenant federal environments
• Familiarity with defect-tracking and test-management tools, such as Jira, Azure DevOps, or TestRail

Required skills

• Software and Data Quality Assurance Testing, Functional, Integration, and Regression Testing, SQL, Data Pipeline and ETL/ELT Testing, Data Migration Testing, Databricks, AWS, Delta Lake, Test Case, Test Plan, and Traceability Documentation, Agile/Scrum, AI/ML Output and AI Agent Validation, FISMA High

Preferred skills

• Written and Verbal Communication

Experience

• Mid level