AI Data Platform Engineer

Banner Quality Management Inc. is hiring an AI Data Platform Engineer to build and operationalize GenAI and data platform capabilities for its customer’s Safety & Mission Assurance use cases. The role focuses on AWS data lakes and pipelines, secure AI integrations, and governed, reliable GenAI systems.

Responsibilities

Architect, build, and operate a cloud data lake on AWS that ingests and organizes structured, semi-structured, and unstructured data from relational databases (e.g., SQL Server, managed RDS), object storage, documents, transcripts, RSS/news feeds, and M365/SharePoint sources, and makes that data AI-ready

Design and build end-to-end data pipelines: ingestion, transformation, document parsing and chunking, metadata enrichment, embedding generation, and loading into vector/semantic and structured stores, with orchestration, scheduling, data quality checks, and monitoring

Develop and operationalize retrieval-augmented generation (RAG) and agentic GenAI capabilities using AWS-native foundation model services and open frameworks, including knowledge bases, embeddings, vector search, natural-language-to-SQL, and tool use over the various datasets

Design, develop, secure, and document APIs and MCP servers that expose lake datasets and enterprise systems to LLM orchestrators, chat interfaces, and web applications as governed, discoverable tools

Implement authentication and authorization for AI services, APIs, and data access using OIDC/OAuth 2.0 and Microsoft Entra ID; configure and administer identity providers (including Keycloak) for scopes, roles, service-to-service authentication, and federation

Build evaluation and observability for GenAI systems: retrieval quality, answer groundedness, hallucination detection, validation of NL-to-SQL outputs against source data, tracing, and cost/latency monitoring

Embed data governance into pipelines and retrieval: data classification and marking, document-level and row/column-level access controls, PII handling, lineage, and audit logging

Design and optimize prompts and agent workflows for large language models (LLMs) to ensure accurate, grounded, context-aware outputs with source citations

Evaluate and recommend tools: help the team select the right AWS services, open-source, and third-party components for each job based on capability, cost, security accreditation, and maintainability, avoiding over-engineering

Integrate AI capabilities into existing web applications, tools, training platforms, and M365/SharePoint solutions

Collaborate with subject-matter experts, engineers, data stewards, and mission programs to define use cases, gather requirements, and measure impact (e.g., reduced analysis time, improved risk foresight, higher detection accuracy)

Ensure AI systems follow the Customer's "AI advises, humans decide" posture and responsible AI principles: human-in-the-loop review, source traceability, clear distinction between retrieved data and AI-generated content, explainability, robustness, safety, and compliance with federal guidelines (e.g., NIST AI Risk Management Framework, Customer AI governance)

Stay current on frontier AI advances (e.g., agentic systems, the MCP ecosystem, trustworthy AI) and adapt them to constrained, high-assurance aerospace domains

Document architecture, pipelines, code, and processes to support reproducibility, audits, and knowledge transfer across the Customer organization

Preferred

Keycloak a plus

familiarity with scikit-learn or PyTorch a plus

C#/.NET a plus, for integration with existing web applications and backend services

TypeScript/Node.js a plus, for MCP servers and frontend integration

Prior Federal government, defense, or contracting experience

Thrive under pressure and enjoy working in an environment with competing priorities

(PhD preferred for senior levels)

scikit-learn

PyTorch

C#/.NET

TypeScript

Node.js

Web Application Integration

Backend Service Integration

Frontend Integration

Federal Government Experience

Defense Experience

Government Contracting Experience

PhD

Thriving Under Pressure

Managing Competing Priorities

Company

Managerial, technical, and professional services for federal government.

Friendswood, Texas, USA

https://bqmi.com/

Founded in 2009

51-200 employees

Qualifications

Bachelor's or Master's degree in Computer Science, Data Science, Artificial Intelligence, Engineering, or a related field

3+ years of hands-on experience building and deploying AI and data-intensive systems in production

Proficiency in Python and strong SQL; experience with modern data engineering libraries and frameworks

Hands-on AWS experience across storage, compute, data, and AI services (object storage, managed relational and vector databases, serverless and containerized compute, managed foundation model and knowledge base services), including IAM and security best practices

Demonstrated experience designing data lake or lakehouse architectures and pipelines for heterogeneous data at scale, including document processing and embedding workflows

Experience building and securing REST APIs and/or MCP servers: API design, authentication, versioning, containerization (Docker), and deployment

Working knowledge of OIDC/OAuth 2.0 flows, JWTs, and enterprise identity providers (Microsoft Entra ID required; Keycloak a plus)

Strong understanding of data handling in regulated/high-stakes domains: CUI/PII-aware design, access controls, auditability, and NLP over technical documents

Experience implementing GenAI solutions (not just experimentation) using APIs, SDKs, and frameworks (e.g., Amazon Bedrock, LangChain/LangGraph, LlamaIndex, LiteLLM or other model gateways, Hugging Face)

Work with large language models (RAG, embeddings and vector databases, agent frameworks, NL-to-SQL) for technical document analysis or knowledge extraction

Experience with data workflow orchestration and processing tools (e.g., AWS Step Functions, Glue, Lambda, Airflow, dbt, Spark); specific tooling is not prescribed and candidates are expected to help select it

Experience evaluating and monitoring LLM applications (e.g., RAG evaluation frameworks, LLM-as-judge, tracing/observability platforms, OpenTelemetry)

Experience implementing robust guardrails, content safety, and groundedness controls

ML literacy sufficient to operationalize, monitor, and retrain existing models and embedding pipelines

Experience integrating with M365/SharePoint (e.g., Microsoft Graph API)

Experience with Git/GitHub workflows, branching strategies, and code review in an Agile team

Strong communication, presentation, and storytelling skills

Experience collaborating with multiple cross-functional partners

Experience working in a fast-paced, iterative environment where multi-tasking and time-management skills are critical

Experience supporting developers in the implementation of design deliverables

Ability to perform work within specific timeframes and adhere to deadlines

Willingness to keep skills current and quickly adapt to new technologies, as needed

U.S. citizenship is required to obtain access to government facilities and systems

Keycloak a plus

Familiarity with scikit-learn or PyTorch a plus

C#/.NET a plus, for integration with existing web applications and backend services

TypeScript/Node.js a plus, for MCP servers and frontend integration

Prior Federal government, defense, or contracting experience

Thrive under pressure and enjoy working in an environment with competing priorities

(PhD preferred for senior levels)

Required skills

Python, SQL, Amazon Web Services (AWS), Data Lake and Lakehouse Architecture, Data Pipeline Engineering, Retrieval-Augmented Generation (RAG), Amazon Bedrock, LangChain and LangGraph, REST API and Model Context Protocol (MCP) Development, OIDC and OAuth 2.0, Microsoft Entra ID, Docker, Microsoft Graph API and SharePoint, CUI/PII Data Handling

Preferred skills

Keycloak a plus, familiarity with scikit-learn or PyTorch a plus, Prior Federal government, defense, or contracting experience, (PhD preferred for senior levels), Banner Quality Management Inc., Friendswood, Texas, USA, https://bqmi.com/, Growth Stage, Leadership Team, Pura Stalnaker, Owner, Company data provided by, AI Tools, Customize Your Resume, Maximize your interview chances, Build Cover Letter, Make your application stand out, Analyze How Well You Fit, Understand your strength & weakness

Experience

3+ years