← Back to jobsJob ID col-cmvv4p64b04cl42b9nvq19du4

IT consulting and custom-built enterprise software solutionsPosted 30+ days ago

AI Lead – Platform Intelligence & Applied AI

Full-time
Remote
Competitive
Posted 30+ days ago

Georgia IT, Inc. is a company focused on innovative technology solutions, and they are seeking an AI Lead for their Platform Intelligence & Applied AI team. The role involves developing AI strategies, managing model usage, and ensuring the integration of AI capabilities into platform features while adhering to governance and responsible AI principles.

Posted
30+ Days Ago
Source
www1.jobdiva.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Continuously track and evaluate:
  • LLM and foundation model advancements
  • Agent frameworks and orchestration patterns
  • Retrieval, memory, and context management techniques
  • AI evaluation, safety, and governance approaches
  • Translate emerging AI trends into:
  • Platform design principles
  • Proofs of concept and experiments
  • Scalable, production-ready capabilities
  • Advise leadership on when and how new AI capabilities should be adopted
  • Own the strategy for LLM and model usage across the platform, including:
  • Model selection and benchmarking
  • Versioning and lifecycle management
  • Cost, performance, and latency trade-offs
  • Fallback and redundancy strategies
  • Establish best practices for:
  • Prompt and instruction design
  • Skill and Tool calling
  • Structured outputs and determinism
  • Design and evolve the platform's semantic routing layer, including:
  • Intent detection and task classification
  • Routing to appropriate models, agents, or workflows
  • Context-aware decisioning based on workspace state
  • Define orchestration patterns for:
  • Multi-step and parallel execution
  • Long-running and asynchronous tasks
  • Human-in-the-loop controls
  • Ensure routing logic is transparent, testable, and tunable
  • Consult on the firm's agent strategy, including:
  • When to use agents vs. workflows vs. direct LLM calls
  • Agent composition, memory, and tool access
  • Guardrails and behavioral constraints
  • Partner with engineering to implement:
  • Agent frameworks and runtime infrastructure
  • Monitoring and debugging capabilities
  • Ensure agents are:
  • Predictable and auditable
  • Aligned to service methods and delivery workflows
  • Safe for enterprise and client-facing use
  • Own the design of contextual intelligence within workspaces, including:
  • Document ingestion, chunking, and enrichment strategies
  • Vector, keyword, and hybrid retrieval approaches
  • Context assembly across client data, firm IP, and engagement artifacts
  • Define standards for:
  • Source attribution and transparency
  • Data isolation and compliance
  • Relevance, freshness, and performance
  • Continuously evaluate new approaches to memory, retrieval, and grounding
  • Establish the platform's AI evaluation and testing framework, including:
  • Task-based and scenario-driven evaluations
  • Regression testing for prompts, agents, and routing logic
  • Comparative benchmarking across models and configurations
  • Define metrics for:
  • Accuracy, relevance, and consistency
  • Cost efficiency and latency
  • User trust and explainability
  • Partner with engineering and risk teams to ensure:
  • Observability into AI behavior
  • Safe deployment and controlled experimentation
  • Continuous improvement loops based on real usage
  • Work closely with:
  • Platform engineering teams
  • Product and design partners
  • Consulting and delivery leaders
  • Provide technical guidance on:
  • How AI capabilities should be embedded into platform features
  • Where AI adds leverage vs. complexity
  • Support enablement through:
  • Technical documentation and reference architectures
  • Internal education and design reviews
  • Advisory support for high-impact use cases
  • Define technical guardrails that support:
  • Security, privacy, and data residency
  • Responsible AI principles
  • Regulatory and client requirements
  • Ensure AI systems are:
  • Explainable where required
  • Observable and auditable
  • Designed for controlled evolution over time

Qualifications

  • Strong experience with AI strategy, platform intelligence, and applied AI solutions
  • Hands-on experience with LLMs, foundation models, and model lifecycle management
  • Experience designing and implementing agent architectures and orchestration frameworks
  • Strong understanding of RAG architecture, retrieval strategies, embeddings, vector databases, and context management
  • Experience with prompt engineering, structured outputs, tool calling, and AI workflow design
  • Experience designing semantic routing, intent classification, and AI decisioning systems
  • Strong knowledge of AI evaluation frameworks, benchmarking methodologies, testing strategies, and observability
  • Experience implementing AI governance, security, privacy, and responsible AI practices
  • Ability to translate emerging AI technologies into enterprise-scale platform capabilities
  • Strong collaboration skills across engineering, product, design, consulting, and leadership teams

Required skills

AI decisioning systemsAI evaluation frameworksAI governanceAI strategyAI workflow designAgent architecturesApplied AI solutionsBenchmarking methodologiesContext managementEmbeddingsFoundation modelsIntent classificationLarge Language Models (LLMs)Model lifecycle management

Full job description

Georgia IT, Inc. is a company focused on innovative technology solutions, and they are seeking an AI Lead for their Platform Intelligence & Applied AI team. The role involves developing AI strategies, managing model usage, and ensuring the integration of AI capabilities into platform features while adhering to governance and responsible AI principles.

Responsibilities

  • Continuously track and evaluate:
  • LLM and foundation model advancements
  • Agent frameworks and orchestration patterns
  • Retrieval, memory, and context management techniques
  • AI evaluation, safety, and governance approaches
  • Translate emerging AI trends into:
  • Platform design principles
  • Proofs of concept and experiments
  • Scalable, production-ready capabilities
  • Advise leadership on when and how new AI capabilities should be adopted
  • Own the strategy for LLM and model usage across the platform, including:
  • Model selection and benchmarking
  • Versioning and lifecycle management
  • Cost, performance, and latency trade-offs
  • Fallback and redundancy strategies
  • Establish best practices for:
  • Prompt and instruction design
  • Skill and Tool calling
  • Structured outputs and determinism
  • Design and evolve the platform's semantic routing layer, including:
  • Intent detection and task classification
  • Routing to appropriate models, agents, or workflows
  • Context-aware decisioning based on workspace state
  • Define orchestration patterns for:
  • Multi-step and parallel execution
  • Long-running and asynchronous tasks
  • Human-in-the-loop controls
  • Ensure routing logic is transparent, testable, and tunable
  • Consult on the firm's agent strategy, including:
  • When to use agents vs. workflows vs. direct LLM calls
  • Agent composition, memory, and tool access
  • Guardrails and behavioral constraints
  • Partner with engineering to implement:
  • Agent frameworks and runtime infrastructure
  • Monitoring and debugging capabilities
  • Ensure agents are:
  • Predictable and auditable
  • Aligned to service methods and delivery workflows
  • Safe for enterprise and client-facing use
  • Own the design of contextual intelligence within workspaces, including:
  • Document ingestion, chunking, and enrichment strategies
  • Vector, keyword, and hybrid retrieval approaches
  • Context assembly across client data, firm IP, and engagement artifacts
  • Define standards for:
  • Source attribution and transparency
  • Data isolation and compliance
  • Relevance, freshness, and performance
  • Continuously evaluate new approaches to memory, retrieval, and grounding
  • Establish the platform's AI evaluation and testing framework, including:
  • Task-based and scenario-driven evaluations
  • Regression testing for prompts, agents, and routing logic
  • Comparative benchmarking across models and configurations
  • Define metrics for:
  • Accuracy, relevance, and consistency
  • Cost efficiency and latency
  • User trust and explainability
  • Partner with engineering and risk teams to ensure:
  • Observability into AI behavior
  • Safe deployment and controlled experimentation
  • Continuous improvement loops based on real usage
  • Work closely with:
  • Platform engineering teams
  • Product and design partners
  • Consulting and delivery leaders
  • Provide technical guidance on:
  • How AI capabilities should be embedded into platform features
  • Where AI adds leverage vs. complexity
  • Support enablement through:
  • Technical documentation and reference architectures
  • Internal education and design reviews
  • Advisory support for high-impact use cases
  • Define technical guardrails that support:
  • Security, privacy, and data residency
  • Responsible AI principles
  • Regulatory and client requirements
  • Ensure AI systems are:
  • Explainable where required
  • Observable and auditable
  • Designed for controlled evolution over time

Benefits

  • Location: Chicago, IL (Remote)

Company

  • IT consulting and custom-built enterprise software solutions
  • Alpharetta, Georgia, USA
  • http://www.georgiait.com/
  • Founded in 2007
  • 51-200 employees

Qualifications

  • Strong experience with AI strategy, platform intelligence, and applied AI solutions
  • Hands-on experience with LLMs, foundation models, and model lifecycle management
  • Experience designing and implementing agent architectures and orchestration frameworks
  • Strong understanding of RAG architecture, retrieval strategies, embeddings, vector databases, and context management
  • Experience with prompt engineering, structured outputs, tool calling, and AI workflow design
  • Experience designing semantic routing, intent classification, and AI decisioning systems
  • Strong knowledge of AI evaluation frameworks, benchmarking methodologies, testing strategies, and observability
  • Experience implementing AI governance, security, privacy, and responsible AI practices
  • Ability to translate emerging AI technologies into enterprise-scale platform capabilities
  • Strong collaboration skills across engineering, product, design, consulting, and leadership teams

Required skills

  • AI decisioning systems, AI evaluation frameworks, AI governance, AI strategy, AI workflow design, Agent architectures, Applied AI solutions, Benchmarking methodologies, Context management, Embeddings, Foundation models, Intent classification, Large Language Models (LLMs), Model lifecycle management, Orchestration frameworks, Platform intelligence, Prompt engineering, Responsible AI practices, Retrieval strategies, Retrieval-Augmented Generation (RAG) architecture, Semantic routing, Structured outputs, Testing strategies, Tool calling

Job details

Employment type

Full-time

Seniority level

Not stated

Date posted

Jul 21, 2026

Work mode

Remote

Job source

www1.jobdiva.com

Company

IT consulting and custom-built enterprise software solutions

Information Technology & AI

IT consulting and custom-built enterprise software solutions

  • Alpharetta, Georgia, USA
  • Information Technology & AI
  • 51-200 employees
  • Founded 2007
  • georgiait.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

Yotta Systems Inc

1d ago

New

Generative AI Engineer

Full-timeRemoteUnited StatesCompetitive

Yotta Systems Inc is seeking a Generative AI Engineer to develop AI applications using Python, LLMs, and retrieval-augmented generation. The role involves building AI agents and integrating REST APIs.

Why similarSame roleEmbeddingsLarge Language Models (LLMs)

EVERSANA

1d ago

New

Sr. AI Developer, Engineering

Full-timeRemoteUnited States$122K – $200K/yr

EVERSANA is hiring a Senior AI Developer to design, build, and deploy enterprise-grade AI solutions for pharmaceutical and healthcare marketing operations.

Why similarSame roleLarge Language Models (LLMs)

HubSpot

1d ago

New

Senior AI Engineer

Full-timeRemoteUnited States$148K – $223K/yr

HubSpot is hiring a Senior AI Engineer for its AI Marketing Solutions team. The role builds scalable, production-grade generative AI systems for marketing applications, leads AI research and development, and partners with stakeholders to shape technical…

Why similarSame roleLarge Language Models (LLMs)

Get new AI Engineer jobs by email

Create job alert

AI Lead – Platform Intelligence & Applied AI

IT consulting and custom-built enterprise software solutions · Competitive

Apply on company site