← Back to jobsJob ID col-cmwf79tpj0big89hq5mt7lahc

KPG99 INCPosted 8 days ago

Data & AI / LLM Engineer

Contract
Remote
Mid level
Competitive
Posted 8 days ago

KPG99 Inc. is seeking a Data & AI / LLM Engineer to build and support data pipelines, analytics, machine-learning models, and enterprise generative AI applications. The role also develops Azure-based production solutions and applies DevOps practices to deliver secure, reliable data and AI capabilities, including for insurance-related use cases.

Posted
8 days ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, build, test, and maintain scalable data pipelines and data products using Databricks, Apache Spark/PySpark, Delta Lake, SQL, and Python
  • Perform exploratory and advanced data analysis to identify patterns, anomalies, trends, relationships, and opportunities within complex insurance datasets
  • Build reliable ingestion, transformation, integration, and data-quality processes across structured and unstructured data
  • Work with large-scale datasets across cloud data platforms, APIs, files, databases, and enterprise applications
  • Apply sound practices around data quality, lineage, observability, metadata, security, and governance
  • Optimize pipelines and workloads for reliability, performance, scalability, and cost
  • Develop, evaluate, deploy, and monitor machine learning models using Python and appropriate ML frameworks
  • Understand core ML techniques including supervised and unsupervised learning, classification, regression, clustering, feature engineering, model evaluation, and model monitoring
  • Translate business problems into analytical or machine-learning approaches and determine when traditional analytics, ML, or Generative AI is most appropriate
  • Work with data scientists, business SMEs, and engineering teams to productionize models and analytical solutions
  • Design and implement enterprise LLM applications, including Retrieval-Augmented Generation (RAG), document processing, summarization, extraction, classification, conversational assistants, and agentic workflows
  • Develop solutions using LLM APIs and frameworks, with experience in areas such as prompt engineering, embeddings, vector search, chunking, grounding, tool/function calling, and structured outputs
  • Understand evaluation techniques for LLM solutions, including accuracy, relevance, hallucination risk, latency, cost, security, and responsible AI considerations
  • Integrate structured enterprise data and unstructured content into secure and governed AI solutions
  • Build reusable AI components and APIs that can be incorporated into broader enterprise applications
  • Effectively use modern AI development tools such as GitHub Copilot, Claude, and similar coding assistants to accelerate engineering delivery
  • Use AI tools to help create, refactor, debug, test, document, review, and maintain code
  • Apply engineering judgment when using AI-generated code, including validating functionality, security, performance, maintainability, and compliance with coding standards
  • Demonstrate an AI-first engineering mindset, identifying opportunities to automate repetitive development, analysis, testing, and documentation activities rather than simply using AI as an autocomplete capability
  • Build and deploy solutions using the Microsoft Azure technology stack, with relevant experience across services such as Azure Databricks, Azure Storage/Data Lake, Microsoft Entra ID, Key Vault, Azure Functions, APIs, Azure AI services, and related cloud services
  • Work within modern CI/CD and DevOps practices using tools such as Azure DevOps and/or GitHub
  • Use Git-based source control, branching, pull requests, automated testing, build/release pipelines, infrastructure configuration, and environment management
  • Design solutions with appropriate consideration for security, identity, secrets management, logging, monitoring, resilience, scalability, and production support
  • Partner with architecture, cybersecurity, data governance, infrastructure, and application teams to ensure solutions meet enterprise technology standards
  • The engineer should be able to engage with underwriters, actuaries, claims professionals, operations teams, data analysts, and technology teams and translate business needs into appropriate data and AI solutions

Qualifications

  • Strong professional experience in data engineering, analytics, machine learning, AI, or software engineering
  • Advanced programming skills in Python and SQL
  • Strong experience with Databricks, Spark/PySpark, and Delta Lake
  • Experience designing and supporting production-scale ETL/ELT and data pipelines
  • Practical experience performing data analysis on large and complex datasets
  • Working knowledge of statistical analysis and machine-learning techniques
  • Hands-on experience developing solutions using LLMs and Generative AI
  • Experience with RAG, embeddings, vector search, prompt engineering, evaluation, or related LLM patterns
  • Experience with the Microsoft Azure cloud ecosystem
  • Strong understanding of Git, CI/CD, DevOps, testing, code reviews, and production deployment practices
  • Experience using AI coding assistants such as GitHub Copilot, Claude, or comparable tools as part of day-to-day software engineering
  • Ability to work independently from an ambiguous business problem through analysis, technical design, implementation, testing, deployment, and production support

Preferred

  • The ideal candidate should have experience working within insurance, financial services, or another highly regulated data-intensive industry, with insurance experience strongly preferred
  • Prior experience in P&C, commercial, specialty, or reinsurance environments
  • Experience with Azure Databricks and Azure AI services
  • Experience operationalizing ML models using MLflow/MLOps practices
  • Experience with vector databases/vector search and enterprise RAG architectures
  • Experience working with insurance documents and unstructured datasets
  • Experience building APIs and microservices supporting data and AI applications
  • Familiarity with data governance, data cataloging, lineage, model governance, and Responsible AI practices
  • Experience with Infrastructure as Code and automated cloud deployments
  • Bachelor's or Master's degree in Computer Science, Data Science, Artificial Intelligence, Engineering, Mathematics, or a related discipline, or equivalent professional experience
  • Insurance Industry Experience
  • Financial Services Experience
  • Regulated Industry Experience
  • Data-Intensive Industry Experience

Required skills

Apache Spark/PySparkCI/CDDatabricksDelta LakeETL/ELT Data PipelinesMachine LearningMicrosoft AzurePrompt EngineeringPythonRetrieval-Augmented Generation (RAG)SQL

Full job description

KPG99 Inc. is seeking a Data & AI / LLM Engineer to build and support data pipelines, analytics, machine-learning models, and enterprise generative AI applications. The role also develops Azure-based production solutions and applies DevOps practices to deliver secure, reliable data and AI capabilities, including for insurance-related use cases.

Responsibilities

  • Design, build, test, and maintain scalable data pipelines and data products using Databricks, Apache Spark/PySpark, Delta Lake, SQL, and Python
  • Perform exploratory and advanced data analysis to identify patterns, anomalies, trends, relationships, and opportunities within complex insurance datasets
  • Build reliable ingestion, transformation, integration, and data-quality processes across structured and unstructured data
  • Work with large-scale datasets across cloud data platforms, APIs, files, databases, and enterprise applications
  • Apply sound practices around data quality, lineage, observability, metadata, security, and governance
  • Optimize pipelines and workloads for reliability, performance, scalability, and cost
  • Develop, evaluate, deploy, and monitor machine learning models using Python and appropriate ML frameworks
  • Understand core ML techniques including supervised and unsupervised learning, classification, regression, clustering, feature engineering, model evaluation, and model monitoring
  • Translate business problems into analytical or machine-learning approaches and determine when traditional analytics, ML, or Generative AI is most appropriate
  • Work with data scientists, business SMEs, and engineering teams to productionize models and analytical solutions
  • Design and implement enterprise LLM applications, including Retrieval-Augmented Generation (RAG), document processing, summarization, extraction, classification, conversational assistants, and agentic workflows
  • Develop solutions using LLM APIs and frameworks, with experience in areas such as prompt engineering, embeddings, vector search, chunking, grounding, tool/function calling, and structured outputs
  • Understand evaluation techniques for LLM solutions, including accuracy, relevance, hallucination risk, latency, cost, security, and responsible AI considerations
  • Integrate structured enterprise data and unstructured content into secure and governed AI solutions
  • Build reusable AI components and APIs that can be incorporated into broader enterprise applications
  • Effectively use modern AI development tools such as GitHub Copilot, Claude, and similar coding assistants to accelerate engineering delivery
  • Use AI tools to help create, refactor, debug, test, document, review, and maintain code
  • Apply engineering judgment when using AI-generated code, including validating functionality, security, performance, maintainability, and compliance with coding standards
  • Demonstrate an AI-first engineering mindset, identifying opportunities to automate repetitive development, analysis, testing, and documentation activities rather than simply using AI as an autocomplete capability
  • Build and deploy solutions using the Microsoft Azure technology stack, with relevant experience across services such as Azure Databricks, Azure Storage/Data Lake, Microsoft Entra ID, Key Vault, Azure Functions, APIs, Azure AI services, and related cloud services
  • Work within modern CI/CD and DevOps practices using tools such as Azure DevOps and/or GitHub
  • Use Git-based source control, branching, pull requests, automated testing, build/release pipelines, infrastructure configuration, and environment management
  • Design solutions with appropriate consideration for security, identity, secrets management, logging, monitoring, resilience, scalability, and production support
  • Partner with architecture, cybersecurity, data governance, infrastructure, and application teams to ensure solutions meet enterprise technology standards
  • The engineer should be able to engage with underwriters, actuaries, claims professionals, operations teams, data analysts, and technology teams and translate business needs into appropriate data and AI solutions

Preferred

  • The ideal candidate should have experience working within insurance, financial services, or another highly regulated data-intensive industry, with insurance experience strongly preferred
  • Prior experience in P&C, commercial, specialty, or reinsurance environments
  • Experience with Azure Databricks and Azure AI services
  • Experience operationalizing ML models using MLflow/MLOps practices
  • Experience with vector databases/vector search and enterprise RAG architectures
  • Experience working with insurance documents and unstructured datasets
  • Experience building APIs and microservices supporting data and AI applications
  • Familiarity with data governance, data cataloging, lineage, model governance, and Responsible AI practices
  • Experience with Infrastructure as Code and automated cloud deployments
  • Bachelor's or Master's degree in Computer Science, Data Science, Artificial Intelligence, Engineering, Mathematics, or a related discipline, or equivalent professional experience
  • Insurance Industry Experience
  • Financial Services Experience
  • Regulated Industry Experience
  • Data-Intensive Industry Experience
  • Casualty Insurance
  • Commercial Insurance
  • Specialty Insurance
  • Reinsurance
  • Azure Databricks
  • Azure AI Services
  • Machine Learning Operations
  • MLflow
  • Vector Databases
  • Enterprise RAG Architectures
  • Insurance Document Processing
  • Unstructured Data
  • API Development
  • Microservices Development
  • Data Governance
  • Data Cataloging
  • Data Lineage
  • Model Governance
  • Responsible AI
  • Infrastructure as Code
  • Automated Cloud Deployments
  • Computer Science
  • Data Science
  • Mathematics

Company

  • Business and technology consulting, development, and staffing services
  • Hamilton, Ohio, USA
  • https://www.kpg99.com/
  • Founded in 2013
  • 51-200 employees

Qualifications

  • Strong professional experience in data engineering, analytics, machine learning, AI, or software engineering
  • Advanced programming skills in Python and SQL
  • Strong experience with Databricks, Spark/PySpark, and Delta Lake
  • Experience designing and supporting production-scale ETL/ELT and data pipelines
  • Practical experience performing data analysis on large and complex datasets
  • Working knowledge of statistical analysis and machine-learning techniques
  • Hands-on experience developing solutions using LLMs and Generative AI
  • Experience with RAG, embeddings, vector search, prompt engineering, evaluation, or related LLM patterns
  • Experience with the Microsoft Azure cloud ecosystem
  • Strong understanding of Git, CI/CD, DevOps, testing, code reviews, and production deployment practices
  • Experience using AI coding assistants such as GitHub Copilot, Claude, or comparable tools as part of day-to-day software engineering
  • Ability to work independently from an ambiguous business problem through analysis, technical design, implementation, testing, deployment, and production support
  • The ideal candidate should have experience working within insurance, financial services, or another highly regulated data-intensive industry, with insurance experience strongly preferred
  • Prior experience in P&C, commercial, specialty, or reinsurance environments
  • Experience with Azure Databricks and Azure AI services
  • Experience operationalizing ML models using MLflow/MLOps practices
  • Experience with vector databases/vector search and enterprise RAG architectures
  • Experience working with insurance documents and unstructured datasets
  • Experience building APIs and microservices supporting data and AI applications
  • Familiarity with data governance, data cataloging, lineage, model governance, and Responsible AI practices
  • Experience with Infrastructure as Code and automated cloud deployments
  • Bachelor's or Master's degree in Computer Science, Data Science, Artificial Intelligence, Engineering, Mathematics, or a related discipline, or equivalent professional experience

Required skills

  • Apache Spark/PySpark, CI/CD, Databricks, Delta Lake, ETL/ELT Data Pipelines, Generative AI and LLM Engineering, Machine Learning, Microsoft Azure, Prompt Engineering, Python, Retrieval-Augmented Generation (RAG), SQL

Preferred skills

  • Experience with Azure Databricks and Azure AI services

Experience

  • Mid level

Job details

Employment type

Contract

Seniority level

Mid level

Date posted

Nov 13, 2026

Work mode

Remote

Job source

linkedin.com

Company

KPG99 INC

Information Technology & AI

Business and technology consulting, development, and staffing services

See all 5 jobs from KPG99 INC →
  • Hamilton, Ohio, USA
  • Information Technology & AI
  • 51-200 employees
  • Founded 2013
  • kpg99.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs

Curana Health

1d ago

New

Data Engineer

Full-timeRemoteUnited StatesCompetitive

Curana Health is hiring a Data Engineer to build, optimize, and maintain data pipelines supporting clinical, operational, and analytical reporting.

Why similarSame roleDatabricksPython

Coinbase

1d ago

New

Senior Software Engineer, Data Engineering Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer for its Data Platform team. The role builds and maintains SDKs, self-service applications, reusable abstractions, and security and observability tooling that help internal teams create, manage, and use data…

Why similarSame roleDatabricksPython

R Systems

1d ago

New

AI Data Engineer

Full-timeOn-siteUnited StatesCompetitive

R Systems is hiring an AI Data Engineer to design, build, and maintain data pipelines, lakehouses, and retrieval infrastructure for production AI, machine learning, and generative AI applications.

Why similarSame rolePythonSQL

Get new Data Engineer jobs by email

Create job alert

Data & AI / LLM Engineer

KPG99 INC · Competitive

Apply on company site