← Back to jobsJob ID col-cmwpde5aa0ayzd8haae23xope

Bright Vision TechnologiesPosted 1 day ago

Senior Data EngineerNew

Contract
On-site
13+ years
Competitive
Posted 1 day ago

Bright Vision Technologies is recruiting a Senior Data Engineer for an unnamed insurance industry client in Charlotte, NC. The role focuses on building and maintaining scalable data pipelines and integrating AI Agent capabilities into enterprise data workflows.

Posted
1 day ago
Source
brightvisiontechnologies.applytojob.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks and Python
  • Build and optimize ETL/ELT workflows for processing structured and unstructured data
  • Develop data transformation solutions using PySpark, Spark SQL, and Python
  • Work with Databricks Lakehouse architecture, Delta Lake, and Unity Catalog
  • Implement batch and real-time data processing solutions
  • Develop reusable data engineering frameworks and optimize data processing performance
  • Integrate data from multiple enterprise systems, APIs, databases, and cloud platforms
  • Implement data quality checks, validation, monitoring, and error-handling mechanisms
  • Collaborate with data architects, data scientists, AI engineers, and business stakeholders
  • Support AI Agent configuration, development, and implementation within enterprise workflows
  • Integrate AI Agents with enterprise data sources, APIs, and backend services
  • Assist in implementing Retrieval-Augmented Generation (RAG) workflows and AI-powered data solutions
  • Follow best practices for data security, governance, scalability, and performance

Qualifications

  • Experience Required: 13+ Years
  • The Data Engineer with strong hands-on expertise in Databricks and Python to join our insurance industry client in Charlotte, NC. The ideal candidate will have extensive experience designing, developing, and maintaining scalable data engineering solutions using Databricks, Python, and modern cloud-based data platforms
  • Additionally, the candidate should have exposure to AI Agent configuration, development, and implementation, including integrating AI-powered capabilities into enterprise data workflows
  • Strong hands-on experience with Databricks and its ecosystem
  • Strong programming experience in Python
  • Hands-on experience with PySpark, Spark SQL, and Apache Spark
  • Experience building complex ETL/ELT data pipelines
  • Strong understanding of data warehousing, data lakes, and Lakehouse architecture
  • Experience with Delta Lake and Databricks workflows
  • Experience with SQL and relational databases
  • Understanding of cloud platforms such as AWS, Azure, or GCP
  • Exposure to AI Agent configuration, development, and implementation
  • Understanding of REST APIs and integration with enterprise applications

Preferred

  • Candidates with prior experience in the insurance industry, particularly in building data solutions for policy administration, claims processing, underwriting, billing, or customer analytics, will be preferred
  • Insurance Industry Experience

Required skills

AI AgentsAWSApache SparkDatabricksDelta LakeETL/ELTGoogle Cloud PlatformLakehouse ArchitectureMicrosoft AzurePySparkPythonREST APIsRelational DatabasesSQL

Full job description

Bright Vision Technologies is recruiting a Senior Data Engineer for an unnamed insurance industry client in Charlotte, NC. The role focuses on building and maintaining scalable data pipelines and integrating AI Agent capabilities into enterprise data workflows.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks and Python
  • Build and optimize ETL/ELT workflows for processing structured and unstructured data
  • Develop data transformation solutions using PySpark, Spark SQL, and Python
  • Work with Databricks Lakehouse architecture, Delta Lake, and Unity Catalog
  • Implement batch and real-time data processing solutions
  • Develop reusable data engineering frameworks and optimize data processing performance
  • Integrate data from multiple enterprise systems, APIs, databases, and cloud platforms
  • Implement data quality checks, validation, monitoring, and error-handling mechanisms
  • Collaborate with data architects, data scientists, AI engineers, and business stakeholders
  • Support AI Agent configuration, development, and implementation within enterprise workflows
  • Integrate AI Agents with enterprise data sources, APIs, and backend services
  • Assist in implementing Retrieval-Augmented Generation (RAG) workflows and AI-powered data solutions
  • Follow best practices for data security, governance, scalability, and performance

Preferred

  • Candidates with prior experience in the insurance industry, particularly in building data solutions for policy administration, claims processing, underwriting, billing, or customer analytics, will be preferred
  • Insurance Industry Experience
  • Data Solution Development
  • Policy Administration
  • Claims Processing
  • Underwriting
  • Billing
  • Customer Analytics

Benefits

  • Tremendous career growth potential

Company

  • AI-powered talent intelligence and enterprise automation platform
  • Bridgewater, New Jersey, USA
  • https://bvteck.com/
  • Founded in 2020
  • 51-200 employees

Qualifications

  • Experience Required: 13+ Years
  • The Data Engineer with strong hands-on expertise in Databricks and Python to join our insurance industry client in Charlotte, NC. The ideal candidate will have extensive experience designing, developing, and maintaining scalable data engineering solutions using Databricks, Python, and modern cloud-based data platforms
  • Additionally, the candidate should have exposure to AI Agent configuration, development, and implementation, including integrating AI-powered capabilities into enterprise data workflows
  • Strong hands-on experience with Databricks and its ecosystem
  • Strong programming experience in Python
  • Hands-on experience with PySpark, Spark SQL, and Apache Spark
  • Experience building complex ETL/ELT data pipelines
  • Strong understanding of data warehousing, data lakes, and Lakehouse architecture
  • Experience with Delta Lake and Databricks workflows
  • Experience with SQL and relational databases
  • Understanding of cloud platforms such as AWS, Azure, or GCP
  • Exposure to AI Agent configuration, development, and implementation
  • Understanding of REST APIs and integration with enterprise applications
  • Candidates with prior experience in the insurance industry, particularly in building data solutions for policy administration, claims processing, underwriting, billing, or customer analytics, will be preferred

Required skills

  • AI Agents, AWS, Apache Spark, Databricks, Delta Lake, ETL/ELT, Google Cloud Platform, Lakehouse Architecture, Microsoft Azure, PySpark, Python, REST APIs, Relational Databases, SQL, Spark SQL

Experience

  • 13+ years

Job details

Employment type

Contract

Seniority level

13+ years

Date posted

Nov 20, 2026

Work mode

On-site

Job source

brightvisiontechnologies.applytojob.com

Company

Bright Vision Technologies

Information Technology & AI

AI-powered talent intelligence and enterprise automation platform

See all 19 jobs from Bright Vision Technologies →
  • Bridgewater, New Jersey, USA
  • Information Technology & AI
  • 51-200 employees
  • Founded 2020
  • bvteck.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Charlotte

Dexian

1d ago

New

Data Engineer

Full-timeHybridCharlotte, NCCompetitive

Dexian is recruiting for a Data Engineer role; the hiring client is not identified. The role focuses on enterprise data platform administration and development, including Cloudera, distributed data processing, cloud platforms, and production support.

Why similarSame roleApache SparkCharlotte

Dice

1d ago

New

Data Engineer (W2 only)

TemporaryOn-siteDurham, NCCompetitive

Dice lists a Data Engineer role focused on designing, building, and managing data architecture. The role develops and optimizes ETL processes, data pipelines, databases, and cloud-based storage to support analysis and reporting.

Why similarSame rolePythonDurham

Modis

1d ago

New

AWS Data Engineer

TemporaryOn-siteRichmond, VACompetitive

Modis is recruiting for a client in Richmond, VA, for a contract Data Engineer role. The role focuses on developing, enhancing, and supporting large-scale data processing workflows and ETL pipelines using Spark, Scala, and AWS.

Why similarSame roleAWSApache Spark

Get new Data Engineer jobs in Charlotte by email

Create job alert

Senior Data Engineer

Bright Vision Technologies · Competitive

Apply on company site