← Back to jobsJob ID col-cmv8fernw06cpoz01xfts5ox5

Zurich North AmericaPosted 30+ days ago

Data Engineer - Databricks

Full-time
On-site
3+ years
Competitive
Posted 30+ days ago

Zurich North America is seeking a Data Engineer - Databricks to join their Capability Center. The main responsibilities include designing and maintaining scalable data pipelines, optimizing ETL processes, and collaborating with various teams to ensure data quality and support analytics initiatives.

Posted
30+ Days Ago
Source
Ethic Leaf recruiter
Sector
Information Technology & AI

No employer link yet — an Ethic Leaf recruiter forwards your application

Responsibilities

  • Design, build, and maintain scalable data pipelines using Databricks and cloud-based data platforms
  • Develop, optimize, and automate ETL/ELT processes to support analytics, reporting, and machine learning initiatives
  • Work closely with Data Scientists, Analysts, ML Engineers, and business stakeholders to understand data requirements and deliver reliable datasets
  • Implement data ingestion frameworks from multiple structured and unstructured data sources
  • Build and maintain data models, data lakes, and data warehouses that support enterprise analytics needs
  • Ensure data quality, consistency, governance, and security across platforms
  • Optimize Spark workloads and Databricks environments for performance and cost efficiency
  • Support deployment and operationalization of machine learning solutions by providing production-ready datasets and feature pipelines
  • Collaborate with Azure, IT, and DevOps teams to implement CI/CD and DataOps best practices
  • Monitor, troubleshoot, and continuously improve data platform performance and reliability

Qualifications

  • Bachelor's Degree in Computer Science, Engineering, Information Systems, Mathematics, or a related field
  • 3+ years of experience in Data Engineering, Data Warehousing, or Big Data environments
  • Strong programming skills in Python and SQL
  • Hands-on experience with Databricks, Apache Spark, and distributed data processing
  • Experience designing and developing ETL/ELT data pipelines
  • Experience working with Data Lakes and modern data architectures
  • Understanding of data modeling concepts including Star Schema and Dimensional Modeling
  • Experience working with Git and version control systems
  • Strong analytical and problem-solving skills
  • English level B2 or higher

Preferred

  • Experience with Azure Data Platform services, including: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Azure DevOps
  • Experience working with Delta Lake and Lakehouse architecture
  • Knowledge of orchestration tools such as Airflow, Databricks Workflows, or Azure Data Factory
  • Experience supporting Machine Learning use cases and MLOps practices
  • Familiarity with MLflow and model deployment processes
  • Knowledge of CI/CD, Infrastructure as Code, and DataOps practices
  • Experience with streaming technologies such as Kafka or Event Hubs
  • Experience working in Agile environments
  • Insurance industry experience is a plus
  • Azure Data Lake Storage
  • Insurance industry experience
  • Agile experience

Required skills

DatabricksApache SparkPythonSQLETL/ELT data pipelinesData LakesData WarehousingGitAzure DatabricksAzure Data FactoryAzure Synapse AnalyticsAzure DevOpsDelta Lake

Full job description

Zurich North America is seeking a Data Engineer - Databricks to join their Capability Center. The main responsibilities include designing and maintaining scalable data pipelines, optimizing ETL processes, and collaborating with various teams to ensure data quality and support analytics initiatives.

Responsibilities

  • Design, build, and maintain scalable data pipelines using Databricks and cloud-based data platforms
  • Develop, optimize, and automate ETL/ELT processes to support analytics, reporting, and machine learning initiatives
  • Work closely with Data Scientists, Analysts, ML Engineers, and business stakeholders to understand data requirements and deliver reliable datasets
  • Implement data ingestion frameworks from multiple structured and unstructured data sources
  • Build and maintain data models, data lakes, and data warehouses that support enterprise analytics needs
  • Ensure data quality, consistency, governance, and security across platforms
  • Optimize Spark workloads and Databricks environments for performance and cost efficiency
  • Support deployment and operationalization of machine learning solutions by providing production-ready datasets and feature pipelines
  • Collaborate with Azure, IT, and DevOps teams to implement CI/CD and DataOps best practices
  • Monitor, troubleshoot, and continuously improve data platform performance and reliability

Preferred

  • Experience with Azure Data Platform services, including: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Azure DevOps
  • Experience working with Delta Lake and Lakehouse architecture
  • Knowledge of orchestration tools such as Airflow, Databricks Workflows, or Azure Data Factory
  • Experience supporting Machine Learning use cases and MLOps practices
  • Familiarity with MLflow and model deployment processes
  • Knowledge of CI/CD, Infrastructure as Code, and DataOps practices
  • Experience with streaming technologies such as Kafka or Event Hubs
  • Experience working in Agile environments
  • Insurance industry experience is a plus
  • Azure Data Platform
  • Azure Databricks
  • Azure Data Factory
  • Azure Data Lake Storage
  • Azure Synapse Analytics
  • Azure DevOps
  • Delta Lake
  • Lakehouse architecture
  • Airflow
  • Databricks Workflows
  • Machine Learning
  • MLOps
  • MLflow
  • model deployment
  • CI/CD
  • Infrastructure as Code
  • DataOps
  • streaming technologies
  • Kafka
  • Event Hubs
  • Insurance industry experience
  • Agile experience

Company

  • Property, casualty, and life insurance for businesses and individuals
  • Schaumburg, Illinois, USA
  • https://www.zurichna.com/
  • Founded in 2016
  • 5001-10000 employees

Qualifications

  • Bachelor's Degree in Computer Science, Engineering, Information Systems, Mathematics, or a related field
  • 3+ years of experience in Data Engineering, Data Warehousing, or Big Data environments
  • Strong programming skills in Python and SQL
  • Hands-on experience with Databricks, Apache Spark, and distributed data processing
  • Experience designing and developing ETL/ELT data pipelines
  • Experience working with Data Lakes and modern data architectures
  • Understanding of data modeling concepts including Star Schema and Dimensional Modeling
  • Experience working with Git and version control systems
  • Strong analytical and problem-solving skills
  • English level B2 or higher
  • Experience with Azure Data Platform services, including: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Azure DevOps
  • Experience working with Delta Lake and Lakehouse architecture
  • Knowledge of orchestration tools such as Airflow, Databricks Workflows, or Azure Data Factory
  • Experience supporting Machine Learning use cases and MLOps practices
  • Familiarity with MLflow and model deployment processes
  • Knowledge of CI/CD, Infrastructure as Code, and DataOps practices
  • Experience with streaming technologies such as Kafka or Event Hubs
  • Experience working in Agile environments
  • Insurance industry experience is a plus
  • 3+ years of experience in Data Engineering, Data Warehousing, or Big Data environments.

Required skills

  • Databricks, Apache Spark, Python, SQL, ETL/ELT data pipelines, Data Lakes, Data Warehousing, Data modeling - Star Schema, Data modeling - Dimensional Modeling, Git, Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Azure DevOps, Delta Lake, Lakehouse architecture, Airflow, Databricks Workflows, MLOps, MLflow, CI/CD, Infrastructure as Code, DataOps, Kafka, Event Hubs, Agile

Preferred skills

  • Familiarity with MLflow and model deployment processes, Experience working in Agile environments, Insurance industry experience is a plus

Experience

  • 3+ years

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Oct 3, 2026

Work mode

On-site

Job source

Ethic Leaf recruiter

Company

Zurich North America

Information Technology & AI

Property, casualty, and life insurance for businesses and individuals

  • Schaumburg, Illinois, USA
  • Information Technology & AI
  • 5001-10000 employees
  • Founded 2016
  • zurichna.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in United States

United Software Group Inc

1d ago

New

Azure Data Engineer (ADF) with Databricks Agentic experience for Marketing AI

TemporaryRemoteUnited StatesCompetitive

United Software Group Inc is seeking an Azure Data Engineer for a Marketing AI role. The position calls for Azure Databricks, Azure Data Factory, PySpark, Git, Databricks Agentic experience, and knowledge graph expertise or working knowledge.

Why similarSame roleAzure Data FactoryAzure Databricks

R Systems

1d ago

New

AI Data Engineer

Full-timeOn-siteUnited StatesCompetitive

R Systems is hiring an AI Data Engineer to design, build, and maintain data pipelines, lakehouses, and retrieval infrastructure for production AI, machine learning, and generative AI applications.

Why similarSame roleApache SparkGit

Curana Health

1d ago

New

Data Engineer

Full-timeRemoteUnited StatesCompetitive

Curana Health is hiring a Data Engineer to build, optimize, and maintain data pipelines supporting clinical, operational, and analytical reporting.

Why similarSame roleAzure Data FactoryData Warehousing

Get new Data Engineer jobs in United States by email

Create job alert

Data Engineer - Databricks

Zurich North America · Competitive

Apply via Ethic Leaf