← Back to jobsJob ID col-cmvgy4xy7003us3ctdkwkhqys

Essentia HealthPosted 30+ days ago

Data Engineer II

Full-time
On-site
2–5 years
$90K – $134K/yr
Posted 30+ days ago

Essentia Health is hiring a Data Engineer II to design and optimize scalable data pipelines and workflows. The role implements advanced data processing, supports data quality and governance, and collaborates with stakeholders to deliver reliable data systems and business-critical insights.

Posted
30+ Days Ago
Source
apply.j-vers.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Designs and optimizes scalable and robust data pipelines and workflows to handle large datasets to meet functional and non-functional business requirement
  • Implements advanced data processing and scheduling techniques using frameworks like Apache Spark, ADF and Airflow
  • Write and optimize advanced SQL queries for reporting and applications
  • Ensures data quality, governance, and security through automated testing and monitoring solutions
  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements
  • Provide technical guidance and mentorship to junior data engineers
  • Develop infrastructure to support real-time and batch processing workflows
  • Deliver actionable data products and insights for business-critical tools

Qualifications

  • Bachelor's degree in computer science, data analytics, statistics, or related field
  • 2-5 years of experience in data engineering or a related role
  • Proficiency in SQL and experience with database management systems
  • Strong programming skills in languages such as Python, Java, or Scala
  • Experience with pipelines using orchestration tools such as Apache Airflow or AWS Glue for seamless data ingestion and delivery
  • Experience with modern data management technologies (e.g., data lake, lakehouse, data catalogs)
  • Experience supporting both batch and streaming data, enabling near real-time analytics and reporting

Preferred

  • Familiarity with applying AI and machine learning techniques to data use cases
  • Experience creating robust data transformation workflows, including metadata management, dependency tracking, and workload orchestration
  • Experience with DBT
  • Experience with Microsoft Fabric
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills
  • Attention to Detail

Required skills

AWS GlueApache AirflowData LakesJavaLakehousesMachine LearningMicrosoft FabricPythonSQLScaladbt

Full job description

Essentia Health is hiring a Data Engineer II to design and optimize scalable data pipelines and workflows. The role implements advanced data processing, supports data quality and governance, and collaborates with stakeholders to deliver reliable data systems and business-critical insights.

Responsibilities

  • Designs and optimizes scalable and robust data pipelines and workflows to handle large datasets to meet functional and non-functional business requirement
  • Implements advanced data processing and scheduling techniques using frameworks like Apache Spark, ADF and Airflow
  • Write and optimize advanced SQL queries for reporting and applications
  • Ensures data quality, governance, and security through automated testing and monitoring solutions
  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements
  • Provide technical guidance and mentorship to junior data engineers
  • Develop infrastructure to support real-time and batch processing workflows
  • Deliver actionable data products and insights for business-critical tools

Preferred

  • Familiarity with applying AI and machine learning techniques to data use cases
  • Experience creating robust data transformation workflows, including metadata management, dependency tracking, and workload orchestration
  • Experience with DBT
  • Experience with Microsoft Fabric
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills
  • AI
  • Machine Learning
  • Data Transformation Workflows
  • Metadata Management
  • Dependency Tracking
  • Workload Orchestration
  • dbt
  • Microsoft Fabric
  • Problem-Solving
  • Attention to Detail
  • Communication
  • Collaboration

Benefits

  • Medical, dental, vision, life, and disability insurance, along with supplemental options to fit your needs (benefit eligibility may vary).
  • 401(k) plan with employer contributions (benefit eligibility may vary).
  • Professional development through training, tuition reimbursement, and educational programs (benefit eligibility may vary).
  • Flexible scheduling (benefit eligibility may vary).
  • Generous time off (benefit eligibility may vary).
  • Wellness resources focused on your physical, mental, and emotional health (benefit eligibility may vary).
  • Possible remote work option.

Company

  • Integrated health system serving Minnesota, Wisconsin, and North Dakota
  • Duluth, Minnesota, USA
  • https://www.essentiahealth.org/
  • Founded in 2004
  • 10001+ employees

Qualifications

  • Bachelor's degree in computer science, data analytics, statistics, or related field
  • 2-5 years of experience in data engineering or a related role
  • Proficiency in SQL and experience with database management systems
  • Strong programming skills in languages such as Python, Java, or Scala
  • Experience with pipelines using orchestration tools such as Apache Airflow or AWS Glue for seamless data ingestion and delivery
  • Experience with modern data management technologies (e.g., data lake, lakehouse, data catalogs)
  • Experience supporting both batch and streaming data, enabling near real-time analytics and reporting
  • Familiarity with applying AI and machine learning techniques to data use cases
  • Experience creating robust data transformation workflows, including metadata management, dependency tracking, and workload orchestration
  • Experience with DBT
  • Experience with Microsoft Fabric
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills

Required skills

  • AWS Glue, Apache Airflow, Batch and Streaming Data Processing, Data Lakes, Java, Lakehouses, Machine Learning, Microsoft Fabric, Python, SQL, Scala, dbt

Preferred skills

  • Excellent problem-solving skills and attention to detail, Experience with DBT, Experience with Microsoft Fabric, Strong communication and collaboration skills

Experience

  • 2-5 years

Job details

Employment type

Full-time

Seniority level

2–5 years

Date posted

Oct 20, 2026

Work mode

On-site

Job source

apply.j-vers.com

Company

Essentia Health

Information Technology & AI

Integrated health system serving Minnesota, Wisconsin, and North Dakota

  • Duluth, Minnesota, USA
  • Information Technology & AI
  • 10001+ employees
  • Founded 2004
  • essentiahealth.org

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Duluth

Flow Traders

Today

New

Core Data Engineer

Full-timeOn-siteNew York, NY$165K – $210K/yr

Flow Traders is hiring a Core Data Engineer to own the lifecycle and quality of foundational data products, including market, trading, and reference data.

Why similarSame rolePythonSQL

MaxIT Consulting - Max Corporate Group

6d ago

Data Engineer - ClickHouse, SQLMesh & TypeScript (Fintech)

Full-timeOn-siteNew York, NYCompetitive

MaxIT Consulting is recruiting a Software Engineer, Data Platform for an unnamed financial data and accounting automation platform.

Why similarSame roleDbtPython

Snorkel AI

Today

New

Senior/Staff Forward Deployed Engineer - Data as a Service

Full-timeHybridNew York, NY$180K – $320K/yr

Snorkel AI is a frontier AI data lab that develops datasets, benchmarks, evaluations, and custom solutions for AI systems.

Why similarSame roleMachine LearningPython

Get new Data Engineer jobs in Duluth by email

Create job alert

Data Engineer II

Essentia Health · $90K – $134K/yr

Apply on company site