Data Engineer

Responsibilities

Pipeline Development — Design, develop, test, and maintain scalable, reliable data pipelines within Databricks, using PySpark, SQL, Delta Lake, and Databricks Workflows/Jobs

Build ETL/ELT processes that ingest, transform, and deliver data from a variety of source systems into curated, analytics-ready datasets

Implement data quality checks, validation logic, and monitoring/alerting to ensure pipeline reliability and data accuracy

Escalation & Production Support — Act as a primary point of escalation for production data pipeline issues, performing root-cause analysis, troubleshooting failures, and implementing timely fixes

Partner with support and business teams to triage incoming issues, communicate status, and drive incidents to resolution within SLA

Document recurring issues and implement long-term fixes or process improvements to reduce future escalations

Azure-to-Databricks Migration — Lead and execute the migration of existing Azure Data Factory pipelines and Azure Functions to the Databricks platform, re-architecting logic as needed to leverage Databricks-native capabilities

Validate data parity and pipeline performance between legacy Azure-based solutions and their Databricks replacements, ensuring a clean, low-risk cutover

Retire legacy Azure Data Factory/Azure Functions components once migrations are validated and stable

Collaboration & Best Practices — Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical designs

Follow version control, code review, and CI/CD best practices for all pipeline code and configuration

Contribute to documentation of pipeline architecture, data flows, and operational runbooks

Embody AnewHealth’s Core Values in all communications and interactions

Other duties as assigned

Benefits

For full-time employees: medical, dental, and vision coverage (effective the 1st of the month following date of hire)

For full-time employees: flexible spending

For full-time employees: company-paid life insurance

For full-time employees: short-term disability

For full-time employees: voluntary benefits

For full-time employees: 401(k)

For full-time employees: Paid Time Off

For full-time employees: paid holidays

Remote position

AnewHealth is a pharmacy care that enhances healthcare outcomes by offering an assortment of solutions, comprising full pharmacy services.

Wauwatosa, Wisconsin, USA

https://anewhealthrx.com

Late Stage

Total Funding

unknown

Key Investors

Vistria Group

2024-07-22

Private Equity

Leadership Team

Brian Adams

President and CEO

Recent News

AnewHealth Names Ken Burdick Chairman of Board of Directors

2025-12-02

Company data provided by

AI Tools

Customize Your Resume

Maximize your interview chances

Build Cover Letter

Qualifications

Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience

Required: 3+ years of experience as a Data Engineer building and supporting production data pipelines

Hands-on experience developing data pipelines in Databricks, including PySpark, Delta Lake, and Databricks Workflows/Jobs

Experience with Azure Data Factory and/or Azure Functions, with the ability to interpret existing ADF pipelines/Functions and re-implement them in Databricks

Strong SQL skills, including query optimization and experience with relational and dimensional data models

Proficiency in Python for data engineering and pipeline automation

Working knowledge of the broader Azure cloud ecosystem (e.g., Azure Data Lake Storage, Azure SQL Database, Azure Key Vault)

Solid understanding of ETL/ELT design patterns, data warehousing concepts, and data quality/validation practices

Strong troubleshooting and analytical skills, with the ability to diagnose and resolve production issues under time pressure

Excellent communication skills, with the ability to explain technical issues clearly to both technical and non-technical stakeholders

Applicants must be eligible to work in this country

Required: 3+ years of experience as a Data Engineer building and supporting production data pipelines.

Required skills

Databricks, PySpark, SQL, Delta Lake, Databricks Workflows/Jobs, Azure Data Factory, Azure Functions, Python, Azure Data Lake Storage, Azure SQL Database, Azure Key Vault, ETL/ELT, Data Warehousing, Data Quality and Validation

Experience

3+ years