← Back to jobsJob ID col-cmv8f66lp062hoz01uz7gswe9

HAVIPosted 30+ days ago

Data Engineer

Full-time
Hybrid
3+ years
$100K – $115K/yr
Posted 30+ days ago

Responsibilities Responsible for working with the data management, data science, decision science, and technology teams to address supply chain data needs in demand and supply planning, replenishment, pricing, and optimization Develop/refine the data requirements, design/develop data deliverables, and optimize data pipelines in non-production and production environments Design, build, and manage/monitor data pipeline

Posted
30+ Days Ago
Source
jobs.havi.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Responsible for working with the data management, data science, decision science, and technology teams to address supply chain data needs in demand and supply planning, replenishment, pricing, and optimization
  • Develop/refine the data requirements, design/develop data deliverables, and optimize data pipelines in non-production and production environments
  • Design, build, and manage/monitor data pipelines for data structures encompassing data transformation, data models, schemas, metadata, and workload management. The ability to work with both IT and business
  • Integrate analytics and data science output into business processes and workflows
  • Build and optimize data pipelines, pipeline architectures, and integrated datasets. These should include ETL/ELT, data replication/CI-CD, API design, and access
  • Work with and optimize existing ETL processes and data integration and preparation flows and help move them to production
  • Work with popular data discovery, analytics, and BI and AI tools in semantic-layer data discovery
  • Adept in agile methodologies and capable of applying DevOps and DataOps principles to data pipelines to improve communication, integration, reuse, and automation of data flows between data managers and data consumers across the organization
  • Implement Agentic AI capability to drive efficiency and opportunity

Qualifications

  • Bachelor's degree in computer science, data management, information systems, information science or a related field
  • 3+ years in data engineering building production data pipelines (batch and/or streaming) with Spark on cloud
  • 2+ years hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake) including Delta Lake operations (MERGE/CDC, OPTIMIZE/Z-ORDER, VACUUM, partitioning, schema evolution)
  • Unity Catalog (RBAC, permissions, lineage, data masking/row-level access)
  • Databricks Jobs/Workflows or Delta Live Tables
  • Azure Data Factory for orchestration (pipelines, triggers, parameterization, IRs) and integration with ADLS Gen2, Key Vault
  • Strong SQL across large datasets; performance tuning (joins, partitions, file sizing)
  • Data quality at scale (e.g., Great Expectations/Deequ), monitoring and alerting; debug/backfill playbooks
  • DevOps for data: Git branching, code reviews, unit/integration testing (pytest/dbx), CI/CD (Azure DevOps/GitHub Actions)
  • Infrastructure as Code (Terraform or Bicep) for Databricks workspaces, cluster policies, ADF, storage
  • Observability & cost control: Azure Monitor/Log Analytics; cluster sizing, autoscaling, Photon; cost/perf trade-offs
  • Proven experience collaborating with cross-functional stakeholders (analytics, data governance, product, security) to ship and support data products

Preferred

  • advanced degree in computer science, data management, information systems, information science or a related field

Required skills

SparkAzure DatabricksPySparkScalaSpark SQLDelta LakeDelta Lake MERGEDelta Lake CDCDelta Lake OPTIMIZEDelta Lake Z-ORDERDelta Lake VACUUMDelta Lake partitioningDelta Lake schema evolutionUnity Catalog RBAC

Full job description

Responsibilities

  • Responsible for working with the data management, data science, decision science, and technology teams to address supply chain data needs in demand and supply planning, replenishment, pricing, and optimization
  • Develop/refine the data requirements, design/develop data deliverables, and optimize data pipelines in non-production and production environments
  • Design, build, and manage/monitor data pipelines for data structures encompassing data transformation, data models, schemas, metadata, and workload management. The ability to work with both IT and business
  • Integrate analytics and data science output into business processes and workflows
  • Build and optimize data pipelines, pipeline architectures, and integrated datasets. These should include ETL/ELT, data replication/CI-CD, API design, and access
  • Work with and optimize existing ETL processes and data integration and preparation flows and help move them to production
  • Work with popular data discovery, analytics, and BI and AI tools in semantic-layer data discovery
  • Adept in agile methodologies and capable of applying DevOps and DataOps principles to data pipelines to improve communication, integration, reuse, and automation of data flows between data managers and data consumers across the organization
  • Implement Agentic AI capability to drive efficiency and opportunity

Preferred

  • advanced degree in computer science, data management, information systems, information science or a related field

Benefits

  • Generous medical, dental, vision and other great benefits
  • Paid parental and medical leave programs
  • 401(k) with a company match component and profit sharing
  • 15 days of paid time off plus company holidays
  • Hybrid work model with flexibility
  • Tuition reimbursement and student loan repayment assistance
  • Inclusive employee resource groups

Qualifications

  • Bachelor's degree in computer science, data management, information systems, information science or a related field
  • 3+ years in data engineering building production data pipelines (batch and/or streaming) with Spark on cloud
  • 2+ years hands-on Azure Databricks (PySpark/Scala, Spark SQL, Delta Lake) including Delta Lake operations (MERGE/CDC, OPTIMIZE/Z-ORDER, VACUUM, partitioning, schema evolution)
  • Unity Catalog (RBAC, permissions, lineage, data masking/row-level access)
  • Databricks Jobs/Workflows or Delta Live Tables
  • Azure Data Factory for orchestration (pipelines, triggers, parameterization, IRs) and integration with ADLS Gen2, Key Vault
  • Strong SQL across large datasets; performance tuning (joins, partitions, file sizing)
  • Data quality at scale (e.g., Great Expectations/Deequ), monitoring and alerting; debug/backfill playbooks
  • DevOps for data: Git branching, code reviews, unit/integration testing (pytest/dbx), CI/CD (Azure DevOps/GitHub Actions)
  • Infrastructure as Code (Terraform or Bicep) for Databricks workspaces, cluster policies, ADF, storage
  • Observability & cost control: Azure Monitor/Log Analytics; cluster sizing, autoscaling, Photon; cost/perf trade-offs
  • Proven experience collaborating with cross-functional stakeholders (analytics, data governance, product, security) to ship and support data products
  • Advanced degree in computer science, data management, information systems, information science or a related field

Required skills

  • Spark, Azure Databricks, PySpark, Scala, Spark SQL, Delta Lake, Delta Lake MERGE, Delta Lake CDC, Delta Lake OPTIMIZE, Delta Lake Z-ORDER, Delta Lake VACUUM, Delta Lake partitioning, Delta Lake schema evolution, Unity Catalog RBAC, Unity Catalog permissions, Unity Catalog lineage, Unity Catalog data masking, Unity Catalog row-level access, Databricks Jobs, Databricks Workflows, Delta Live Tables, Azure Data Factory, Azure Data Lake Storage Gen2, Azure Key Vault, SQL, SQL performance tuning, Great Expectations, Deequ, Git branching, Code reviews, Unit testing, Integration testing, pytest, dbx, Azure DevOps, GitHub Actions, Terraform, Bicep, Azure Monitor, Azure Log Analytics, Cluster sizing, Cluster autoscaling, Photon

Experience

  • 3+ years

Company

  • HAVI, part of Morgan Street Holdings, a Chicago-based company and private investment group, is a global leader in integrated supply chain management for the food industry, providing end-to-end solutions for retail, quick-service restaurants (QSR), and food service (FSR) in over 30 markets.
  • Chicago, Illinois, USA
  • https://havigs.com

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Oct 1, 2026

Work mode

Hybrid

Job source

jobs.havi.com

Company

HAVI

Information Technology & AI

HAVI, part of Morgan Street Holdings, a Chicago-based company and private investment group, is a global leader in integrated supply chain management for the food industry, providing end-to-end solutions for retail, quick-service restaurants (QSR), and food service (FSR) in over 30 markets.

See all 3 jobs from HAVI →
  • Chicago, Illinois, USA
  • Information Technology & AI
  • havigs.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Chicago

Diverse Lynx

1d ago

New

Data Engineer || Quincy, MA

Full-timeOn-siteQuincy, MACompetitive

Diverse Lynx is recruiting a Data Engineer for a confidential client. The role focuses on building and developing data ingestion, streaming, and transformation solutions using Azure Databricks, as well as supporting data warehouse and lakehouse…

Why similarSame roleDelta LakePySpark

Curana Health

1d ago

New

Data Engineer

Full-timeRemoteUnited StatesCompetitive

Curana Health is hiring a Data Engineer to build, optimize, and maintain data pipelines supporting clinical, operational, and analytical reporting.

Why similarSame rolePySparkRemote

United Software Group Inc

1d ago

New

Azure Data Engineer (ADF) with Databricks Agentic experience for Marketing AI

TemporaryRemoteUnited StatesCompetitive

United Software Group Inc is seeking an Azure Data Engineer for a Marketing AI role. The position calls for Azure Databricks, Azure Data Factory, PySpark, Git, Databricks Agentic experience, and knowledge graph expertise or working knowledge.

Why similarSame roleAzure DatabricksRemote

Get new Data Engineer jobs in Chicago by email

Create job alert

Data Engineer

HAVI · $100K – $115K/yr

Apply on company site