← Back to jobsJob ID col-cmv8k6kwi0c7doz01pp28wxl4

On-Demand GroupPosted 30+ days ago

Data Engineer

Full-time
Remote
3+ years
Competitive
Posted 30+ days ago

On-Demand Group is seeking a Data Engineer to design, develop, and maintain data pipelines and solutions using Databricks, SQL, and PySpark. The role focuses on reliable data delivery, data quality, modernizing pipelines, and supporting business reporting, analytics, and data science initiatives.

Posted
30+ Days Ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, develop, test, and maintain data pipelines using Databricks, SQL, and PySpark
  • Modernize existing pipelines and improve performance, reliability, and maintainability
  • Develop and manage data transformations and reporting-layer datasets to support business analytics and reporting
  • Monitor, troubleshoot, and resolve pipeline issues to ensure accurate and timely data delivery
  • Create and maintain technical documentation, including data mappings, lineage, and data dictionaries
  • Collaborate with the team on solution design, development standards, and continuous improvement initiatives
  • Partner with business stakeholders and analytics teams to understand data requirements and develop solutions that support business needs
  • Implement data quality checks, validation processes, and reconciliation procedures to ensure data accuracy and integrity
  • Troubleshoot data integration issues and identify opportunities to improve existing processes
  • Communicate project progress, technical challenges, and potential solutions to team members and stakeholders
  • Take ownership of assigned development tasks while collaborating with the broader team
  • Contribute to improving data engineering practices, coding standards, and development processes
  • Stay current with relevant data engineering technologies and apply new techniques when appropriate
  • Collaborate with team members to support analytics, automation, and future data initiatives
  • Participate in team discussions, knowledge sharing, and continuous improvement efforts

Qualifications

  • 3+ years of hands-on data engineering or related development experience
  • Strong hands-on experience with Databricks, including developing and maintaining production data pipelines
  • Proficiency in SQL and PySpark for data transformations, processing, and pipeline development
  • Experience with ETL/ELT development, data warehousing, and data integration
  • Experience implementing data quality checks, testing, validation, and troubleshooting
  • Familiarity with data modeling and developing datasets for analytics and reporting
  • Experience working with cloud-based data environments
  • Strong problem-solving skills and ability to independently manage assigned development tasks
  • Effective communication skills and experience collaborating with technical and business stakeholders

Preferred

  • Experience with Microsoft Azure, including Azure Data Factory
  • Experience with Snowflake, Delta Lake, and Databricks notebooks
  • Familiarity with Azure DevOps, Jira, Git, or similar development tools

Required skills

DatabricksSQLPySparkETL/ELT DevelopmentData WarehousingData IntegrationData Quality ValidationData ModelingMicrosoft AzureAzure Data FactorySnowflakeDelta LakeAzure DevOpsJira

Full job description

On-Demand Group is seeking a Data Engineer to design, develop, and maintain data pipelines and solutions using Databricks, SQL, and PySpark. The role focuses on reliable data delivery, data quality, modernizing pipelines, and supporting business reporting, analytics, and data science initiatives.

Responsibilities

  • Design, develop, test, and maintain data pipelines using Databricks, SQL, and PySpark
  • Modernize existing pipelines and improve performance, reliability, and maintainability
  • Develop and manage data transformations and reporting-layer datasets to support business analytics and reporting
  • Monitor, troubleshoot, and resolve pipeline issues to ensure accurate and timely data delivery
  • Create and maintain technical documentation, including data mappings, lineage, and data dictionaries
  • Collaborate with the team on solution design, development standards, and continuous improvement initiatives
  • Partner with business stakeholders and analytics teams to understand data requirements and develop solutions that support business needs
  • Implement data quality checks, validation processes, and reconciliation procedures to ensure data accuracy and integrity
  • Troubleshoot data integration issues and identify opportunities to improve existing processes
  • Communicate project progress, technical challenges, and potential solutions to team members and stakeholders
  • Take ownership of assigned development tasks while collaborating with the broader team
  • Contribute to improving data engineering practices, coding standards, and development processes
  • Stay current with relevant data engineering technologies and apply new techniques when appropriate
  • Collaborate with team members to support analytics, automation, and future data initiatives
  • Participate in team discussions, knowledge sharing, and continuous improvement efforts

Preferred

  • Experience with Microsoft Azure, including Azure Data Factory
  • Experience with Snowflake, Delta Lake, and Databricks notebooks
  • Familiarity with Azure DevOps, Jira, Git, or similar development tools
  • Microsoft Azure
  • Azure Data Factory
  • Snowflake
  • Delta Lake
  • Databricks Notebooks
  • Azure DevOps
  • Jira
  • Git

Benefits

  • Healthcare, dental, and vision insurance
  • Bonus

Company

  • Tech consulting and IT talent staffing services
  • Minneapolis, Minnesota, USA
  • http://www.ondemandgroup.com/
  • Founded in 1996
  • 201-500 employees

Qualifications

  • 3+ years of hands-on data engineering or related development experience
  • Strong hands-on experience with Databricks, including developing and maintaining production data pipelines
  • Proficiency in SQL and PySpark for data transformations, processing, and pipeline development
  • Experience with ETL/ELT development, data warehousing, and data integration
  • Experience implementing data quality checks, testing, validation, and troubleshooting
  • Familiarity with data modeling and developing datasets for analytics and reporting
  • Experience working with cloud-based data environments
  • Strong problem-solving skills and ability to independently manage assigned development tasks
  • Effective communication skills and experience collaborating with technical and business stakeholders
  • Experience with Microsoft Azure, including Azure Data Factory
  • Experience with Snowflake, Delta Lake, and Databricks notebooks
  • Familiarity with Azure DevOps, Jira, Git, or similar development tools
  • 3+ years of hands-on data engineering or related development experience.

Required skills

  • Databricks, SQL, PySpark, ETL/ELT Development, Data Warehousing, Data Integration, Data Quality Validation, Data Modeling, Microsoft Azure, Azure Data Factory, Snowflake, Delta Lake, Azure DevOps, Jira, Git

Experience

  • 3+ years

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Oct 14, 2026

Work mode

Remote

Job source

linkedin.com

Company

On-Demand Group

Information Technology & AI

Tech consulting and IT talent staffing services

  • Minneapolis, Minnesota, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 1996
  • ondemandgroup.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs

Curana Health

1d ago

New

Data Engineer

Full-timeRemoteUnited StatesCompetitive

Curana Health is hiring a Data Engineer to build, optimize, and maintain data pipelines supporting clinical, operational, and analytical reporting.

Why similarSame roleAzure Data FactoryRemote

Coinbase

1d ago

New

Senior Software Engineer, Data Engineering Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer for its Data Platform team. The role builds and maintains SDKs, self-service applications, reusable abstractions, and security and observability tooling that help internal teams create, manage, and use data…

Why similarSame roleDatabricksRemote

Tech Consulting

1d ago

New

Data Engineer

Full-timeOn-siteManchester, NHCompetitive

Tech Consulting is hiring a Data Engineer to build and maintain data pipelines, ETL/ELT workflows, and data platforms. The role supports data integration, data quality, cloud-based solutions, and collaboration on data-driven projects.

Why similarSame roleData ModelingMicrosoft Azure

Get new Data Engineer jobs by email

Create job alert

Data Engineer

On-Demand Group · Competitive

Apply on company site