← Back to jobsJob ID col-cmv8e5ych04utoz01i5qb14wy

Information TechnologyPosted 30+ days ago

Azure Databricks Data Engineer

Full-time
On-site
3+ years
Competitive
Posted 30+ days ago

InnoCore Solutions, Inc. is hiring an Azure Databricks Data Engineer to build, operate, and optimize Azure-based data platforms and Databricks Lakehouse solutions. The role develops scalable batch and streaming pipelines, supports data quality and governance, and delivers reliable analytics data for business reporting and decision-making.

Posted
30+ Days Ago
Source
Ethic Leaf recruiter
Sector
Information Technology & AI

No employer link yet — an Ethic Leaf recruiter forwards your application

Responsibilities

  • Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions
  • Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) and traditional data warehouse tools
  • Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support
  • Design, develop, and maintain scalable data pipelines and transformation jobs on the Databricks Lakehouse Platform to generate business metrics, KPIs, and curated datasets
  • Develop and optimize batch and streaming data pipelines using Databricks, Apache Spark (PySpark/Scala), and Delta Lake technologies
  • Build and maintain data ingestion frameworks from various enterprise source systems into Azure-based data lakes and Databricks environments
  • Implement and maintain Medallion Architecture (Bronze, Silver, and Gold layers) to support analytics and self-service reporting
  • Develop, optimize, and maintain Delta tables and data models to ensure high-performance data processing and analytics
  • Monitor, troubleshoot, and support Databricks workflows, clusters, and production data pipelines to ensure data reliability and availability
  • Implement data quality checks and validation frameworks to ensure data accuracy, completeness, timeliness, and consistency
  • Optimize Spark jobs, cluster utilization, and query performance to improve scalability and cost efficiency
  • Build and deploy Databricks code, workflows, and infrastructure using •GitHub Actions•-based CI/CD pipelines

Qualifications

  • 3+ years of experience in Data Engineering and building enterprise-scale data platforms
  • 3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
  • 3+ years of hands-on experience with Databricks and Apache Spark development using PySpark or Scala
  • Strong experience designing and implementing data pipelines on Azure and Databricks platforms
  • Strong SQL skills and experience with data modeling and dimensional modeling techniques
  • Experience developing and deploying solutions using GitHub Actions and Git-based source control practices
  • Experience with data quality, metadata management, and data governance frameworks
  • Strong troubleshooting, performance tuning, and production support experience in cloud-based data platforms
  • Excellent communication and collaboration skills with the ability to work effectively with global teams
  • Bachelor's degree in Computer Science/Engineering or a related field

Preferred

  • Databricks certifications such as •Databricks Certified Data Engineer Associate
  • or• •Professional •
  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional

Required skills

Azure DatabricksApache SparkPySparkScalaMicrosoft AzureSQLAzure Data FactoryAzure Data Lake StorageGitHub ActionsData ModelingData QualityDatabricks Certified Data Engineer

Nice to have

prefer Microsoft Azure

Full job description

InnoCore Solutions, Inc. is hiring an Azure Databricks Data Engineer to build, operate, and optimize Azure-based data platforms and Databricks Lakehouse solutions. The role develops scalable batch and streaming pipelines, supports data quality and governance, and delivers reliable analytics data for business reporting and decision-making.

Responsibilities

  • Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions
  • Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) and traditional data warehouse tools
  • Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support
  • Design, develop, and maintain scalable data pipelines and transformation jobs on the Databricks Lakehouse Platform to generate business metrics, KPIs, and curated datasets
  • Develop and optimize batch and streaming data pipelines using Databricks, Apache Spark (PySpark/Scala), and Delta Lake technologies
  • Build and maintain data ingestion frameworks from various enterprise source systems into Azure-based data lakes and Databricks environments
  • Implement and maintain Medallion Architecture (Bronze, Silver, and Gold layers) to support analytics and self-service reporting
  • Develop, optimize, and maintain Delta tables and data models to ensure high-performance data processing and analytics
  • Monitor, troubleshoot, and support Databricks workflows, clusters, and production data pipelines to ensure data reliability and availability
  • Implement data quality checks and validation frameworks to ensure data accuracy, completeness, timeliness, and consistency
  • Optimize Spark jobs, cluster utilization, and query performance to improve scalability and cost efficiency
  • Build and deploy Databricks code, workflows, and infrastructure using •GitHub Actions•-based CI/CD pipelines

Preferred

  • prefer Microsoft Azure
  • Databricks certifications such as •Databricks Certified Data Engineer Associate • •or• •Professional •
  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional

Company

  • IT services company offering digital solutions, cloud, engineering.
  • Irving, Texas, USA
  • https://innocoresolutions.com/
  • Founded in 2005
  • 201-500 employees

Qualifications

  • 3+ years of experience in Data Engineering and building enterprise-scale data platforms
  • 3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
  • 3+ years of hands-on experience with Databricks and Apache Spark development using PySpark or Scala
  • Strong experience designing and implementing data pipelines on Azure and Databricks platforms
  • Strong SQL skills and experience with data modeling and dimensional modeling techniques
  • Experience developing and deploying solutions using GitHub Actions and Git-based source control practices
  • Experience with data quality, metadata management, and data governance frameworks
  • Strong troubleshooting, performance tuning, and production support experience in cloud-based data platforms
  • Excellent communication and collaboration skills with the ability to work effectively with global teams
  • Bachelor's degree in Computer Science/Engineering or a related field
  • Prefer Microsoft Azure
  • Databricks certifications such as •Databricks Certified Data Engineer Associate • •or• •Professional •
  • 3+ years of experience in Data Engineering and building enterprise-scale data platforms.
  • 3+ years of hands-on experience with Databricks and Apache Spark development using PySpark or Scala.

Required skills

  • Azure Databricks, Apache Spark, PySpark, Scala, Microsoft Azure, SQL, Azure Data Factory, Azure Data Lake Storage, GitHub Actions, Data Modeling, Data Quality, Databricks Certified Data Engineer

Preferred skills

  • prefer Microsoft Azure

Experience

  • 3+ years

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Oct 13, 2026

Work mode

On-site

Job source

Ethic Leaf recruiter

Company

Information Technology

Information Technology & AI

IT services company offering digital solutions, cloud, engineering.

See all 55 jobs from Information Technology →

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in United States

United Software Group Inc

1d ago

New

Azure Data Engineer (ADF) with Databricks Agentic experience for Marketing AI

TemporaryRemoteUnited StatesCompetitive

United Software Group Inc is seeking an Azure Data Engineer for a Marketing AI role. The position calls for Azure Databricks, Azure Data Factory, PySpark, Git, Databricks Agentic experience, and knowledge graph expertise or working knowledge.

Why similarSame roleAzure Data FactoryAzure Databricks

Curana Health

1d ago

New

Data Engineer

Full-timeRemoteUnited StatesCompetitive

Curana Health is hiring a Data Engineer to build, optimize, and maintain data pipelines supporting clinical, operational, and analytical reporting.

Why similarSame roleAzure Data FactoryPySpark

Airbnb

1d ago

New

Data Engineer Tech Foundations

Full-timeRemoteUnited States$162K – $186K/yr

Airbnb is hiring a Data Engineer to build and operate reliable, reusable datasets and pipelines that support AI usage and cost measurement, Unit Economics, enterprise application data, and critical financial metrics.

Why similarSame roleApache SparkData Modeling

Get new Data Engineer jobs in United States by email

Create job alert

Azure Databricks Data Engineer

Information Technology · Competitive

Apply via Ethic Leaf