← Back to jobsJob ID col-cmv9vuy3n03mqqu01205l2tmd

TechnoroverPosted 30+ days ago

Azure Data Engineer

Full-time
Remote
Mid level
Competitive
Posted 30+ days ago

Technorover is seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data engineering solutions on Microsoft Azure. The role focuses on building data pipelines, ETL/ELT frameworks, lakehouse solutions, and large-scale data processing platforms using Azure Databricks and related technologies.

Posted
30+ Days Ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, develop, and maintain scalable data pipelines and data engineering solutions on Microsoft Azure
  • Build and optimize complex ETL/ELT pipelines using Azure Databricks
  • Develop large-scale data processing solutions using PySpark, Spark SQL, Python, and SQL
  • Design and implement Databricks Lakehouse architecture for structured and unstructured data
  • Work extensively with Delta Lake / Delta Tables for reliable and high-performance data processing
  • Develop and manage Databricks notebooks, workflows, jobs, clusters, and pipelines
  • Implement data ingestion and transformation pipelines using Azure Data Factory (ADF) and Azure Databricks
  • Integrate data from multiple sources including databases, APIs, files, cloud storage, and enterprise applications
  • Work with Azure Data Lake Storage (ADLS Gen2) for enterprise-scale data storage and processing
  • Design efficient data models and transformation frameworks to support analytics and reporting requirements
  • Perform Spark and Databricks performance tuning , including query optimization, partitioning, caching, cluster optimization, and workload management
  • Implement data quality, validation, monitoring, logging, and error-handling frameworks
  • Support batch and real-time/streaming data processing requirements
  • Implement security and access controls across Azure data platforms
  • Collaborate with Data Architects, Data Scientists, BI teams, and business stakeholders to deliver enterprise data solutions
  • Participate in code reviews, testing, deployment, troubleshooting, and production support
  • Implement CI/CD and DevOps practices for Azure data engineering solutions

Qualifications

  • Strong hands-on experience with Azure Databricks – Mandatory
  • Strong experience with Apache Spark and PySpark
  • Strong programming experience in Python
  • Advanced SQL and data transformation skills
  • Hands-on experience with Azure Data Factory (ADF)
  • Experience with Azure Data Lake Storage (ADLS Gen2)
  • Strong understanding of Delta Lake and Lakehouse Architecture
  • Experience designing and developing ETL/ELT and enterprise data pipelines
  • Strong understanding of data warehousing, data modeling, and distributed data-processing concepts
  • Experience optimizing Databricks/Spark workloads for performance and scalability
  • Knowledge of Azure security, identity, monitoring, and data governance concepts
  • Experience with Git and CI/CD deployment processes
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline
  • Strong professional experience in Azure Data Engineering and Databricks-based data platforms
  • Proven experience delivering scalable, production-grade data pipelines and enterprise data solutions

Preferred

  • Experience with Databricks Unity Catalog and data governance
  • Experience with Delta Live Tables / Lakeflow Declarative Pipelines
  • Knowledge of Azure Synapse Analytics and other Azure data services
  • Experience with streaming technologies such as Kafka or Azure Event Hubs
  • Experience working with Power BI or downstream analytics platforms
  • Familiarity with Terraform / Infrastructure as Code
  • Relevant Microsoft Azure or Databricks certifications are preferred

Required skills

Azure DatabricksApache SparkPySparkPythonSQLAzure Data Factory (ADF)Delta LakeLakehouse ArchitectureETL/ELT Pipeline DevelopmentGit and CI/CD

Full job description

Technorover is seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data engineering solutions on Microsoft Azure. The role focuses on building data pipelines, ETL/ELT frameworks, lakehouse solutions, and large-scale data processing platforms using Azure Databricks and related technologies.

Responsibilities

  • Design, develop, and maintain scalable data pipelines and data engineering solutions on Microsoft Azure
  • Build and optimize complex ETL/ELT pipelines using Azure Databricks
  • Develop large-scale data processing solutions using PySpark, Spark SQL, Python, and SQL
  • Design and implement Databricks Lakehouse architecture for structured and unstructured data
  • Work extensively with Delta Lake / Delta Tables for reliable and high-performance data processing
  • Develop and manage Databricks notebooks, workflows, jobs, clusters, and pipelines
  • Implement data ingestion and transformation pipelines using Azure Data Factory (ADF) and Azure Databricks
  • Integrate data from multiple sources including databases, APIs, files, cloud storage, and enterprise applications
  • Work with Azure Data Lake Storage (ADLS Gen2) for enterprise-scale data storage and processing
  • Design efficient data models and transformation frameworks to support analytics and reporting requirements
  • Perform Spark and Databricks performance tuning , including query optimization, partitioning, caching, cluster optimization, and workload management
  • Implement data quality, validation, monitoring, logging, and error-handling frameworks
  • Support batch and real-time/streaming data processing requirements
  • Implement security and access controls across Azure data platforms
  • Collaborate with Data Architects, Data Scientists, BI teams, and business stakeholders to deliver enterprise data solutions
  • Participate in code reviews, testing, deployment, troubleshooting, and production support
  • Implement CI/CD and DevOps practices for Azure data engineering solutions

Preferred

  • Experience with Databricks Unity Catalog and data governance
  • Experience with Delta Live Tables / Lakeflow Declarative Pipelines
  • Knowledge of Azure Synapse Analytics and other Azure data services
  • Experience with streaming technologies such as Kafka or Azure Event Hubs
  • Experience working with Power BI or downstream analytics platforms
  • Familiarity with Terraform / Infrastructure as Code
  • Relevant Microsoft Azure or Databricks certifications are preferred
  • Databricks Unity Catalog
  • Delta Live Tables
  • Lakeflow Declarative Pipelines
  • Azure Synapse Analytics
  • Azure Data Services
  • Kafka
  • Azure Event Hubs
  • Power BI
  • Analytics Platforms
  • Terraform
  • Infrastructure as Code
  • Microsoft Azure Certification
  • Databricks Certification

Company

  • Digital engineering and IT services for enterprise transformation
  • Bengaluru, Karnataka, IN
  • https://technorover.com/
  • Founded in 2022
  • 51-200 employees

Qualifications

  • Strong hands-on experience with Azure Databricks – Mandatory
  • Strong experience with Apache Spark and PySpark
  • Strong programming experience in Python
  • Advanced SQL and data transformation skills
  • Hands-on experience with Azure Data Factory (ADF)
  • Experience with Azure Data Lake Storage (ADLS Gen2)
  • Strong understanding of Delta Lake and Lakehouse Architecture
  • Experience designing and developing ETL/ELT and enterprise data pipelines
  • Strong understanding of data warehousing, data modeling, and distributed data-processing concepts
  • Experience optimizing Databricks/Spark workloads for performance and scalability
  • Knowledge of Azure security, identity, monitoring, and data governance concepts
  • Experience with Git and CI/CD deployment processes
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline
  • Strong professional experience in Azure Data Engineering and Databricks-based data platforms
  • Proven experience delivering scalable, production-grade data pipelines and enterprise data solutions
  • Experience with Databricks Unity Catalog and data governance
  • Experience with Delta Live Tables / Lakeflow Declarative Pipelines
  • Knowledge of Azure Synapse Analytics and other Azure data services
  • Experience with streaming technologies such as Kafka or Azure Event Hubs
  • Experience working with Power BI or downstream analytics platforms
  • Familiarity with Terraform / Infrastructure as Code
  • Relevant Microsoft Azure or Databricks certifications are preferred

Required skills

  • Azure Databricks, Apache Spark, PySpark, Python, SQL, Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS Gen2), Delta Lake, Lakehouse Architecture, ETL/ELT Pipeline Development, Data Warehousing and Data Modeling, Git and CI/CD

Preferred skills

  • Experience with Databricks Unity Catalog and data governance, Familiarity with Terraform / Infrastructure as Code

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Oct 15, 2026

Work mode

Remote

Job source

linkedin.com

Company

Technorover

Information Technology & AI

Digital engineering and IT services for enterprise transformation

  • Bengaluru, Karnataka, IN
  • Information Technology & AI
  • 51-200 employees
  • Founded 2022
  • technorover.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs

Trilogy Federal

1w ago

Data Visualization Engineer

Full-timeRemoteUnited StatesCompetitive

Responsibilities Design, develop, and maintain interactive dashboards, reports, and visual analytics solutions using Microsoft Power BI and other Government-approved business intelligence tools Collaborate with VA stakeholders to gather reporting…

Why similarSame roleAzure DatabricksRemote

KPG99 INC

1w ago

GCP Data Engineer - W2 Only

TemporaryRemoteUnited StatesCompetitive

KPG99 INC is seeking a GCP Data Engineer for a six-month contract-to-hire role. The role focuses on hands-on data engineering, including BigQuery and data pipeline development, in a fast-moving environment.

Why similarSame rolePythonRemote

The Voleon Group

Today

New

Software Engineer, Data Infrastructure

Full-timeRemoteUnited States$235K – $300K/yr

The Voleon Group is a technology company applying AI and machine learning to finance. The Software Engineer on its Data Infrastructure team builds and scales data infrastructure and tooling, collaborates with teams to improve their use of data, and helps…

Why similarSame rolePythonRemote

Get new Data Engineer jobs by email

Create job alert

Azure Data Engineer

Technorover · Competitive

Apply on company site