Data Engineer 1

Confidential is seeking a Cloud & Data Engineer to build, optimize, and operate its Voice of Customer AI platform. The role spans data engineering, Azure cloud infrastructure, platform reliability, automation, and production operations.

Human Resources

• Insider Connection @Mindlance
• 2 email credits available today
• Beyond your network
• Chandramouli Katari
• Senior Data Engineer
• From your previous company
• Chandramouli Katari & 4 connections
• Previously@Tata Consultancy Services and...
• from your School
• Find More Connections
• Find Any Email

Responsibilities

• Build and maintain ETL/ELT pipelines for structured and unstructured data sources
• Develop data-processing workloads using Azure Databricks, Python/PySpark, and SQL
• Optimize Databricks jobs, compute, and data layouts for performance and cost
• Work with Delta Lake and Unity Catalog for data storage, governance, and access control
• Implement data quality checks, monitoring, error handling, and recovery mechanisms
• Build, operate, and optimize Azure services including App Service, Functions, Blob/ADLS storage, Azure SQL DB for Postgres, Key Vault, Container Registry and Azure Monitor
• Experience with cloud AI services including vector search and embedding pipelines
• Improve platform performance, scalability, reliability, security, and cost efficiency
• Implement secure identity, and access management using Azure managed identities, Key Vault, secrets managed via scopes
• Support development, staging, and production environments
• Improve platform observability through logging, monitoring, dashboards, and alerting
• Automate infrastructure and deployments using Infrastructure as Code (IaC) and CI/CD
• Troubleshoot issues across cloud services, storage, databases, networking, and data pipelines
• Support production incidents and root-cause analysis
• Collaborate with application, AI/ML, and data engineering teams

Preferred

• Experience with Terraform or ARM templates
• Experience with Azure DevOps or GitHub Actions
• Familiarity with Azure networking, including VNets and private endpoints
• Experience with Azure Data Factory, Databricks Workflows, or Airflow
• Familiarity with data platforms supporting AI/ML, NLP, analytics, or GenAI applications

Benefits

• Hybrid work arrangement
• Glassdoor
• 3.9
• Mindlance is a Staffing and Recruiting company which provides multi-vertical staffing services.
• Union, New Jersey, USA
• http://www.mindlance.com
• Distribution of Different Job Fields Receiving Sponsorship
• Represents job field similar to this job
• Engineering and Development
• Management and Executive
• Sales
• Customer Service and Support
• Accounting and Finance
• Marketing
• Legal and Compliance
• Creatives and Design
• Trends of Total Sponsorships
• *2026
• (53)
• 2025
• (71)
• 2024
• 2023
• (37)
• 2022
• (72)
• 2021
• (36)
• 2020

Qualifications

• 3–5 years of experience in data engineering, cloud engineering, or a related role
• Hands-on experience with Microsoft Azure, Databricks, APIs, and object storage
• Strong skills in Python/PySpark, SQL
• Experience building and operating production data ETL/ELT pipelines
• Experience with relational and semi-structured/unstructured data, database technologies
• Experience with Spark, Delta Lake, and lakehouse architectures
• Working knowledge of Databricks Unity Catalog and data-access controls
• Understanding of cloud security concepts such as RBAC, managed identities, service principals, and Key Vault
• Experience with Git, CI/CD, monitoring, troubleshooting, and performance optimization
• Experience with Terraform or ARM templates
• Experience with Azure DevOps or GitHub Actions
• Familiarity with Azure networking, including VNets and private endpoints
• Experience with Azure Data Factory, Databricks Workflows, or Airflow
• Familiarity with data platforms supporting AI/ML, NLP, analytics, or GenAI applications
• 3–5 years of experience in data engineering, cloud engineering, or a related role.

Required skills

• Apache Spark, Azure Key Vault, Databricks, Delta Lake, ETL/ELT Pipelines, Lakehouse Architecture, Microsoft Azure, PySpark, Python, RBAC, SQL, Unity Catalog

Preferred skills

• Experience with Azure DevOps or GitHub Actions, Experience with Terraform or ARM templates

Experience

• 3-5 years