Data Engineer 1

The hiring client is confidential; VARITE is the recruiting company. The role builds, optimizes, and operates a Voice of Customer AI platform, spanning data engineering, Azure cloud infrastructure, and platform reliability.

Big Data

• Information Technology
• Analytics
• Insider Connection @VARITE INC
• 2 email credits available today
• Beyond your network
• Bhawna Malhotra & 1 connections
• From your previous company
• Kiran Ravat
• Senior Business Manager
• Previously@Tata Consultancy Services
• from your School

Responsibilities

• Build and maintain ETL/ELT pipelines for structured and unstructured data sources
• Develop data-processing workloads using Azure Databricks, Python/PySpark, and SQL
• Optimize Databricks jobs, compute, and data layouts for performance and cost
• Work with Delta Lake and Unity Catalog for data storage, governance, and access control
• Implement data quality checks, monitoring, error handling, and recovery mechanisms
• Build, operate, and optimize Azure services including App Service, Functions, Blob/ADLS storage, Azure SQL DB for Postgres, Key Vault, Container Registry and Azure Monitor
• Experience with cloud AI services including vector search and embedding pipelines
• Improve platform performance, scalability, reliability, security, and cost efficiency
• Implement secure identity, and access management using Azure managed identities, Key Vault, secrets managed via scopes
• Support development, staging, and production environments
• Improve platform observability through logging, monitoring, dashboards, and alerting
• Automate infrastructure and deployments using Infrastructure as Code (IaC) and CI/CD
• Troubleshoot issues across cloud services, storage, databases, networking, and data pipelines
• Support production incidents and root-cause analysis
• Collaborate with application, AI/ML, and data engineering teams

Preferred

• Experience with Terraform or ARM templates
• Experience with Azure DevOps or GitHub Actions
• Familiarity with Azure networking, including VNets and private endpoints
• Experience with Azure Data Factory, Databricks Workflows, or Airflow
• Familiarity with data platforms supporting AI/ML, NLP, analytics, or GenAI applications

Benefits

• Hybrid work arrangement
• Glassdoor
• 3.6
• Varite is an information technology company providing networking, business analytics and cloud services.
• San Jose, California, USA
• http://varite.com
• Late Stage
• Leadership Team
• Adarsh Katyal
• President & CEO
• Company data provided by
• AI Tools
• Customize Your Resume
• Maximize your interview chances
• Build Cover Letter
• Make your application stand out
• Analyze How Well You Fit
• Understand your strength & weakness

Qualifications

• 3–5 years of experience in data engineering, cloud engineering, or a related role
• Hands-on experience with Microsoft Azure, Databricks, APIs, and object storage
• Strong skills in Python/PySpark, SQL
• Experience building and operating production data ETL/ELT pipelines
• Experience with relational and semi-structured/unstructured data, database technologies
• Experience with Spark, Delta Lake, and lakehouse architectures
• Working knowledge of Databricks Unity Catalog and data-access controls
• Understanding of cloud security concepts such as RBAC, managed identities, service principals, and Key Vault
• Experience with Git, CI/CD, monitoring, troubleshooting, and performance optimization
• No formal requirements if skills are met
• Experience with Terraform or ARM templates
• Experience with Azure DevOps or GitHub Actions
• Familiarity with Azure networking, including VNets and private endpoints
• Experience with Azure Data Factory, Databricks Workflows, or Airflow
• Familiarity with data platforms supporting AI/ML, NLP, analytics, or GenAI applications
• 3–5 years of experience in data engineering, cloud engineering, or a related role.

Required skills

• APIs, Apache Spark, Azure Databricks, Azure Key Vault, CI/CD, Databricks Unity Catalog, Delta Lake, ETL/ELT Pipelines, Microsoft Azure, PySpark, Python, SQL

Preferred skills

• Experience with Azure DevOps or GitHub Actions, Experience with Terraform or ARM templates

Experience

• 3-5 years