Azure Databricks Engineer Jersey City, NJ w2

Steneral Consulting is seeking an Azure Databricks Engineer to design, implement, and develop data platform solutions on Microsoft Azure. The role focuses on building and optimizing data pipelines, applying security and governance practices, and delivering production-grade Databricks solutions.

Responsibilities

• Support design, implementation, and development of Databricks data platform on Microsoft Azure
• Collaborate with technology and data teams to build and enhance scalable data solutions
• Develop and optimize data processing and ETL/ELT pipelines using Databricks, Spark, and Azure technologies
• Ensure security, automation, and adherence to platform best practices within the Databricks ecosystem
• Work hands-on with Databricks Workspace, Unity Catalog, Delta Lake, Spark UI, and MLflow
• Program and engineer data solutions using Python, PySpark, SQL, and/or Java
• Utilize Azure Databricks, Azure Data Lake Storage Gen2, and Azure Data Factory for cloud data solutions
• Optionally leverage AWS services (S3, IAM) if required
• Troubleshoot and performance-tune Spark workloads and data processing pipelines
• Implement DevOps and MLOps practices, including using Git, CI/CD pipelines, Kubernetes, OpenShift, and Terraform (IaC)
• Apply security and governance controls such as access management, secrets handling, and Unity Catalog
• Automate workflows, orchestrate jobs, monitor systems, and provide production support
• Collaborate with application development, infrastructure, cloud, security, architecture, and data teams
• Operate within established enterprise architecture, security, and governance standards
• Utilize Apache Airflow for workflow management
• Deliver production-grade, resilient, and governed Databricks solutions suitable for large enterprise environments

Company

• Technical staffing and engineering services
• Plano, Texas, USA
• https://www.steneral.com/
• Founded in 2016
• 51-200 employees

Required skills

• AI Tools, Analyze How Well You Fit, Build Cover Letter, Company data provided by, Customize Your Resume, Delta Lake, Growth Stage, Make your application stand out, Maximize your interview chances, Plano, Texas, USA, Understand your strength & weakness, Unity Catalog, https://www.steneral.com

Experience

• Mid level