← Back to jobsJob ID col-cmwp5ptrs065ld8hajnv8qfhm

BrillioPosted 1 day ago

Data SpecialistNew

Full-time
Hybrid
5+ years
Competitive
Posted 1 day ago

Brillio is hiring a Data Specialist to architect and optimize scalable Databricks data solutions. The role develops ETL pipelines, data warehousing solutions, and data integrations while supporting data governance, reliability, and analytics.

Posted
1 day ago
Source
jobs.lever.co
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Architect and optimize scalable data solutions on Databricks to ensure high performance and reliability
  • Develop and maintain robust ETL pipelines using advanced SQL, Python, and Databricks features for processing large-scale datasets
  • Design and implement data warehousing solutions, including data modeling and schema design, to support analytics and business intelligence
  • Automate data transformations and integrations by developing, testing, and deploying complex stored procedures with PLSQL and T-SQL
  • Lead requirements gathering and solution architecture with cross-functional teams to deliver high-quality data products
  • Monitor and troubleshoot data workflows, optimizing performance to maintain data accuracy, integrity, and availability
  • Enforce best practices in data governance, security, and compliance within Databricks environments
  • Document technical designs, engineering processes, and operational procedures for ongoing support and knowledge sharing

Qualifications

  • ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
  • With at least 5 years of experience in data engineering, including 2+ years specifically working with Databricks and modern data platforms
  • Expertise in Databricks platform and ecosystem
  • Advanced ETL pipeline development
  • Advanced SQL, including query optimization and complex joins
  • Python programming for data engineering
  • Data warehousing implementation and data modeling
  • PLSQL and T-SQL for stored procedure development
  • Experience with modern data platform architectures
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline
  • Databricks Data Engineer Associate certification or higher
  • Microsoft Certified: Azure Data Engineer Associate or equivalent SQL/Python certification

Preferred

  • Integration of Databricks with Azure or AWS cloud platforms
  • Proficiency in Apache Spark and distributed data processing
  • Experience with CI/CD automation for data engineering
  • Familiarity with data quality frameworks
  • Experience with real-time data streaming and processing

Required skills

Apache SparkData ModelingData WarehousingDatabricksETL Pipeline DevelopmentModern Data Platform ArchitecturePL/SQLPythonSQLT-SQL

Full job description

Brillio is hiring a Data Specialist to architect and optimize scalable Databricks data solutions. The role develops ETL pipelines, data warehousing solutions, and data integrations while supporting data governance, reliability, and analytics.

Responsibilities

  • Architect and optimize scalable data solutions on Databricks to ensure high performance and reliability
  • Develop and maintain robust ETL pipelines using advanced SQL, Python, and Databricks features for processing large-scale datasets
  • Design and implement data warehousing solutions, including data modeling and schema design, to support analytics and business intelligence
  • Automate data transformations and integrations by developing, testing, and deploying complex stored procedures with PLSQL and T-SQL
  • Lead requirements gathering and solution architecture with cross-functional teams to deliver high-quality data products
  • Monitor and troubleshoot data workflows, optimizing performance to maintain data accuracy, integrity, and availability
  • Enforce best practices in data governance, security, and compliance within Databricks environments
  • Document technical designs, engineering processes, and operational procedures for ongoing support and knowledge sharing

Preferred

  • Integration of Databricks with Azure or AWS cloud platforms
  • Proficiency in Apache Spark and distributed data processing
  • Experience with CI/CD automation for data engineering
  • Familiarity with data quality frameworks
  • Experience with real-time data streaming and processing
  • Databricks Integration
  • Azure Cloud
  • AWS Cloud
  • Apache Spark
  • Distributed Data Processing
  • CI/CD Automation
  • Data Quality Frameworks
  • Real-Time Data Streaming
  • Real-Time Data Processing

Benefits

  • Hybrid work arrangement

Company

  • Enterprise digital transformation and AI consulting services
  • Dallas, Texas, USA
  • http://www.brillio.com/
  • Founded in 2014
  • 5001-10000 employees

Qualifications

  • ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
  • With at least 5 years of experience in data engineering, including 2+ years specifically working with Databricks and modern data platforms
  • Expertise in Databricks platform and ecosystem
  • Advanced ETL pipeline development
  • Advanced SQL, including query optimization and complex joins
  • Python programming for data engineering
  • Data warehousing implementation and data modeling
  • PLSQL and T-SQL for stored procedure development
  • Experience with modern data platform architectures
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline
  • Databricks Data Engineer Associate certification or higher
  • Microsoft Certified: Azure Data Engineer Associate or equivalent SQL/Python certification
  • Integration of Databricks with Azure or AWS cloud platforms
  • Proficiency in Apache Spark and distributed data processing
  • Experience with CI/CD automation for data engineering
  • Familiarity with data quality frameworks
  • Experience with real-time data streaming and processing

Required skills

  • Apache Spark, Data Modeling, Data Warehousing, Databricks, Databricks Data Engineer Associate Certification, ETL Pipeline Development, Microsoft Certified Azure Data Engineer Associate, Modern Data Platform Architecture, PL/SQL, Python, SQL, T-SQL

Preferred skills

  • Experience with CI/CD automation for data engineering, Experience with real-time data streaming and processing, Familiarity with data quality frameworks, Integration of Databricks with Azure or AWS cloud platforms, Proficiency in Apache Spark and distributed data processing

Experience

  • 5+ years

Job details

Employment type

Full-time

Seniority level

5+ years

Date posted

Nov 19, 2026

Work mode

Hybrid

Job source

jobs.lever.co

Company

Brillio

Information Technology & AI

Enterprise digital transformation and AI consulting services

See all 6 jobs from Brillio →
  • Dallas, Texas, USA
  • Information Technology & AI
  • 5001-10000 employees
  • Founded 2014
  • brillio.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Analyst jobs in San Francisco

Precision Technologies

4d ago

Data Analyst

Full-timeRemoteUnited StatesCompetitive

Precision Technologies is seeking an experienced Data Analyst to support business decision-making through data analysis, business intelligence, and reporting.

Why similarSame roleData ModelingRemote

Finance

4d ago

Senior Analyst, Investment Risk and Data Science

Full-timeHybridNew York, NY$150K – $175K/yr

Harbor Capital Advisors is seeking a Senior Analyst for its Investment Risk and Data Science team. The role analyzes portfolio performance, positioning, characteristics, and risk; supports due diligence on current and prospective subadvisors; and develops…

Why similarSame rolePythonSQL

Guardian

4d ago

Compliance Lead, Data Analyst

Full-timeHybridNew York, NY$101K – $166K/yr

The Guardian Life Insurance Company of America is hiring a Compliance Data Analyst to turn complex compliance questions into meaningful analytics and actionable insights.

Why similarSame rolePythonSQL

Get new Data Analyst jobs in San Francisco by email

Create job alert

Data Specialist

Brillio · Competitive

Apply on company site