← Back to jobsJob ID col-cmwjgrjsv0hjd89hqxrh5uct8

DicePosted 30+ days ago

Mng. Consultant - Databricks Data Engineering Lead

Contract
Remote
4+ years
$120K – $150K/yr
Posted 30+ days ago

The Judge Group is recruiting for a federal government human-capital data modernization program. The role builds and tests Databricks pipelines, migration workflows, data-quality controls, APIs, and reusable data products.

Consulting

Posted
30+ Days Ago
Source
dice.com
Sector
Consulting

Opens the employer's application page in a new tab

Responsibilities

  • Build and maintain Databricks ingestion, transformation, orchestration, migration, and data-processing pipelines
  • Develop scalable ETL/ELT solutions using Databricks, Apache Spark, PySpark, Python, SQL, and Delta Lake
  • Implement source-to-target mappings, transformation rules, business logic, data contracts, metadata, lineage, and data-quality requirements
  • Develop migrated data feeds, APIs, curated datasets, reporting layers, and reusable data products
  • Create reconciliation routines and support source-to-target validation, exception analysis, and defect resolution
  • Build unit, integration, regression, performance, and data-quality tests and document technical results
  • Support Git-based development, CI/CD, release management, deployment, monitoring, troubleshooting, and stabilization
  • Analyze and resolve job failures, cluster-performance issues, pipeline bottlenecks, schema changes, and data-quality problems
  • Collaborate with data architects, engineering leads, integration engineers, profiling analysts, testers, security specialists, governance leads, and source-system teams
  • Document reusable code, technical patterns, runbooks, troubleshooting procedures, and lessons learned for later modernization waves
  • Participate in Agile ceremonies, backlog refinement, sprint planning, demonstrations, and technical reviews

Qualifications

  • MUST BE PROCESSED FOR E PUBLIC TRUST CLEARANCE
  • Bachelor's degree in computer science, data engineering, information systems, engineering, analytics, or a related field
  • Minimum 4 years of experience in data engineering, software development, ETL/ELT, cloud analytics, or a related technical discipline
  • Hands-on experience with Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, and workflow orchestration
  • Experience building, testing, and maintaining batch data pipelines, transformations, and curated data layers
  • Experience with enterprise data migration, source-to-target mapping, reconciliation, validation, and data-quality controls
  • Familiarity with Git, CI/CD, automated testing, deployment, monitoring, logging, and troubleshooting
  • Strong analytical, problem-solving, documentation, collaboration, and communication skills
  • Ability to obtain and maintain a Federal Public Trust

Required skills

Apache SparkCI/CDData MigrationData QualityDatabricksDelta LakeETL/ELTFederal Public Trust ClearanceGitPySparkPythonSQLSource-to-Target MappingWorkflow Orchestration

Full job description

The Judge Group is recruiting for a federal government human-capital data modernization program. The role builds and tests Databricks pipelines, migration workflows, data-quality controls, APIs, and reusable data products.

Consulting

  • Human Resources
  • Recruiting
  • Staffing Agency

Responsibilities

  • Build and maintain Databricks ingestion, transformation, orchestration, migration, and data-processing pipelines
  • Develop scalable ETL/ELT solutions using Databricks, Apache Spark, PySpark, Python, SQL, and Delta Lake
  • Implement source-to-target mappings, transformation rules, business logic, data contracts, metadata, lineage, and data-quality requirements
  • Develop migrated data feeds, APIs, curated datasets, reporting layers, and reusable data products
  • Create reconciliation routines and support source-to-target validation, exception analysis, and defect resolution
  • Build unit, integration, regression, performance, and data-quality tests and document technical results
  • Support Git-based development, CI/CD, release management, deployment, monitoring, troubleshooting, and stabilization
  • Analyze and resolve job failures, cluster-performance issues, pipeline bottlenecks, schema changes, and data-quality problems
  • Collaborate with data architects, engineering leads, integration engineers, profiling analysts, testers, security specialists, governance leads, and source-system teams
  • Document reusable code, technical patterns, runbooks, troubleshooting procedures, and lessons learned for later modernization waves
  • Participate in Agile ceremonies, backlog refinement, sprint planning, demonstrations, and technical reviews

Benefits

  • Healthcare
  • 401k
  • Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.
  • REMOTE

Qualifications

  • MUST BE PROCESSED FOR E PUBLIC TRUST CLEARANCE
  • Bachelor's degree in computer science, data engineering, information systems, engineering, analytics, or a related field
  • Minimum 4 years of experience in data engineering, software development, ETL/ELT, cloud analytics, or a related technical discipline
  • Hands-on experience with Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, and workflow orchestration
  • Experience building, testing, and maintaining batch data pipelines, transformations, and curated data layers
  • Experience with enterprise data migration, source-to-target mapping, reconciliation, validation, and data-quality controls
  • Familiarity with Git, CI/CD, automated testing, deployment, monitoring, logging, and troubleshooting
  • Strong analytical, problem-solving, documentation, collaboration, and communication skills
  • Ability to obtain and maintain a Federal Public Trust
  • Minimum 4 years of experience in data engineering, software development, ETL/ELT, cloud analytics, or a related technical discipline.

Required skills

  • Apache Spark, CI/CD, Data Migration, Data Quality, Databricks, Delta Lake, ETL/ELT, Federal Public Trust Clearance, Git, PySpark, Python, SQL, Source-to-Target Mapping, Workflow Orchestration

Experience

  • 4+ years

Company

  • Tech career marketplace connecting professionals with recruiters.
  • Centennial, Colorado, USA
  • https://www.or-quest.nl/

Job details

Employment type

Contract

Seniority level

4+ years

Sector · Sub-sector

Consulting · IT Consulting

Date posted

Oct 20, 2026

Work mode

Remote

Job source

dice.com

Company

Dice

Consulting

Tech career marketplace connecting professionals with recruiters.

See all 250 jobs from Dice →

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Consultant jobs

GTECH LLC

4d ago

Sr. MDM Consultant

Full-timeRemoteUnited StatesCompetitive

GTECH LLC is hiring a Senior MDM Consultant to support Informatica MDM implementations on IDMC. The role focuses on MDM data modeling, match and merge, survivorship, trust, and related data integration and quality technologies.

Why similarSame roleData QualitySQL

NAM Info Inc

4d ago

Eightfold Consultant (Configuration / Implementation)

Full-timeRemoteUnited StatesCompetitive

NAM Info Inc is seeking an Eightfold Consultant to configure and support the Eightfold Talent Intelligence platform.

Why similarSame role

FICO

Today

New

Software Engineering – Data Engineer (Python & Cloud Databases)

Full-timeRemoteUnited States$84K – $132K/yr

FICO is hiring a Data Engineer for the myFICO engineering team. The role owns cloud databases, builds and operates Python data pipelines, prepares data for ML and AI applications, and supports analytics and data-driven decision-making.

Why similarSimilar titleCI/CDPython

Get new Data Consultant jobs by email

Create job alert

Mng. Consultant - Databricks Data Engineering Lead

Dice · $120K – $150K/yr

Apply on company site