← Back to jobsJob ID col-cmv8ty4qz05mgmd01ykpy8mj3

ConsultingPosted 30+ days ago

Data Engineer - Databricks

Full-time
On-site
2–4 years
Competitive
Posted 30+ days ago

Steampunk, Inc. is seeking a seasoned Data Engineer to help its team and clients develop enterprise-grade data platforms, services, and pipelines in Databricks. The role focuses on architecting data migrations, assessing and optimizing data workflows and systems, addressing technical inquiries, and supporting Agile development teams working on analytics and machine learning solutions.

Posted
30+ Days Ago
Source
internal-steampunk.icims.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Lead and architect migrations of data using Databricks with focus on performance, reliability, and scalability
  • Assess and understand ETL jobs, workflows, data marts, BI tools, and reports
  • Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products
  • Experience working with database/data warehouse/data mart solutions in cloud (Preferably AWS. Alternatively Azure, GCP)
  • Key must have skill sets – Databricks, SQL, PySpark/Python, AWS
  • Support an Agile software development lifecycle
  • You will contribute to the growth of our AI & Data Exploitation Practice!
  • Ability to hold a position of public trust with the US government
  • 2-4 years industry experience coding commercial software and a passion for solving complex problems
  • 2-4 years direct experience in Data Engineering with experience in tools such as:
  • Big data tools: Databricks, Apache Spark, Delta Lake, etc
  • Relational SQL (Preferably T-SQL. Alternatively pgSQL, MySQL)
  • Data pipeline and workflow management tools: Databricks Workflows, Airflow, Step Functions, etc
  • AWS cloud services: Databricks on AWS, S3, EC2, RDS (or Azure equivalents)
  • Object-oriented/object function scripting languages: PySpark/Python, Java, C++, Scala, etc
  • Experience working with Data Lakehouse architecture and Delta Lake/Apache Iceberg
  • Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization (SQL) as well as working familiarity with a variety of databases
  • Experience manipulating, processing, and extracting value from large, disconnected datasets
  • Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks
  • Experience manipulating structured and unstructured data
  • Experience architecting data systems (transactional and warehouses)
  • Experience the SDLC, CI/CD, and operating in dev/test/prod environments
  • Experience with data cataloging tools such as Informatica EDC, Unity Catalog, Collibra, Alation, Purview, or DataZone is a plus
  • Commitment to data governance
  • Experience working in an Agile environment
  • Experience supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models

Qualifications

  • We are looking for seasoned **Data Engineer** to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks
  • We are looking for more than just a "Data Engineer", but a technologist with excellent communication and customer service skills and a passion for data and problem solving
  • Experience working with database/data warehouse/data mart solutions in cloud (Preferably AWS. Alternatively Azure, GCP)
  • Key must have skill sets  Databricks, SQL, PySpark/Python, AWS
  • Ability to hold a position of public trust with the US government
  • 2-4 years industry experience coding commercial software and a passion for solving complex problems
  • 2-4 years direct experience in Data Engineering with experience in tools such as:
  • Big data tools: Databricks, Apache Spark, Delta Lake, etc
  • Relational SQL (Preferably T-SQL. Alternatively pgSQL, MySQL)
  • Data pipeline and workflow management tools: Databricks Workflows, Airflow, Step Functions, etc
  • AWS cloud services: Databricks on AWS, S3, EC2, RDS (or Azure equivalents)
  • Object-oriented/object function scripting languages: PySpark/Python, Java, C++, Scala, etc
  • Experience working with Data Lakehouse architecture and Delta Lake/Apache Iceberg
  • Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization (SQL) as well as working familiarity with a variety of databases
  • Experience manipulating, processing, and extracting value from large, disconnected datasets
  • Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks
  • Experience manipulating structured and unstructured data
  • Experience architecting data systems (transactional and warehouses)
  • Experience the SDLC, CI/CD, and operating in dev/test/prod environments
  • Commitment to data governance
  • Experience working in an Agile environment
  • Experience supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models

Preferred

  • Experience with data cataloging tools such as Informatica EDC, Unity Catalog, Collibra, Alation, Purview, or DataZone is a plus

Required skills

DatabricksSQLPythonPySparkAWSApache SparkDelta LakeData Lakehouse ArchitectureData Pipeline DevelopmentData WarehousingCI/CDPublic Trust Clearance

Full job description

Steampunk, Inc. is seeking a seasoned Data Engineer to help its team and clients develop enterprise-grade data platforms, services, and pipelines in Databricks. The role focuses on architecting data migrations, assessing and optimizing data workflows and systems, addressing technical inquiries, and supporting Agile development teams working on analytics and machine learning solutions.

Responsibilities

  • Lead and architect migrations of data using Databricks with focus on performance, reliability, and scalability
  • Assess and understand ETL jobs, workflows, data marts, BI tools, and reports
  • Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products
  • Experience working with database/data warehouse/data mart solutions in cloud (Preferably AWS. Alternatively Azure, GCP)
  • Key must have skill sets – Databricks, SQL, PySpark/Python, AWS
  • Support an Agile software development lifecycle
  • You will contribute to the growth of our AI & Data Exploitation Practice!
  • Ability to hold a position of public trust with the US government
  • 2-4 years industry experience coding commercial software and a passion for solving complex problems
  • 2-4 years direct experience in Data Engineering with experience in tools such as:
  • Big data tools: Databricks, Apache Spark, Delta Lake, etc
  • Relational SQL (Preferably T-SQL. Alternatively pgSQL, MySQL)
  • Data pipeline and workflow management tools: Databricks Workflows, Airflow, Step Functions, etc
  • AWS cloud services: Databricks on AWS, S3, EC2, RDS (or Azure equivalents)
  • Object-oriented/object function scripting languages: PySpark/Python, Java, C++, Scala, etc
  • Experience working with Data Lakehouse architecture and Delta Lake/Apache Iceberg
  • Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization (SQL) as well as working familiarity with a variety of databases
  • Experience manipulating, processing, and extracting value from large, disconnected datasets
  • Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks
  • Experience manipulating structured and unstructured data
  • Experience architecting data systems (transactional and warehouses)
  • Experience the SDLC, CI/CD, and operating in dev/test/prod environments
  • Experience with data cataloging tools such as Informatica EDC, Unity Catalog, Collibra, Alation, Purview, or DataZone is a plus
  • Commitment to data governance
  • Experience working in an Agile environment
  • Experience supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models

Preferred

  • * Experience with data cataloging tools such as Informatica EDC, Unity Catalog, Collibra, Alation, Purview, or DataZone is a plus
  • Data cataloging tools
  • Informatica EDC
  • Unity Catalog
  • Collibra
  • Alation
  • Purview
  • DataZone

Company

  • Federal government digital services and mission delivery consulting
  • Washington, District of Columbia, USA
  • https://steampunk.com/
  • Founded in 2019
  • 501-1000 employees

Qualifications

  • We are looking for seasoned **Data Engineer** to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks
  • We are looking for more than just a "Data Engineer", but a technologist with excellent communication and customer service skills and a passion for data and problem solving
  • * Experience working with database/data warehouse/data mart solutions in cloud (Preferably AWS. Alternatively Azure, GCP)
  • * Key must have skill sets  Databricks, SQL, PySpark/Python, AWS
  • * Ability to hold a position of public trust with the US government
  • * 2-4 years industry experience coding commercial software and a passion for solving complex problems
  • * 2-4 years direct experience in Data Engineering with experience in tools such as:
  • * Big data tools: Databricks, Apache Spark, Delta Lake, etc
  • * Relational SQL (Preferably T-SQL. Alternatively pgSQL, MySQL)
  • * Data pipeline and workflow management tools: Databricks Workflows, Airflow, Step Functions, etc
  • * AWS cloud services: Databricks on AWS, S3, EC2, RDS (or Azure equivalents)
  • * Object-oriented/object function scripting languages: PySpark/Python, Java, C++, Scala, etc
  • * Experience working with Data Lakehouse architecture and Delta Lake/Apache Iceberg
  • * Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization (SQL) as well as working familiarity with a variety of databases
  • * Experience manipulating, processing, and extracting value from large, disconnected datasets
  • * Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks
  • * Experience manipulating structured and unstructured data
  • * Experience architecting data systems (transactional and warehouses)
  • * Experience the SDLC, CI/CD, and operating in dev/test/prod environments
  • * Commitment to data governance
  • * Experience working in an Agile environment
  • * Experience supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models
  • * Experience with data cataloging tools such as Informatica EDC, Unity Catalog, Collibra, Alation, Purview, or DataZone is a plus
  • * 2-4 years industry experience coding commercial software and a passion for solving complex problems.

Required skills

  • Databricks, SQL, Python, PySpark, AWS, Apache Spark, Delta Lake, Data Lakehouse Architecture, Data Pipeline Development, Data Warehousing, CI/CD, Public Trust Clearance

Experience

  • 2-4 years

Job details

Employment type

Full-time

Seniority level

2–4 years

Date posted

Oct 15, 2026

Work mode

On-site

Job source

internal-steampunk.icims.com

Company

Consulting

Information Technology & AI

Federal government digital services and mission delivery consulting

See all 76 jobs from Consulting →
  • United States
  • Information Technology & AI
  • 501-1000 employees
  • Founded 2019
  • steampunk.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in United States

R Systems

1d ago

New

AI Data Engineer

Full-timeOn-siteUnited StatesCompetitive

R Systems is hiring an AI Data Engineer to design, build, and maintain data pipelines, lakehouses, and retrieval infrastructure for production AI, machine learning, and generative AI applications.

Why similarSame roleApache SparkPython

Curana Health

1d ago

New

Data Engineer

Full-timeRemoteUnited StatesCompetitive

Curana Health is hiring a Data Engineer to build, optimize, and maintain data pipelines supporting clinical, operational, and analytical reporting.

Why similarSame roleData WarehousingDatabricks

just now

1d ago

New

Data Engineer

Full-timeOn-siteUnited StatesCompetitive

KGS Technology Group, Inc is seeking a Junior Data Engineer to develop, maintain, and optimize data pipelines and support data integration. The role involves working with datasets, databases, and data warehouses to build reliable, scalable data solutions.

Why similarSame roleData WarehousingPython

Get new Data Engineer jobs in United States by email

Create job alert

Data Engineer - Databricks

Consulting · Competitive

Apply on company site