← Back to jobsJob ID col-cmwf6tony0a1889hqbmby8bxz

Kforce IncPosted 8 days ago

Databricks Engineer

Full-time
On-site
5–8 years
Competitive
Posted 8 days ago

Kforce is recruiting for an unnamed client seeking a Mid-Level Databricks Engineer. The role supports migration of Hadoop workloads to the Databricks Lakehouse platform and develops, optimizes, and monitors scalable data solutions.

Posted
8 days ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Identify and categorize existing Hadoop jobs (ETL, batch, streaming) and data sources to support migration planning
  • Participate in selecting scalable and repeatable migration use cases for Minimum Viable Product (MVP) initiatives
  • Provision and configure Databricks workspaces, ensuring Lakehouse architecture and federation capabilities are enabled
  • Execute pilot migrations of representative Hadoop workloads using tools such as Databricks Migration Accelerator or partner solutions
  • Validate and monitor post-migration performance, cost efficiency, and data integrity
  • Enable and test advanced Databricks features (e.g., Liquid Clustering, Lakehouse AI monitoring, Serverless warehouse, Unity Catalog) to optimize data layout and pipeline health
  • Engage with data engineering, analytics, and governance teams to gather feedback and document learnings, blockers, and feature gaps
  • Track and report on key success metrics such as migration time, query latency, cost savings, and feature adoption
  • Contribute to the development of a phased roadmap for full-scale migration and advanced feature rollout

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent professional experience
  • 5-8 years of experience in data engineering, with hands-on experience in Databricks and Hadoop ecosystems
  • Proficiency in Spark (Scala or PySpark), ETL pipeline development, and data migration practices
  • Solid understanding of cloud platforms (Azure) and data governance concepts
  • Strong analytical and problem-solving skills with attention to detail
  • Ability to work collaboratively in cross-functional teams and communicate effectively with both technical and non-technical stakeholders

Preferred

  • Experience with Lakehouse architecture, Delta Lake, and Databricks advanced features (e.g., Lakehouse Federation, Liquid Clustering, Unity Catalog) is a strong plus
  • Experience with Databricks Migration Accelerator or similar migration tools
  • Familiarity with synthetic data generation and pipeline health monitoring
  • Understanding of performance tuning, query optimization, and cost management on cloud data platforms
  • Ability to document migration patterns and contribute to best practices for broader adoption

Required skills

Apache SparkAzureData GovernanceDatabricksDelta LakeETL Pipeline DevelopmentHadoopLakehouse ArchitecturePySparkScalaUnity Catalog

Full job description

Kforce is recruiting for an unnamed client seeking a Mid-Level Databricks Engineer. The role supports migration of Hadoop workloads to the Databricks Lakehouse platform and develops, optimizes, and monitors scalable data solutions.

Responsibilities

  • Identify and categorize existing Hadoop jobs (ETL, batch, streaming) and data sources to support migration planning
  • Participate in selecting scalable and repeatable migration use cases for Minimum Viable Product (MVP) initiatives
  • Provision and configure Databricks workspaces, ensuring Lakehouse architecture and federation capabilities are enabled
  • Execute pilot migrations of representative Hadoop workloads using tools such as Databricks Migration Accelerator or partner solutions
  • Validate and monitor post-migration performance, cost efficiency, and data integrity
  • Enable and test advanced Databricks features (e.g., Liquid Clustering, Lakehouse AI monitoring, Serverless warehouse, Unity Catalog) to optimize data layout and pipeline health
  • Engage with data engineering, analytics, and governance teams to gather feedback and document learnings, blockers, and feature gaps
  • Track and report on key success metrics such as migration time, query latency, cost savings, and feature adoption
  • Contribute to the development of a phased roadmap for full-scale migration and advanced feature rollout

Preferred

  • Experience with Lakehouse architecture, Delta Lake, and Databricks advanced features (e.g., Lakehouse Federation, Liquid Clustering, Unity Catalog) is a strong plus
  • Experience with Databricks Migration Accelerator or similar migration tools
  • Familiarity with synthetic data generation and pipeline health monitoring
  • Understanding of performance tuning, query optimization, and cost management on cloud data platforms
  • Ability to document migration patterns and contribute to best practices for broader adoption
  • Lakehouse Architecture
  • Delta Lake
  • Databricks Advanced Features
  • Lakehouse Federation
  • Liquid Clustering
  • Unity Catalog
  • Databricks Migration Accelerator
  • Data Migration Tools
  • Synthetic Data Generation
  • Pipeline Health Monitoring
  • Performance Tuning
  • Query Optimization
  • Cloud Cost Management
  • Cloud Data Platforms
  • Migration Pattern Documentation
  • Best Practices Development

Benefits

  • Medical, dental, and vision insurance, HSA, FSA, 401(k), and life, disability, and ADD insurance for eligible employees
  • Paid time off for salaried personnel
  • Paid sick leave for hourly employees on a Service Contract Act project

Company

  • Technology, finance and accounting, and professional staffing services
  • Tampa, Florida, USA
  • https://www.kforce.com/
  • Founded in 1962
  • 1001-5000 employees

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent professional experience
  • 5-8 years of experience in data engineering, with hands-on experience in Databricks and Hadoop ecosystems
  • Proficiency in Spark (Scala or PySpark), ETL pipeline development, and data migration practices
  • Solid understanding of cloud platforms (Azure) and data governance concepts
  • Strong analytical and problem-solving skills with attention to detail
  • Ability to work collaboratively in cross-functional teams and communicate effectively with both technical and non-technical stakeholders
  • Experience with Lakehouse architecture, Delta Lake, and Databricks advanced features (e.g., Lakehouse Federation, Liquid Clustering, Unity Catalog) is a strong plus
  • Experience with Databricks Migration Accelerator or similar migration tools
  • Familiarity with synthetic data generation and pipeline health monitoring
  • Understanding of performance tuning, query optimization, and cost management on cloud data platforms
  • Ability to document migration patterns and contribute to best practices for broader adoption

Required skills

  • Apache Spark, Azure, Data Governance, Databricks, Delta Lake, ETL Pipeline Development, Hadoop, Lakehouse Architecture, PySpark, Scala, Unity Catalog

Experience

  • 5-8 years

Job details

Employment type

Full-time

Seniority level

5–8 years

Date posted

Nov 13, 2026

Work mode

On-site

Job source

linkedin.com

Company

Kforce Inc

Information Technology & AI

Technology, finance and accounting, and professional staffing services

See all 26 jobs from Kforce Inc →
  • Tampa, Florida, USA
  • Information Technology & AI
  • 1001-5000 employees
  • Founded 1962
  • kforce.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Warehouse Engineer jobs in Harrison

Apexon

1d ago

New

Data Warehouse and BI Maintenance and Operations Engineer

Full-timeRemoteUnited StatesCompetitive

Apexon is hiring a Data Warehouse and BI Maintenance and Operations Engineer to support the data lake, data warehouse, and reporting layer of a Medicaid Analytics platform.

Why similarSame roleRemote

just now

1d ago

New

Forward Deployed Engineer

Full-timeRemoteUnited StatesCompetitive

United Software Group Inc is hiring a Forward Deployed Engineer to build, deploy, and optimize data pipelines, semantic definitions, and automated cloud workflows within customer business units.

Why similarSame roleRemote

United Software Group Inc

1d ago

New

Forward Deployed Engineer-BI, LookML and BigQuery at 100% Remote Role

TemporaryRemoteUnited StatesCompetitive

United Software Group Inc is hiring a Forward Deployed Engineer to help modernize BI environments with Looker and BigQuery and prepare them for AI.

Why similarSame roleRemote

Get new Data Warehouse Engineer jobs in Harrison by email

Create job alert

Databricks Engineer

Kforce Inc · Competitive

Apply on company site