← Back to jobsJob ID col-cmwpb34j8096ed8hax633yhox

Randstad Digital AmericasPosted 1 day ago

Data EngineerNew

Full-time
On-site
8+ years
Competitive
Posted 1 day ago

Randstad Digital is hiring a Data Engineer to build, optimize, and support scalable data pipelines and workflows. The role focuses on AWS EMR, Scala/Spark, Python, SQL, and Databricks, while improving automation, reliability, and engineering practices.

Posted
1 day ago
Source
randstadusa.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, build, and optimize ETL pipelines on AWS EMR using Scala/Spark, processing data at scale with attention to performance, cost, and reliability
  • Write and maintain Python scripts and utilities to support data workflows, automation, and tooling where Scala isn't the right tool for the job
  • Develop and troubleshoot complex SQL for data validation, transformation logic, and downstream analytics use cases
  • Work with Databricks notebooks/jobs as our data platform usage grows, contributing to migration and modernization efforts where relevant
  • Operate with autonomy on tasks with limited detail - scope ambiguous problems, propose solutions, and drive them to completion without heavy oversight
  • Identify and implement opportunities for automation, reuse, and simplification across existing pipelines, reducing team toil
  • Conduct peer code reviews, flag areas for improvement, and help maintain team coding/design standards and documentation
  • Participate in production support - troubleshoot pipeline failures, perform root-cause analysis, and implement fixes that avoid technical debt
  • Communicate progress, risks, and blockers proactively to the team and stakeholders

Qualifications

  • 8+ years of professional experience in data engineering or related software engineering roles
  • Strong hands-on experience with Scala and Apache Spark, specifically on AWS EMR
  • Working proficiency in Python for scripting, tooling, or pipeline components
  • Strong SQL skills - complex queries, performance tuning, and data validation
  • Demonstrated experience owning ETL pipelines end-to-end: design, build, test, deploy, monitor
  • Ability to work independently in ambiguous situations, exploring multiple approaches before settling on a solution
  • Experience with version control (Git), CI/CD practices, and production-grade engineering hygiene

Preferred

  • Experience with Databricks (notebooks, jobs, Delta Lake, cluster management)
  • Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
  • Familiarity with AWS data ecosystem beyond EMR (S3, Glue, Redshift, Athena)
  • Experience mentoring other engineers or leading technical design discussions
  • Background in financial services or another regulated industry
  • Regulated Industry Experience

Required skills

AWS EMRAWS Step FunctionsApache AirflowApache SparkCI/CDDatabricksDelta LakeETL Pipeline EngineeringGitPythonSQLScala

Full job description

Randstad Digital is hiring a Data Engineer to build, optimize, and support scalable data pipelines and workflows. The role focuses on AWS EMR, Scala/Spark, Python, SQL, and Databricks, while improving automation, reliability, and engineering practices.

Responsibilities

  • Design, build, and optimize ETL pipelines on AWS EMR using Scala/Spark, processing data at scale with attention to performance, cost, and reliability
  • Write and maintain Python scripts and utilities to support data workflows, automation, and tooling where Scala isn't the right tool for the job
  • Develop and troubleshoot complex SQL for data validation, transformation logic, and downstream analytics use cases
  • Work with Databricks notebooks/jobs as our data platform usage grows, contributing to migration and modernization efforts where relevant
  • Operate with autonomy on tasks with limited detail - scope ambiguous problems, propose solutions, and drive them to completion without heavy oversight
  • Identify and implement opportunities for automation, reuse, and simplification across existing pipelines, reducing team toil
  • Conduct peer code reviews, flag areas for improvement, and help maintain team coding/design standards and documentation
  • Participate in production support - troubleshoot pipeline failures, perform root-cause analysis, and implement fixes that avoid technical debt
  • Communicate progress, risks, and blockers proactively to the team and stakeholders

Preferred

  • Experience with Databricks (notebooks, jobs, Delta Lake, cluster management)
  • Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
  • Familiarity with AWS data ecosystem beyond EMR (S3, Glue, Redshift, Athena)
  • Experience mentoring other engineers or leading technical design discussions
  • Background in financial services or another regulated industry
  • Databricks
  • Databricks Notebooks
  • Databricks Jobs
  • Delta Lake
  • Cluster Management
  • Workflow Orchestration
  • Apache Airflow
  • AWS Step Functions
  • AWS Data Ecosystem
  • Amazon S3
  • AWS Glue
  • Amazon Redshift
  • Amazon Athena
  • Financial Services
  • Regulated Industry Experience
  • Mentoring Engineers
  • Technical Design Leadership

Benefits

  • Medical, prescription, dental, vision, AD&D, and life insurance offerings (all benefits are based on eligibility).
  • Short-term disability (based on eligibility).
  • A 401K plan (based on eligibility).

Company

  • Digital transformation and managed talent solutions provider
  • Atlanta, Georgia, USA
  • https://www.randstaddigital.com/
  • Founded in 1984
  • 10001+ employees

Qualifications

  • 8+ years of professional experience in data engineering or related software engineering roles
  • Strong hands-on experience with Scala and Apache Spark, specifically on AWS EMR
  • Working proficiency in Python for scripting, tooling, or pipeline components
  • Strong SQL skills - complex queries, performance tuning, and data validation
  • Demonstrated experience owning ETL pipelines end-to-end: design, build, test, deploy, monitor
  • Ability to work independently in ambiguous situations, exploring multiple approaches before settling on a solution
  • Experience with version control (Git), CI/CD practices, and production-grade engineering hygiene
  • Experience with Databricks (notebooks, jobs, Delta Lake, cluster management)
  • Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
  • Familiarity with AWS data ecosystem beyond EMR (S3, Glue, Redshift, Athena)
  • Experience mentoring other engineers or leading technical design discussions
  • Background in financial services or another regulated industry

Required skills

  • AWS EMR, AWS Step Functions, Apache Airflow, Apache Spark, CI/CD, Databricks, Delta Lake, ETL Pipeline Engineering, Git, Python, SQL, Scala

Experience

  • 8+ years

Job details

Employment type

Full-time

Seniority level

8+ years

Date posted

Nov 20, 2026

Work mode

On-site

Job source

randstadusa.com

Company

Randstad Digital Americas

Information Technology & AI

Digital transformation and managed talent solutions provider

See all 34 jobs from Randstad Digital Americas →
  • Atlanta, Georgia, USA
  • Information Technology & AI
  • 10001+ employees
  • Founded 1984
  • randstaddigital.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Henrico

Modis

1d ago

New

AWS Data Engineer

TemporaryOn-siteRichmond, VACompetitive

Modis is recruiting for a client in Richmond, VA, for a contract Data Engineer role. The role focuses on developing, enhancing, and supporting large-scale data processing workflows and ETL pipelines using Spark, Scala, and AWS.

Why similarSame roleAWS EMRRichmond

Scalence L.L.C.

1d ago

New

Development - Data Engineer

TemporaryOn-siteRichmond, VACompetitive

A confidential client is seeking a Senior Data Engineer for its Customer Data Engineering team. The role focuses on building, optimizing, and maintaining large-scale Scala and Spark ETL pipelines on AWS, including pipelines supporting new customer and…

Why similarSame roleAWS EMRRichmond

just now

1d ago

New

Senior Data Engineer - ETL/Scala

TemporaryOn-siteRichmond, VACompetitive

Genesis10 is recruiting a Senior Data Engineer for a confidential major financial institution. The role builds and maintains large-scale ETL pipelines on AWS EMR, primarily using Scala, while supporting data workflows, platform modernization, and production…

Why similarSame roleAWS EMRRichmond

Get new Data Engineer jobs in Henrico by email

Create job alert

Data Engineer

Randstad Digital Americas · Competitive

Apply on company site