← Back to jobsJob ID col-cmwp7szkd07iod8hav3cdhsow

just nowPosted 1 day ago

Senior Data Engineer - ETL/ScalaNew

Contract
On-site
8+ years
Competitive
Posted 1 day ago

Genesis10 is recruiting a Senior Data Engineer for a confidential major financial institution. The role builds and maintains large-scale ETL pipelines on AWS EMR, primarily using Scala, while supporting data workflows, platform modernization, and production operations.

Posted
1 day ago
Source
www1.jobdiva.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, build, and optimize ETL pipelines on AWS EMR using Scala/Spark, processing data at scale with attention to performance, cost, and reliability
  • Write and maintain Python scripts and utilities to support data workflows, automation, and tooling where Scala isn't the right tool for the job
  • Develop and troubleshoot complex SQL for data validation, transformation logic, and downstream analytics use cases
  • Work with Databricks notebooks/jobs as our data platform usage grows, contributing to migration and modernization efforts where relevant
  • Operate with autonomy on tasks with limited detail — scope ambiguous problems, propose solutions, and drive them to completion without heavy oversight
  • Identify and implement opportunities for automation, reuse, and simplification across existing pipelines, reducing team toil
  • Conduct peer code reviews, flag areas for improvement, and help maintain team coding/design standards and documentation
  • Participate in production support — troubleshoot pipeline failures, perform root-cause analysis, and implement fixes that avoid technical debt
  • Communicate progress, risks, and blockers proactively to the team and stakeholders

Qualifications

  • 8+ years of professional experience in data engineering or related software engineering roles
  • Strong hands-on experience with Scala and Apache Spark, specifically on AWS EMR
  • Working proficiency in Python for scripting, tooling, or pipeline components
  • Strong SQL skills — complex queries, performance tuning, and data validation
  • Demonstrated experience owning ETL pipelines end-to-end: design, build, test, deploy, monitor
  • Ability to work independently in ambiguous situations, exploring multiple approaches before settling on a solution
  • Experience with version control (Git), CI/CD practices, and production-grade engineering hygiene

Preferred

  • Experience with Databricks (notebooks, jobs, Delta Lake, cluster management)
  • Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
  • Familiarity with AWS data ecosystem beyond EMR (S3, Glue, Redshift, Athena)
  • Experience mentoring other engineers or leading technical design discussions
  • Background in financial services or another regulated industry
  • Regulated Industry Experience

Required skills

AWS EMRAWS Step FunctionsApache AirflowApache SparkCI/CDDatabricksDelta LakeETL Pipeline EngineeringGitPythonSQLScala

Full job description

Genesis10 is recruiting a Senior Data Engineer for a confidential major financial institution. The role builds and maintains large-scale ETL pipelines on AWS EMR, primarily using Scala, while supporting data workflows, platform modernization, and production operations.

Responsibilities

  • Design, build, and optimize ETL pipelines on AWS EMR using Scala/Spark, processing data at scale with attention to performance, cost, and reliability
  • Write and maintain Python scripts and utilities to support data workflows, automation, and tooling where Scala isn't the right tool for the job
  • Develop and troubleshoot complex SQL for data validation, transformation logic, and downstream analytics use cases
  • Work with Databricks notebooks/jobs as our data platform usage grows, contributing to migration and modernization efforts where relevant
  • Operate with autonomy on tasks with limited detail — scope ambiguous problems, propose solutions, and drive them to completion without heavy oversight
  • Identify and implement opportunities for automation, reuse, and simplification across existing pipelines, reducing team toil
  • Conduct peer code reviews, flag areas for improvement, and help maintain team coding/design standards and documentation
  • Participate in production support — troubleshoot pipeline failures, perform root-cause analysis, and implement fixes that avoid technical debt
  • Communicate progress, risks, and blockers proactively to the team and stakeholders

Preferred

  • Experience with Databricks (notebooks, jobs, Delta Lake, cluster management)
  • Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
  • Familiarity with AWS data ecosystem beyond EMR (S3, Glue, Redshift, Athena)
  • Experience mentoring other engineers or leading technical design discussions
  • Background in financial services or another regulated industry
  • Databricks
  • Databricks Notebooks
  • Databricks Jobs
  • Delta Lake
  • Cluster Management
  • Workflow Orchestration
  • Apache Airflow
  • AWS Step Functions
  • AWS S3
  • AWS Glue
  • Amazon Redshift
  • Amazon Athena
  • Financial Services
  • Regulated Industry Experience
  • Mentoring
  • Technical Leadership
  • Design Facilitation

Benefits

  • For contract roles: Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
  • For contract roles: The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
  • For contract roles: Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
  • For contract roles: Behavioral Health Platform
  • For contract roles: Medical, Dental, Vision
  • For contract roles: Health Savings Account
  • For contract roles: Voluntary Hospital Indemnity (Critical Illness & Accident)
  • For contract roles: Voluntary Term Life Insurance
  • For contract roles: 401K
  • For contract roles: Sick Pay (for applicable states/municipalities)

Company

  • IT staffing, consulting, and workforce solutions
  • New York, New York, USA
  • http://www.genesis10.com/
  • Founded in 1999
  • 1001-5000 employees

Qualifications

  • 8+ years of professional experience in data engineering or related software engineering roles
  • Strong hands-on experience with Scala and Apache Spark, specifically on AWS EMR
  • Working proficiency in Python for scripting, tooling, or pipeline components
  • Strong SQL skills — complex queries, performance tuning, and data validation
  • Demonstrated experience owning ETL pipelines end-to-end: design, build, test, deploy, monitor
  • Ability to work independently in ambiguous situations, exploring multiple approaches before settling on a solution
  • Experience with version control (Git), CI/CD practices, and production-grade engineering hygiene
  • Experience with Databricks (notebooks, jobs, Delta Lake, cluster management)
  • Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
  • Familiarity with AWS data ecosystem beyond EMR (S3, Glue, Redshift, Athena)
  • Experience mentoring other engineers or leading technical design discussions
  • Background in financial services or another regulated industry

Required skills

  • AWS EMR, AWS Step Functions, Apache Airflow, Apache Spark, CI/CD, Databricks, Delta Lake, ETL Pipeline Engineering, Git, Python, SQL, Scala

Experience

  • 8+ years

Job details

Employment type

Contract

Seniority level

8+ years

Date posted

Nov 20, 2026

Work mode

On-site

Job source

www1.jobdiva.com

Company

just now

Information Technology & AI

IT staffing, consulting, and workforce solutions

See all 132 jobs from just now →
  • New York, New York, USA
  • Information Technology & AI
  • 1001-5000 employees
  • Founded 1999
  • genesis10.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Richmond

Modis

1d ago

New

AWS Data Engineer

TemporaryOn-siteRichmond, VACompetitive

Modis is recruiting for a client in Richmond, VA, for a contract Data Engineer role. The role focuses on developing, enhancing, and supporting large-scale data processing workflows and ETL pipelines using Spark, Scala, and AWS.

Why similarSame roleAWS EMRRichmond

Scalence L.L.C.

1d ago

New

Development - Data Engineer

TemporaryOn-siteRichmond, VACompetitive

A confidential client is seeking a Senior Data Engineer for its Customer Data Engineering team. The role focuses on building, optimizing, and maintaining large-scale Scala and Spark ETL pipelines on AWS, including pipelines supporting new customer and…

Why similarSame roleAWS EMRRichmond

EPITEC

1d ago

New

Data Engineer

TemporaryHybridRichmond, VACompetitive

EPITEC is seeking a Data Engineer to build and maintain large-scale ETL pipelines on AWS EMR, primarily using Scala and Spark. The role also supports Python and SQL workflows, Databricks platform evolution, production support, and engineering standards.

Why similarSame roleAWS EMRRichmond

Get new Data Engineer jobs in Richmond by email

Create job alert

Senior Data Engineer - ETL/Scala

just now · Competitive

Apply on company site