← Back to jobsJob ID col-cmwpb34c70963d8ha65e0ej6c

Scalence L.L.C.Posted 1 day ago

Development - Data EngineerNew

Contract
On-site
8+ years
Competitive
Posted 1 day ago

A confidential client is seeking a Senior Data Engineer for its Customer Data Engineering team. The role focuses on building, optimizing, and maintaining large-scale Scala and Spark ETL pipelines on AWS, including pipelines supporting new customer and personal loan data integration.

Artificial Intelligence (AI)

Posted
1 day ago
Source
www1.jobdiva.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, develop, enhance, and maintain large-scale ETL data pipelines using Scala and Apache Spark
  • Develop and optimize distributed data processing applications running on AWS EMR
  • Support existing Spark/Scala data pipelines to facilitate the integration of new Discover customer and personal loan data
  • Build, maintain, and enhance data ingestion and transformation workflows across multiple databases and data platforms
  • Leverage AWS services, including EMR, S3, Glue, Redshift, and Athena, to support scalable data engineering solutions
  • Work with large datasets, implementing data extraction, transformation, processing, and loading (ETL) workflows
  • Develop and optimize data processing jobs to improve performance, scalability, reliability, and efficiency
  • Work with Databricks and distributed computing frameworks to support data engineering and analytics initiatives
  • Collaborate with cross-functional engineering teams to understand data requirements and deliver reliable data solutions
  • Troubleshoot complex data pipeline issues, identify root causes, and implement effective solutions
  • Follow engineering best practices, coding standards, and data security requirements while handling sensitive customer information
  • Work independently on complex technical challenges and contribute to engineering standards and best practices across the team

Qualifications

  • 8+ years of professional experience in Data Engineering or related Software Engineering roles
  • Strong hands-on experience with **Scala programming** in production environments
  • Extensive experience with **Apache Spark and Spark-based data processing**
  • Strong experience working with **AWS EMR (Elastic MapReduce)**
  • Solid understanding of AWS ecosystem and infrastructure supporting data engineering workloads
  • Hands-on experience with AWS services such as S3, Redshift, and Athena
  • Experience developing, maintaining, and optimizing large-scale ETL pipelines
  • Ability to independently develop production-ready code and troubleshoot complex data engineering problems
  • Strong understanding of distributed computing and large-scale data processing concepts

Preferred

  • Experience working with Databricks
  • Familiarity with AWS Glue
  • Experience with Python and SQL
  • Experience working with databases and data platforms such as Cassandra, DynamoDB, Neptune, and Snowflake
  • Experience supporting customer data integration, migration, and analytics environments
  • Exposure to Generative AI technologies, including LLMs, GPT, and MCP, is an added advantage

Required skills

AWS EMRAWS GlueAWS S3Amazon AthenaAmazon RedshiftApache SparkDatabricksDistributed ComputingETL Pipeline DevelopmentPythonSQLScala

Full job description

A confidential client is seeking a Senior Data Engineer for its Customer Data Engineering team. The role focuses on building, optimizing, and maintaining large-scale Scala and Spark ETL pipelines on AWS, including pipelines supporting new customer and personal loan data integration.

Artificial Intelligence (AI)

  • Enterprise Software
  • Cloud Computing
  • Cyber Security
  • Big Data
  • Software
  • Business Process Automation (BPA)
  • Data Management
  • Data Visualization
  • Robotic Process Automation (RPA)
  • Software Engineering

Responsibilities

  • Design, develop, enhance, and maintain large-scale ETL data pipelines using Scala and Apache Spark
  • Develop and optimize distributed data processing applications running on AWS EMR
  • Support existing Spark/Scala data pipelines to facilitate the integration of new Discover customer and personal loan data
  • Build, maintain, and enhance data ingestion and transformation workflows across multiple databases and data platforms
  • Leverage AWS services, including EMR, S3, Glue, Redshift, and Athena, to support scalable data engineering solutions
  • Work with large datasets, implementing data extraction, transformation, processing, and loading (ETL) workflows
  • Develop and optimize data processing jobs to improve performance, scalability, reliability, and efficiency
  • Work with Databricks and distributed computing frameworks to support data engineering and analytics initiatives
  • Collaborate with cross-functional engineering teams to understand data requirements and deliver reliable data solutions
  • Troubleshoot complex data pipeline issues, identify root causes, and implement effective solutions
  • Follow engineering best practices, coding standards, and data security requirements while handling sensitive customer information
  • Work independently on complex technical challenges and contribute to engineering standards and best practices across the team

Preferred

  • Experience working with Databricks
  • Familiarity with AWS Glue
  • Experience with Python and SQL
  • Experience working with databases and data platforms such as Cassandra, DynamoDB, Neptune, and Snowflake
  • Experience supporting customer data integration, migration, and analytics environments
  • Exposure to Generative AI technologies, including LLMs, GPT, and MCP, is an added advantage

Company

  • IT and BPO managed solutions provider.
  • Morristown, New Jersey, USA
  • https://scalence.com

Qualifications

  • 8+ years of professional experience in Data Engineering or related Software Engineering roles
  • Strong hands-on experience with **Scala programming** in production environments
  • Extensive experience with **Apache Spark and Spark-based data processing**
  • Strong experience working with **AWS EMR (Elastic MapReduce)**
  • Solid understanding of AWS ecosystem and infrastructure supporting data engineering workloads
  • Hands-on experience with AWS services such as S3, Redshift, and Athena
  • Experience developing, maintaining, and optimizing large-scale ETL pipelines
  • Ability to independently develop production-ready code and troubleshoot complex data engineering problems
  • Strong understanding of distributed computing and large-scale data processing concepts
  • Experience working with Databricks
  • Familiarity with AWS Glue
  • Experience with Python and SQL
  • Experience working with databases and data platforms such as Cassandra, DynamoDB, Neptune, and Snowflake
  • Experience supporting customer data integration, migration, and analytics environments
  • Exposure to Generative AI technologies, including LLMs, GPT, and MCP, is an added advantage
  • 8+ years of professional experience in Data Engineering or related Software Engineering roles.

Required skills

  • AWS EMR, AWS Glue, AWS S3, Amazon Athena, Amazon Redshift, Apache Spark, Databricks, Distributed Computing, ETL Pipeline Development, Python, SQL, Scala

Preferred skills

  • Experience with Python and SQL, Experience working with Databricks, Familiarity with AWS Glue

Experience

  • 8+ years

Job details

Employment type

Contract

Seniority level

8+ years

Date posted

Nov 20, 2026

Work mode

On-site

Job source

www1.jobdiva.com

Company

Scalence L.L.C.

Information Technology & AI

IT and BPO managed solutions provider.

See all 14 jobs from Scalence L.L.C. →
  • Morristown, New Jersey, USA
  • Information Technology & AI
  • scalence.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Richmond

Modis

1d ago

New

AWS Data Engineer

TemporaryOn-siteRichmond, VACompetitive

Modis is recruiting for a client in Richmond, VA, for a contract Data Engineer role. The role focuses on developing, enhancing, and supporting large-scale data processing workflows and ETL pipelines using Spark, Scala, and AWS.

Why similarSame roleAWS EMRRichmond

just now

1d ago

New

Senior Data Engineer - ETL/Scala

TemporaryOn-siteRichmond, VACompetitive

Genesis10 is recruiting a Senior Data Engineer for a confidential major financial institution. The role builds and maintains large-scale ETL pipelines on AWS EMR, primarily using Scala, while supporting data workflows, platform modernization, and production…

Why similarSame roleAWS EMRRichmond

EPITEC

1d ago

New

Data Engineer

TemporaryHybridRichmond, VACompetitive

EPITEC is seeking a Data Engineer to build and maintain large-scale ETL pipelines on AWS EMR, primarily using Scala and Spark. The role also supports Python and SQL workflows, Databricks platform evolution, production support, and engineering standards.

Why similarSame roleAWS EMRRichmond

Get new Data Engineer jobs in Richmond by email

Create job alert

Development - Data Engineer

Scalence L.L.C. · Competitive

Apply on company site