← Back to jobsJob ID col-cmv9vhu820388qu01kd8vx1ag

Vantage Point Consulting Inc.Posted 30+ days ago

Data Engineer

Full-time
On-site
3–5 years
Competitive
Posted 30+ days ago

A confidential client is seeking a Data Engineer to migrate datastores from an on-premises data lake to an AWS-hosted lakehouse. The role focuses on migrating pipelines and data consumption patterns, reconciling and validating data, and coordinating hand-offs with data owners.

Posted
30+ Days Ago
Source
www1.jobdiva.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Refactor and migrate extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Execute the physical migration of underlying datasets while ensuring data integrity
  • Act as a technical liaison to internal clients, facilitating hand-off and sign-off discussions with data owners to ensure migrated assets meet business requirements
  • Translate and optimize legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg
  • Understand usage patterns to deliver the required data products
  • Apply a rigorous approach to data validation using reconciliation frameworks to ensure migrated data is functionally equivalent to data already used in production workflows
  • Work with the internal Data Management Platforms team
  • Demonstrate an aptitude for learning new workflows and language constructs as necessary

Qualifications

  • Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3–5 years of hands-on coding experience in a collaborative, team-based environment
  • Ability to troubleshoot SQL and perform basic scripting
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC), CI/CD best practices, and Kubernetes (K8s) deployment experience
  • Managing state changes over time, such as Slowly Changing Dimension (SCD) Type 2
  • Expertise in schema evolution, referencing Apache Iceberg, and schema enforcement strategies
  • Advanced knowledge of data partitioning and clustering
  • Understanding the balance between normalization and denormalization and the strategic use of natural versus surrogate keys
  • Hadoop (HDFS/Hive)
  • Demonstrates strong integrity and consistently models good conduct and ethical decision-making
  • Acts as a trusted team player who collaborates effectively across multiple teams and functions
  • Communicates with clarity and confidence through concise written updates, structured verbal briefings, and proactive stakeholder management
  • Works effectively with global teams across time zones and cultures, builds alignment, and resolves issues constructively
  • Maintains a strong sense of ownership, drives work to closure, and meets commitments
  • Brings high energy and urgency to achieve targets while maintaining quality and professionalism
  • Shows intellectual curiosity, asks thoughtful questions, surfaces risks early, and seeks feedback to continuously improve

Required skills

PythonJavaSQLKubernetesCI/CDApache SparkApache IcebergSnowflakeKafkaSchema EvolutionData Partitioning and Clustering

Nice to have

Teamwork and Collaboration

Full job description

A confidential client is seeking a Data Engineer to migrate datastores from an on-premises data lake to an AWS-hosted lakehouse. The role focuses on migrating pipelines and data consumption patterns, reconciling and validating data, and coordinating hand-offs with data owners.

Responsibilities

  • Refactor and migrate extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Execute the physical migration of underlying datasets while ensuring data integrity
  • Act as a technical liaison to internal clients, facilitating hand-off and sign-off discussions with data owners to ensure migrated assets meet business requirements
  • Translate and optimize legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg
  • Understand usage patterns to deliver the required data products
  • Act as a technical liaison to internal clients, facilitating hand-off and sign-off discussions with data owners to ensure migrated assets meet business requirements
  • Apply a rigorous approach to data validation using reconciliation frameworks to ensure migrated data is functionally equivalent to data already used in production workflows
  • Work with the internal Data Management Platforms team
  • Demonstrate an aptitude for learning new workflows and language constructs as necessary

Company

  • Staffing and software solutions for the U.S. market.
  • Alpharetta, Georgia, USA
  • https://vpcstaffing.com/
  • Founded in 2009
  • 51-200 employees
  • Established in 2009, Vantage Point Consulting has provided Staffing and Software Solutions to the US market.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3–5 years of hands-on coding experience in a collaborative, team-based environment
  • Ability to troubleshoot SQL and perform basic scripting
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC), CI/CD best practices, and Kubernetes (K8s) deployment experience
  • Managing state changes over time, such as Slowly Changing Dimension (SCD) Type 2
  • Expertise in schema evolution, referencing Apache Iceberg, and schema enforcement strategies
  • Advanced knowledge of data partitioning and clustering
  • Understanding the balance between normalization and denormalization and the strategic use of natural versus surrogate keys
  • Kafka
  • ANSI SQL
  • FTP
  • Apache Spark
  • JSON
  • Avro
  • Parquet
  • Hadoop (HDFS/Hive)
  • Snowflake
  • Sybase IQ
  • Demonstrates strong integrity and consistently models good conduct and ethical decision-making
  • Acts as a trusted team player who collaborates effectively across multiple teams and functions
  • Communicates with clarity and confidence through concise written updates, structured verbal briefings, and proactive stakeholder management
  • Works effectively with global teams across time zones and cultures, builds alignment, and resolves issues constructively
  • Maintains a strong sense of ownership, drives work to closure, and meets commitments
  • Brings high energy and urgency to achieve targets while maintaining quality and professionalism
  • Shows intellectual curiosity, asks thoughtful questions, surfaces risks early, and seeks feedback to continuously improve

Required skills

  • Python, Java, SQL, Kubernetes, CI/CD, Apache Spark, Apache Iceberg, Snowflake, Kafka, Temporal Data Modeling (SCD Type 2), Schema Evolution, Data Partitioning and Clustering

Preferred skills

  • Teamwork and Collaboration

Experience

  • 3-5 years

Job details

Employment type

Full-time

Seniority level

3–5 years

Date posted

Oct 15, 2026

Work mode

On-site

Job source

www1.jobdiva.com

Company

Vantage Point Consulting Inc.

Information Technology & AI

Staffing and software solutions for the U.S. market.

  • Alpharetta, Georgia, USA
  • Information Technology & AI
  • 51-200 employees
  • Founded 2009
  • vpcstaffing.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Dallas

R1 RCM

Today

New

Software Engineer - Data Platform (R37)

Full-timeOn-siteAustin, TX$120K – $150K/yr

R1 RCM’s R37 AI innovation lab builds technology to transform healthcare, including the Phare OS platform.

Why similarSame roleApache SparkAustin

The Voleon Group

Today

New

Software Engineer, Data Infrastructure

Full-timeRemoteUnited States$235K – $300K/yr

The Voleon Group is a technology company applying AI and machine learning to finance. The Software Engineer on its Data Infrastructure team builds and scales data infrastructure and tooling, collaborates with teams to improve their use of data, and helps…

Why similarSame roleJavaRemote

Flow Traders

Today

New

Core Data Engineer

Full-timeOn-siteNew York, NY$165K – $210K/yr

Flow Traders is hiring a Core Data Engineer to own the lifecycle and quality of foundational data products, including market, trading, and reference data.

Why similarSame roleKafkaPython

Get new Data Engineer jobs in Dallas by email

Create job alert

Data Engineer

Vantage Point Consulting Inc. · Competitive

Apply on company site