Data Engineer (DataLake to AWS)

NTT DATA’s client is seeking a Data Engineer to migrate on-premises DataLake environments to AWS-hosted Lakehouse platforms. The role focuses on modernizing data pipelines and processing logic, validating data migrations, and collaborating with business and technical teams throughout the migration lifecycle.

Consulting

• Marketing
• Information Technology
• Cloud Computing
• Digital Marketing
• Information Services
• IT Management
• Insider Connection @NTT DATA North America
• 2 email credits available today
• Beyond your network
• Madhuri Krishna Siddana & 4 connections
• From your previous company

Responsibilities

• Perform end-to-end datastore migrations from on-premises DataLake environments to AWS-hosted Lakehouse platforms as part of the migration factory team
• Refactor and migrate existing data pipelines, including data extraction logic, transformation processes, and job scheduling
• Execute large-scale data transfers while ensuring data integrity, completeness, reliability, and consistency between source and target platforms
• Translate and modernize legacy SQL and Apache Spark-based processing logic for Snowflake and Apache Iceberg environments
• Analyze existing data usage patterns, business requirements, and downstream consumption to support the development and delivery of reusable data products
• Design and build data reconciliation and validation frameworks to verify data accuracy during and after migration
• Collaborate with business stakeholders, application teams, data owners, and technical teams to perform validation and obtain migration sign-off
• Act as a technical liaison between migration, data engineering, application, infrastructure, and business teams throughout the migration lifecycle
• Troubleshoot data pipeline, data transformation, performance, and migration-related issues and implement appropriate technical solutions
• Optimize data pipelines and processing workloads to improve performance, scalability, and operational efficiency
• Apply core data engineering concepts including Slowly Changing Dimensions (SCD Type 2), schema evolution, partitioning, clustering, normalization and denormalization, natural and surrogate keys, and data quality controls
• Work with structured and semi-structured data formats including JSON, Avro, and Parquet
• Follow established Software Development Life Cycle (SDLC), source-control, testing, deployment, and Continuous Integration/Continuous Deployment (CI/CD) practices
• Adapt to new data technologies, migration tools, engineering standards, and workflows as required by the program
• Collaborate effectively with geographically distributed and global delivery teams

Preferred

• Experience performing large-scale data platform or datastore migration initiatives
• Experience migrating data workloads from on-premises environments to cloud-based platforms, particularly AWS
• Experience working with Lakehouse architectures
• Experience with Snowflake and Apache Iceberg-based data platforms
• Experience working within the financial services industry
• Experience supporting complex migration programs involving multiple business, technology, and global delivery teams

Benefits

• Company benefits may include medical, dental, and vision insurance, flexible spending or health savings account, life, and AD&D insurance, short-and long-term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally required benefits.
• Glassdoor
• 3.9
• NTT DATA, Inc. is a trusted global innovator of business and technology services.
• Plano, Texas, USA
• https://us.nttdata.com
• Distribution of Different Job Fields Receiving Sponsorship
• Represents job field similar to this job
• Engineering and Development
• Management and Executive
• Customer Service and Support
• Sales
• Legal and Compliance
• Accounting and Finance
• Human Resources
• Product Management
• Trends of Total Sponsorships
• *2026
• (87)
• 2025
• (144)
• 2024
• (182)
• 2023
• (257)
• 2022
• (871)
• 2021
• (809)
• 2020

Qualifications

• Minimum 3+ years of hands-on software development and/or data engineering experience, including coding, development, troubleshooting, and implementation of data-related solutions
• Minimum 3+ years of experience working with SQL, including development, analysis, query troubleshooting, and performance optimization
• Minimum 3+ years of hands-on programming experience using Python and/or Java for data processing, application development, automation, or integration
• Minimum 3+ years of experience developing or supporting ETL/ELT data pipelines, including data extraction, transformation, loading, and pipeline troubleshooting
• Experience developing or supporting distributed data-processing solutions using Apache Spark
• Experience working with data engineering concepts including SCD Type 2, schema evolution, partitioning, clustering, normalization versus denormalization, natural versus surrogate keys, and data quality frameworks
• Experience working with one or more data and integration technologies including Kafka, ANSI SQL, FTP, Apache Spark, Hadoop, Snowflake, Apache Iceberg, and Sybase IQ
• Experience working with structured and semi-structured data formats including JSON, Avro, and Parquet
• Experience working within established SDLC and CI/CD processes, including source control, testing, deployment, and release practices
• Familiarity with containerized application environments and Kubernetes
• Demonstrated ability to troubleshoot technical issues, communicate effectively with stakeholders, collaborate across global teams, and take ownership of assigned deliverables
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical field, or equivalent work experience
• Experience performing large-scale data platform or datastore migration initiatives
• Experience migrating data workloads from on-premises environments to cloud-based platforms, particularly AWS
• Experience working with Lakehouse architectures
• Experience with Snowflake and Apache Iceberg-based data platforms
• Experience working within the financial services industry
• Experience supporting complex migration programs involving multiple business, technology, and global delivery teams
• Minimum 3+ years of hands-on software development and/or data engineering experience, including coding, development, troubleshooting, and implementation of data-related solutions.
• Minimum 3+ years of experience working with SQL, including development, analysis, query troubleshooting, and performance optimization.
• Minimum 3+ years of hands-on programming experience using Python and/or Java for data processing, application development, automation, or integration.
• Minimum 3+ years of experience developing or supporting ETL/ELT data pipelines, including data extraction, transformation, loading, and pipeline troubleshooting.

Required skills

• AWS Data Migration, Apache Iceberg, Apache Spark, Data Platform Migration, ETL/ELT Pipelines, JSON, Avro, and Parquet, Java, Kubernetes, Python, SCD Type 2, SQL, Snowflake

Preferred skills

• Experience working with Lakehouse architectures, Experience working within the financial services industry

Experience

• 3+ years