← Back to jobsJob ID col-cmv8dgx0t03zqoz01w8tr29sn

Big DataPosted 30+ days ago

Data Engineer

Full-time
On-site
3+ years
Competitive
Posted 30+ days ago

Creative Information Technology, Inc. is an IT services company serving government and commercial sectors with technology solutions. The company is seeking a hands-on Data Engineer to design, develop, and optimize AWS-based data pipelines supporting Enterprise Data Warehouse and Data Lake solutions. The role focuses on data ingestion, transformation, integration, quality, security, compliance, and analytics readiness, including healthcare data integration.

Posted
30+ Days Ago
Source
Ethic Leaf recruiter
Sector
Information Technology & AI

No employer link yet — an Ethic Leaf recruiter forwards your application

Responsibilities

  • Design, develop and maintain data pipelines, and extract, transform, load (ETL) processes to collect, process and store structured and unstructured data
  • Build data architecture and storage solutions, including data lakehouses, data lakes, data warehouse, and data marts to support analytics and reporting
  • Develop data reliability, efficiency, and qualify checks and processes
  • Prepare data for data modeling
  • Monitor and optimize data architecture and data processing systems
  • Collaboration with multiple teams to understand requirements and objectives
  • Administer testing and troubleshooting related to performance, reliability, and scalability
  • Create and update documentation
  • Design, code, and deploy ETL/ELT pipelines across bronze, silver, and gold layers of the Data Lakehouse
  • Build ingestion pipelines for structured (SQL), semi-structured (JSON, XML), and unstructured data using PySpark/Python programming language using AWS Glue or EMR
  • Implement incremental loads, deduplication, error handling, and data validation
  • Actively troubleshoot, debug, and optimize pipelines for scalability and cost efficiency
  • Develop dimensional data models (Star Schema, Snowflake Schema) for analytics and reporting
  • Build and maintain tables in Iceberg, Delta Lake, or equivalent OTF formats
  • Optimize partitioning, indexing, and metadata for fast query performance
  • Build ingestion and transformation pipelines for EDI X12 transactions (837, 835, 278, etc.)
  • Implement mapping and transformation of EDI data with FHIR and HL7 frameworks
  • Work hands-on with AWS Health Lake (or equivalent) to store and query healthcare data
  • Develop automated validation scripts to enforce data quality and integrity
  • Implement IAM roles, encryption, and auditing to meet HIPAA and CMS compliance standards
  • Maintain lineage and governance documentation for all pipelines
  • Work closely with the Lead Data Engineer, analysts, and data scientists to deliver pipelines that support enterprise-wide analytics
  • Actively contribute to CI/CD pipelines, Infrastructure-as-Code (IaC), and automation
  • Continuously improve pipelines and adopt new technologies where appropriate

Qualifications

  • The candidate should have experience as data engineer or similar role with a strong understanding of data architecture and ETL processes
  • The candidate should be proficient in programming languages for data processing and knowledgeable of distributed computing and parallel processing
  • This position requires a bachelor's or master's degree from an accredited college or university with a major in computer science, statistics, mathematics, economics, or a related field
  • Three (3) years of equivalent experience in a related field may be substituted for the Bachelor's degree
  • 3+ years hands-on experience in building, deploying, and maintaining data pipelines on AWS or equivalent cloud platforms
  • Strong coding skills in Python and SQL
  • Proven experience with Apache Spark (PySpark) for large-scale processing
  • Hands-on experience with AWS Glue, S3, Redshift, Athena, EMR, Lake Formation
  • Strong debugging and performance optimization skills in distributed systems
  • Hands-on experience with Iceberg, Delta Lake, or other OTF table formats
  • Experience with Airflow or other pipeline orchestration frameworks
  • Practical experience in CI/CD and Infrastructure-as-Code (Terraform, CloudFormation)
  • Practical experience with EDI X12, HL7, or FHIR data formats
  • Strong understanding of Medallion Architecture for data lake houses
  • Hands-on experience building dimensional models and data warehouses
  • Working knowledge of HIPAA and CMS interoperability requirements
  • Three (3) years of equivalent experience in a related field may be substituted for the Bachelor’s degree.

Preferred

  • Scala or Java a plus

Required skills

AWS Data EngineeringPythonSQLApache Spark (PySpark)AWS GlueAmazon S3Amazon RedshiftAmazon AthenaAmazon EMRAWS Lake FormationInfrastructure as Code Terraform

Full job description

Creative Information Technology, Inc. is an IT services company serving government and commercial sectors with technology solutions. The company is seeking a hands-on Data Engineer to design, develop, and optimize AWS-based data pipelines supporting Enterprise Data Warehouse and Data Lake solutions. The role focuses on data ingestion, transformation, integration, quality, security, compliance, and analytics readiness, including healthcare data integration.

Responsibilities

  • Design, develop and maintain data pipelines, and extract, transform, load (ETL) processes to collect, process and store structured and unstructured data
  • Build data architecture and storage solutions, including data lakehouses, data lakes, data warehouse, and data marts to support analytics and reporting
  • Develop data reliability, efficiency, and qualify checks and processes
  • Prepare data for data modeling
  • Monitor and optimize data architecture and data processing systems
  • Collaboration with multiple teams to understand requirements and objectives
  • Administer testing and troubleshooting related to performance, reliability, and scalability
  • Create and update documentation
  • Design, code, and deploy ETL/ELT pipelines across bronze, silver, and gold layers of the Data Lakehouse
  • Build ingestion pipelines for structured (SQL), semi-structured (JSON, XML), and unstructured data using PySpark/Python programming language using AWS Glue or EMR
  • Implement incremental loads, deduplication, error handling, and data validation
  • Actively troubleshoot, debug, and optimize pipelines for scalability and cost efficiency
  • Develop dimensional data models (Star Schema, Snowflake Schema) for analytics and reporting
  • Build and maintain tables in Iceberg, Delta Lake, or equivalent OTF formats
  • Optimize partitioning, indexing, and metadata for fast query performance
  • Build ingestion and transformation pipelines for EDI X12 transactions (837, 835, 278, etc.)
  • Implement mapping and transformation of EDI data with FHIR and HL7 frameworks
  • Work hands-on with AWS Health Lake (or equivalent) to store and query healthcare data
  • Develop automated validation scripts to enforce data quality and integrity
  • Implement IAM roles, encryption, and auditing to meet HIPAA and CMS compliance standards
  • Maintain lineage and governance documentation for all pipelines
  • Work closely with the Lead Data Engineer, analysts, and data scientists to deliver pipelines that support enterprise-wide analytics
  • Actively contribute to CI/CD pipelines, Infrastructure-as-Code (IaC), and automation
  • Continuously improve pipelines and adopt new technologies where appropriate

Preferred

  • Scala or Java a plus
  • Scala
  • Java

Company

  • Enterprise IT solutions provider for government and healthcare
  • Falls Church, Virginia, USA
  • https://www.citi-us.com/
  • Founded in 1996
  • 201-500 employees

Qualifications

  • The candidate should have experience as data engineer or similar role with a strong understanding of data architecture and ETL processes
  • The candidate should be proficient in programming languages for data processing and knowledgeable of distributed computing and parallel processing
  • This position requires a bachelor's or master's degree from an accredited college or university with a major in computer science, statistics, mathematics, economics, or a related field
  • Three (3) years of equivalent experience in a related field may be substituted for the Bachelor's degree
  • 3+ years hands-on experience in building, deploying, and maintaining data pipelines on AWS or equivalent cloud platforms
  • Strong coding skills in Python and SQL
  • Proven experience with Apache Spark (PySpark) for large-scale processing
  • Hands-on experience with AWS Glue, S3, Redshift, Athena, EMR, Lake Formation
  • Strong debugging and performance optimization skills in distributed systems
  • Hands-on experience with Iceberg, Delta Lake, or other OTF table formats
  • Experience with Airflow or other pipeline orchestration frameworks
  • Practical experience in CI/CD and Infrastructure-as-Code (Terraform, CloudFormation)
  • Practical experience with EDI X12, HL7, or FHIR data formats
  • Strong understanding of Medallion Architecture for data lake houses
  • Hands-on experience building dimensional models and data warehouses
  • Working knowledge of HIPAA and CMS interoperability requirements
  • Scala or Java a plus
  • Three (3) years of equivalent experience in a related field may be substituted for the Bachelor’s degree.
  • 3+ years hands-on experience in building, deploying, and maintaining data pipelines on AWS or equivalent cloud platforms.

Required skills

  • AWS Data Engineering, Python, SQL, Apache Spark (PySpark), AWS Glue, Amazon S3, Amazon Redshift, Amazon Athena, Amazon EMR, AWS Lake Formation, Data Pipeline Orchestration (Airflow), Infrastructure as Code Terraform, Infrastructure as Code CloudFormation

Preferred skills

  • Scala or Java a plus

Experience

  • 3+ years

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Jul 31, 2026

Work mode

On-site

Job source

Ethic Leaf recruiter

Company

Big Data

Information Technology & AI

Enterprise IT solutions provider for government and healthcare

See all 27 jobs from Big Data →
  • Falls Church, Virginia, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 1996
  • citi-us.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in United States

eTeam

1d ago

New

Data Engineer

TemporaryRemoteUnited StatesCompetitive

SMBC US is hiring a Data Engineer to build systems that gather, store, and process large volumes of data for analysis. The role focuses on developing ETL pipelines, ensuring data quality, and optimizing data storage solutions.

Why similarSame roleAWS GluePython

Genesis10

1d ago

New

Data Engineer

TemporaryRemoteUnited StatesCompetitive

SMBC is seeking a Data Engineer to build systems that gather, store, and process large volumes of data for analysis. The role focuses on developing ETL pipelines, ensuring data quality, and optimizing data storage solutions.

Why similarSame roleAWS GluePython

R Systems

1d ago

New

AI Data Engineer

Full-timeOn-siteUnited StatesCompetitive

R Systems is hiring an AI Data Engineer to design, build, and maintain data pipelines, lakehouses, and retrieval infrastructure for production AI, machine learning, and generative AI applications.

Why similarSame rolePythonSQL

Get new Data Engineer jobs in United States by email

Create job alert

Data Engineer

Big Data · Competitive

Apply via Ethic Leaf