AWS Python Data Engineer

VDart is seeking an AWS Python Data Engineer to build and support cloud-based data solutions. The role involves AWS services, Python, APIs and microservices, infrastructure automation, CI/CD, and scalable system design.

Responsibilities

Cloud data engineer building Python data pipelines and scalable AWS services

Preferred

Experience with Pyspark

Experience with Fast API/Flask frameworks

Large-scale data processing (JSON/XML/Parquet) is preferred

Experience with Distributed Systems, SQL & NoSQL (PostgreSQL, DynamoDB)

PySpark

FastAPI

Flask

Large-Scale Data Processing

JSON

XML

Parquet

Distributed Systems

SQL

NoSQL

PostgreSQL

DynamoDB

Company

Global technology staffing and solutions provider

Alpharetta, Georgia, USA

https://www.vdart.com/

Founded in 2007

1001-5000 employees

Qualifications

Experience with AWS (EC2, ECS, ECR, EFS, EMR, Lambda, Step functions, RDS, Glue, S3, API Gateway), SQS/SNS, REST APIs & Microservices

Experience in Python libraries and scripting

Experience with CI/CD (GitLab, Git), Docker & Kubernetes, Terraform (IaC), SDLC

Familiarities with Cloud-native architecture patterns, Production monitoring & reliability improvements

Experience with System Design & Scalability

Experience with Pyspark

Experience with Fast API/Flask frameworks

Large-scale data processing (JSON/XML/Parquet) is preferred

Experience with Distributed Systems, SQL & NoSQL (PostgreSQL, DynamoDB)

Required skills

AWS EC2, AWS ECS, AWS ECR, AWS EFS, AWS EMR, AWS Lambda, AWS Step Functions, AWS RDS, AWS Glue, AWS S3, AWS API Gateway, AWS SQS, AWS SNS, Python, REST APIs, Microservices, GitLab CI/CD, Git, Docker, Kubernetes, Terraform, Cloud-Native Architecture, System Design and Scalability

Experience

Mid level