Python Data Engineer

SCI Solutions Global is hiring a Python Data Engineer to support data engineering work using Python, PySpark, and big data technologies. The role is onsite in Plano, Texas, and involves technologies including AWS, Terraform, and data-processing and messaging platforms.

Responsibilities

Python/PySpark Data Engineer building cloud big-data pipelines, infrastructure, and workflow orchestration

Preferred

US Citizen, Green Card, or GC EAD preferred

Experience with Databricks (workspaces, notebooks, jobs)

Familiarity with machine learning models (e.g., training/inference workflows, model lifecycle) is a plus

Databricks

Databricks Workspaces

Databricks Notebooks

Databricks Jobs

Machine Learning Models

Inference Workflows

Model Lifecycle

Company

Technology consulting and talent solutions for digital transformation

Sheridan, Wyoming, US

https://scisolutionsglobal.com/

11-50 employees

Qualifications

Strong hands-on experience in Python, PySpark and Bigdata technologies for data engineering

Practical experience with AWS, specifically S3, EMR, and Lambda

Working knowledge of Terraform (infrastructure as code)

Working knowledge on Java, Rest API, MQ Messaging, Kafka, Cassandra

Working knowledge on Airflow, Control-M, native schedulers

US Citizen, Green Card, or GC EAD preferred

Experience with Databricks (workspaces, notebooks, jobs)

Familiarity with machine learning models (e.g., training/inference workflows, model lifecycle) is a plus

Required skills

Python, PySpark, Big Data, AWS S3, Amazon EMR, AWS Lambda, Terraform, Java, REST APIs, MQ Messaging, Apache Kafka, Apache Cassandra, Apache Airflow, Control-M, Native Schedulers, Databricks, Machine Learning

Experience

Mid level