← Back to jobsJob ID col-cmwp6z95j071xd8hax7q6sqlr

Artificial Intelligence (AI)Posted 1 day ago

Data EngineerNew

Full-time
Hybrid
8+ years
Competitive
Posted 1 day ago

Prudent Technologies and Consulting, Inc. is hiring a Data Engineer to build and maintain data pipelines and support migration of Snowflake transformations to Databricks. The role also focuses on data ingestion, quality monitoring, pipeline reliability, and collaboration with analytics and marketing partners.

Posted
1 day ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Assist in building and maintaining ETL/ELT pipelines for acquisition reporting using Databricks, PySpark, SQL, and Unity Catalog under the guidance of senior engineers
  • Support the migration of existing Snowflake SQL scripts and transformations into Databricks UC by updating queries, validating outputs, and helping implement governance best practices
  • Contribute to developing ingestion processes for marketing vendor data, including data parsing, normalization, and basic quality validations
  • Implement and maintain foundational data quality checks, monitoring alerts, and issue triage workflows using Databricks, Snowflake, Airflow, and internal tooling
  • Partner with the Data Reliability Engineering team to assist with SLA monitoring, simple incident troubleshooting, and logging improvements
  • Collaborate with analytics and marketing partners to understand data requirements and ensure accuracy of datasets used in dashboards and reporting
  • Support performance tuning, logging improvements, and general pipeline reliability work
  • Participate in engineering best practices, including code reviews, documentation, and contributing to shared frameworks and tools

Qualifications

  • 8+ years of experience as a Data Engineer or similar role
  • Strong proficiency in SQL (analytical SQL, complex joins, window functions)
  • Hands-on experience with PySpark and/or Spark SQL in production
  • Good understanding of data modeling, ETL/ELT design patterns, and distributed data processing
  • Experience building pipelines in Databricks, including Delta Lake, Unity Catalog, data governance, and Lakehouse patterns
  • Experience in AWS (S3, IAM, EC2, Glue, Lambda, or related services)
  • Experience with Airflow or similar orchestration tools
  • Experience building robust ingestion pipelines and working with semi‑structured formats (JSON, Parquet, CSV)
  • Experience with Git/GitHub, CI/CD, and modern DevOps practices
  • Excellent communication skills and ability to work with cross‑functional partners

Required skills

AWS EC2AWS GlueAWS IAMAWS LambdaAWS S3Apache AirflowCI/CDData ModelingDatabricksDelta LakeDistributed Data ProcessingETL/ELT DesignGit/GitHubPySpark

Full job description

Prudent Technologies and Consulting, Inc. is hiring a Data Engineer to build and maintain data pipelines and support migration of Snowflake transformations to Databricks. The role also focuses on data ingestion, quality monitoring, pipeline reliability, and collaboration with analytics and marketing partners.

Responsibilities

  • Assist in building and maintaining ETL/ELT pipelines for acquisition reporting using Databricks, PySpark, SQL, and Unity Catalog under the guidance of senior engineers
  • Support the migration of existing Snowflake SQL scripts and transformations into Databricks UC by updating queries, validating outputs, and helping implement governance best practices
  • Contribute to developing ingestion processes for marketing vendor data, including data parsing, normalization, and basic quality validations
  • Implement and maintain foundational data quality checks, monitoring alerts, and issue triage workflows using Databricks, Snowflake, Airflow, and internal tooling
  • Partner with the Data Reliability Engineering team to assist with SLA monitoring, simple incident troubleshooting, and logging improvements
  • Collaborate with analytics and marketing partners to understand data requirements and ensure accuracy of datasets used in dashboards and reporting
  • Support performance tuning, logging improvements, and general pipeline reliability work
  • Participate in engineering best practices, including code reviews, documentation, and contributing to shared frameworks and tools

Benefits

  • Hybrid work: 4 days onsite and 1 day remote.

Company

  • Enterprise technology services for data, AI, cybersecurity, and applications
  • Dallas, Texas, USA
  • https://www.prudentconsulting.com/
  • Founded in 1998
  • 501-1000 employees

Qualifications

  • 8+ years of experience as a Data Engineer or similar role
  • Strong proficiency in SQL (analytical SQL, complex joins, window functions)
  • Hands-on experience with PySpark and/or Spark SQL in production
  • Good understanding of data modeling, ETL/ELT design patterns, and distributed data processing
  • Experience building pipelines in Databricks, including Delta Lake, Unity Catalog, data governance, and Lakehouse patterns
  • Experience in AWS (S3, IAM, EC2, Glue, Lambda, or related services)
  • Experience with Airflow or similar orchestration tools
  • Experience building robust ingestion pipelines and working with semi‑structured formats (JSON, Parquet, CSV)
  • Experience with Git/GitHub, CI/CD, and modern DevOps practices
  • Excellent communication skills and ability to work with cross‑functional partners
  • 8+ years of experience as a Data Engineer or similar role.

Required skills

  • AWS EC2, AWS Glue, AWS IAM, AWS Lambda, AWS S3, Apache Airflow, CI/CD, Data Modeling, Databricks, Delta Lake, Distributed Data Processing, ETL/ELT Design, Git/GitHub, PySpark, SQL, Spark SQL, Unity Catalog

Experience

  • 8+ years

Job details

Employment type

Full-time

Seniority level

8+ years

Date posted

Nov 20, 2026

Work mode

Hybrid

Job source

linkedin.com

Company

Artificial Intelligence (AI)

Information Technology & AI

Enterprise technology services for data, AI, cybersecurity, and applications

See all 19 jobs from Artificial Intelligence (AI) →

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Glendale

Meritore Technologies

1d ago

New

AWS Data Engineer

Full-timeOn-siteTorrance, CACompetitive

Meritore Technologies is hiring an AWS Data Engineer to build and operate scalable AWS data pipelines and cloud-based data lake and warehouse solutions.

Why similarSame roleAWS GlueTorrance

EXL

1d ago

New

Senior Data Engineer

Full-timeRemoteUnited StatesCompetitive

EXL is seeking a seasoned Data Engineer to join their Sports Analytics & Engineering Practice. This role is pivotal in shaping and implementing a cloud-native data ecosystem, where you will architect and build scalable data infrastructure that transforms raw…

Why similarSame roleAWS GlueRemote

Dice

1d ago

New

Senior AWS Data Engineer

TemporaryHybridIndianapolis, INCompetitive

Alchemy is recruiting for an unnamed client seeking a Senior AWS Data Engineer with healthcare data project experience.

Why similarSame roleAWS GlueAWS Lambda

Get new Data Engineer jobs in Glendale by email

Create job alert

Data Engineer

Artificial Intelligence (AI) · Competitive

Apply on company site