← Back to jobsJob ID col-cmwp9brsx08r8d8hacq0sh4an

RandomTreesPosted 1 day ago

GCP Data EngineerNew

Full-time
On-site
Mid level
Competitive
Posted 1 day ago

RandomTrees is hiring a GCP Data Engineer to build, maintain, and support scalable data pipelines on Google Cloud Platform. The role also covers workflow orchestration, data transformations, production reliability, root-cause analysis, and data validation.

Posted
1 day ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Building, maintaining, and supporting scalable batch and streaming data pipelines on Google Cloud Platform
  • Author, schedule, troubleshoot, and optimize complex Airflow DAGs in a managed Cloud Composer environment (custom operators, task dependencies, retries, backfills, log diagnostics, and runtime/SLA tuning)
  • Building, maintaining, and debugging Apache Beam pipelines written in Java on Google Cloud Dataflow, including job monitoring and performance troubleshooting
  • Developing and debugging SQLX ELT transformations, data quality assertions, and dependency graphs in Dataform
  • Writing and debugging production-grade Airflow tasks, API integrations, and automation scripts
  • Monitoring daily DAG/task runs, performing deep root-cause analysis (RCA) on failures or data discrepancies, building automated data validation/reconciliation checks, and deploying permanent fixes within SLA

Qualifications

  • Hands-on production experience building, maintaining, and supporting scalable batch and streaming data pipelines on Google Cloud Platform, specifically BigQuery and Google Cloud Storage (GCS)
  • Proven ability to author, schedule, troubleshoot, and optimize complex Airflow DAGs in a managed Cloud Composer environment (custom operators, task dependencies, retries, backfills, log diagnostics, and runtime/SLA tuning)
  • Hands-on experience building, maintaining, and debugging Apache Beam pipelines written in Java on Google Cloud Dataflow, including job monitoring and performance troubleshooting
  • Practical experience developing and debugging SQLX ELT transformations, data quality assertions, and dependency graphs in Dataform
  • Deep SQL proficiency in BigQuery, including partitioned (\_PARTITIONTIME) and clustered tables, query performance tuning, slot/cost optimization, and querying operational metadata/telemetry tables
  • Strong python3 skills for writing and debugging production-grade Airflow tasks, API integrations, and automation scripts
  • Demonstrated ability to own production reliability—monitoring daily DAG/task runs, performing deep root-cause analysis (RCA) on failures or data discrepancies, building automated data validation/reconciliation checks, and deploying permanent fixes within SLA

Required skills

Apache AirflowApache BeamBigQueryBigQuery SQL OptimizationCloud ComposerData ValidationDataform (SQLX)Google Cloud DataflowGoogle Cloud Platform (GCP)Google Cloud Storage (GCS)JavaPython

Full job description

RandomTrees is hiring a GCP Data Engineer to build, maintain, and support scalable data pipelines on Google Cloud Platform. The role also covers workflow orchestration, data transformations, production reliability, root-cause analysis, and data validation.

Responsibilities

  • Building, maintaining, and supporting scalable batch and streaming data pipelines on Google Cloud Platform
  • Author, schedule, troubleshoot, and optimize complex Airflow DAGs in a managed Cloud Composer environment (custom operators, task dependencies, retries, backfills, log diagnostics, and runtime/SLA tuning)
  • Building, maintaining, and debugging Apache Beam pipelines written in Java on Google Cloud Dataflow, including job monitoring and performance troubleshooting
  • Developing and debugging SQLX ELT transformations, data quality assertions, and dependency graphs in Dataform
  • Writing and debugging production-grade Airflow tasks, API integrations, and automation scripts
  • Monitoring daily DAG/task runs, performing deep root-cause analysis (RCA) on failures or data discrepancies, building automated data validation/reconciliation checks, and deploying permanent fixes within SLA

Company

  • Enterprise data engineering and generative AI solutions
  • Cypress, Texas, USA
  • https://www.randomtrees.com/
  • Founded in 2017
  • 201-500 employees

Qualifications

  • Hands-on production experience building, maintaining, and supporting scalable batch and streaming data pipelines on Google Cloud Platform, specifically BigQuery and Google Cloud Storage (GCS)
  • Proven ability to author, schedule, troubleshoot, and optimize complex Airflow DAGs in a managed Cloud Composer environment (custom operators, task dependencies, retries, backfills, log diagnostics, and runtime/SLA tuning)
  • Hands-on experience building, maintaining, and debugging Apache Beam pipelines written in Java on Google Cloud Dataflow, including job monitoring and performance troubleshooting
  • Practical experience developing and debugging SQLX ELT transformations, data quality assertions, and dependency graphs in Dataform
  • Deep SQL proficiency in BigQuery, including partitioned (\_PARTITIONTIME) and clustered tables, query performance tuning, slot/cost optimization, and querying operational metadata/telemetry tables
  • Strong python3 skills for writing and debugging production-grade Airflow tasks, API integrations, and automation scripts
  • Demonstrated ability to own production reliability—monitoring daily DAG/task runs, performing deep root-cause analysis (RCA) on failures or data discrepancies, building automated data validation/reconciliation checks, and deploying permanent fixes within SLA

Required skills

  • Apache Airflow, Apache Beam, BigQuery, BigQuery SQL Optimization, Cloud Composer, Data Validation, Dataform (SQLX), Google Cloud Dataflow, Google Cloud Platform (GCP), Google Cloud Storage (GCS), Java, Python

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Nov 20, 2026

Work mode

On-site

Job source

linkedin.com

Company

RandomTrees

Information Technology & AI

Enterprise data engineering and generative AI solutions

  • Cypress, Texas, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 2017
  • randomtrees.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Philadelphia

Dice

1d ago

New

Google Cloud Platform Data Engineer

TemporaryHybridPhiladelphia, PACompetitive

Sansutek Inc is seeking a Google Cloud Platform Data Engineer to build and support production data pipelines and provide US-hours operations, triage, and root-cause analysis.

Why similarSame roleApache AirflowPhiladelphia

NTT DATA

1d ago

New

Sr Data Engineer

Full-timeOn-sitePhiladelphia, PACompetitive

NTT DATA is hiring a Senior Data Engineer for its Cencora Data Mapping & Automation engagement. The role designs, builds, tests, and operationalizes reusable data pipelines and mapping components across Salesforce, Azure, APIs, files, and approved client…

Why similarSame roleJavaPhiladelphia

Coinbase

1d ago

New

Senior Software Engineer, Data Engineering Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer for its Data Platform team. The role builds and maintains SDKs, self-service applications, reusable abstractions, and security and observability tooling that help internal teams create, manage, and use data…

Why similarSame roleApache AirflowRemote

Get new Data Engineer jobs in Philadelphia by email

Create job alert

GCP Data Engineer

RandomTrees · Competitive

Apply on company site