← Back to jobsJob ID col-cmwp7ecr507a4d8hauwi635rm

DicePosted 1 day ago

Google Cloud Platform Data and platform EngineerNew

Full-time
Remote
7–9 years
Competitive
Posted 1 day ago

Amaze Systems is recruiting for a Senior Data Engineer to build and operate Google Cloud data pipelines, curated datasets, and machine-learning features. The role also covers data quality, disaster recovery, archival, HIPAA/PHI controls, and technical documentation.

Posted
1 day ago
Source
dice.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Ingestion: Stream health, benefits, news and click-through files (CV/Parquet) through Kafka and Dataflow into Cloud Storage and BigQuery-
  • Transformation: Run ETL/ELT jobs on Dataflow and Datapros Spark to produce clean, normalized BigQuery datasets
  • Curated marts: Build 360° denormalized views that combine prescription (Rx), benefits, behavioral and clinical signals
  • Feature Store and ML datasets: Load the Google Cloud Platform Feature Store, build batch and online feature paths, create train/eval splits and version datasets. Monitor data drift and feature freshness with Vertex Al
  • Adobe Analytics: Bring in behavioral event data and line it up with clinical and benefits data
  • Data quality and BigQuery operations: Set up SLAs, alerting, schema validation and anomaly detection. Manage partitioning, schema changes and cost
  • Disaster recovery: Set recovery time and recovery point targets (RTO/RPO), replicate BigQuery across regions, maintain DR buckets and Feature Store snapshots, and test failover runbooks
  • Archival: Set BigQuery table expiry, move older data to cheaper Cloud Storage tiers (Nearline, Coldline, Archive) and meet HIPAA retention rules
  • HIPAA and patient health information (PHI): Apply field-level encryption and masking and de-identify data (Safe Harbor or Expert Determination) before training. Enforce access controls and audit logging
  • Documentation: Write up data contracts, data lineage, Feature Store definitions, DR runbooks and archival policies

Qualifications

  • 7-9 years in data engineering or ML data engineering, in production Google Cloud Platform
  • BigQuery (advanced), Kafka, Dataflow/Beam, Spark (PySpark or Scala), Pub/Sub, Composer/Airflow, plus strong SQL and data modeling (Lakehouse)
  • Feature Stores, Vertex Al Pipelines or similar MLOps tools, and the ML lifecycle
  • Proven experience with: DR design, archival and retention for regulated data, and hands-on HIPAA/PHI controls

Preferred

  • Adobe Experience Platform, Looker, Google Cloud Platform customer-managed encryption keys (CMEK), HIPAA business associate agreement (BAA) awareness
  • NIST/HITRUST, and healthcare data experience (Rx, clinical or benefits)
  • Adobe Experience Platform
  • Google Cloud Platform CMEK
  • Healthcare Data Experience

Required skills

Apache SparkBigQueryCloud Composer/Apache AirflowDataflow/Apache BeamDisaster Recovery DesignFeature StoresGoogle Cloud Platform (GCP)HIPAA/PHI Data ControlsKafkaPub/SubSQLVertex AI Pipelines

Full job description

Amaze Systems is recruiting for a Senior Data Engineer to build and operate Google Cloud data pipelines, curated datasets, and machine-learning features. The role also covers data quality, disaster recovery, archival, HIPAA/PHI controls, and technical documentation.

Responsibilities

  • Ingestion: Stream health, benefits, news and click-through files (CV/Parquet) through Kafka and Dataflow into Cloud Storage and BigQuery-
  • Transformation: Run ETL/ELT jobs on Dataflow and Datapros Spark to produce clean, normalized BigQuery datasets
  • Curated marts: Build 360° denormalized views that combine prescription (Rx), benefits, behavioral and clinical signals
  • Feature Store and ML datasets: Load the Google Cloud Platform Feature Store, build batch and online feature paths, create train/eval splits and version datasets. Monitor data drift and feature freshness with Vertex Al
  • Adobe Analytics: Bring in behavioral event data and line it up with clinical and benefits data
  • Data quality and BigQuery operations: Set up SLAs, alerting, schema validation and anomaly detection. Manage partitioning, schema changes and cost
  • Disaster recovery: Set recovery time and recovery point targets (RTO/RPO), replicate BigQuery across regions, maintain DR buckets and Feature Store snapshots, and test failover runbooks
  • Archival: Set BigQuery table expiry, move older data to cheaper Cloud Storage tiers (Nearline, Coldline, Archive) and meet HIPAA retention rules
  • HIPAA and patient health information (PHI): Apply field-level encryption and masking and de-identify data (Safe Harbor or Expert Determination) before training. Enforce access controls and audit logging
  • Documentation: Write up data contracts, data lineage, Feature Store definitions, DR runbooks and archival policies

Preferred

  • Adobe Experience Platform, Looker, Google Cloud Platform customer-managed encryption keys (CMEK), HIPAA business associate agreement (BAA) awareness
  • NIST/HITRUST, and healthcare data experience (Rx, clinical or benefits)
  • Adobe Experience Platform
  • Looker
  • Google Cloud Platform CMEK
  • HIPAA BAA Awareness
  • NIST
  • HITRUST
  • Healthcare Data Experience
  • Prescription Data
  • Clinical Data
  • Benefits Data

Benefits

  • Remote work (US)

Company

  • Tech career marketplace connecting professionals with recruiters
  • Centennial, Colorado, USA
  • https://www.or-quest.nl/
  • Founded in 1990
  • 201-500 employees

Qualifications

  • 7-9 years in data engineering or ML data engineering, in production Google Cloud Platform
  • BigQuery (advanced), Kafka, Dataflow/Beam, Spark (PySpark or Scala), Pub/Sub, Composer/Airflow, plus strong SQL and data modeling (Lakehouse)
  • Feature Stores, Vertex Al Pipelines or similar MLOps tools, and the ML lifecycle
  • Proven experience with: DR design, archival and retention for regulated data, and hands-on HIPAA/PHI controls
  • Adobe Experience Platform, Looker, Google Cloud Platform customer-managed encryption keys (CMEK), HIPAA business associate agreement (BAA) awareness
  • NIST/HITRUST, and healthcare data experience (Rx, clinical or benefits)

Required skills

  • Apache Spark, BigQuery, Cloud Composer/Apache Airflow, Dataflow/Apache Beam, Disaster Recovery Design, Feature Stores, Google Cloud Platform (GCP), HIPAA/PHI Data Controls, Kafka, Pub/Sub, SQL, Vertex AI Pipelines

Experience

  • 7-9 years

Job details

Employment type

Full-time

Seniority level

7–9 years

Date posted

Nov 20, 2026

Work mode

Remote

Job source

dice.com

Company

Dice

Information Technology & AI

Tech career marketplace connecting professionals with recruiters

See all 301 jobs from Dice →
  • Centennial, Colorado, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 1990
  • or-quest.nl

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs

Coinbase

1d ago

New

Senior Software Engineer - Data Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer to build and operate systems that centralize internal and third-party data.

Why similarSame roleKafkaSQL

R Systems

1d ago

New

AI Data Engineer

Full-timeOn-siteUnited StatesCompetitive

R Systems is hiring an AI Data Engineer to design, build, and maintain data pipelines, lakehouses, and retrieval infrastructure for production AI, machine learning, and generative AI applications.

Why similarSame roleApache SparkKafka

Airbnb

1d ago

New

Data Engineer Tech Foundations

Full-timeRemoteUnited States$162K – $186K/yr

Airbnb is hiring a Data Engineer to build and operate reliable, reusable datasets and pipelines that support AI usage and cost measurement, Unit Economics, enterprise application data, and critical financial metrics.

Why similarSame roleApache SparkSQL

Get new Data Engineer jobs by email

Create job alert

Google Cloud Platform Data and platform Engineer

Dice · Competitive

Apply on company site