← Back to jobsJob ID col-cmv8l8gv80dfqoz013d6ndxx0

IBMPosted 30+ days ago

Data Engineer-Data Platforms-Google - 2

Full-time
Remote
Mid level
$215K – $253K/yr
Posted 30+ days ago

IBM Consulting helps clients across industries advance their hybrid cloud and AI journeys through collaboration, technology, and innovative solutions. The Senior Data Engineer will design, build, maintain, schedule, and optimize scalable batch and real-time data platforms and pipelines using Google Cloud services and open-source technologies.

Posted
30+ Days Ago
Source
ibmglobal.avature.net
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design Data Pipelines: Design and develop batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services such as DataProc, DataFlow, PubSub, BigQuery, and Big Table
  • Develop Data Engineering Solutions: Build and maintain data engineering solutions using Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, Google DataFlow with Apache Beam or Python, and other open-source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala
  • Manage Data Platforms: Schedule and manage the data platform using Google Cloud Scheduler and Cloud Composer (Airflow), ensuring seamless data pipeline operations
  • Optimize Data Layer: Design and optimize the data layer for efficient data migration and data processing using Google Cloud services
  • Ensure Scalability: Ensure scalability and efficiency of data pipelines and data engineering solutions to meet business needs

Qualifications

  • Proven experience designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem, including Google DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB
  • Experience with Apache Beam, Apache Airflow, dbt, Spark/Python, or Spark/Scala, and ability to integrate these technologies with Google Cloud services
  • Experience developing and managing batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services
  • Experience scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow)
  • Experience designing and optimizing data layers for efficient data migration and data processing using Google Cloud services

Preferred

  • Experience with Apache Beam, including integrating it with Google Cloud services such as DataFlow, is highly valued
  • Ability to optimize Beam pipelines for scalability and efficiency is a plus
  • Familiarity with dbt and data modeling concepts, including data warehousing and data lake architecture, is beneficial for designing and optimizing data layers
  • Proficiency in Spark and Scala, including integrating them with Google Cloud services such as DataProc, is desirable for building and maintaining data engineering solutions

Required skills

Google Cloud PlatformData EngineeringData PipelinesData WarehousingData LakesGoogle Cloud DataflowGoogle Cloud DataprocGoogle Cloud Pub/SubGoogle BigQueryGoogle BigtableCloud SpannerCloud SQLAlloyDBApache Beam

Full job description

IBM Consulting helps clients across industries advance their hybrid cloud and AI journeys through collaboration, technology, and innovative solutions. The Senior Data Engineer will design, build, maintain, schedule, and optimize scalable batch and real-time data platforms and pipelines using Google Cloud services and open-source technologies.

Responsibilities

  • Design Data Pipelines: Design and develop batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services such as DataProc, DataFlow, PubSub, BigQuery, and Big Table
  • Develop Data Engineering Solutions: Build and maintain data engineering solutions using Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, Google DataFlow with Apache Beam or Python, and other open-source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala
  • Manage Data Platforms: Schedule and manage the data platform using Google Cloud Scheduler and Cloud Composer (Airflow), ensuring seamless data pipeline operations
  • Optimize Data Layer: Design and optimize the data layer for efficient data migration and data processing using Google Cloud services
  • Ensure Scalability: Ensure scalability and efficiency of data pipelines and data engineering solutions to meet business needs

Preferred

  • Experience with Apache Beam, including integrating it with Google Cloud services such as DataFlow, is highly valued
  • Ability to optimize Beam pipelines for scalability and efficiency is a plus
  • Familiarity with dbt and data modeling concepts, including data warehousing and data lake architecture, is beneficial for designing and optimizing data layers
  • Proficiency in Spark and Scala, including integrating them with Google Cloud services such as DataProc, is desirable for building and maintaining data engineering solutions
  • Google Cloud
  • Dataflow
  • Beam pipeline optimization
  • Scalability optimization
  • Efficiency optimization
  • Data modeling
  • Data warehousing
  • Data lake architecture
  • Spark
  • Dataproc

Benefits

  • This role can be performed from anywhere in the United States of America
  • Support for long-term career development
  • Tools provided through strategic partners, IBM technology, and Red Hat

Company

  • Enterprise AI, hybrid cloud, automation, data, and consulting solutions
  • Armonk, New York, USA
  • http://www.ibm.com/
  • Founded in 1911
  • 10001+ employees

Qualifications

  • Proven experience designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem, including Google DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB
  • Experience with Apache Beam, Apache Airflow, dbt, Spark/Python, or Spark/Scala, and ability to integrate these technologies with Google Cloud services
  • Experience developing and managing batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud services
  • Experience scheduling and managing data platforms using Google Cloud Scheduler and Cloud Composer (Airflow)
  • Experience designing and optimizing data layers for efficient data migration and data processing using Google Cloud services
  • Experience with Apache Beam, including integrating it with Google Cloud services such as DataFlow, is highly valued
  • Ability to optimize Beam pipelines for scalability and efficiency is a plus
  • Familiarity with dbt and data modeling concepts, including data warehousing and data lake architecture, is beneficial for designing and optimizing data layers
  • Proficiency in Spark and Scala, including integrating them with Google Cloud services such as DataProc, is desirable for building and maintaining data engineering solutions

Required skills

  • Google Cloud Platform, Data Engineering, Data Pipelines, Data Warehousing, Data Lakes, Google Cloud Dataflow, Google Cloud Dataproc, Google Cloud Pub/Sub, Google BigQuery, Google Bigtable, Cloud Spanner, Cloud SQL, AlloyDB, Apache Beam, Apache Airflow, dbt, Apache Spark, Python, Scala, Hadoop, Google Cloud Storage, Cloud Composer, Cloud Scheduler, Data Modeling

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Oct 6, 2026

Work mode

Remote

Job source

ibmglobal.avature.net

Company

IBM

Information Technology & AI

Enterprise AI, hybrid cloud, automation, data, and consulting solutions

See all 14 jobs from IBM →
  • Armonk, New York, USA
  • Information Technology & AI
  • 10001+ employees
  • Founded 1911
  • ibm.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs

Dice

1d ago

New

Google Cloud Platform Data and platform Engineer

Full-timeRemoteUnited StatesCompetitive

Amaze Systems is recruiting for a Senior Data Engineer to build and operate Google Cloud data pipelines, curated datasets, and machine-learning features.

Why similarSame roleRemote

EXL

1d ago

New

Senior Data Engineer

Full-timeRemoteUnited StatesCompetitive

EXL is seeking a seasoned Data Engineer to join their Sports Analytics & Engineering Practice. This role is pivotal in shaping and implementing a cloud-native data ecosystem, where you will architect and build scalable data infrastructure that transforms raw…

Why similarSame roleData warehousingRemote

Curana Health

1d ago

New

Data Engineer

Full-timeRemoteUnited StatesCompetitive

Curana Health is hiring a Data Engineer to build, optimize, and maintain data pipelines supporting clinical, operational, and analytical reporting.

Why similarSame roleData WarehousingRemote

Get new Data Engineer jobs by email

Create job alert

Data Engineer-Data Platforms-Google - 2

IBM · $215K – $253K/yr

Apply on company site