← Back to jobsJob ID col-cmvl9ukbk02h2s3ct0rsgtrnf

DicePosted 21 days ago

Data Engineer

Full-time
On-site
Mid level
Competitive
Posted 21 days ago

Responsibilities Design, build, and maintain scalable data pipelines to collect, transform, and deliver data from multiple sources Develop and optimize ETL workflows to support analytics, reporting, and downstream applications Use Python and Apache Spark to process large-volume datasets efficiently and reliably Work with Hadoop-based environments to manage distributed data storage and processing needs Implement and s

Posted
21 days ago
Source
dice.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, build, and maintain scalable data pipelines to collect, transform, and deliver data from multiple sources
  • Develop and optimize ETL workflows to support analytics, reporting, and downstream applications
  • Use Python and Apache Spark to process large-volume datasets efficiently and reliably
  • Work with Hadoop-based environments to manage distributed data storage and processing needs
  • Implement and support Kafka-based data streaming solutions for real-time data movement
  • Partner with technical and business stakeholders to understand data requirements and translate them into practical engineering solutions
  • Monitor pipeline performance, troubleshoot data issues, and improve overall data quality and reliability

Qualifications

  • Hands-on experience as a Data Engineer or in a similar data-focused engineering role
  • Strong programming ability in Python for data processing and workflow development
  • Practical experience with Apache Spark for large-scale data transformation
  • Working knowledge of Apache Hadoop and distributed data processing concepts
  • Experience using Apache Kafka for event streaming or real-time data integration
  • Solid understanding of ETL design, development, and optimization best practices
  • Ability to work effectively with cross-functional teams in a fast-paced environment
  • All applicants applying for U.S. job openings must be legally authorized to work in the United States

Required skills

Apache HadoopApache KafkaApache SparkDistributed Data ProcessingETL Design and OptimizationPython

Full job description

Responsibilities

  • Design, build, and maintain scalable data pipelines to collect, transform, and deliver data from multiple sources
  • Develop and optimize ETL workflows to support analytics, reporting, and downstream applications
  • Use Python and Apache Spark to process large-volume datasets efficiently and reliably
  • Work with Hadoop-based environments to manage distributed data storage and processing needs
  • Implement and support Kafka-based data streaming solutions for real-time data movement
  • Partner with technical and business stakeholders to understand data requirements and translate them into practical engineering solutions
  • Monitor pipeline performance, troubleshoot data issues, and improve overall data quality and reliability

Benefits

  • Free online training
  • Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance.
  • Hired contract/temporary professionals are also eligible to enroll in the company 401(k) plan.
  • Dice is the go-to career marketplace for tech professionals.
  • Centennial, Colorado, USA
  • https://www.or-quest.nl/
  • Growth Stage
  • Leadership Team
  • Daniel Hinck
  • Client Success Partner
  • Kalyn Thorne
  • Client Success Partner - Enterprise
  • Recent News
  • WebProNews
  • 68% of Tech Pros Distrust AI Hiring, Dice Study Shows
  • 2025-08-25
  • PC Gamer
  • 'It's the definition of insanity here': The Battlefield subreddit's good vibes nosedive into outrage after DICE announces there'll be no class weapon restrictions in Battlefield 6
  • 2025-05-23
  • Business Insider
  • I'm the president of a tech career website and have over 25 years of experience. Here are 5 qualities that can get you promoted faster.
  • 2025-04-21
  • Company data provided by
  • AI Tools
  • Customize Your Resume
  • Maximize your interview chances
  • Build Cover Letter
  • Make your application stand out
  • Analyze How Well You Fit
  • Understand your strength & weakness

Qualifications

  • Hands-on experience as a Data Engineer or in a similar data-focused engineering role
  • Strong programming ability in Python for data processing and workflow development
  • Practical experience with Apache Spark for large-scale data transformation
  • Working knowledge of Apache Hadoop and distributed data processing concepts
  • Experience using Apache Kafka for event streaming or real-time data integration
  • Solid understanding of ETL design, development, and optimization best practices
  • Ability to work effectively with cross-functional teams in a fast-paced environment
  • All applicants applying for U.S. job openings must be legally authorized to work in the United States

Required skills

  • Apache Hadoop, Apache Kafka, Apache Spark, Distributed Data Processing, ETL Design and Optimization, Python

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Oct 23, 2026

Work mode

On-site

Job source

dice.com

Company

Dice

Information Technology & AI

See all 110 jobs from Dice →
  • Houston, TX
  • Information Technology & AI

Similar jobs

Other roles in Houston, TX or Information Technology & AI

Information Technology & AI

30+ days ago

Software Engineer, Kernel Performance & AI Tooling

Full-timeSan Francisco, CACompetitive

We are looking for a systems-minded engineer to help advance our kernel development, performance engineering, and hardware-software co-design capabilities, with a particular focus on AI-assisted workflows and tooling.

Information Technology & AI

30+ days ago

AI Support Engineer

Full-timeSan Francisco, CACompetitive

We’re looking for dedicated, experienced, and deeply curious individuals to help solve some of the most complex challenges faced by our customers while building the future of post-AGI support alongside us.

Information Technology & AI

30+ days ago

Staff Software Engineer, Payment Systems

Full-timeSeattle, NYCompetitive

As a Staff Engineer on Payment Intelligence, you’ll work across our product portfolio to ensure we’re building in a consistent, efficient, and effective manner.

Data Engineer

Dice · Competitive

Apply on company site