← Back to jobsJob ID col-cmv8bfmd401jjoz012lh1qjvy

VitolPosted 30+ days ago

Data Engineer

Full-time
On-site
3+ years
Competitive
Posted 30+ days ago

Vitol is a leader in energy and commodities that produces, manages, and delivers energy and commodities worldwide. The Data Engineer will build, operate, and support production data pipelines and warehouse models for a centralized data platform serving energy traders, analysts, applications, and AI systems. The role also involves migrating legacy pipelines, implementing data quality controls, and collaborating directly with analysts and desk users.

Posted
30+ Days Ago
Source
Ethic Leaf recruiter
Sector
Information Technology & AI

No employer link yet — an Ethic Leaf recruiter forwards your application

Responsibilities

  • Build, test, and operate production data pipelines in Python on our modern pipeline framework, orchestrated with Prefect
  • Build and maintain warehouse models in Snowflake using dbt — clean, tested, documented, and cost-aware
  • Migrate legacy pipelines and Oracle-based components onto current frameworks and standards, retiring technical debt as you go
  • Work across the platform stack — Kafka, Redis, InfluxDB, Oracle, and Snowflake — building to the established pattern for each rather than reaching for the tool you already know
  • Acquire data from external sources — vendor APIs, files, feeds, and web sources — and land it reliably
  • Implement data quality, freshness, and reconciliation checks so problems surface before users find them
  • Use AWS data services where our platform patterns call for them
  • Support what you ship — monitoring and alerting on your components, and investigating when something breaks
  • Contribute to making platform data AI-ready, and work with the catalog and steward teams so what you build is documented, classified, and findable
  • Engage directly with analysts and desk users to check that what you are building solves the actual problem

Qualifications

  • 3+ years** of hands-on data engineering experience building and operating production data pipelines
  • Strong Python** — clean, tested, maintainable code, not scripts that happen to run. Fluency with pandas and the wider data-handling ecosystem
  • SQL depth** — you can model, query, and tune, and you know what makes a query expensive before you run it
  • Snowflake or a comparable cloud warehouse** — dimensional modeling, performance tuning, and cost-aware design
  • Breadth across data technologies** — streaming, caching, timeseries, relational, and warehouse, with a view on where each belongs
  • Pipeline orchestration experience** — Airflow, Dagster, or similar considered
  • Sound engineering fundamentals** — object-oriented design, design patterns, testing, code review, and version control as habits rather than requirements
  • Working knowledge of AWS data services** and how to compose them into something reliable
  • A build-to-operate mindset** — monitoring, alerting, and failure recovery are part of how you design, not something added later
  • Clear communication** — you can explain a technical trade-off to an analyst, and turn a vague request into the right set of questions
  • Terraform, Docker, or API development** (FastAPI, Flask) exposure is welcome — we use all three

Preferred

  • Snowflake or a comparable cloud warehouse** — dimensional modeling, performance tuning, and cost-aware design. dbt experience is a strong plus
  • Pipeline orchestration experience** — Prefect preferred
  • Experience in financial services, commodities, or energy trading data** is a plus; the data volume, latency requirements, and stakes are real

Required skills

PythonSQLSnowflakedbtData Pipeline OrchestrationAWS Data ServicesKafkaRedisInfluxDBOracleData Quality ManagementMonitoring and Alerting

Full job description

Vitol is a leader in energy and commodities that produces, manages, and delivers energy and commodities worldwide. The Data Engineer will build, operate, and support production data pipelines and warehouse models for a centralized data platform serving energy traders, analysts, applications, and AI systems. The role also involves migrating legacy pipelines, implementing data quality controls, and collaborating directly with analysts and desk users.

Responsibilities

  • Build, test, and operate production data pipelines in Python on our modern pipeline framework, orchestrated with Prefect
  • Build and maintain warehouse models in Snowflake using dbt — clean, tested, documented, and cost-aware
  • Migrate legacy pipelines and Oracle-based components onto current frameworks and standards, retiring technical debt as you go
  • Work across the platform stack — Kafka, Redis, InfluxDB, Oracle, and Snowflake — building to the established pattern for each rather than reaching for the tool you already know
  • Acquire data from external sources — vendor APIs, files, feeds, and web sources — and land it reliably
  • Implement data quality, freshness, and reconciliation checks so problems surface before users find them
  • Use AWS data services where our platform patterns call for them
  • Support what you ship — monitoring and alerting on your components, and investigating when something breaks
  • Contribute to making platform data AI-ready, and work with the catalog and steward teams so what you build is documented, classified, and findable
  • Engage directly with analysts and desk users to check that what you are building solves the actual problem

Preferred

  • **Snowflake or a comparable cloud warehouse** — dimensional modeling, performance tuning, and cost-aware design. dbt experience is a strong plus
  • **Pipeline orchestration experience** — Prefect preferred
  • **Experience in financial services, commodities, or energy trading data** is a plus; the data volume, latency requirements, and stakes are real
  • Cloud data warehousing
  • dbt
  • Prefect
  • Financial services
  • Commodities data
  • Energy trading data
  • High-volume data
  • Low-latency systems

Benefits

  • Medical
  • Dental
  • Vision
  • Paid Vacation
  • 401k with company contributions
  • Life insurance
  • Short-term & Long-term disability

Company

  • Global energy and commodities trading and distribution company
  • Rotterdam, Zuid-Holland, NLD
  • http://www.vitol.com/
  • Founded in 1966
  • 1001-5000 employees

Qualifications

  • 3+ years** of hands-on data engineering experience building and operating production data pipelines
  • **Strong Python** — clean, tested, maintainable code, not scripts that happen to run. Fluency with pandas and the wider data-handling ecosystem
  • **SQL depth** — you can model, query, and tune, and you know what makes a query expensive before you run it
  • **Snowflake or a comparable cloud warehouse** — dimensional modeling, performance tuning, and cost-aware design
  • **Breadth across data technologies** — streaming, caching, timeseries, relational, and warehouse, with a view on where each belongs
  • **Pipeline orchestration experience** — Airflow, Dagster, or similar considered
  • **Sound engineering fundamentals** — object-oriented design, design patterns, testing, code review, and version control as habits rather than requirements
  • **Working knowledge of AWS data services** and how to compose them into something reliable
  • **A build-to-operate mindset** — monitoring, alerting, and failure recovery are part of how you design, not something added later
  • **Clear communication** — you can explain a technical trade-off to an analyst, and turn a vague request into the right set of questions
  • **Terraform, Docker, or API development** (FastAPI, Flask) exposure is welcome — we use all three
  • **Snowflake or a comparable cloud warehouse** — dimensional modeling, performance tuning, and cost-aware design. dbt experience is a strong plus
  • **Pipeline orchestration experience** — Prefect preferred
  • **Experience in financial services, commodities, or energy trading data** is a plus; the data volume, latency requirements, and stakes are real

Required skills

  • Python, SQL, Snowflake, dbt, Data Pipeline Orchestration, AWS Data Services, Kafka, Redis, InfluxDB, Oracle, Data Quality Management, Monitoring and Alerting

Preferred skills

  • **Pipeline orchestration experience** — Prefect preferred

Experience

  • 3+ years

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Oct 3, 2026

Work mode

On-site

Job source

Ethic Leaf recruiter

Company

Vitol

Information Technology & AI

Global energy and commodities trading and distribution company

  • Houston, TX
  • Information Technology & AI
  • 1001-5000 employees
  • Founded 1966
  • vitol.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Houston

Senior Data Engineer (Fraud) Job Details

1d ago

New

Senior Data Engineer (Fraud)

Full-timeOn-siteRichardson, TXCompetitive

BOK Financial is hiring a Senior Data Engineer (Fraud) to design, develop, and deliver scalable data pipelines and solutions for enterprise analytics and data platform initiatives.

Why similarSame rolePythonRichardson

Dice

1d ago

New

Senior Data Engineer with AI

TemporaryHybridDallas, TXCompetitive

The hiring employer is not identified in the posting. The role builds and maintains scalable data infrastructure across ingestion, transformation, orchestration, and delivery, while using AI-assisted development tools and collaborating with backend, BI, and…

Why similarSame roleKafkaDallas

Coinbase

1d ago

New

Senior Software Engineer - Data Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer to build and operate systems that centralize internal and third-party data.

Why similarSame roleKafkaRemote

Get new Data Engineer jobs in Houston by email

Create job alert

Data Engineer

Vitol · Competitive

Apply via Ethic Leaf