← Back to jobsJob ID col-cmv8ary6s00o5oz01a00xz92g

Caterpillar Inc.Posted 30+ days ago

Data Engineer – Physical AI Platform

Full-time
On-site
3+ years
$98K – $158K/yr
Posted 30+ days ago

Caterpillar Inc. develops technology that connects machines, data, and people to enable safer, more productive, and more sustainable jobsites. The Data Engineer will design, build, and maintain scalable data pipelines, microservices, and cloud-based data systems supporting real-time and batch processing, with an emphasis on performance, reliability, and data quality.

Posted
30+ Days Ago
Source
Ethic Leaf recruiter
Sector
Information Technology & AI

No employer link yet — an Ethic Leaf recruiter forwards your application

Responsibilities

  • Design, build, and optimize data pipelines and microservices using Python for real-time and batch processing
  • Develop cloud-based data ingestion solutions using AWS services (Kinesis, S3, DynamoDB, EventBridge, etc.)
  • Build and maintain data integration workflows for source data pipelines aligned to CI Autonomy
  • Translate business requirements into reliable data workflows, mappings, and system designs
  • Implement automated testing and validation to ensure data integrity across distributed systems
  • Monitor and troubleshoot pipelines using tools like CloudWatch to maintain reliability

Qualifications

  • Ability to analyze issues in distributed data systems and deliver scalable solutions
  • Ability to document data flows, mappings, and system behavior clearly for cross-team use
  • Experience building backend systems and pipelines using Python, Java, and modern frameworks
  • Experience delivering solutions in an agile environment
  • Experience integrating APIs, streaming platforms, and databases
  • Ability to design scalable, event-driven data systems
  • Strong understanding of AWS services and data engineering tools
  • Experience implementing testing strategies to ensure data quality and system reliability

Preferred

  • Bachelor's degree in Computer Science, Computer Engineering, or related field
  • 2+ years development experience on modern, large scale, complex data platforms
  • 3+ years developing and deploying Java or Python solutions to a production environment
  • Experience building high-throughput, scalable data pipelines
  • Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.)
  • Proficiency in SQL, including data quality and validation practices
  • Proficiency in deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc
  • Experience developing microservices that support real-time data ingestion
  • Experience developing software applications using relational and noSQL databases
  • Ability to ensure data integrity across distributed and streaming systems
  • Experience with API development and secure integrations (OAuth 2.0)
  • Proven experience with monitoring, testing, and automation in large-scale data environments
  • OAuth 2.0

Required skills

PythonJavaData Pipeline DevelopmentMicroservicesAWS KinesisAWS S3AWS DynamoDBAWS EventBridgeSQLCI/CDRelational and NoSQL DatabasesAPI Development

Full job description

Caterpillar Inc. develops technology that connects machines, data, and people to enable safer, more productive, and more sustainable jobsites. The Data Engineer will design, build, and maintain scalable data pipelines, microservices, and cloud-based data systems supporting real-time and batch processing, with an emphasis on performance, reliability, and data quality.

Responsibilities

  • Design, build, and optimize data pipelines and microservices using Python for real-time and batch processing
  • Develop cloud-based data ingestion solutions using AWS services (Kinesis, S3, DynamoDB, EventBridge, etc.)
  • Build and maintain data integration workflows for source data pipelines aligned to CI Autonomy
  • Translate business requirements into reliable data workflows, mappings, and system designs
  • Implement automated testing and validation to ensure data integrity across distributed systems
  • Monitor and troubleshoot pipelines using tools like CloudWatch to maintain reliability

Preferred

  • Bachelor's degree in Computer Science, Computer Engineering, or related field
  • 2+ years development experience on modern, large scale, complex data platforms
  • 3+ years developing and deploying Java or Python solutions to a production environment
  • Experience building high-throughput, scalable data pipelines
  • Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.)
  • Proficiency in SQL, including data quality and validation practices
  • Proficiency in deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc
  • Experience developing microservices that support real-time data ingestion
  • Experience developing software applications using relational and noSQL databases
  • Ability to ensure data integrity across distributed and streaming systems
  • Experience with API development and secure integrations (OAuth 2.0)
  • Proven experience with monitoring, testing, and automation in large-scale data environments
  • Computer Science
  • Computer Engineering
  • Large-Scale Data Platforms
  • Production Deployment
  • Scalable Data Pipelines
  • AWS Data Services
  • Amazon Kinesis
  • Amazon S3
  • Amazon DynamoDB
  • Amazon EventBridge
  • SQL
  • Data Quality
  • Data Validation
  • CI/CD
  • Azure DevOps
  • Jira
  • Jenkins
  • Microservices Development
  • Real-Time Data Ingestion
  • Relational Databases
  • NoSQL Databases
  • Data Integrity
  • Distributed Systems
  • Streaming Systems
  • API Development
  • Secure Integrations
  • OAuth 2.0
  • System Monitoring
  • Software Testing

Benefits

  • Visa sponsorship is available with this position.
  • Medical, dental, and vision benefits
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)
  • 401(k) savings plans
  • Health Savings Account (HSA)
  • Flexible Spending Accounts (FSAs)
  • Health Lifestyle Programs
  • Employee Assistance Program
  • Voluntary Benefits and Employee Discounts
  • Career Development
  • Incentive bonus
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement
  • These benefits also apply to part-time employees
  • Domestic relocation assistance is available for this position
  • Visa sponsorship is available with this position

Company

  • Construction and mining equipment, engines, turbines, locomotives
  • Irving, Texas, USA
  • https://www.caterpillar.com/
  • Founded in 1925
  • 10001+ employees

Qualifications

  • Ability to analyze issues in distributed data systems and deliver scalable solutions
  • Ability to document data flows, mappings, and system behavior clearly for cross-team use
  • Experience building backend systems and pipelines using Python, Java, and modern frameworks
  • Experience delivering solutions in an agile environment
  • Experience integrating APIs, streaming platforms, and databases
  • Ability to design scalable, event-driven data systems
  • Strong understanding of AWS services and data engineering tools
  • Experience implementing testing strategies to ensure data quality and system reliability
  • Bachelor's degree in Computer Science, Computer Engineering, or related field
  • 2+ years development experience on modern, large scale, complex data platforms
  • 3+ years developing and deploying Java or Python solutions to a production environment
  • Experience building high-throughput, scalable data pipelines
  • Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.)
  • Proficiency in SQL, including data quality and validation practices
  • Proficiency in deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc
  • Experience developing microservices that support real-time data ingestion
  • Experience developing software applications using relational and noSQL databases
  • Ability to ensure data integrity across distributed and streaming systems
  • Experience with API development and secure integrations (OAuth 2.0)
  • Proven experience with monitoring, testing, and automation in large-scale data environments

Required skills

  • Python, Java, Data Pipeline Development, Microservices, AWS Kinesis, AWS S3, AWS DynamoDB, AWS EventBridge, SQL, CI/CD, Relational and NoSQL Databases, API Development, OAuth 2.0, Automated Testing and Data Validation

Preferred skills

  • Experience building high-throughput, scalable data pipelines

Experience

  • 3+ years

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Oct 13, 2026

Work mode

On-site

Job source

Ethic Leaf recruiter

Company

Caterpillar Inc.

Information Technology & AI

Construction and mining equipment, engines, turbines, locomotives

See all 4 jobs from Caterpillar Inc. →
  • Irving, Texas, USA
  • Information Technology & AI
  • 10001+ employees
  • Founded 1925
  • caterpillar.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Chicago

Coinbase

1d ago

New

Senior Software Engineer - Data Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer to build and operate systems that centralize internal and third-party data.

Why similarSame roleJavaRemote

Dice

1d ago

New

AI Cloud Data Engineer

Full-timeOn-siteWoodlands, TX$125K – $150K/yr

Jobot is recruiting for an unnamed client seeking an AI Cloud Data Engineer to build and improve enterprise models and data pipelines. The role partners with stakeholders on custom solutions and owns architecture, modeling, and cloud and data engineering.

Why similarSame roleCI/CDPython

Numerator

1d ago

New

Data Engineer II

Full-timeOn-siteChicago, IL$106K – $146K/yr

Numerator is hiring a Data Engineer II to develop resilient data pipelines and infrastructure for data products, analytics, and data science models.

Why similarSame rolePythonChicago

Get new Data Engineer jobs in Chicago by email

Create job alert

Data Engineer – Physical AI Platform

Caterpillar Inc. · $98K – $158K/yr

Apply via Ethic Leaf