Data Engineer II, AWS Data Platform

Responsibilities

• Build and maintain streaming ingestion, API-based data workflows, and distributed data transformations using AWS services (Kinesis, Lambda, Glue/Spark, EMR, S3)
• Develop and maintain REST APIs for data ingestion and consumption
• Design and implement platform automation and standardized, repeatable deployment mechanisms (e.g., versioned releases, environment promotion, and deterministic deployment workflows)
• Develop and optimize data lake and operational data models for near-real-time use cases
• Work across both streaming (operational) and batch (analytical) layers to ensure consistent, high-quality data delivery
• Help improve reliability, automation, and observability across the RDE data platform
• Participate in an on-call rotation to help provide support for the team’s data systems and services

Benefits

• Opportunity for annual cash bonus
• Health / Dental / Vision Benefits Day-One
• 5% matching 401k
• Financial support
• Pet insurance
• Mental health resources
• Volunteer paid days off
• Employee stock program
• Foundation donation matching
• Dog-friendly office
• Glassdoor
• 3.4
• 10,000+ people, one global focus - enhancing the health and well-being of pets, people, and livestock We are passionate about what we do at IDEXX – and why wouldn’t we be? When you’re working to raise the standard of care for pets, make drinking water safe for billions and keep our livestock population around the globe healthy and free of disease, it’s no wonder that what we do each day is more than just a job.
• Westbrook, Maine, USA
• http://www.idexx.com
• Distribution of Different Job Fields Receiving Sponsorship
• Represents job field similar to this job
• Engineering and Development
• Customer Service and Support
• Accounting and Finance
• Marketing
• Management and Executive
• Trends of Total Sponsorships
• *2026
• (14)
• 2025
• (28)
• 2024
• (18)

Qualifications

• **PLEASE NOTE**: **Location:** ***We are only considering candidates located in Maine, New Hampshire, or Massachusetts*** **who are willing to be onsite eight times per month. Reduced onsite requirements may be considered for candidates located farther from the office within Massachusetts or New Hampshire.**
• 2-4 years of experience building, operating, and supporting production-grade data systems and services in highly reliable, fault-tolerant environments
• 2-4 years of hands-on experience designing and developing solutions on AWS, including services such as Lambda, Glue, Kinesis, EMR, S3, SNS, SQS, DynamoDB, API Gateway, and IAM
• Strong proficiency in Python and experience with shell scripting
• Experience troubleshooting, debugging, and optimizing distributed data systems, including streaming pipelines, Spark workloads, APIs, messaging queues, and storage layers
• Experience designing, building, and maintaining RESTful APIs
• Experience implementing Infrastructure as Code using Terraform and/or CloudFormation
• Experience building CI/CD pipelines and automated testing frameworks using tools such as Jenkins
• Knowledge of relational, document, and key-value database technologies
• Experience working with semi-structured event data (JSON, XML) and evolving data schemas
• Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent combination of education and practical experience

Required skills

• AWS, Python, Shell Scripting, Amazon Kinesis, AWS Lambda, AWS Glue, Apache Spark, Amazon EMR, Amazon S3, RESTful APIs, Distributed Data Systems, Streaming Data Pipelines, Terraform, AWS CloudFormation, CI/CD Pipelines, Jenkins, Relational Databases, Document Databases, Key-Value Databases, JSON, XML

Experience

• 2+ years