Associate - Data Engineer

New York Life is seeking an Associate Data Engineer to build and maintain reliable data pipelines and models for enterprise analytics, data science, and AI. The role also contributes to engineering standards, data governance, and collaboration across technical and business teams.

Responsibilities

• Build and maintain scalable data models and pipelines using dbt, PySpark, AWS Glue, Databricks, and streaming technologies to deliver clean, reliable, and well-structured data for analytics, data science, and AI use cases
• Apply software engineering best practices across data development, including version control, testing, integration, code reviews, and pull request approvals, to promote quality and consistency
• Partner with data scientists, business stakeholders, and data stewards to source strategic enterprise data, address data quality and availability needs, and align solutions with data governance standards
• Translate business and technical requirements into actionable development plans and Jira stories, establish milestones, and manage work through delivery
• Collaborate with Technology teams on data strategy, tooling, system integrations, and deployment processes while clearly communicating technical concepts and recommendations to diverse stakeholders

Preferred

• Experience with Google Cloud Platform (GCP) or related cloud data technologies
• Experience working in the insurance, financial services, or another regulated industry
• Experience partnering with data science teams to support analytics, machine learning, or AI use cases
• Google Cloud Platform (GCP)
• Cloud Data Technologies
• Regulated Industry Experience
• Insurance Industry Experience
• Financial Services Experience
• Machine Learning
• Artificial Intelligence
• Cross-Functional Collaboration

Benefits

• Employees are eligible for an annual discretionary bonus.
• Employees may also be eligible to participate in an incentive program.
• Leave programs
• Adoption assistance
• Student loan repayment programs
• Hybrid work arrangement: 3 days per week

Company

• Life insurance and financial services provider
• New York, New York, USA
• https://www.newyorklife.com/
• Founded in 1845
• 10001+ employees

Qualifications

• 2–5+ years of relevant data engineering or related experience, including hands-on experience building and maintaining dbt data models and transformation pipelines
• Proficiency with AWS Glue, including ETL development, job orchestration, and catalog integration, and experience using PySpark for data processing
• Strong working knowledge of Databricks, including SQL, notebooks, and distributed data processing
• Experience with Kafka or comparable streaming technologies for real-time data ingestion and processing
• Strong analytical and problem-solving skills, with the ability to troubleshoot complex data and engineering issues and develop practical solutions
• Effective communication and collaboration skills, with the ability to work across technical and business teams and explain technical concepts to varied audiences
• Experience with Google Cloud Platform (GCP) or related cloud data technologies
• Experience working in the insurance, financial services, or another regulated industry
• Experience partnering with data science teams to support analytics, machine learning, or AI use cases
• 2–5+ years of relevant data engineering or related experience, including hands-on experience building and maintaining dbt data models and transformation pipelines.

Required skills

• dbt, AWS Glue, PySpark, Databricks, SQL, Kafka, Streaming Data Processing, Google Cloud Platform (GCP), Financial Services, Machine Learning, Data Engineering

Experience

• 2+ years