← Back to jobsJob ID col-cmwp6ukjd06zud8hakip9uopx

Greater New York Insurance CompaniesPosted 1 day ago

Data Engineer 2 - GuidewireNew

Full-time
Remote
5+ years
$87K – $161K/yr
Posted 1 day ago

Greater New York Insurance Companies is hiring a Data Engineer to build and maintain scalable data pipelines and models for insurance analytics and Generative AI initiatives. The role focuses on Guidewire and Commercial P&C data, data quality and governance, and collaboration with analysts, business users, and AI teams.

Posted
1 day ago
Source
paycomonline.net
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Analyze integration and system requirements by understanding business needs and designing effective data solutions, particularly for Guidewire Policy, Billing Center and Commercial P&C data domains
  • Design, develop, and optimize ELT pipelines to ingest, transform, and load data into a Delta Lakehouse platform
  • Design, Develop and maintain data models and schemas ensuring data quality and integrity
  • Build and maintain dashboards and reports delivering actionable business insights
  • Monitor pipeline and storage performance; troubleshoot and resolve data issues promptly
  • Collaborate with cross-functional teams, including analysts and business users, to deliver end-to-end insurance data solutions
  • Implement data governance, security, and compliance standards across platforms
  • Conduct root cause analysis for system failures and performance events; drive continuous improvements in enterprise data integration pipelines
  • Create and manage testing procedures (unit, scenario, end-to-end) to ensure pipeline reliability
  • Stay current with emerging technologies and recommend improvements to workflows
  • Mentor team members on data engineering tools, Guidewire data model concepts and best practices
  • Build and maintain data pipelines to process structured and unstructured data (like documents and text) for Generative AI tasks, including creating embeddings and working with vector databases to support AI search features
  • Prepare and clean large datasets to ensure high-quality inputs for training and fine-tuning Generative AI models
  • Collaborate with AI and data science teams to understand data requirements and deliver scalable solutions that support model training and inference
  • Implement processes to enrich data with metadata and context to improve AI model accuracy and relevance
  • Optimize data storage and retrieval methods to support fast, low-latency responses for AI-powered applications
  • Monitor data workflows for Generative AI projects, troubleshooting issues, and ensure continuous pipeline performance

Qualifications

  • Bachelor's degree in relevant field of study required(e.g. computer science, data science, data analytics, applied mathematics, etc.)
  • 5+ years of progressive work experience in IT or a related field required
  • 3+ years of experience in data engineering and analytics, with a solid foundation in data architecture and integration, including hands-on work with complex enterprise P& C Insurance data models required
  • 2+ years of experience with data-centric projects within the Guidewire ecosystem, including working with Guidewire Policy Center and related data structures required
  • In-depth understanding of relational database systems (e.g., Oracle, SQL Server, MySQL), including their features and performance optimization strategies
  • Solid grasp of ETL processes, data pipeline architectures, and data integration techniques, particularly for operational source systems such as Guidewire
  • 2+ years of hands-on experience with Azure Databricks, Azure data factory including developing and optimizing data pipelines using Apache Spark required
  • 2+ years of experience working with Power BI or other leading data visualization and reporting tools required
  • Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required
  • Proficient in Microsoft Azure services, including: + Azure SQL Database + Azure Data Lake Storage Gen2 + Azure Event Grid + Azure Key Vault
  • Strong understanding of CI/CD pipelines and experience in Agile development environments
  • Demonstrated ability to troubleshoot system issues, identify root causes, and implement effective solutions quickly
  • Capable of managing multiple priorities with strong attention to detail and follow-through
  • Knowledge of data governance, metadata management, and data quality frameworks
  • Understanding of data security and privacy principles, including encryption, anonymization, and access control mechanisms
  • Proficient in Microsoft Office Suites
  • Strong understanding of the Insurance Domain and Experience using Guidewire CDA data model to build use case specific datasets
  • Expertise in Azure Databricks, Azure Data Factory, Apache Spark, and data pipeline development for scalable data engineering solutions
  • Collaboration with cross-functional groups
  • Strong analytical and problem-solving skills, with the ability to translate business requirements into practical data solutions

Preferred

  • Working knowledge of Generative AI frameworks and use cases in data engineering is a plus
  • Generative AI Use Cases

Required skills

Agile DevelopmentApache SparkAzure Data FactoryAzure DatabricksAzure Event GridAzure Key VaultAzure SQL DatabaseCI/CDCommercial P&C Insurance DataData ModelingData WarehousingDelta LakehouseGuidewire CDA Data ModelGuidewire PolicyCenter

Full job description

Greater New York Insurance Companies is hiring a Data Engineer to build and maintain scalable data pipelines and models for insurance analytics and Generative AI initiatives. The role focuses on Guidewire and Commercial P&C data, data quality and governance, and collaboration with analysts, business users, and AI teams.

Responsibilities

  • Analyze integration and system requirements by understanding business needs and designing effective data solutions, particularly for Guidewire Policy, Billing Center and Commercial P&C data domains
  • Design, develop, and optimize ELT pipelines to ingest, transform, and load data into a Delta Lakehouse platform
  • Design, Develop and maintain data models and schemas ensuring data quality and integrity
  • Build and maintain dashboards and reports delivering actionable business insights
  • Monitor pipeline and storage performance; troubleshoot and resolve data issues promptly
  • Collaborate with cross-functional teams, including analysts and business users, to deliver end-to-end insurance data solutions
  • Implement data governance, security, and compliance standards across platforms
  • Conduct root cause analysis for system failures and performance events; drive continuous improvements in enterprise data integration pipelines
  • Create and manage testing procedures (unit, scenario, end-to-end) to ensure pipeline reliability
  • Stay current with emerging technologies and recommend improvements to workflows
  • Mentor team members on data engineering tools, Guidewire data model concepts and best practices
  • Build and maintain data pipelines to process structured and unstructured data (like documents and text) for Generative AI tasks, including creating embeddings and working with vector databases to support AI search features
  • Prepare and clean large datasets to ensure high-quality inputs for training and fine-tuning Generative AI models
  • Collaborate with AI and data science teams to understand data requirements and deliver scalable solutions that support model training and inference
  • Implement processes to enrich data with metadata and context to improve AI model accuracy and relevance
  • Optimize data storage and retrieval methods to support fast, low-latency responses for AI-powered applications
  • Monitor data workflows for Generative AI projects, troubleshooting issues, and ensure continuous pipeline performance

Preferred

  • Working knowledge of Generative AI frameworks and use cases in data engineering is a plus
  • Generative AI Frameworks
  • Generative AI Use Cases

Benefits

  • Remote position with the ability to travel to our NJ and NY locations up to 25% of the time.
  • Eligibility for an annual discretionary bonus based on performance.

Company

  • Middle-market property and casualty insurer for commercial real estate
  • New York, New York, USA
  • https://www.gny.com/
  • Founded in 1914
  • 201-500 employees

Qualifications

  • Bachelor's degree in relevant field of study required(e.g. computer science, data science, data analytics, applied mathematics, etc.)
  • 5+ years of progressive work experience in IT or a related field required
  • 3+ years of experience in data engineering and analytics, with a solid foundation in data architecture and integration, including hands-on work with complex enterprise P& C Insurance data models required
  • 2+ years of experience with data-centric projects within the Guidewire ecosystem, including working with Guidewire Policy Center and related data structures required
  • In-depth understanding of relational database systems (e.g., Oracle, SQL Server, MySQL), including their features and performance optimization strategies
  • Solid grasp of ETL processes, data pipeline architectures, and data integration techniques, particularly for operational source systems such as Guidewire
  • 2+ years of hands-on experience with Azure Databricks, Azure data factory including developing and optimizing data pipelines using Apache Spark required
  • 2+ years of experience working with Power BI or other leading data visualization and reporting tools required
  • Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required
  • Proficient in Microsoft Azure services, including: + Azure SQL Database + Azure Data Lake Storage Gen2 + Azure Event Grid + Azure Key Vault
  • Strong understanding of CI/CD pipelines and experience in Agile development environments
  • Demonstrated ability to troubleshoot system issues, identify root causes, and implement effective solutions quickly
  • Capable of managing multiple priorities with strong attention to detail and follow-through
  • Knowledge of data governance, metadata management, and data quality frameworks
  • Understanding of data security and privacy principles, including encryption, anonymization, and access control mechanisms
  • Proficient in Microsoft Office Suites
  • Strong understanding of the Insurance Domain and Experience using Guidewire CDA data model to build use case specific datasets
  • Data Modeling
  • Expertise in Azure Databricks, Azure Data Factory, Apache Spark, and data pipeline development for scalable data engineering solutions
  • Collaboration with cross-functional groups
  • Strong analytical and problem-solving skills, with the ability to translate business requirements into practical data solutions
  • Working knowledge of Generative AI frameworks and use cases in data engineering is a plus
  • 5+ years of progressive work experience in IT or a related field required.
  • 3+ years of experience in data engineering and analytics, with a solid foundation in data architecture and integration, including hands-on work with complex enterprise P& C Insurance data models required.
  • 2+ years of experience with data-centric projects within the Guidewire ecosystem, including working with Guidewire Policy Center and related data structures required.
  • 2+ years of hands-on experience with Azure Databricks, Azure data factory including developing and optimizing data pipelines using Apache Spark required.
  • 2+ years of experience working with Power BI or other leading data visualization and reporting tools required.

Required skills

  • Agile Development, Apache Spark, Azure Data Factory, Azure Data Lake Storage Gen2, Azure Databricks, Azure Event Grid, Azure Key Vault, Azure SQL Database, CI/CD, Commercial P&C Insurance Data, Data Modeling, Data Warehousing, Delta Lakehouse, Guidewire CDA Data Model, Guidewire PolicyCenter, Power BI, Relational Databases MySQL, Relational Databases Oracle, Relational Databases SQL Server

Experience

  • 5+ years

Job details

Employment type

Full-time

Seniority level

5+ years

Date posted

Nov 19, 2026

Work mode

Remote

Job source

paycomonline.net

Company

Greater New York Insurance Companies

Information Technology & AI

Middle-market property and casualty insurer for commercial real estate

See all 2 jobs from Greater New York Insurance Companies →
  • New York, New York, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 1914
  • gny.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs

Bright Vision Technologies

Today

New

Azure Data Engineer

Full-timeRemoteUnited States$115K – $165K/yr

Bright Vision Technologies is seeking an Azure Data Engineer to design, build, validate, and support data solutions for enterprise operations, analytics, and decision-making.

Why similarSame roleAzure Data FactoryAzure Databricks

Finance

1d ago

New

Data Engineer

Full-timeRemoteUnited States$140K – $190K/yr

Lakeview Loan Servicing is hiring a Data Engineer for the Nebula team to build and evolve the data foundation powering analytics, reporting, AI development, and operational decision-making.

Why similarSame roleCI/CDData Modeling

Intuitive.ai

1d ago

New

Senior Data Engineer

Full-timeRemoteUnited StatesCompetitive

Intuitive.AI is hiring a Senior Data Engineer to build and operate a modern data platform that transforms operational data into trusted datasets for analytics, reporting, and AI applications.

Why similarSame roleCI/CDData Modeling

Get new Data Engineer jobs by email

Create job alert

Data Engineer 2 - Guidewire

Greater New York Insurance Companies · $87K – $161K/yr

Apply on company site