← Back to jobsJob ID col-cmv8bhdpj01kwoz01dpyjgj0i

SynechronPosted 30+ days ago

Data Engineer (PySpark)

Full-time
On-site
Mid level
$90K – $95K/yr
Posted 30+ days ago

Synechron is seeking a Data Engineer to design, build, and operate reliable, scalable data solutions in a production environment. The role focuses on developing data pipelines, extending reusable platform capabilities, and enabling federated teams to onboard and manage data consistently.

Posted
30+ Days Ago
Source
Ethic Leaf recruiter
Sector
Information Technology & AI

No employer link yet — an Ethic Leaf recruiter forwards your application

Responsibilities

  • Design, build, and harden production-grade data pipelines supporting Data ingestion and curation, Reconciliation and auditability, Data quality monitoring, Metadata and lineage, Notifications and operational alerting
  • Contribute to and extend the organization’s generic pipeline framework, enabling federated teams to onboard and manage data consistently and efficiently
  • Build scalable data transformations primarily using PySpark on GCP Dataproc/Spark, with BigQuery as the primary query engine
  • Implement best practices for Schema management and evolution, Performance optimization, Reliability and recoverability, Resource utilization and cost efficiency
  • Work with large-scale datasets and modern data formats, including Parquet and Apache Iceberg
  • Integrate data pipelines with centralized data cataloging and governance platforms, such as Dataplex, Knowledge Catalog, or equivalent technologies
  • Support automated metadata and lineage harvesting to improve data discovery, governance, and reuse
  • Collaborate with platform, security, and central cloud teams to deliver secure, maintainable, and scalable data solutions
  • Support hybrid data access and federated query patterns using technologies such as Starburst/Trino, where appropriate
  • Develop resilient, observable, and recoverable data flows that meet production service-level agreements
  • Participate in production support, incident response, root-cause analysis, and continuous improvement activities
  • Apply sound software engineering practices, including code reviews, automated testing, CI/CD, documentation, and version control

Qualifications

  • Hands-on experience building and supporting data engineering solutions in production environments
  • Strong SQL skills and experience developing data transformations at scale
  • Practical experience with Apache Spark, preferably using PySpark
  • Experience working with big data file formats, particularly Parquet
  • Experience delivering reliable, scheduled data pipelines with monitoring, alerting, and incident response
  • Understanding of data cataloging, metadata management, and data lineage concepts, including their importance for governance, discoverability, and reuse
  • Exposure to GCP data services such as Dataproc/Spark and Big Query
  • Understanding of production data operations, reliability, and recoverability
  • Solid software engineering practices, including Version control, CI/CD, Automated testing, Code reviews, technical documentation
  • Ability to collaborate effectively with central cloud, platform, security, and governance teams
  • Strong written and verbal communication skills

Preferred

  • familiarity with Iceberg concepts
  • Experience building reusable data pipeline frameworks, platform components, or shared engineering capabilities adopted by multiple teams
  • Familiarity with Starburst or Trino for federated querying across hybrid environments
  • Knowledge of data quality frameworks, reconciliation processes, auditability, and data controls in regulated or enterprise environments
  • Reusable data pipeline frameworks

Required skills

SQLApache SparkPySparkGoogle Cloud DataprocBigQueryParquetApache IcebergData pipeline engineeringVersion controlCI/CDAutomated testingStarburst/Trino

Full job description

Synechron is seeking a Data Engineer to design, build, and operate reliable, scalable data solutions in a production environment. The role focuses on developing data pipelines, extending reusable platform capabilities, and enabling federated teams to onboard and manage data consistently.

Responsibilities

  • Design, build, and harden production-grade data pipelines supporting Data ingestion and curation, Reconciliation and auditability, Data quality monitoring, Metadata and lineage, Notifications and operational alerting
  • Contribute to and extend the organization’s generic pipeline framework, enabling federated teams to onboard and manage data consistently and efficiently
  • Build scalable data transformations primarily using PySpark on GCP Dataproc/Spark, with BigQuery as the primary query engine
  • Implement best practices for Schema management and evolution, Performance optimization, Reliability and recoverability, Resource utilization and cost efficiency
  • Work with large-scale datasets and modern data formats, including Parquet and Apache Iceberg
  • Integrate data pipelines with centralized data cataloging and governance platforms, such as Dataplex, Knowledge Catalog, or equivalent technologies
  • Support automated metadata and lineage harvesting to improve data discovery, governance, and reuse
  • Collaborate with platform, security, and central cloud teams to deliver secure, maintainable, and scalable data solutions
  • Support hybrid data access and federated query patterns using technologies such as Starburst/Trino, where appropriate
  • Develop resilient, observable, and recoverable data flows that meet production service-level agreements
  • Participate in production support, incident response, root-cause analysis, and continuous improvement activities
  • Apply sound software engineering practices, including code reviews, automated testing, CI/CD, documentation, and version control

Preferred

  • familiarity with Iceberg concepts
  • Experience building reusable data pipeline frameworks, platform components, or shared engineering capabilities adopted by multiple teams
  • Familiarity with Starburst or Trino for federated querying across hybrid environments
  • Knowledge of data quality frameworks, reconciliation processes, auditability, and data controls in regulated or enterprise environments
  • Iceberg concepts
  • Reusable data pipeline frameworks
  • Platform component development
  • Shared engineering capabilities
  • Cross-team adoption
  • Starburst
  • Trino
  • Federated querying
  • Hybrid environments
  • Data quality frameworks
  • Data reconciliation
  • Auditability
  • Data controls
  • Regulated data environments

Benefits

  • A multinational organization with 58 offices in 22 countries and the possibility to work abroad.
  • 10 days of paid annual leave (plus sick leave and national holidays).
  • Maternity & paternity leave plans.
  • A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).
  • Retirement savings plans.
  • A higher education certification policy.
  • Commuter benefits (varies by region).
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
  • Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.
  • A flat and approachable organization.
  • A truly diverse, fun-loving, and global work culture.
  • Flexible workplace arrangements, mentoring, internal mobility, learning and development programs.

Company

  • Digital consulting for financial services and technology firms
  • New York, New York, USA
  • http://www.synechron.com/
  • Founded in 2001
  • 10001+ employees

Qualifications

  • Hands-on experience building and supporting data engineering solutions in production environments
  • Strong SQL skills and experience developing data transformations at scale
  • Practical experience with Apache Spark, preferably using PySpark
  • Experience working with big data file formats, particularly Parquet
  • Experience delivering reliable, scheduled data pipelines with monitoring, alerting, and incident response
  • Understanding of data cataloging, metadata management, and data lineage concepts, including their importance for governance, discoverability, and reuse
  • Exposure to GCP data services such as Dataproc/Spark and Big Query
  • Understanding of production data operations, reliability, and recoverability
  • Solid software engineering practices, including Version control, CI/CD, Automated testing, Code reviews, technical documentation
  • Ability to collaborate effectively with central cloud, platform, security, and governance teams
  • Strong written and verbal communication skills
  • Familiarity with Iceberg concepts
  • Experience building reusable data pipeline frameworks, platform components, or shared engineering capabilities adopted by multiple teams
  • Familiarity with Starburst or Trino for federated querying across hybrid environments
  • Knowledge of data quality frameworks, reconciliation processes, auditability, and data controls in regulated or enterprise environments

Required skills

  • SQL, Apache Spark, PySpark, Google Cloud Dataproc, BigQuery, Parquet, Apache Iceberg, Data pipeline engineering, Data cataloging, metadata management, and data lineage, Version control, CI/CD, Automated testing, Starburst/Trino

Preferred skills

  • familiarity with Iceberg concepts

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Oct 5, 2026

Work mode

On-site

Job source

Ethic Leaf recruiter

Company

Synechron

Information Technology & AI

Digital consulting for financial services and technology firms

See all 14 jobs from Synechron →
  • New York, New York, USA
  • Information Technology & AI
  • 10001+ employees
  • Founded 2001
  • synechron.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Charlotte

Bright Vision Technologies

1d ago

New

Senior Data Engineer

TemporaryOn-siteCharlotte, NCCompetitive

Bright Vision Technologies is recruiting a Senior Data Engineer for an unnamed insurance industry client in Charlotte, NC.

Why similarSame roleApache SparkCharlotte

Dexian

1d ago

New

Data Engineer

Full-timeHybridCharlotte, NCCompetitive

Dexian is recruiting for a Data Engineer role; the hiring client is not identified. The role focuses on enterprise data platform administration and development, including Cloudera, distributed data processing, cloud platforms, and production support.

Why similarSame roleApache IcebergCharlotte

Dice

1d ago

New

Senior Data Engineer - Databricks

Full-timeOn-siteNew York, NY$84K – $156K/yr

Capgemini is seeking a Senior Databricks Data Engineer to design, build, and optimize scalable cloud-based data platforms and pipelines.

Why similarSame roleApache SparkCI/CD

Get new Data Engineer jobs in Charlotte by email

Create job alert

Data Engineer (PySpark)

Synechron · $90K – $95K/yr

Apply via Ethic Leaf