← Back to jobsJob ID col-cmwf61bfi079789hq9n92ty88

NBMEPosted 8 days ago

Senior Data Engineer (Customer Data Products)

Full-time
Remote
7+ years
$127K – $160K/yr
Posted 8 days ago

NBME is seeking a Senior Data Engineer to modernize, expand, and optimize its data platform. The role builds scalable data lakes and integration pipelines supporting analytics, AI/ML, and business decision-making, and promotes AI-assisted engineering practices across the IT organization.

Posted
8 days ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Code, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes, feature stores, and vector databases in accordance with best practices and security standards throughout the development lifecycle
  • Partner closely with data scientists, AI researchers, data and enterprise architects, and business stakeholders to identify, extract, clean, and format structured and unstructured data for AI/ML model training, fine-tuning, and feature extraction
  • Lead evaluation, research, and experimentation efforts with batch and streaming data technologies, LLM data preparation frameworks, and MLOps tools to keep pace with industry innovation
  • Act as a technical lead to showcase the capabilities of emerging AI and data technologies, enabling the widespread adoption of modern data techniques across the organization
  • Significantly contribute to the definition and refinement of processes and procedures for the data engineering practice
  • Educate and develop ETL developers on data engineering cloud-bases initiatives to enable transition to data engineer and practice
  • Assures the integrity and accuracy of the corporate data, with particular attention to data security
  • Responsible for ensuring high data quality for Data Services, Analytics and Master Data Management
  • Helps coordinate technical solutions, takes responsibility for designs, development, testing and delivery of solutions
  • Build automated, scalable, test-driven data pipelines
  • Utilize software development practices such as version control via Git, CI/CD, and release management to enhance existing CI/CD pipelines in AWS
  • Collaborate with Data Engineers, DevOps engineers and architects on improvement opportunities for DataOps tools and frameworks

Qualifications

  • Bachelor's Degree
  • At least 7 years of experience in application development (Internship experience does not apply)
  • At least 4 years of experience in big data technologies
  • At least 4 years' experience with cloud computing using AWS
  • 4+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years' experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL etc.)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift)
  • 6+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 7+ years of experience with Agile engineering practices
  • 7+ years of experience with SQL optimization
  • 4+ years of experience with PySpark
  • 3+ year of experience with process orchestration including AirFlow, KubeFlow, AWS step functions, or Luigi

Preferred

  • Proven experience implementing Generative AI, LLM data preparation pipelines, and Vector Databases (e.g., Pinecone, Milvus, pgvector)
  • Strong experience building and maintaining Feature Stores for machine learning models
  • Experience building highly scalable, secure, and production-ready APIs and Data-as-a-Service (DaaS) platforms
  • AWS Certified Data Engineer or AWS Certified Machine Learning - Specialty certifications
  • 3+ year of experience with Machine Learning
  • Experience with building a Data-as-a-service platform
  • Experience with building APIs
  • Data-as-a-Service Platforms
  • AWS Certified Data Engineer
  • AWS Certified Machine Learning – Specialty

Required skills

API DevelopmentAWSAWS Step FunctionsAgile EngineeringAmazon EMRAmazon RedshiftApache AirflowCassandraData-as-a-Service (DaaS)Feature StoresGenerative AIHadoopHive

Full job description

NBME is seeking a Senior Data Engineer to modernize, expand, and optimize its data platform. The role builds scalable data lakes and integration pipelines supporting analytics, AI/ML, and business decision-making, and promotes AI-assisted engineering practices across the IT organization.

Responsibilities

  • Code, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes, feature stores, and vector databases in accordance with best practices and security standards throughout the development lifecycle
  • Partner closely with data scientists, AI researchers, data and enterprise architects, and business stakeholders to identify, extract, clean, and format structured and unstructured data for AI/ML model training, fine-tuning, and feature extraction
  • Lead evaluation, research, and experimentation efforts with batch and streaming data technologies, LLM data preparation frameworks, and MLOps tools to keep pace with industry innovation
  • Act as a technical lead to showcase the capabilities of emerging AI and data technologies, enabling the widespread adoption of modern data techniques across the organization
  • Significantly contribute to the definition and refinement of processes and procedures for the data engineering practice
  • Educate and develop ETL developers on data engineering cloud-bases initiatives to enable transition to data engineer and practice
  • Assures the integrity and accuracy of the corporate data, with particular attention to data security
  • Responsible for ensuring high data quality for Data Services, Analytics and Master Data Management
  • Helps coordinate technical solutions, takes responsibility for designs, development, testing and delivery of solutions
  • Build automated, scalable, test-driven data pipelines
  • Utilize software development practices such as version control via Git, CI/CD, and release management to enhance existing CI/CD pipelines in AWS
  • Collaborate with Data Engineers, DevOps engineers and architects on improvement opportunities for DataOps tools and frameworks

Preferred

  • Proven experience implementing Generative AI, LLM data preparation pipelines, and Vector Databases (e.g., Pinecone, Milvus, pgvector)
  • Strong experience building and maintaining Feature Stores for machine learning models
  • Experience building highly scalable, secure, and production-ready APIs and Data-as-a-Service (DaaS) platforms
  • AWS Certified Data Engineer or AWS Certified Machine Learning - Specialty certifications
  • 3+ year of experience with Machine Learning
  • Experience with building a Data-as-a-service platform
  • Experience with building APIs
  • Generative AI
  • LLM Data Preparation
  • Vector Databases
  • Pinecone
  • Milvus
  • pgvector
  • Feature Stores
  • Machine Learning
  • Scalable API Development
  • Secure API Development
  • Production-Ready APIs
  • Data-as-a-Service Platforms
  • AWS Certified Data Engineer
  • AWS Certified Machine Learning – Specialty

Benefits

  • Healthcare plans
  • Dental plans
  • Prescription plans
  • Vision plans
  • 401(k) with match
  • Tuition reimbursement plan
  • Commuter benefit: public transit or parking options
  • Remote-friendly workplace
  • Hybrid position; may require occasional onsite work for team collaboration or meetings

Company

  • Medical education assessment and learning tools for health professionals
  • Philadelphia, Pennsylvania, USA
  • http://www.nbme.org/
  • Founded in 1915
  • 501-1000 employees

Qualifications

  • Bachelor's Degree
  • At least 7 years of experience in application development (Internship experience does not apply)
  • At least 4 years of experience in big data technologies
  • At least 4 years' experience with cloud computing using AWS
  • 4+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years' experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, MySQL etc.)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift)
  • 6+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 7+ years of experience with Agile engineering practices
  • 7+ years of experience with SQL optimization
  • 4+ years of experience with PySpark
  • 3+ year of experience with process orchestration including AirFlow, KubeFlow, AWS step functions, or Luigi
  • Proven experience implementing Generative AI, LLM data preparation pipelines, and Vector Databases (e.g., Pinecone, Milvus, pgvector)
  • Strong experience building and maintaining Feature Stores for machine learning models
  • Experience building highly scalable, secure, and production-ready APIs and Data-as-a-Service (DaaS) platforms
  • AWS Certified Data Engineer or AWS Certified Machine Learning - Specialty certifications
  • 3+ year of experience with Machine Learning
  • Experience with building a Data-as-a-service platform
  • Experience with building APIs

Required skills

  • API Development, AWS, AWS Certified Data Engineer, AWS Certified Machine Learning – Specialty, AWS Step Functions, Agile Engineering, Amazon EMR, Amazon Redshift, Apache Airflow, Cassandra, Data-as-a-Service (DaaS), Feature Stores, Generative AI, Hadoop, Hive, Java, Kafka, Kubeflow, LLM Data Preparation, Luigi, Machine Learning, Milvus, MongoDB, MySQL, Pinecone, PySpark, Python, Real-Time Data Streaming, SQL, SQL Optimization, Scala, Shell Scripting, Spark, UNIX/Linux, Vector Databases, pgvector

Preferred skills

  • 3+ year of experience with Machine Learning, Experience with building APIs, Experience with building a Data-as-a-service platform

Experience

  • 7+ years

Job details

Employment type

Full-time

Seniority level

7+ years

Date posted

Nov 13, 2026

Work mode

Remote

Job source

linkedin.com

Company

NBME

Information Technology & AI

Medical education assessment and learning tools for health professionals

  • Philadelphia, Pennsylvania, USA
  • Information Technology & AI
  • 501-1000 employees
  • Founded 1915
  • nbme.org

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs

SoftStandard Solutions

1d ago

New

Data Engineer

TemporaryOn-siteUnited StatesCompetitive

SoftStandard Solutions is seeking a Data Engineer to build and maintain scalable data pipelines and ETL/ELT processes.

Why similarSame roleAWSApache Airflow

EXL

1d ago

New

Senior Data Engineer

Full-timeRemoteUnited StatesCompetitive

EXL is seeking a seasoned Data Engineer to join their Sports Analytics & Engineering Practice. This role is pivotal in shaping and implementing a cloud-native data ecosystem, where you will architect and build scalable data infrastructure that transforms raw…

Why similarSame roleAWS Step FunctionsAmazon Redshift

First Citizens Bank

1d ago

New

Senior Data Engineer - DevOps (Remote - NC, AZ, TX, FL)

Full-timeRemoteUnited StatesCompetitive

First Citizens Bank is seeking a Senior Data Engineer - DevOps to support its data engineering platform.

Why similarSame roleAWS

Get new Data Engineer jobs by email

Create job alert

Senior Data Engineer (Customer Data Products)

NBME · $127K – $160K/yr

Apply on company site