← Back to jobsJob ID col-cmv8f7wt2064roz011q6tfet1

NelnetPosted 30+ days ago

Data Engineer

Full-time
Hybrid
Mid level
$100K/yr
Posted 30+ days ago

Nelnet Business Services, a division of Nelnet, provides payment technology and education services to higher education institutions, K-12 schools, and individual students, families, and supporters. The Data Engineer builds and maintains CDC and batch ingestion pipelines, Snowflake Bronze-layer infrastructure, and data-quality and reconciliation processes. The role also contributes to Silver-layer modeling, pipeline observability, platform collaboration, and the migration from HVR to Redpanda CDC.

Posted
30+ Days Ago
Source
nelnet.wd1.myworkdayjobs.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Build and maintain CDC and batch pipelines from source systems into the Snowflake Bronze layer using Redpanda, Python, and Dagster
  • Manage source-specific adapters across relational (SQL Server, Oracle), document (MongoDB), API, and file-based sources, and stand up new sources as the platform grows
  • Handle the complexity of consolidating single-tenant source databases into a multi-tenant Snowflake model
  • Implement idempotent load patterns with deduplication so pipelines can re-run safely without producing duplicate or missing records
  • Design and maintain raw snapshot tables that preserve source-system state with minimal transformation — the immutable audit trail back to source
  • Implement historical tracking so no data is silently overwritten
  • Handle hard deletes from source systems by tracking deletions in Snowflake rather than losing them
  • Maintain source-schema documentation and change detection — alert when upstream schemas drift unexpectedly
  • Build conformed Silver models from the business rules, grain, and conforming logic the Analytics Engineer defines — starting with close guidance and taking on more independence over time
  • Own Bronze-to-Silver reconciliation: row counts and totals tie out, no records lost or double-counted across the transformation
  • Help build and automate the mechanical contract gates — reconciliation tie-out, freshness, and schema validation — as CI/CD checks
  • Apply classification tags at Bronze so columns can promote to Silver, partnering with the data owner and Data Governance on classification decisions
  • Handle incremental logic and performance tuning as models grow in volume, with support as needed
  • Run and monitor Dagster orchestration — scheduling, retries, failure alerting — and grow into fuller ownership of it, including SLA monitoring, over time
  • Implement data-quality checks at the ingestion boundary (row counts, schema validation, freshness checks)
  • Monitor Snowflake concurrent-write limits and tune ingestion patterns to avoid bottlenecks
  • Participate in severity-1 incident response — failed file loads, latency cascades, duplicate transactions, and similar
  • Work with Platform Engineering on Docker-based containerization and provisioning of Snowflake databases, schemas, and warehouses
  • Apply required tags (domain, squad, product, layer, environment) to Snowflake objects, Dagster jobs, and streaming topics for cost attribution
  • Participate in the HVR-to-Redpanda CDC migration and validate data integrity during cutover
  • Contribute to shared CI/CD pipeline templates that standardize ingestion and build patterns

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related field; or an equivalent combination of education and directly related experience
  • Experience building and operating production data pipelines with strong Python and SQL skills
  • Solid working knowledge of relational databases (SQL Server, Oracle, or PostgreSQL)
  • Experience implementing data-quality checks at the ingestion boundary — schema-drift detection, row-count validation, freshness monitoring — and reconciling that data ties out end to end
  • General familiarity with data modeling concepts
  • Strong analytical and problem-solving skills, with the discipline to prove data is correct rather than assume it
  • Comfort working closely with an Analytics Engineer — taking direction on modeling logic while owning the build and reliability of it
  • A genuine interest in growing into conforming and Silver-layer modeling work; coachable and motivated by a defined growth path
  • Clear written and verbal communication, including documenting pipelines and surfacing issues early rather than absorbing them silently
  • Attention to detail with data quality, historical preservation, and auditability
  • Ability to manage competing priorities and participate in incident response with composure
  • Collaborative working style across engineering, platform, governance, and product roles
  • To be considered, candidates must already be authorized to work in the United States without the need for current or future sponsorship

Preferred

  • Any prior exposure to CDC / streaming platforms (Redpanda, Kafka, or similar)
  • Experience with a document / NoSQL platform (MongoDB preferred)
  • Experience with Snowflake (multi-tenant patterns, Snowpipe, tasks, streams)
  • Containerization and provisioning experience with Docker
  • Experience consolidating single-tenant sources into a multi-tenant warehouse
  • Exposure to data-governance practices — classification, masking, retention — in a regulated data environment
  • Experience with financial, payment, or transaction data, including reconciliation and settlement concepts

Required skills

PythonSQLData Pipeline DevelopmentSQL ServerOraclePostgreSQLData Quality ValidationData ReconciliationData ModelingRedpandaMongoDBSnowflake

Full job description

Nelnet Business Services, a division of Nelnet, provides payment technology and education services to higher education institutions, K-12 schools, and individual students, families, and supporters. The Data Engineer builds and maintains CDC and batch ingestion pipelines, Snowflake Bronze-layer infrastructure, and data-quality and reconciliation processes. The role also contributes to Silver-layer modeling, pipeline observability, platform collaboration, and the migration from HVR to Redpanda CDC.

Responsibilities

  • Build and maintain CDC and batch pipelines from source systems into the Snowflake Bronze layer using Redpanda, Python, and Dagster
  • Manage source-specific adapters across relational (SQL Server, Oracle), document (MongoDB), API, and file-based sources, and stand up new sources as the platform grows
  • Handle the complexity of consolidating single-tenant source databases into a multi-tenant Snowflake model
  • Implement idempotent load patterns with deduplication so pipelines can re-run safely without producing duplicate or missing records
  • Design and maintain raw snapshot tables that preserve source-system state with minimal transformation — the immutable audit trail back to source
  • Implement historical tracking so no data is silently overwritten
  • Handle hard deletes from source systems by tracking deletions in Snowflake rather than losing them
  • Maintain source-schema documentation and change detection — alert when upstream schemas drift unexpectedly
  • Build conformed Silver models from the business rules, grain, and conforming logic the Analytics Engineer defines — starting with close guidance and taking on more independence over time
  • Own Bronze-to-Silver reconciliation: row counts and totals tie out, no records lost or double-counted across the transformation
  • Help build and automate the mechanical contract gates — reconciliation tie-out, freshness, and schema validation — as CI/CD checks
  • Apply classification tags at Bronze so columns can promote to Silver, partnering with the data owner and Data Governance on classification decisions
  • Handle incremental logic and performance tuning as models grow in volume, with support as needed
  • Run and monitor Dagster orchestration — scheduling, retries, failure alerting — and grow into fuller ownership of it, including SLA monitoring, over time
  • Implement data-quality checks at the ingestion boundary (row counts, schema validation, freshness checks)
  • Monitor Snowflake concurrent-write limits and tune ingestion patterns to avoid bottlenecks
  • Participate in severity-1 incident response — failed file loads, latency cascades, duplicate transactions, and similar
  • Work with Platform Engineering on Docker-based containerization and provisioning of Snowflake databases, schemas, and warehouses
  • Apply required tags (domain, squad, product, layer, environment) to Snowflake objects, Dagster jobs, and streaming topics for cost attribution
  • Participate in the HVR-to-Redpanda CDC migration and validate data integrity during cutover
  • Contribute to shared CI/CD pipeline templates that standardize ingestion and build patterns

Preferred

  • Any prior exposure to CDC / streaming platforms (Redpanda, Kafka, or similar)
  • Experience with a document / NoSQL platform (MongoDB preferred)
  • Experience with Snowflake (multi-tenant patterns, Snowpipe, tasks, streams)
  • Containerization and provisioning experience with Docker
  • Experience consolidating single-tenant sources into a multi-tenant warehouse
  • Exposure to data-governance practices — classification, masking, retention — in a regulated data environment
  • Experience with financial, payment, or transaction data, including reconciliation and settlement concepts
  • CDC Platforms
  • Streaming Platforms
  • Redpanda
  • Apache Kafka
  • Document Databases
  • NoSQL
  • MongoDB
  • Snowflake
  • Multi-Tenant Patterns
  • Snowpipe
  • Snowflake Tasks
  • Snowflake Streams
  • Containerization
  • Docker
  • Infrastructure Provisioning
  • Multi-Tenant Data Warehousing
  • Data Classification
  • Data Masking
  • Data Retention
  • Regulated Data Environments
  • Financial Data
  • Payment Data
  • Transaction Data
  • Reconciliation
  • Settlement

Benefits

  • Medical insurance
  • Dental insurance
  • Vision insurance
  • HSA
  • FSA
  • Generous earned time off
  • 401K/student loan repayment
  • Life insurance and AD&D insurance
  • Employee assistance program
  • Employee stock purchase program
  • Tuition reimbursement
  • Performance-based incentive pay
  • Short- and long-term disability
  • Robust wellness program
  • Hybrid work option for associates living within 30 miles of an office location, allowing remote work for part of the week and in-office presence three days per week
  • Mentorship and support provided for skills developed in the role

Company

  • Student loan servicing and education payment technology provider
  • Lincoln, Nebraska, USA
  • https://nelnetinc.com/
  • Founded in 1996
  • 5001-10000 employees

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related field; or an equivalent combination of education and directly related experience
  • Experience building and operating production data pipelines with strong Python and SQL skills
  • Solid working knowledge of relational databases (SQL Server, Oracle, or PostgreSQL)
  • Experience implementing data-quality checks at the ingestion boundary — schema-drift detection, row-count validation, freshness monitoring — and reconciling that data ties out end to end
  • General familiarity with data modeling concepts
  • Strong analytical and problem-solving skills, with the discipline to prove data is correct rather than assume it
  • Comfort working closely with an Analytics Engineer — taking direction on modeling logic while owning the build and reliability of it
  • A genuine interest in growing into conforming and Silver-layer modeling work; coachable and motivated by a defined growth path
  • Clear written and verbal communication, including documenting pipelines and surfacing issues early rather than absorbing them silently
  • Attention to detail with data quality, historical preservation, and auditability
  • Ability to manage competing priorities and participate in incident response with composure
  • Collaborative working style across engineering, platform, governance, and product roles
  • To be considered, candidates must already be authorized to work in the United States without the need for current or future sponsorship
  • Any prior exposure to CDC / streaming platforms (Redpanda, Kafka, or similar)
  • Experience with a document / NoSQL platform (MongoDB preferred)
  • Experience with Snowflake (multi-tenant patterns, Snowpipe, tasks, streams)
  • Containerization and provisioning experience with Docker
  • Experience consolidating single-tenant sources into a multi-tenant warehouse
  • Exposure to data-governance practices — classification, masking, retention — in a regulated data environment
  • Experience with financial, payment, or transaction data, including reconciliation and settlement concepts

Required skills

  • Python, SQL, Data Pipeline Development, SQL Server, Oracle, PostgreSQL, Data Quality Validation, Data Reconciliation, Data Modeling, Redpanda, MongoDB, Snowflake

Preferred skills

  • Containerization and provisioning experience with Docker

Experience

  • Mid level

Job details

Employment type

Full-time

Seniority level

Mid level

Date posted

Oct 9, 2026

Work mode

Hybrid

Job source

nelnet.wd1.myworkdayjobs.com

Company

Nelnet

Information Technology & AI

Student loan servicing and education payment technology provider

  • Lincoln, Nebraska, USA
  • Information Technology & AI
  • 5001-10000 employees
  • Founded 1996
  • nelnetinc.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Lincoln

Airbnb

1d ago

New

Data Engineer Tech Foundations

Full-timeRemoteUnited States$162K – $186K/yr

Airbnb is hiring a Data Engineer to build and operate reliable, reusable datasets and pipelines that support AI usage and cost measurement, Unit Economics, enterprise application data, and critical financial metrics.

Why similarSame roleData ModelingRemote

First Citizens Bank

1d ago

New

Senior Data Engineer - ETL/ELT (Remote - NC, AZ, TX, FL)

Full-timeRemoteUnited StatesCompetitive

First Citizens Bank is hiring a Senior Data Engineer to implement, enhance, and support data pipelines and platform capabilities within established architectural patterns.

Why similarSame rolePythonRemote

Coinbase

1d ago

New

Senior Software Engineer, Data Engineering Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer for its Data Platform team. The role builds and maintains SDKs, self-service applications, reusable abstractions, and security and observability tooling that help internal teams create, manage, and use data…

Why similarSame rolePythonRemote

Get new Data Engineer jobs in Lincoln by email

Create job alert

Data Engineer

Nelnet · $100K/yr

Apply on company site