← Back to jobsJob ID col-cmv95vma90j44md01wwsro13d

Information TechnologyPosted 30+ days ago

Cloud Dataflow Engineer/Analyst

Full-time
Hybrid
2+ years
$75K – $110K/yr
Posted 30+ days ago

Spatial Front, Inc. is seeking a Cloud Dataflow Engineer/Analyst to support a mission-critical enterprise data modernization initiative. The role focuses on ingesting, automating, monitoring, and migrating high-volume real-time data streams from legacy on-premise systems to reliable cloud platforms while supporting data integration, quality control, and operational availability.

Posted
30+ Days Ago
Source
recruiting.paylocity.com
Sector
Electrical Engineering

Opens the employer's application page in a new tab

Responsibilities

  • Execute and streamline large-scale data ingestion and migration processes from legacy on-premise systems to cloud environments (AWS/Azure/GCP)
  • Transition legacy dataflow pipelines into automated, API-driven workflows using Python, Bash, and modern CI/CD practices
  • Maintain, refactor, and migrate legacy scripts and tools (Bash, Perl, SQL) to scalable, cloud-native solutions
  • This role offers a unique opportunity to learn the foundational legacy systems of the National Weather Service while simultaneously building the "Gold Standard" of cloud-based weather data dissemination
  • Ensure continuous, low-latency delivery of mission-critical, high-volume data streams in a 24/7 operational environment
  • Monitor, troubleshoot, and optimize data routing applications, ingestion processes, and underlying cloud services
  • Serve as a Tier 2 technical escalation point for complex data ingestion, formatting, and delivery issues
  • Participate in a 24/7 on-call rotation to support mission-critical availability
  • Manage end-to-end data flow operations, including validation, quality control, archival, and retrieval
  • Collaborate with internal engineering teams and external stakeholders to resolve data access, formatting, and integration challenges
  • Author and maintain technical documentation, standard operating procedures (SOPs), and configuration standards

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience)
  • 1–2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP)
  • 2+ years of Linux/Unix system administration or engineering support experience
  • Strong proficiency in Python and Bash scripting, alongside solid SQL experience and relational database fundamentals
  • Demonstrated experience supporting ETL pipelines, data integration workflows, and automated CI/CD deployment tools
  • At least one (1) active foundational or associate-level cloud certification (e.g., AWS Certified Cloud Practitioner or equivalent)
  • Ability to obtain and maintain a Public Trust clearance
  • Must be authorized to work in the U.S. and be able to obtain and keep a public trust clearance

Preferred

  • Experience with scientific or meteorological data dissemination systems (NOAA, NASA, DoD)
  • familiarity with data formats such as METAR, TAF, GRIB, and BUFR
  • Hands-on experience with monitoring tools (e.g., Big Brother, Nagios) or cloud-native monitoring solutions (e.g., AWS CloudWatch)
  • Experience with Perl for legacy script migration
  • Proficiency with Git, SVN, or similar version control tools
  • Associate or Professional-level cloud engineering certifications
  • Scientific data dissemination systems
  • Meteorological data dissemination systems

Required skills

AWSAzureGCPLinux/Unix AdministrationPythonBashSQLETL PipelinesData IntegrationCI/CDFoundational Cloud CertificationPublic Trust Clearance

Full job description

Spatial Front, Inc. is seeking a Cloud Dataflow Engineer/Analyst to support a mission-critical enterprise data modernization initiative. The role focuses on ingesting, automating, monitoring, and migrating high-volume real-time data streams from legacy on-premise systems to reliable cloud platforms while supporting data integration, quality control, and operational availability.

Responsibilities

  • Execute and streamline large-scale data ingestion and migration processes from legacy on-premise systems to cloud environments (AWS/Azure/GCP)
  • Transition legacy dataflow pipelines into automated, API-driven workflows using Python, Bash, and modern CI/CD practices
  • Maintain, refactor, and migrate legacy scripts and tools (Bash, Perl, SQL) to scalable, cloud-native solutions
  • This role offers a unique opportunity to learn the foundational legacy systems of the National Weather Service while simultaneously building the "Gold Standard" of cloud-based weather data dissemination
  • Ensure continuous, low-latency delivery of mission-critical, high-volume data streams in a 24/7 operational environment
  • Monitor, troubleshoot, and optimize data routing applications, ingestion processes, and underlying cloud services
  • Serve as a Tier 2 technical escalation point for complex data ingestion, formatting, and delivery issues
  • Participate in a 24/7 on-call rotation to support mission-critical availability
  • Manage end-to-end data flow operations, including validation, quality control, archival, and retrieval
  • Collaborate with internal engineering teams and external stakeholders to resolve data access, formatting, and integration challenges
  • Author and maintain technical documentation, standard operating procedures (SOPs), and configuration standards

Preferred

  • Experience with scientific or meteorological data dissemination systems (NOAA, NASA, DoD)
  • familiarity with data formats such as METAR, TAF, GRIB, and BUFR
  • Hands-on experience with monitoring tools (e.g., Big Brother, Nagios) or cloud-native monitoring solutions (e.g., AWS CloudWatch)
  • Experience with Perl for legacy script migration
  • Proficiency with Git, SVN, or similar version control tools
  • Associate or Professional-level cloud engineering certifications
  • Scientific data dissemination systems
  • Meteorological data dissemination systems
  • METAR
  • TAF
  • GRIB
  • BUFR
  • System monitoring tools
  • Big Brother
  • Nagios
  • AWS CloudWatch
  • Perl
  • Legacy script migration
  • Git
  • SVN
  • Version control
  • Cloud engineering certifications

Benefits

  • Hybrid work environment

Company

  • Information technology solutions and business support services
  • Bethesda, Maryland, USA
  • http://www.spatialfront.com/pages/index.html
  • Founded in 2008
  • 501-1000 employees

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience)
  • 1–2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP)
  • 2+ years of Linux/Unix system administration or engineering support experience
  • Strong proficiency in Python and Bash scripting, alongside solid SQL experience and relational database fundamentals
  • Demonstrated experience supporting ETL pipelines, data integration workflows, and automated CI/CD deployment tools
  • At least one (1) active foundational or associate-level cloud certification (e.g., AWS Certified Cloud Practitioner or equivalent)
  • Ability to obtain and maintain a Public Trust clearance
  • Must be authorized to work in the U.S. and be able to obtain and keep a public trust clearance
  • Experience with scientific or meteorological data dissemination systems (NOAA, NASA, DoD)
  • Familiarity with data formats such as METAR, TAF, GRIB, and BUFR
  • Hands-on experience with monitoring tools (e.g., Big Brother, Nagios) or cloud-native monitoring solutions (e.g., AWS CloudWatch)
  • Experience with Perl for legacy script migration
  • Proficiency with Git, SVN, or similar version control tools
  • Associate or Professional-level cloud engineering certifications
  • 1–2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP).
  • 2+ years of Linux/Unix system administration or engineering support experience.

Required skills

  • AWS, Azure, GCP, Linux/Unix Administration, Python, Bash, SQL, ETL Pipelines, Data Integration, CI/CD, Foundational Cloud Certification, Public Trust Clearance

Preferred skills

  • Experience with Perl for legacy script migration, Proficiency with Git, SVN, or similar version control tools

Experience

  • 2+ years

Job details

Employment type

Full-time

Seniority level

2+ years

Date posted

Sep 30, 2026

Work mode

Hybrid

Job source

recruiting.paylocity.com

Company

Information Technology

Electrical Engineering

Information technology solutions and business support services

See all 55 jobs from Information Technology →
  • Bethesda, Maryland, USA
  • Electrical Engineering
  • 501-1000 employees
  • Founded 2008
  • spatialfront.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Systems Integration Engineer jobs in United States

Just Appraised

1d ago

New

Product Engineer

Full-timeRemoteUnited StatesCompetitive

Alltus is hiring a Product Engineer to build and shape workflows, automation, and AI-powered experiences for local government.

Why similarSame roleAWSPython

Bright Vision Technologies

1d ago

New

BI Developer

Full-timeRemoteUnited States$115K – $165K/yr

Bright Vision Technologies is seeking a BI Developer to design, develop, test, and support enterprise software applications and services.

Why similarSame roleCI/CDSQL

Infosys

1d ago

New

Azure Databricks Engineer

Full-timeOn-siteCincinnati, OHCompetitive

Infosys is hiring an Azure Databricks Engineer to design and implement data solutions using Azure technologies and data engineering tools.

Why similarSame rolePythonSQL

Get new Systems Integration Engineer jobs in United States by email

Create job alert

Cloud Dataflow Engineer/Analyst

Information Technology · $75K – $110K/yr

Apply on company site