← Back to jobsJob ID col-cmv9yxwzw001ijl01u7b170hf

The Amatriot GroupPosted 30+ days ago

Data Engineering Software Developer (Mid)

Full-time
On-site
8+ years
$175K – $200K/yr
Posted 30+ days ago

The Amatriot Group is seeking a Data Engineering Software Developer to support complex enterprise data environments. The role designs, builds, integrates, and maintains scalable data systems and pipelines while supporting analytics, reporting, operational insight, security, compliance, automation, and platform optimization.

Posted
30+ Days Ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design, build, and maintain scalable and reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting
  • Unify and integrate data from multiple network operations systems into a consistent and accessible platform
  • Develop and maintain ETL/ELT processes supporting data ingestion, transformation, validation, and cleansing
  • Create and maintain Kafka, Elastic, and Logstash pipelines supporting enterprise data processing requirements
  • Automate data-related processing and monitoring activities
  • Implement data solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift/Kubernetes
  • Develop and manage data warehouses and data lakes supporting analytics, reporting, and operational dashboards
  • Develop data-engineering capabilities using Python, Java, SQL, shell scripting, and related technologies
  • Support Kibana visualizations and dashboards using React, JavaScript, and HTML
  • Apply software engineering and automation practices to improve the maintainability and scalability of data solutions
  • Analyze and optimize data-ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms
  • Optimize infrastructure for performance, scalability, reliability, and cost effectiveness
  • Troubleshoot and resolve issues related to data ingestion, processing, storage, memory utilization, partitioning, and cluster performance
  • Identify and resolve performance bottlenecks affecting data availability and downstream analytics
  • Ensure data quality, accuracy, security, and compliance with applicable DoD and DISA requirements
  • Apply appropriate data security and access-control practices
  • Support CI/CD pipelines for automated build, test, and deployment activities
  • Apply version control and DevOps practices to data engineering and software development workflows
  • Collaborate with data analysts, visualization engineers, software developers, and other stakeholders to deliver integrated and actionable data solutions
  • Document data architecture, integration patterns, configurations, and operational procedures
  • Develop and maintain technical documentation and runbooks supporting data platforms, pipelines, and applications

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related technical discipline with 8+ years of relevant experience
  • Hands-on experience designing, building, and maintaining ETL/ELT data pipelines and integrating multiple disparate data sources
  • Experience with data warehouse and/or data lake technologies such as AWS Redshift, Amazon S3, Hadoop, Snowflake, or similar platforms
  • Experience with Elastic Stack, including Elasticsearch, Logstash, and Kibana, and/or Kafka for data ingestion and processing
  • Experience with Linux/UNIX system administration and automation
  • Experience with CI/CD pipelines, containerized pipelines, version control technologies such as Git and Bitbucket, and DevOps practices
  • Familiarity with network operations data, including logs, metrics, events, ticketing, CMDB data, and related data models
  • Proficiency with data engineering and software development technologies and languages such as Python, Java, SQL, and shell scripting
  • Knowledge of data security, access controls, and compliance frameworks, including DoD, DISA, RMF, and STIG requirements
  • Strong communication and documentation skills supporting collaboration and knowledge sharing
  • Current Security+ certification or higher/equivalent certification
  • Active TS/SCI security clearance
  • Willingness and ability to complete and maintain additional customer suitability screenings throughout employment
  • Bachelor’s degree in Computer Science, Engineering, or a related technical discipline with 8+ years of relevant experience.

Preferred

  • Experience supporting DISA, DISN, or other DoD network environments
  • Experience developing and deploying software applications that meet DoD security standards, including applicable STIGs
  • Knowledge of network security, encryption, and access controls within classified environments
  • Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack
  • Experience applying big data technologies to text mining, summarization, search, and entity extraction
  • Experience with cloud-based data platforms, including AWS, Azure, GCP, or AWS GovCloud
  • Experience with cloud-integrated platforms and Infrastructure as Code, including networking and security policies
  • Familiarity with Kubernetes deployment, platform upgrades, and patching
  • Experience with configuration management technologies such as Ansible, Puppet, or Chef
  • Experience with monitoring, alerting, and observability technologies such as Prometheus, Grafana, and Elastic
  • Experience with business intelligence and visualization tools such as Kibana
  • Experience developing and maintaining technical documentation and operational runbooks
  • Strong understanding and practical experience with Agile methodologies, including Scrum and SAFe
  • Experience with Atlassian Jira and Confluence
  • Elastic Certified Engineer certification
  • Experience working remotely with geographically dispersed teams and within matrixed organizations
  • Experience combining software development, integration, and data engineering practices
  • Experience applying knowledge of system architecture, networking, and centralized logging using ELK to support data transformation initiatives
  • Security Technical Implementation Guides

Required skills

Security+ CertificationETL/ELT Data PipelinesElastic StackApache KafkaPythonJavaSQLShell ScriptingLinux/UNIX System AdministrationCI/CDGit and BitbucketDevOps

Nice to have

Confluent Developer certification

Full job description

The Amatriot Group is seeking a Data Engineering Software Developer to support complex enterprise data environments. The role designs, builds, integrates, and maintains scalable data systems and pipelines while supporting analytics, reporting, operational insight, security, compliance, automation, and platform optimization.

Responsibilities

  • Design, build, and maintain scalable and reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting
  • Unify and integrate data from multiple network operations systems into a consistent and accessible platform
  • Develop and maintain ETL/ELT processes supporting data ingestion, transformation, validation, and cleansing
  • Create and maintain Kafka, Elastic, and Logstash pipelines supporting enterprise data processing requirements
  • Automate data-related processing and monitoring activities
  • Implement data solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift/Kubernetes
  • Develop and manage data warehouses and data lakes supporting analytics, reporting, and operational dashboards
  • Develop data-engineering capabilities using Python, Java, SQL, shell scripting, and related technologies
  • Support Kibana visualizations and dashboards using React, JavaScript, and HTML
  • Apply software engineering and automation practices to improve the maintainability and scalability of data solutions
  • Analyze and optimize data-ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms
  • Optimize infrastructure for performance, scalability, reliability, and cost effectiveness
  • Troubleshoot and resolve issues related to data ingestion, processing, storage, memory utilization, partitioning, and cluster performance
  • Identify and resolve performance bottlenecks affecting data availability and downstream analytics
  • Ensure data quality, accuracy, security, and compliance with applicable DoD and DISA requirements
  • Apply appropriate data security and access-control practices
  • Support CI/CD pipelines for automated build, test, and deployment activities
  • Apply version control and DevOps practices to data engineering and software development workflows
  • Collaborate with data analysts, visualization engineers, software developers, and other stakeholders to deliver integrated and actionable data solutions
  • Document data architecture, integration patterns, configurations, and operational procedures
  • Develop and maintain technical documentation and runbooks supporting data platforms, pipelines, and applications

Preferred

  • Experience supporting DISA, DISN, or other DoD network environments
  • Experience developing and deploying software applications that meet DoD security standards, including applicable STIGs
  • Knowledge of network security, encryption, and access controls within classified environments
  • Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack
  • Experience applying big data technologies to text mining, summarization, search, and entity extraction
  • Experience with cloud-based data platforms, including AWS, Azure, GCP, or AWS GovCloud
  • Experience with cloud-integrated platforms and Infrastructure as Code, including networking and security policies
  • Familiarity with Kubernetes deployment, platform upgrades, and patching
  • Experience with configuration management technologies such as Ansible, Puppet, or Chef
  • Experience with monitoring, alerting, and observability technologies such as Prometheus, Grafana, and Elastic
  • Experience with business intelligence and visualization tools such as Kibana
  • Experience developing and maintaining technical documentation and operational runbooks
  • Strong understanding and practical experience with Agile methodologies, including Scrum and SAFe
  • Experience with Atlassian Jira and Confluence
  • Confluent Developer certification
  • Elastic Certified Engineer certification
  • Experience working remotely with geographically dispersed teams and within matrixed organizations
  • Experience combining software development, integration, and data engineering practices
  • Experience applying knowledge of system architecture, networking, and centralized logging using ELK to support data transformation initiatives
  • DISA Network Environments
  • DISN Network Environments
  • DoD Network Environments
  • Secure Software Development
  • DoD Security Standards
  • Security Technical Implementation Guides
  • Network Security
  • Encryption
  • Classified Environments
  • Big Data Technologies
  • Spark
  • NiFi
  • Databricks
  • ELK Stack
  • Text Mining
  • Text Summarization
  • Entity Extraction
  • Cloud Data Platforms
  • AWS
  • Azure
  • GCP
  • AWS GovCloud
  • Cloud-Integrated Platforms
  • Infrastructure as Code
  • Cloud Networking
  • Security Policies
  • Kubernetes Deployment
  • Platform Upgrades
  • Patching
  • Configuration Management
  • Ansible
  • Puppet
  • Chef
  • Monitoring
  • Alerting
  • Observability
  • Prometheus
  • Grafana
  • Elastic
  • Business Intelligence
  • Data Visualization
  • Technical Documentation
  • Operational Runbooks
  • Agile Methodologies
  • Scrum
  • SAFe
  • Atlassian Jira
  • Confluence
  • Confluent Developer Certification
  • Elastic Certified Engineer Certification
  • Software Integration
  • System Architecture
  • Centralized Logging
  • Data Transformation
  • Cross-Functional Collaboration
  • Matrixed Teamwork

Company

  • Talent solutions for federal intelligence, defense, and national security.
  • Vienna, Virginia, USA
  • https://amatriot.com/
  • Founded in 2011
  • 201-500 employees

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related technical discipline with 8+ years of relevant experience
  • Hands-on experience designing, building, and maintaining ETL/ELT data pipelines and integrating multiple disparate data sources
  • Experience with data warehouse and/or data lake technologies such as AWS Redshift, Amazon S3, Hadoop, Snowflake, or similar platforms
  • Experience with Elastic Stack, including Elasticsearch, Logstash, and Kibana, and/or Kafka for data ingestion and processing
  • Experience with Linux/UNIX system administration and automation
  • Experience with CI/CD pipelines, containerized pipelines, version control technologies such as Git and Bitbucket, and DevOps practices
  • Familiarity with network operations data, including logs, metrics, events, ticketing, CMDB data, and related data models
  • Proficiency with data engineering and software development technologies and languages such as Python, Java, SQL, and shell scripting
  • Knowledge of data security, access controls, and compliance frameworks, including DoD, DISA, RMF, and STIG requirements
  • Strong communication and documentation skills supporting collaboration and knowledge sharing
  • Current Security+ certification or higher/equivalent certification
  • Active TS/SCI security clearance
  • Willingness and ability to complete and maintain additional customer suitability screenings throughout employment
  • Experience supporting DISA, DISN, or other DoD network environments
  • Experience developing and deploying software applications that meet DoD security standards, including applicable STIGs
  • Knowledge of network security, encryption, and access controls within classified environments
  • Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack
  • Experience applying big data technologies to text mining, summarization, search, and entity extraction
  • Experience with cloud-based data platforms, including AWS, Azure, GCP, or AWS GovCloud
  • Experience with cloud-integrated platforms and Infrastructure as Code, including networking and security policies
  • Familiarity with Kubernetes deployment, platform upgrades, and patching
  • Experience with configuration management technologies such as Ansible, Puppet, or Chef
  • Experience with monitoring, alerting, and observability technologies such as Prometheus, Grafana, and Elastic
  • Experience with business intelligence and visualization tools such as Kibana
  • Experience developing and maintaining technical documentation and operational runbooks
  • Strong understanding and practical experience with Agile methodologies, including Scrum and SAFe
  • Experience with Atlassian Jira and Confluence
  • Confluent Developer certification
  • Elastic Certified Engineer certification
  • Experience working remotely with geographically dispersed teams and within matrixed organizations
  • Experience combining software development, integration, and data engineering practices
  • Experience applying knowledge of system architecture, networking, and centralized logging using ELK to support data transformation initiatives
  • Bachelor’s degree in Computer Science, Engineering, or a related technical discipline with 8+ years of relevant experience.

Required skills

  • Security+ Certification, ETL/ELT Data Pipelines, Data Warehousing and Data Lakes, Elastic Stack, Apache Kafka, Python, Java, SQL, Shell Scripting, Linux/UNIX System Administration, CI/CD, Git and Bitbucket, DevOps, Data Security and Access Controls, DoD, DISA, RMF, and STIG Compliance

Preferred skills

  • Experience with Atlassian Jira and Confluence, Confluent Developer certification, Elastic Certified Engineer certification

Experience

  • 8+ years

Job details

Employment type

Full-time

Seniority level

8+ years

Date posted

Sep 28, 2026

Work mode

On-site

Job source

linkedin.com

Company

The Amatriot Group

Information Technology & AI

Talent solutions for federal intelligence, defense, and national security.

See all 3 jobs from The Amatriot Group →
  • Vienna, Virginia, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 2011
  • amatriot.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Washington

Coinbase

1d ago

New

Senior Software Engineer, Data Engineering Platform

Full-timeRemoteUnited States$186K – $219K/yr

Coinbase is hiring a Senior Software Engineer for its Data Platform team. The role builds and maintains SDKs, self-service applications, reusable abstractions, and security and observability tooling that help internal teams create, manage, and use data…

Why similarSame roleJavaRemote

#Data Engineering Opportunities

1d ago

New

#Data Engineering Opportunities | Data Engineer, Senior & Lead

Full-timeOn-siteNew York, NY$140K – $190K/yr

Lakeview Loan Servicing, LLC is hiring Data Engineers at multiple levels to build and evolve the data foundation supporting analytics, reporting, AI, products, and operational decisions.

Why similarSame roleJavaPython

just now

1d ago

New

Senior Developer- Data Engineer

TemporaryHybridColumbia, SCCompetitive

A confidential client, recruiting through TALENT Software Services, is seeking a Senior Developer / Data Engineer to build and support enterprise data solutions and establish its agentic AI capability.

Why similarSame roleCI/CDPython

Get new Data Engineer jobs in Washington by email

Create job alert

Data Engineering Software Developer (Mid)

The Amatriot Group · $175K – $200K/yr

Apply on company site