← Back to jobsJob ID col-cmv8bb5gf01daoz012m1arizy

SpyCloudPosted 30+ days ago

Data Engineer II

Full-time
Remote
5+ years
$104K – $135K/yr
Posted 30+ days ago

SpyCloud is hiring a Data Engineer II to evolve its data platform and build scalable, reliable data pipelines and customer data stores. The role owns complex data engineering initiatives, supports production systems, and collaborates across Product Management, SpyCloud Labs, and Engineering.

Posted
30+ Days Ago
Source
Ethic Leaf recruiter
Sector
Information Technology & AI

No employer link yet — an Ethic Leaf recruiter forwards your application

Responsibilities

  • Design, build, and improve scalable data systems with a focus on performance, and reliability
  • Use Databricks and Spark to prepare, transform, and serve high-quality data to customers and downstream systems
  • Build, optimize, and maintain real-time and batch data pipelines using AWS technologies such as Lambda, S3, DynamoDB, ECS, EKS, and Terraform, as well as develop and maintain pipelines within the Databricks ecosystem
  • Identify and implement improvements to the cost and performance of data ingestion, transformation, and storage workflows
  • Be available for on-call support to troubleshoot and remediate data pipeline failures outside of standard business hours
  • Partner with Product Management, SpyCloud Labs, and Engineering teams to understand requirements and develop effective technical solutions
  • Evaluate and implement modern tooling for data processing, ML/AI data workflows, and observability
  • Contribute to architectural and technical design decisions and help implement scalable solutions aligned with engineering standards
  • Promote engineering best practices through collaboration, code reviews, documentation, and knowledge sharing
  • Identify and resolve complex data quality, performance, security, and reliability issues across production systems
  • Independently own complex data engineering initiatives from design and development through deployment and production support
  • Contribute to the continued evolution of SpyCloud’s data platform as product, customer, and AI requirements grow

Qualifications

  • 5+ years of professional experience in data engineering, software engineering, or a closely related discipline
  • Experience building and operating Lakehouse, Databricks, or large-scale distributed data architectures in AWS
  • Strong understanding of distributed systems as they relate to data storage, processing, and computing
  • Experience building and managing Elasticsearch/OpenSearch data stores
  • Hands-on experience designing, building, and maintaining ETL and data-processing pipelines
  • Experience preparing and managing data for machine learning and LLM workflows
  • Strong development skills in Python, particularly when building data-intensive systems
  • Practical experience with DynamoDB and other AWS-native data services
  • Experience with infrastructure-as-code tools such as Terraform
  • Experience troubleshooting complex data pipeline, performance, and data quality issues in production environments
  • Ability to independently own complex technical projects from design and development through deployment and production support
  • Ability to evaluate technical trade-offs and contribute effectively to architectural and design decisions
  • Strong communication and collaboration skills across technical and non-technical stakeholders
  • SpyCloud is not sponsoring visas at this time

Preferred

  • Familiarity with AI/ML tools and technologies such as SageMaker, LangChain, or vector databases
  • Understanding of data governance, privacy, and compliance considerations within AI and ML environments
  • Experience with observability and monitoring tools for large-scale data platforms
  • Experience with Go or C programming languages
  • Experience working with cybersecurity or security-related datasets and technologies
  • Comfort working in fast-paced environments with evolving product and technical requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related STEM field
  • Computer Science degree
  • Engineering degree
  • STEM degree
  • Comfort in fast-paced environments

Required skills

Data EngineeringLakehouse ArchitectureDatabricksApache SparkAWSDistributed SystemsElasticsearchOpenSearchETL PipelinesMachine Learning Data WorkflowsPythonDynamoDBTerraformData Governance

Full job description

SpyCloud is hiring a Data Engineer II to evolve its data platform and build scalable, reliable data pipelines and customer data stores. The role owns complex data engineering initiatives, supports production systems, and collaborates across Product Management, SpyCloud Labs, and Engineering.

Responsibilities

  • Design, build, and improve scalable data systems with a focus on performance, and reliability
  • Use Databricks and Spark to prepare, transform, and serve high-quality data to customers and downstream systems
  • Build, optimize, and maintain real-time and batch data pipelines using AWS technologies such as Lambda, S3, DynamoDB, ECS, EKS, and Terraform, as well as develop and maintain pipelines within the Databricks ecosystem
  • Identify and implement improvements to the cost and performance of data ingestion, transformation, and storage workflows
  • Be available for on-call support to troubleshoot and remediate data pipeline failures outside of standard business hours
  • Partner with Product Management, SpyCloud Labs, and Engineering teams to understand requirements and develop effective technical solutions
  • Evaluate and implement modern tooling for data processing, ML/AI data workflows, and observability
  • Contribute to architectural and technical design decisions and help implement scalable solutions aligned with engineering standards
  • Promote engineering best practices through collaboration, code reviews, documentation, and knowledge sharing
  • Identify and resolve complex data quality, performance, security, and reliability issues across production systems
  • Independently own complex data engineering initiatives from design and development through deployment and production support
  • Contribute to the continued evolution of SpyCloud’s data platform as product, customer, and AI requirements grow

Preferred

  • Familiarity with AI/ML tools and technologies such as SageMaker, LangChain, or vector databases
  • Understanding of data governance, privacy, and compliance considerations within AI and ML environments
  • Experience with observability and monitoring tools for large-scale data platforms
  • Experience with Go or C programming languages
  • Experience working with cybersecurity or security-related datasets and technologies
  • Comfort working in fast-paced environments with evolving product and technical requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related STEM field
  • AI/ML tools
  • Amazon SageMaker
  • LangChain
  • Vector databases
  • Data governance
  • Data privacy
  • AI/ML compliance
  • Observability tools
  • Large-scale data platforms
  • Go
  • C
  • Cybersecurity datasets
  • Security technologies
  • Computer Science degree
  • Engineering degree
  • STEM degree
  • Adaptability
  • Comfort in fast-paced environments

Benefits

  • 401(k) with Employer Contribution (for full-time employees based in the U.S.)
  • Health, Vision, and Dental Insurance (for full-time employees based in the U.S.)
  • Health Savings Account (HSA) available with Employer Contribution (for full-time employees based in the U.S.)
  • Employer Paid Life, Short-term, and Long-term Disability Insurance (for full-time employees based in the U.S.)
  • Generous PTO Plan and 16 paid holidays per year (for full-time employees based in the U.S.)
  • Retirement Savings Plan with Employer Contribution (for full-time employees based in the U.K.)
  • Employer Provided Private Health Insurance and Healthcare Cashplan (for full-time employees based in the U.K.)
  • Employer Paid Life Insurance, Income Replacement, and Critical Illness Protection (for full-time employees based in the U.K.)
  • Employee Assistance Program (for full-time employees based in the U.K.)
  • 25 days annual accrued holiday plus 8 paid bank holidays and a paid company shutdown during winter holidays (for full-time employees based in the U.K.)
  • Flexible and remote-friendly work options
  • Engaging workspace in South Austin

Company

  • Identity threat protection software preventing account takeover and ransomware
  • Austin, Texas, USA
  • https://spycloud.com/
  • Founded in 2016
  • 201-500 employees

Qualifications

  • 5+ years of professional experience in data engineering, software engineering, or a closely related discipline
  • Experience building and operating Lakehouse, Databricks, or large-scale distributed data architectures in AWS
  • Strong understanding of distributed systems as they relate to data storage, processing, and computing
  • Experience building and managing Elasticsearch/OpenSearch data stores
  • Hands-on experience designing, building, and maintaining ETL and data-processing pipelines
  • Experience preparing and managing data for machine learning and LLM workflows
  • Strong development skills in Python, particularly when building data-intensive systems
  • Practical experience with DynamoDB and other AWS-native data services
  • Experience with infrastructure-as-code tools such as Terraform
  • Experience troubleshooting complex data pipeline, performance, and data quality issues in production environments
  • Ability to independently own complex technical projects from design and development through deployment and production support
  • Ability to evaluate technical trade-offs and contribute effectively to architectural and design decisions
  • Strong communication and collaboration skills across technical and non-technical stakeholders
  • SpyCloud is not sponsoring visas at this time
  • Familiarity with AI/ML tools and technologies such as SageMaker, LangChain, or vector databases
  • Understanding of data governance, privacy, and compliance considerations within AI and ML environments
  • Experience with observability and monitoring tools for large-scale data platforms
  • Experience with Go or C programming languages
  • Experience working with cybersecurity or security-related datasets and technologies
  • Comfort working in fast-paced environments with evolving product and technical requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related STEM field
  • 5+ years of professional experience in data engineering, software engineering, or a closely related discipline.

Required skills

  • Data Engineering, Lakehouse Architecture, Databricks, Apache Spark, AWS, Distributed Systems, Elasticsearch, OpenSearch, ETL Pipelines, Machine Learning Data Workflows, Large Language Model (LLM) Workflows, Python, DynamoDB, Terraform, Data Governance, Data Privacy and Compliance, Amazon SageMaker, LangChain, Vector Databases, Go, C

Preferred skills

  • Experience with Go or C programming languages

Experience

  • 5+ years

Job details

Employment type

Full-time

Seniority level

5+ years

Date posted

Oct 14, 2026

Work mode

Remote

Job source

Ethic Leaf recruiter

Company

SpyCloud

Information Technology & AI

Identity threat protection software preventing account takeover and ransomware

  • Austin, Texas, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 2016
  • spycloud.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs

Airbnb

1d ago

New

Data Engineer Tech Foundations

Full-timeRemoteUnited States$162K – $186K/yr

Airbnb is hiring a Data Engineer to build and operate reliable, reusable datasets and pipelines that support AI usage and cost measurement, Unit Economics, enterprise application data, and critical financial metrics.

Why similarSame roleApache SparkRemote

First Citizens Bank

1d ago

New

Senior Data Engineer - DevOps (Remote - NC, AZ, TX, FL)

Full-timeRemoteUnited StatesCompetitive

First Citizens Bank is seeking a Senior Data Engineer - DevOps to support its data engineering platform.

Why similarSame roleAWSRemote

M Science

1d ago

New

Data Engineer

Full-timeOn-siteNew York, NY$110K – $150K/yr

M Science is hiring a Data Engineer to build and improve large-scale data pipelines and datasets for analytics, experimentation, and machine learning.

Why similarSame roleAWSData Engineering

Get new Data Engineer jobs by email

Create job alert

Data Engineer II

SpyCloud · $104K – $135K/yr

Apply via Ethic Leaf