Full-time
Databricks Data Engineer
Competitive
Washington, DCIT & TechnologyPosted 28d ago
You'll complete your application on the employer's website.
← Back to jobs
Role overview
Job type
Salary
Competitive
Location
Sector
Posted
28 days ago
Job description
Square Peg Technologies is a technology consulting firm specializing in data solutions, analytics, data science, data engineering, and data management. The Data Engineer will design, implement, and maintain data pipelines for customers, develop automated pipelines for diverse data types and datasets, and support challenging data problems using Databricks and related cloud technologies.
Responsibilities
Designing, implementing, and maintaining data pipelines for our customers
The Data Engineer will develop automated pipelines for a variety of data types and datasets
Prepare big data, implement data models and develop database to support the business solutions
Preferred
Experience with using Apache Spark and Hadoop to conduct large-scale data processing
Extensive experience in Extract-Transform-Load (ETL) processes
Demonstrated extensive experience with cloud services (AWS strongly preferred)
Familiarity with open source data engineering tools and processes
Apache Spark
Hadoop
Large-Scale Data Processing
ETL Processes
Cloud Services
Open-Source Data Engineering Tools
Data Engineering Processes
Benefits
Extensive training program
A large amount of vacation
Annual bonuses
401k matching
Paid training
100% health care coverage
Company
Defense and government data systems and security services
Washington, District of Columbia, USA
https://www.squarepegtech.com/
Founded in 2014
11-50 employees
Qualifications
Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph
Proficient with one or more programming languages (Python, SQL, Java)
Understanding of SQL database structures and mapping data structures between different SQL databases
Knowledge of API development techniques
Demonstrated experience in data engineering, data processing and modeling techniques using cloud-based data management, data science, and ML platforms such as Databricks, Splunk, Cloudera, and Snowflake
Demonstrated experience with cloud based database services such as Databricks and AWS
Experience with using Apache Spark and Hadoop to conduct large-scale data processing
Extensive experience in Extract-Transform-Load (ETL) processes
Demonstrated extensive experience with cloud services (AWS strongly preferred)
Familiarity with open source data engineering tools and processes
Required skills
Python, SQL, Java, Data Engineering, Data Modeling, API Development, Databricks, Splunk, Cloudera, Snowflake, AWS, Apache Spark
Experience
Mid level
Interested in this role?
Apply directly on the employer's website — it only takes a few minutes.
Similar vacancies
Other roles in Washington, DC or IT & Technology
ITFull-time
San FranciscoIT & TechnologyPosted 30+ Days Ago
We are looking for a systems-minded engineer to help advance our kernel development, performance engineering, and hardware-software co-design capabilities, with a particular focus on AI-assisted workflows and tooling.
ITFull-time
San FranciscoIT & TechnologyPosted 30+ Days Ago
We’re looking for dedicated, experienced, and deeply curious individuals to help solve some of the most complex challenges faced by our customers while building the future of post-AGI support alongside us.
Staff Software Engineer, Payment Systems
Competitive
ITFull-time
Seattle, New York, San FranciscoIT & TechnologyPosted 30+ Days Ago
As a Staff Engineer on Payment Intelligence, you’ll work across our product portfolio to ensure we’re building in a consistent, efficient, and effective manner. Experience with large, distributed systems on the critical path will help candidates succeed, as will comfort working across the stack and interacting with ML…