Data Engineer

The California Department of Education is hiring a Data Engineer to support public reporting and the DataQuest modernization project. The role develops data requirements and sources for BI reports and a public-facing web application, and builds and validates data warehouse pipelines, notebooks, and semantic models.

Responsibilities

• Work with program staff and management to understand individual needs of the existing reports, including aggregations, visualizations, and data sources
• Work with program staff and management to identify and current business and data workflows
• Analyze current business processes and make recommendations for improvement (As Is - To Be)
• Build pipelines, notebooks and semantic models in Azure warehouse environment for BI reports and webapp integration
• Maintain knowledge of CDE's business processes, data, and transactional applications
• Participates in complex development efforts and analyzes data relationships and map source data to BI data warehouse targets
• Validates data integration results and automates data refreshes by scheduling jobs
• Recognize and apply technology trends and industry best practices related to data warehousing, reporting, and analysis

Preferred

• Experience with continuous integration/continuous delivery workflows in an Agile environment
• Experience working with confidential data, and/or secure data environments
• Experience using dev ops tools (Azure DevOps, JIRA, Confluence)
• Experience eliciting and developing requirements, and documentation for data based projects
• Experience with data engineering in a cloud environment
• Continuous Integration/Continuous Delivery
• Agile
• Confidential Data Handling
• Secure Data Environments
• Azure DevOps
• JIRA
• Confluence
• Requirements Elicitation
• Requirements Development
• Project Documentation
• Data-Based Projects
• Data Engineering
• Cloud Environments

Benefits

• Medical benefits, including health, dental, and vision insurance
• Paid holidays: 11 paid State holidays, 1 personal paid holiday, and 2 professional development days
• 401(k) and 457(b) Plans (Savings Plus)
• Employee Assistance Program
• Commute Program
• This position is subject to PLP 2025 and will have a monthly base pay reduction of 3% in exchange for 5 hours of leave credits through June 2027.
• The hybrid telework schedule includes working remotely and working a minimum of 2 days per week in the office.

Company

• Medical, dental, and mental health care for California prisoners
• Elk Grove, California, USA
• https://cchcs.ca.gov/
• Founded in 2006
• 10001+ employees

Qualifications

• Experience with continuous integration/continuous delivery workflows in an Agile environment
• Experience working with confidential data, and/or secure data environments
• Experience using dev ops tools (Azure DevOps, JIRA, Confluence)
• Experience eliciting and developing requirements, and documentation for data based projects
• Experience with data engineering in a cloud environment

Required skills

• Data Engineering, Data Pipelines, Business Intelligence, Data Analytics, Database Design, Cloud Computing, Continuous Integration/Continuous Delivery, Agile, Azure DevOps, JIRA, Confluence, Requirements Elicitation, Data Workflow Analysis, Secure Data Environments

Preferred skills

• Experience with data engineering in a cloud environment

Experience

• Mid level