Data Engineer (Intermediate OR Senior)

Teacher Retirement System of Texas is hiring a Data Engineer at the Intermediate or Senior level to evolve Investment data platforms and systems. The role designs, develops, and manages data platforms, pipelines, models, and warehouses, while integrating and securing investment data, conducting analysis, and supporting business decisions.

Responsibilities

• Develop and manage data platforms
• Design and implement ETL processes and perform basic data lake management
• Implement and manage CI/CD pipelines with intermediate proficiency
• Create and maintain basic data models to ensure structured data storage and accessibility
• Manage data catalogs to maintain an organized and easily accessible repository of data resources
• Develop and maintain data warehouses
• Perform administrative tasks and assist in basic system administration duties, contributing to the overall management and upkeep of data systems
• Manage data permission, ensuring proper access control and data security
• Contribute to the maintenance and optimization of the data warehouse, ensuring data integrity and availability
• Develop data-driven applications, contributing to the creation of data solutions that support business needs
• Conduct data analysis and assist in larger data analysis projects, providing insights and support to business stakeholders
• Engage in scrum activities and actively participate in Agile methodologies
• Generate reports using reporting tools, and provide support in more advanced reporting tasks as required
• Collaborate with stakeholders to gather requirements and contribute to defining project scopes and objectives
• Develop visually appealing and intuitive dashboards that provide visibility into key performance, risk, and control indicators across agency divisions and departments
• Performs related work as assigned
• Develop and manage data platforms
• Design and maintain ETL processes and perform advanced data lake management
• Oversee and manage the implementation of CI/CD pipelines utilizing advanced DevOps practices
• Create and maintain advanced data models to ensure structured data storage and accessibility
• Enhance data catalogs to maintain an organized and easily accessible repository of data resources
• Enhance the efficiency of data warehouses and oversee complex warehousing
• Optimize system performance and manage complex systems, improving ease of management and reliability of systems
• Maintain complex data permissions, ensuring proper access control and data security
• Improve the maintenance and optimization of data warehouses, ensuring data integrity and availability
• Develop data-driven applications, contributing to the creation of data solutions that support business needs
• Conduct advanced data analysis and lead larger data analysis projects, providing insights and support to business stakeholders
• Lead scrum activities, ensuring team adherence to Agile practices
• Automate reports using reporting tools and provide support for more advanced reporting tasks as required
• Partner with stakeholders to align data strategies with business goals
• Develop visually appealing and intuitive dashboards that provide visibility into key performance, risk, and control indicators across agency divisions and departments
• Performs related work as assigned

Preferred

• Experience with data architecture and modeling
• Experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms
• Experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates)
• Advanced experience with data architecture and modeling
• Advanced experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms
• Advanced experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates)
• Data Modeling

Benefits

• Mentorship
• Continuous learning opportunities

Company

• Texas public educator retirement system investing trust assets and benefits
• Austin, Texas, USA
• https://www.trs.texas.gov/Pages/Homepage.aspx
• Founded in 1937
• 1001-5000 employees

Qualifications

• Bachelor's degree from an accredited college or university in computer information systems, computer science, data management, information systems, information science, mathematics, or a closely related field
• High School diploma or equivalent and additional full-time experience in data pipeline builds and implementation may be substituted on an equivalent year-for-year basis
• Three (3) - Five (5) years of full-time directly related, progressively responsible experience in data pipeline builds and implementation; utilizing ETL tools for creating ETL scripts; Power BI or equivalent modern data visualization package or related experience
• A master's degree or doctoral degree in a closely related field may be substituted on an equivalent year-for-year basis
• Strong knowledge of business intelligence tools, databases, SQL, and object-oriented programming languages to support data analysis and predictive analytics
• Database modeling and data warehousing principles
• System development life cycle concepts
• Knowledge/Advanced knowledge of data platforms, assist in platform management
• Knowledge/Advanced knowledge of ETL concepts, assist in building pipelines
• Knowledge/Advanced knowledge of data architecture and modeling
• Knowledge/Advanced knowledge of Microsoft Fabric, Databricks, Snowflake, Spark, and cloud platforms
• Knowledge/Advanced knowledge of data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates)
• Proficient/Advanced proficiency in Python and SQL
• Experience using technical and statistical analysis skills to deliver clear, concise, and visually appealing management metrics and reports to inform decision making and actions
• Writing report queries, including an understanding of relational databases
• Business process analysis and problem solving
• Completing detailed work with a high degree of accuracy
• Planning, organizing, and prioritizing work assignments to manage a high-volume workload in a fast-paced and changing environment
• Using a computer in a Windows environment with Microsoft Office word processing, spreadsheet, and other business software
• Effective written and verbal communications, including explaining complex information to others in an understandable manner and writing clear and precise policies, procedures, and training or other materials
• Working in a team environment and influence a diverse group of stakeholders
• Operate effectively in a fast-paced environment with competing and shifting priorities
• Continually learn new concepts and tools to support job needs, and strive for ongoing professional development
• Establish and maintain harmonious working relationships with co-workers, agency staff, and external contacts
• Work effectively in a professional team environment
• Participate in Scrum activities, advanced understanding of Agile
• Experience with data architecture and modeling
• Experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms
• Experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates)
• Advanced experience with data architecture and modeling
• Advanced experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms
• Advanced experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates)
• Three (3) - Five (5) years of full-time directly related, progressively responsible experience in data pipeline builds and implementation; utilizing ETL tools for creating ETL scripts; Power BI or equivalent modern data visualization package or related experience.

Required skills

• Agile and Scrum, Apache Spark, Data Architecture and Modeling, Data Pipeline Development, Data Warehousing, Databricks, ETL, Microsoft Fabric, Power BI, Python, REST, SOAP, XML, and JSON, SQL, SSL, SSH, SFTP, and Certificates, Snowflake

Preferred skills

• Advanced experience with data architecture and modeling, Experience with data architecture and modeling

Experience

• 3-5 years