Analytics Engineer, Conversational Analytics

Ro is a vertically integrated healthcare technology company connecting telehealth, diagnostics, pharmacy, and logistics to deliver digital healthcare. The Analytics Engineer will unlock Conversational Analytics by building data and semantic models, documentation, context, and evaluations for LLMs, while training stakeholders to use the data stack effectively.

Responsibilities

• For the first 2-3 months, embed with a stakeholder team to dive into day-to-day analyst work, build stakeholder relationships, and develop business fluence
• Build foundational data models, semantic models, documentation, and context that power conversational analytics across a variety of data domains (growth, product, business metrics, operations etc.)
• Approach opaque, unstructured problems by developing core analytic frameworks and standardized semantic models that shape the way the company thinks about our business
• Communicate and collaborate with different stakeholders to identify opportunities and build solutions that standardize our data approach to common problems across the company
• Teach and guide stakeholders on best practices for using LLMs for their own data needs, and distill what works into reusable training materials
• Develop and maintain AI evaluations for conversational analytics, tracking accuracy programmatically and building stakeholder feedback loops

Preferred

• Experience with AI evaluation of LLM tools
• Experience developing data pipelines and processes
• We are open to data analysts with demonstrable interest and project experience who are looking to make the transition to analytics engineer
• AI evaluation
• LLM tools
• Data pipeline development
• Process development
• Data analysis
• Analytics engineering
• Project experience

Benefits

• Competitive equity package (as applicable)
• Competitive benefits package (as applicable)
• Hybrid work model

Company

• Direct-to-patient telehealth, labs, and pharmacy services
• New York, New York, USA
• https://www.ro.co/
• Founded in 2017
• 201-500 employees

Qualifications

• 4+ years of full-time working experience in quantitative analysis roles, with a portion of that time focused on data modeling in DBT
• Hands-on experience using LLMs for coding and analytics, going beyond asking simple questions and building data products through LLM workflows
• Expert-level SQL skills
• Experience using BI tools (ours are Hex and Looker) to effectively convey information
• Strong communication and teaching skills
• Strong problem solving skills, analytical aptitude, and numerical dexterity
• Demonstrated track record of project ownership
• Experience with AI evaluation of LLM tools
• Experience developing data pipelines and processes
• We are open to data analysts with demonstrable interest and project experience who are looking to make the transition to analytics engineer

Required skills

• AI Evaluation of LLM Tools, Data Modeling with dbt, Hex, LLM Workflows for Coding and Analytics, Looker, Quantitative Analysis, SQL, Semantic Modeling

Preferred skills

• Experience developing data pipelines and processes, Experience with AI evaluation of LLM tools

Experience

• 4+ years