Data Engineer II

Microsoft is hiring a Data Engineer II to build and maintain the data foundation for engineering, customer supportability, customer escalation, and operational intelligence. The role develops reliable data pipelines, telemetry datasets, measurement models, and dashboards to support timely, data-driven decisions.

Responsibilities

Build and maintain data pipelines, transformations, semantic models, and curated datasets across engineering and operational data sources

Partner with product management, engineering teams, support teams, and leadership stakeholders to define metrics, key business measures, and data quality expectations

Develop telemetry validation, data freshness, completeness, and reliability checks

Create and maintain dashboards, scorecards, and operational reporting, including Microsoft reporting tools or equivalent reporting experiences

Integrate data from systems such as Azure DevOps, telemetry platforms, support and escalation systems, release-readiness sources, and business reporting tools

Automate manual reporting and intake workflows where possible

Improve discoverability, governance, ownership, and documentation of critical datasets

Support release readiness, customer health, feature adoption, supportability, and escalation analytics

Investigate data issues, root-cause reporting anomalies, and drive fixes with upstream and downstream partners

Preferred

Experience with Python and PySpark scripting for data transformation, automation, validation, or analytics workflows

Experience building extract-transform-load or extract-load-transform pipelines, scheduled data refreshes, production data workflows, or reporting data models

Experience with Kusto Query Language, Azure Data Explorer, Microsoft Fabric, Azure Synapse Analytics, Apache Spark, or similar big-data platforms

Experience with telemetry, observability, product usage, supportability, or reliability datasets

4+ years of experience with large-scale data platforms, telemetry, business intelligence reporting, or operational analytics

Proven experience developing and deploying autonomous artificial intelligence agents or agentic automation systems that reason over data, operate reliably in production, and help redefine data engineering through continuous, automated insight generation

4+ years of experience with large-scale data platforms, telemetry, business intelligence reporting, or operational analytics.

Python

PySpark

Data Transformation

Workflow Automation

Data Validation

Analytics Workflows

ETL/ELT Pipelines

Scheduled Data Refreshes

Production Data Workflows

Reporting Data Models

Kusto Query Language

Azure Data Explorer

Microsoft Fabric

Azure Synapse Analytics

Apache Spark

Big-Data Platforms

Telemetry Data

Observability Data

Product Usage Data

Supportability Data

Reliability Data

Large-Scale Data Platforms

Business Intelligence Reporting

Operational Analytics

Autonomous AI Agents

Agentic Automation Systems

Data Reasoning

Production Deployment

Production Reliability

Continuous Insight Generation

Company

Software, cloud computing, consumer electronics, and enterprise systems.

Redmond, Washington, USA

https://www.microsoft.com/

Founded in 1975

10001+ employees

Qualifications

Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering

equivalent experience

Equivalent experience

Experience with Python and PySpark scripting for data transformation, automation, validation, or analytics workflows

Experience building extract-transform-load or extract-load-transform pipelines, scheduled data refreshes, production data workflows, or reporting data models

Experience with Kusto Query Language, Azure Data Explorer, Microsoft Fabric, Azure Synapse Analytics, Apache Spark, or similar big-data platforms

Experience with telemetry, observability, product usage, supportability, or reliability datasets

4+ years of experience with large-scale data platforms, telemetry, business intelligence reporting, or operational analytics

Proven experience developing and deploying autonomous artificial intelligence agents or agentic automation systems that reason over data, operate reliably in production, and help redefine data engineering through continuous, automated insight generation

Required skills

Represents the skills you have, click on the tags, PySpark, ETL/ELT Pipelines, Data Modeling, Kusto Query Language (KQL), Azure Data Explorer, Microsoft Fabric, Azure Synapse Analytics, Apache Spark, Telemetry Data, Business Intelligence Reporting, Operational Analytics

Preferred skills

Glassdoor, 4.0, Redmond, Washington, USA, https://www.microsoft.com, H1B Sponsorship, Data Powered by, Distribution of Different Job Fields Receiving Sponsorship, 80, Represents job field similar to this job, Engineering and Development, Management and Executive, Product Management, Customer Service and Support, Marketing, Accounting and Finance, Sales, Creatives and Design, Human Resources, Legal and Compliance, Education and Training, Trends of Total Sponsorships, *2026, (5083), 2025, (9192), 2024, (9343), 2023, (7677), 2022

Experience

1+ years