DQ

Portfolio / MS Fabric

Microsoft Fabric projects

End-to-end analytics on a single SaaS platform: OneLake, Lakehouse, Warehouse, Real-Time Intelligence and Power BI Direct Lake.

Medallion Lakehouse on OneLake

01

Unified 40+ source systems into a bronze/silver/gold lakehouse on Microsoft Fabric.

Challenge

Siloed ERP, CRM and file-based sources fed separate marts, causing conflicting KPIs and multi-day refresh cycles.

Solution

  • Metadata-driven Data Factory pipelines landing raw data into a bronze Lakehouse in Delta format
  • PySpark notebooks for cleansing, SCD Type 2 and conformance in the silver layer
  • Gold star schemas served to Power BI through Direct Lake mode
  • Git integration and deployment pipelines for Dev → Test → Prod promotion
Sources unified
40+
Refresh window
6h → 25m
Single source of truth
1
  • OneLake
  • Lakehouse
  • Data Factory
  • PySpark
  • Delta
  • Direct Lake

Real-Time IoT Telemetry

02

Streaming analytics for sensor data with Eventstream, Eventhouse and KQL.

Challenge

Operations teams detected equipment anomalies hours after they occurred, from batch exports.

Solution

  • Eventstream ingesting device telemetry from Azure Event Hubs
  • Eventhouse / KQL Database with update policies for enrichment
  • Real-Time Dashboards and Activator alerts on threshold breaches
  • Historical data mirrored to OneLake for ML feature generation
Event-to-insight
<10s
Events / month
2B+
Unplanned downtime
-30%
  • Eventstream
  • Eventhouse
  • KQL
  • Activator
  • Event Hubs

Synapse to Fabric Warehouse Migration

03

Migrated a dedicated SQL pool warehouse to Fabric Data Warehouse with zero reporting downtime.

Challenge

Rising fixed compute costs and pause/resume overhead on a legacy Synapse dedicated pool.

Solution

  • Automated schema and T-SQL compatibility assessment
  • Parallel-run validation framework comparing row counts and aggregates
  • Shortcuts to existing ADLS Gen2 data to avoid duplication
  • Capacity sizing and workload monitoring with the Fabric Capacity Metrics app
Compute cost
-45%
Report downtime
0
Objects migrated
300+
  • Fabric Warehouse
  • T-SQL
  • Shortcuts
  • ADLS Gen2
  • Azure DevOps