EPISODE · Sep 22, 2025 · 18 MIN
GitHub, Azure DevOps, or Fabric – Who’s Actually In Charge? Medallion Architecture, CI/CD & GitOps for Fabric Warehouse
from M365.FM - Modern work, security, and productivity with Microsoft 365 · host Mirko Peters - Founder of m365.fm, m365.show and m365con.net
Here’s the uncomfortable truth: without CI/CD, your beautiful Medallion Architecture is just a very expensive CSV swamp wearing a Gold badge. In this episode, we start right where most Fabric teams are stuck—Bronze ingestion scripts living in notebooks, Silver transformations hacked in prod, and Gold dashboards patched at 3 a.m.—and show how GitHub or Azure DevOps becomes the actual control plane. You’ll see how treating notebooks, SQL scripts, and pipeline configs as code (versioned, reviewed, and promoted) turns Fabric Warehouse from “please don’t break” into something you can roll back, test, and move between dev, test, and prod without midnight firefights.BRONZE WITHOUT ROLLBACK – YOUR CSV GRAVEYARDBronze is where the first goblins spawn: corrupted feeds, schema drift, duplicate loads—quietly poisoning everything upstream while pipelines still show a comforting green checkmark. We walk through how bad timestamps, header changes, and extra columns in “raw” zones become permanent damage when ingestion logic isn’t in Git and deployments go straight to production. You’ll learn three non‑negotiables for Bronze: keep every ingestion notebook/script in source control, parameterize connections and schemas instead of hard‑coding prod, and run pre‑deploy schema/dry‑run checks in CI so bad changes never hit your landing zone. With those guardrails, an ingestion failure becomes a quick rollback and redeploy—not a weeks‑long data‑rebuild panic.SILVER: WHERE GOVERNANCE DIES QUIETLYSilver looks clean on the surface—standardized types, deduped rows, pretty column names—but this is where governance often dies in silence. When fixes live in ad‑hoc notebooks and “just this once” patches against production, dev, test, and prod stop matching, and you only notice when numbers don’t reconcile in front of leadership. We show how to force discipline into Silver: every transformation change goes through a pull request, automated data‑quality checks (nulls, uniqueness, schema compatibility) run in CI, and promotions happen only via pipelines—not manual edits. That way, Silver becomes the first layer where “what happens in dev is exactly what happens in prod,” instead of three different realities with the same table names.GOLD AT 3 A.M. – ANALYTICS UNDER PRESSUREGold is the only layer executives actually see—dashboards, KPIs, quarter‑end numbers—and it’s where shortcuts cost the most. One untested schema tweak in Silver or a hotfix in Gold can break trust instantly when financials or key metrics suddenly don’t match past reports. We talk about building mirrored environments (dev/test/prod) for Gold models and reports, wiring deployment pipelines from Git so only tested changes ship, and banning “panic SQL” edits in production warehouses. When GitHub or Azure DevOps becomes the single source of truth for Gold, 3 a.m. calls turn from “what changed?” into “which commit broke this?”—and that’s a problem you can actually solve.WHAT YOU’LL LEARNWhy a Medallion Architecture without CI/CD is just structured chaos in Fabric Warehouse.How Bronze ingestion turns into a CSV graveyard without Git, schema checks, and rollback paths.How Silver quietly destroys governance when fixes live in ad‑hoc notebooks and prod‑only tweaks.How to make Gold analytics reliable under pressure with mirrored environments and pipeline‑driven deploys.How GitHub, Azure DevOps, and Fabric deployment pipelines together form a real GitOps model for your warehouse.THE CORE INSIGHTThe core insight of this episode is that GitHub or Azure DevOps—not Fabric itself—decides whether your warehouse is safe. When every ingestion script, transformation, and Gold model lives in source control, moves through CI/CD checks, and promotes via pipelines, you stop betting your Medallion Architecture on luck and start treating it like real product code—with versions, tests, and rollbacks you can trust.WHO THIS EPISODE IS FORFabric and data engineers tired of babysitting fragile Bronze, Silver, and Gold layers.BI and analytics leads who want real dev/test/prod discipline in Fabric Warehouse.Platform and DevOps teams integrating GitHub or Azure DevOps with Fabric for GitOps‑style workflows.Architects and consultants designing Medallion Architectures that actually survive schema drift and production pressure.ABOUT THE AUTHOR / HOSTMirko Peters is a Microsoft 365 and data platform consultant and host of the M365.FM podcast, helping organizations treat Microsoft 365, Fabric, and their warehouses as one integrated operating system instead of a pile of one‑off scripts and dashboards. He works with teams running on Microsoft 365, Azure, and Fabric to design Medallion Architectures, GitOps workflows, and CI/CD guardrails so that Bronze, Silver, and Gold layers stay versioned, testable, and recoverable—even when things go wrong at 3 a.m.Become a supporter of this podcast: https://www.spreaker.com/podcast/m365-fm-modern-work-security-and-productivity-with-microsoft-365--6704921/support.
What this episode covers
Here’s the uncomfortable truth: without CI/CD, your beautiful Medallion Architecture is just a very expensive CSV swamp wearing a Gold badge. In this episode, we start right where most Fabric teams are stuck—Bronze ingestion scripts living in notebooks, Silver transformations hacked in prod, and Gold dashboards patched at 3 a.m.—and show how GitHub or Azure DevOps becomes the actual control plane. You’ll see how treating notebooks, SQL scripts, and pipeline configs as code (versioned, reviewed, and promoted) turns Fabric Warehouse from “please don’t break” into something you can roll back, test, and move between dev, test, and prod without midnight firefights.BRONZE WITHOUT ROLLBACK – YOUR CSV GRAVEYARDBronze is where the first goblins spawn: corrupted feeds, schema drift, duplicate loads—quietly poisoning everything upstream while pipelines still show a comforting green checkmark. We walk through how bad timestamps, header changes, and extra columns in “raw” zones become permanent damage when ingestion logic isn’t in Git and deployments go straight to production. You’ll learn three non‑negotiables for Bronze: keep every ingestion notebook/script in source control, parameterize connections and schemas instead of hard‑coding prod, and run pre‑deploy schema/dry‑run checks in CI so bad changes never hit your landing zone. With those guardrails, an ingestion failure becomes a quick rollback and redeploy—not a weeks‑long data‑rebuild panic.SILVER: WHERE GOVERNANCE DIES QUIETLYSilver looks clean on the surface—standardized types, deduped rows, pretty column names—but this is where governance often dies in silence. When fixes live in ad‑hoc notebooks and “just this once” patches against production, dev, test, and prod stop matching, and you only notice when numbers don’t reconcile in front of leadership. We show how to force discipline into Silver: every transformation change goes through a pull request, automated data‑quality checks (nulls, uniqueness, schema compatibility) run in CI, and promotions happen only via pipelines—not manual edits. That way, Silver becomes the first layer where “what happens in dev is exactly what happens in prod,” instead of three different realities with the same table names.GOLD AT 3 A.M. – ANALYTICS UNDER PRESSUREGold is the only layer executives actually see—dashboards, KPIs, quarter‑end numbers—and it’s where shortcuts cost the most. One untested schema tweak in Silver or a hotfix in Gold can break trust instantly when financials or key metrics suddenly don’t match past reports. We talk about building mirrored environments (dev/test/prod) for Gold models and reports, wiring deployment pipelines from Git so only tested changes ship, and banning “panic SQL” edits in production warehouses. When GitHub or Azure DevOps becomes the single source of truth for Gold, 3 a.m. calls turn from “what changed?” into “which commit broke this?”—and that’s a problem you can actually solve.WHAT YOU’LL LEARNWhy a Medallion Architecture without CI/CD is just structured chaos in Fabric Warehouse.How Bronze ingestion turns into a CSV graveyard without Git, schema checks, and...
NOW PLAYING
GitHub, Azure DevOps, or Fabric – Who’s Actually In Charge? Medallion Architecture, CI/CD & GitOps for Fabric Warehouse
No transcript for this episode yet
Similar Episodes
Mar 26, 2026 ·1m
Mar 19, 2026 ·34m
Feb 18, 2026 ·11m
Feb 11, 2026 ·45m