Data Governance When Your LLM Can See Everything

Once your LLM is connected to a data lakehouse, it can reach every table your permissions allow. Kate Eberle, Director of Sales at Blue Margin, and Brick Thompson, Blue Margin’s CEO, talk about how to govern data for BI and AI analytics so the right people see the right data and read it correctly. Kate recently presented to a group of analytics practitioners in the legal industry, and governance took over about a third of the hour. She and Brick cover data governance committees, training for self-service users, role-based security in the lakehouse, and how documented context helps an LLM return reliable answers to business users. Chapters 00:00 Governance for BI and AI 00:40 What legal analytics teams are asking about 01:46 Permissions in a single system vs. a lakehouse 02:55 Data governance committees 04:40 Training self-service users 06:17 Supporting business users with AI analytics 06:51 Building context for reliable LLM answers 09:07 Curation and the data team’s role 10:09 Why access control matters more with LLMs 12:33 Getting busy leaders to participate in governance About Blue Margin We build and manage data platforms for mid-market and PE-backed companies. Our managed data services cover everything from bringing your systems together in one place to reporting and AI analytics, all built on a single governed foundation that your whole leadership team can trust. Learn more at bluemargin.com.