Episode 007: Folder Mania — When AI Comes to You

Every AI tool claims it can read your folders. We actually tested that claim — across ChatGPT, Claude, Gemini, and Microsoft Copilot — using a real-world 48-document Chapter 13 case file. The results were all over the place.Ron introduces the "File Cabinet Test": a threshold check that tells you whether an AI tool is actually seeing what you're giving it, before you trust it with anything that matters. Because if the AI is faking it — cherry-picking by relevance, wandering outside your folder, or missing documents entirely — that's not an AI intelligence problem. That's a visibility problem. And for lawyers, visibility is everything.This episode is a deep dive into folder access, document security, workflow design, and what it really means to close the trust gap in your practice.What You'll LearnWhat the File Cabinet Test is and why it's the first question you should ask of any AI toolHow ChatGPT, Claude, Gemini, and Copilot each performed on real legal documents — and where each one surprised usWhy "the AI comes to you" is a game-changer for law firm document securityThe hidden risk when AI output looks complete but isn'tHow a bankruptcy trustee's preference complaint workflow points to the next frontier of AI-assisted legal practiceWhat Claude's new MCP integration with NetDocuments means for Jetsons-level lawyers — right nowChapter Markers0:00 — Introduction: Testing AI folder access across four platforms1:05 — The test case: A complex Chapter 13 with 48 documents2:00 — Introducing the File Cabinet Test (and why AI wants to fake it)3:47 — Heather's ChatGPT zip file test: A home run — and a teaching moment5:54 — Visibility vs. intelligence: The real question we're asking7:30 — The million-document file: A tease for the roadmap8:58 — ChatGPT connected to Google Drive: Same tool, different result10:42 — Claude: Security, redaction, and a perfect file cabinet test13:34 — Claude's limitations: Budget gaps and the timeout problem15:00 — Analysis vs. ecosystem tools: How to frame the choice15:59 — Gemini inside Google Drive: Close, but not quite18:27 — The trust gap: Why small firm lawyers can't do what we just did19:41 — Copilot: Why Ron wanted it to work, and what happened instead22:19 — The Copilot saga escalates: Zip files, crashes, and a 20-file ceiling25:57 — Where Copilot actually belongs in your workflow27:30 — Workflow-first, tools-second: How to find your bottleneck28:49 — AI malpractice on the horizon: The human oversight imperative31:50 — Practice Signal: Preference complaints and the AI merge-print breakthrough36:13 — FSJ Level-Up: Flintstones, Simpsons, and Jetsons recommendations38:49 — Jetsons surprise: Claude + NetDocuments MCP integration, live today40:34 — Ron's take: Why he resisted Claude — and why he changed his mind41:35 — Closing thoughts: Making lawyers less afraidResources & Linkslawyeraitoolkit.comChatGPT Enterprise — openai.comClaude — claude.aiGoogle Gemini — gemini.google.comMicrosoft Copilot — copilot.microsoft.comNetDocuments — netdocuments.com