The Checklist Your Deck Is Missing ft. Jeff McMillan

Everyone wants to talk about agents and models. Jeff McMillan, starts where almost nobody else does: the foundation.In this episode, Jeff McMillan, founder of McMillanAI, former Head of Firmwide AI at Morgan Stanley, and advisor on enterprise AI, maps AI as a stack: high-quality accessible data → semantic layer (knowledge graphs, RAG) → control and governance → models → orchestration → applications. The heavy lifting is in the bottom layers. Organizations that skip them can fake it for a handful of agents, but at 150 or 15,000 agents, you need near-100% accessibility and 99%-plus quality, or you’re monitoring chaos you can’t see.Josh and Robb press him on why knowledge management feels unfundable, why tribal institutional knowledge breaks when machines execute without judgment, and why evaluation (golden datasets, custom org evals, regression when models upgrade) is the work builders hate and operators can’t skip. Robb names the trap CTOs are falling into: grinding tokens on feature backlogs that never reach production or revenue. Jeff agrees on the strategic gap — after controlled experimentation, leaders should ask what destroys the business in ten years, not what demo ships next quarter.The trio also discuss:Embedded ethics and monitoring, including independent models asking, “Does something smell right?”Capacity vs. value (30% freed time spent golfing is not ROI)Process mapping in high-end knowledge businesses that can’t articulate how work movesUse case zero — knowledge that maintains and teaches itselfAgent-in-the-loop and humans with something to lose in the accountability chainJeff’s Board of Advisors experiment at MacmillanAIAI can make you incredibly smart or comfortably dumb. The choice is cultural, not technical.Learn more about McMillanAI: https://mcmillanai.com/---------- Support our show by supporting our sponsors!This episode is supported by OneReach.aiForged over a decade of R&D and proven in 10,000+ deployments, OneReach.ai’s GSX is the first complete AI agent runtime environment (circa 2019) — a hardened AI agent architecture for enterprise control and scale. Backed by UC Berkeley, recognized by Gartner, and trusted across highly regulated industries, including healthcare, finance, government and telecommunications.A complete system for accelerating AI adoption — design, train, test, deploy, monitor, and orchestrate AI agents.Use any AI modelsBuild and deploy intelligent agents fastCreate guardrails for organizational alignmentEnterprise-grade security and governanceGet in touch: https://onereach.ai/contact/?utm_source=soundcloud&utm_medium=social&utm_campaign=s7e12&utm_content=1 ---------- The revised and significantly updated second edition of our bestselling book about succeeding with AI agents, Age of Invisible Machines, is available everywhere: Amazon — https://bit.ly/4hwX0a5#InvisibleMachines #Podcast #TechPodcast#AIPodcast#AI #AgenticAI#AIAgents#EnterpriseAI #KnowledgeManagement#AITransformation