Navigating AI Governance: Trust, Accountability, and the Future of Responsible Tech

Art Kleiner, co-author of "The AI Dilemma" and Principal at Kleiner Powell International, discusses the complexities of AI governance, trust, and accountability in the context of modern technology. He emphasizes the importance of being intentional about risk when deploying AI products, particularly large language models, which can inadvertently perpetuate biases and misinformation. Kleiner shares a compelling example of a Chinese AI system that failed to generate accurate images based on user requests, illustrating the inherent biases present in AI systems. He stresses the need for organizations to be aware of the human effects and unintended consequences of AI deployment.For managed service providers (MSPs) and IT leaders, Kleiner highlights the significance of compliance and oversight in the development process of AI systems. He references the EU AI Act, which mandates a "human in the loop" approach to ensure accountability and effectiveness in AI applications. This requirement encourages organizations to conduct thorough testing and evaluation of AI systems in real-world contexts, ensuring that they meet the needs of users and mitigate potential risks. Kleiner notes that small businesses, in particular, must be vigilant about the implications of AI on their operations and customer interactions.The conversation also delves into the challenges of achieving measurable ROI from AI projects, with studies indicating that a significant percentage of these initiatives fail to deliver tangible business value. Kleiner advocates for scenario planning as a tool to navigate the uncertainties of AI implementation, encouraging organizations to explore various future scenarios and their potential impacts. By understanding the different ways AI can affect productivity, business growth, and risk management, companies can better position themselves to leverage AI effectively.Finally, Kleiner urges leaders to prepare for multiple AI futures by staying informed about emerging technologies and their implications for their businesses. He emphasizes the need for organizations to build trust with their customers by using AI responsibly and transparently. By focusing on creating value and avoiding the pitfalls of "inshittification," businesses can foster stronger relationships with their clients and enhance their overall service offerings. The discussion underscores the critical role of human insight and ethical considerations in the evolving landscape of AI technology.  💼 All Our SponsorsMSP Radio is supported by our partners: LogMeIn · Opentext · Transit AI · Guardz · Pax8 · ABC Solutions · Rythmz · ScalePad · CometBackup · TimeZest Supporting the IT services community through insights, analysis, and transparency. 🚀 Join Business of Tech PlusGet exclusive access to investigative reports, vendor analysis, leadership briefings, and more.👉 https://businessof.tech/plus 🎧 Subscribe to the Business of TechWant the show on your favorite podcast app or prefer the written versions of each story?📲 https://www.businessof.tech/subscribe 📰 Story Links & SourcesLooking for the links from today’s stories?Every episode script — with full source links — is posted at:🌐 https://www.businessof.tech 🎙 Want to Be a Guest?Pitch your story or appear on Business of Tech: Daily 10-Minute IT Services Insights:💬 https://www.podmatch.com/hostdetailpreview/businessoftech 🔗 Follow Business of Tech LinkedIn: https://www.linkedin.com/company/28908079YouTube: https://youtube.com/mspradioBluesky: https://bsky.app/profile/businessof.techInstagram: https://www.instagram.com/mspradioTikTok: https://www.tiktok.com/@businessoftechFacebook: https://www.facebook.com/mspradionews Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.