Hacking AI: The Risks for Businesses

Understanding AI security threats before they become your next crisisOn this episode of Razorwire, I explore the emerging frontier of AI security with leading experts Jonathan Care and Martin Voelk. We examine the latest risks, show you how adversaries are exploiting AI systems and share practical advice for professionals working with these rapidly advancing technologies.We move past the marketing speak to reveal how attackers are using generative AI, what it really takes to test these complex systems and what the rise of agentic, self-operating AI means for defenders. Security leaders, penetration testers and anyone implementing business technology need to understand these threats before committing to new AI solutions.This conversation addresses real incidents, examines practical realities and highlights why many enterprises are dangerously unprepared for what's ahead in AI security.Key TopicsInside the Mind of the Attacker: Learn how both ethical hackers and financially motivated criminals are already using AI to automate attacks, spread misinformation and create new vulnerabilities. Martin and Jonathan share examples of prompt injection, data poisoning and “model jailbreaking” - all tactics reshaping the cyber threat landscape right now.Pen Testing AI: What’s Different and What’s Still the Same: Go behind the scenes with insights into penetration testing for large language models and agentic AI. The episode discusses fresh attack surfaces, why classic testing skills are still vital and the new OWASP Top 10 for LLMs. If you’re considering buying AI-powered tools, take away concrete advice on how to stress-test these systems before attackers do.Business Risk, Legal Headaches and What to Demand from Vendors: With AI now touching everything from customer bots giving dodgy medical advice to autonomous agents able to cause chaos, the conversation gives practical advice about reputational, legal and operational risks. Listen for the must-ask questions every business should take to their vendors as well as new regulatory requirements that mean robust AI testing can’t be left as an afterthought.If you want to stay ahead of AI and cybersecurity developments and avoid building tomorrow's biggest headache, this episode is essential listening.AI Model Bias Debate:&nbsp;" 77% of enterprises are reporting at least one AI related security incident. 62% of enterprises lack any dedicated testing programme.”Jonathan CareListen to this episode on your favourite podcasting platform: https://razorwire.captivate.fm/listenIn this episode, we covered the following topics:Test Your AI Before Attackers Do - With 77% of enterprises already hit by AI security incidents but 62% lacking testing programmes, discover what specific vulnerabilities to check for and how to implement proper AI red teaming.Stop AI Hallucinations From Damaging Your Business - Understand how AI systems fabricate information and create legal liability, plus practical steps to identify and mitigate these risks before they affect customers or operations.Protect Against Medical and Legal AI Disasters - Learn from real cases where AI gave dangerous advice and created legal obligations, including what liability questions you need to address with vendors and internal teams.Secure Agentic AI That Can Take Real Actions - Discover why AI agents that can invoke APIs, modify data and trigger real-world changes require completely different security approaches than traditional chatbots.Defend Against Prompt Injection Attacks - Get specific techniques for testing and protecting against AI-specific vulnerabilities that traditional cybersecurity controls cannot address.Identify Poisoned Training Data and Supply Chain Attacks - Understand how attackers manipulate AI training data and learn what questions to ask about data sources and model provenance.Implement Automated and Continuous AI Testing - Explore new tools and frameworks for always-on adversarial testing of AI systems, including what capabilities to build in-house versus buy.Navigate AI Model Bias and Censorship Issues - Understand how different AI models reflect their creators' biases and learn strategies for getting balanced information across multiple sources.Meet New Regulatory Requirements for AI Testing - Prepare for mandatory adversarial testing under the EU AI Act and US executive orders, including what documentation and processes you'll need.Build AI Security Skills and Career Paths - Identify the specific certifications, training and technical skills needed for AI security roles, plus advice for both newcomers and experienced professionals transitioning to AI security.Resources Mentioned&nbsp;OWASP Top 10 for LLMChatGPTGeminiGrokClaudeAnthropicRetrieval Augmented Generation (RAG)RedditWikipediaHugging FaceGitHubDeepseekGwen (Alibaba)Burp SuiteModel Scan (Hidden Layer)Terra SecurityNIST Generative AI ProfileEU AI ActUS Executive Order 14110NIST AI RMFExpo.comSecOps SchoolLearn PromptingCISO Intelligence (Newsletter)Cyber Sentinels HandbookPliny the PrompterConnect with your host James ReesHello, I am James Rees, the host of the Razorwire podcast. This podcast brings you insights from leading cyber security professionals who dedicate their careers to making a hacker’s life that much more difficult.Our guests bring you experience and expertise from a range of disciplines and from different career stages. We give you various viewpoints for improving your cyber security – from seasoned professionals with years of experience, triumphs and lessons learned under their belt, to those in relatively early stages of their careers offering fresh eyes and new insights.With new episodes every other Wednesday, Razorwire is a podcast for cyber security enthusiasts and professionals providing insights, news and fresh ideas on protecting your organisation from hackers.For more information about us or if you have any questions you would like us to discuss email [email protected] you need consultation, visit <a href="http://www.razorthorn.com" rel="noopener noreferrer"...