When AI Recommends Your Medical Treatment Without Clinical Trials

Episode 26 of AI Ethics with Fexingo dives into the growing use of AI systems that recommend medical treatments—like sepsis management or cancer therapy—without the rigorous clinical trials normally required for drugs or devices. Lucas and Luna examine the case of Epic Systems' Sepsis Model, which was deployed in hundreds of hospitals before a 2021 JAMA study showed it failed to detect sepsis in over two-thirds of cases. They also discuss the FDA's evolving regulatory framework for AI as a Medical Device (SaMD), the tension between rapid deployment and patient safety, and what the recent 2024 FDA guidance on 'predetermined change control plans' really means. The hosts ask: should an algorithm that influences your chemotherapy regimen be held to the same standard as a new pill? #AIinHealthcare #ClinicalAI #EpicSystems #SepsisModel #JAMA #FDA #SaMD #MedicalEthics #AIbias #PatientSafety #AlgorithmicAccountability #HealthcareAI #Technology #FexingoBusiness #BusinessPodcast #AIEthics #ResponsibleAI #AItrials Keep every episode free: buymeacoffee.com/fexingo