What’s Wrong With Me?” What AI Gets Right — And What It Gets Really Wrong

In this episode, I explore where AI can genuinely help with health questions, where it can fall dangerously short, and how to use it more wisely before trusting it with decisions that really matter.AI tools like ChatGPT, Claude, Grok, and Gemini can be useful for understanding lab results, summarizing a doctor’s visit, preparing questions before an appointment, or making sense of complicated medical language. But when people ask AI, “What’s wrong with me?” or “Should I go to the hospital?” the answer can depend heavily on whether the user provides enough clinical context.I tested this myself with two invented scenarios: hand pain and a concerning headache. In both cases, the AI gave general guidance but failed to ask key questions a physician would naturally ask, such as my age, whether symptoms came on suddenly, whether I had experienced this before, or whether there was relevant family history. When I explicitly asked the AI to interview me first, the answers improved dramatically.Research supports that concern. A recent Nature Medicine study found that when real users interacted with AI about clinical scenarios, the AI gave the correct triage recommendation in only about 43% of cases and often underestimated urgency. The problem was not always that AI lacked medical knowledge. It was that users often did not provide enough information, and the AI did not reliably ask for what it needed.Another Nature Medicine study tested ChatGPT Health using complete clinical vignettes. Even with all the information provided, the AI struggled with the most urgent and least urgent cases. It sometimes recognized serious diagnoses but recommended delayed care when immediate emergency care was appropriate. That suggests the issue is not just knowledge, but judgment.AI does perform better in lower-risk, supportive roles. It can translate medical jargon into plain language, explain abnormal lab results, organize a visit summary, and help patients prepare better questions for their doctor. Recording a medical visit with the doctor’s permission and then using AI to create a personal summary can be especially helpful, though AI-generated clinical notes still need careful physician review.The most practical strategy is simple: before asking AI for health guidance, tell it, “Before you respond, please ask me all the questions you need to give me accurate information about my situation.” This does not make AI a doctor, but it can make the interaction more useful and less incomplete.Takeaways: AI can be helpful for understanding, organizing, and preparing for healthcare conversations, especially when the stakes are relatively low. AI is not yet reliable enough to determine whether symptoms are urgent or whether you should go to the ER. When using AI for health questions, ask it to interview you first, and when symptoms feel serious, unusual, sudden, or frightening, do not rely on AI as your final decision-maker.Send us Fan MailSupport the show📥 Tap to join my free newsletter & get the 1-page episode checklists: drbobbylivelongandwell.com