AI Outperforms Doctors at Making Diagnoses, New Study Shows

A new American study shows that AI can outperform doctors at making diagnoses. When ChatGPT was tested independently, it reached 90% accuracy. Could this change the future of healthcare, or is the human factor always needed?

Share
AI Outperforms Doctors at Making Diagnoses, New Study Shows

A new American study has shown that AI can outperform doctors at making medical diagnoses. In the experiment, conducted in late 2023, 50 doctors took part and were asked to assess a number of complex medical cases. Half the group used the AI tool ChatGPT, while the other half worked without digital support.

The result was striking: doctors using AI got 76 percent correct, while the control group without AI achieved 74 percent. When AI, on the other hand, was allowed to perform the test on its own without human involvement, it reached an impressive 90 percent accuracy, according to study co-author Adam Rodman.

What Makes AI So Accurate?

AI has proven particularly skilled at analyzing complex data and drawing logical conclusions without cognitive biases. An important factor is that AI can weigh different possibilities and even question its own conclusions - something humans often struggle with. In the study, ChatGPT proved better at identifying situations where the diagnosis could be wrong, which Rodman believes could be crucial for diagnostic quality.

One reason the doctors who used ChatGPT didn't perform significantly better than those who didn't was a lack of training in how to use the AI tool. Many used it as a search engine rather than an analytical tool.

AI Shouldn't Replace Doctors

Despite AI's successes in the study, Rodman believes the technology isn't ready to replace doctors. Diagnosis is only a small part of the profession. Understanding the patient's needs, asking the right questions, and performing physical exams remain central parts of a doctor's role. In addition, human care requires communication, empathy, and coordination that AI can't replace.

Swedish Doctors See the Potential

AI is already being used in healthcare in Sweden too, especially for transcribing patient conversations and in imaging diagnostics like cancer detection on mammography images. Sofia Rydgren Stale, chair of the Swedish Medical Association, sees potential in AI but emphasizes that the technology should complement, not replace, doctors. She also points out that language models can have shortcomings, such as often not being trained on data from minority groups.

AI in Healthcare - Future or Threat?

AI's advances in medical diagnostics are raising both enthusiasm and concern. The technology is cheap, fast, and never gets tired, but it lacks human empathy and contextual understanding. The question is whether AI will revolutionize healthcare, or whether it will always need to be complemented by human expertise?