AI doctor is in? ChatGPT better than physicians at this: study
Published
4 years ago onBy
Talker NewsBy James Gamble via SWNS
ChatGTP offers better and more sympathetic advice than real doctors and are preferred to general practicioners by users, a new study shows.
And they could be used to lessen the workload of physicians following the latest research.
A medical panel preferred the responses of the AI assistant to those of real doctors eight out of ten times when both answered the same medical questions.
The panel found ChatGTP responses to be three-and-a-half times more likely to be of superior quality and nearly ten times as likely to be more empathetic than doctors' responses.
The Californian researchers who conducted the study say their surprising results could see Robo-docs assist doctors in their workload in the near future.
The study, from The University of California San Diego School of Medicine, offers an early glimpse into the role AI technology could soon play in the future of medicine.
To obtain a large and diverse sample of healthcare questions with responses from qualified physicians, the study team turned to the social media network Reddit.

Millions of patients post daily medical questions on the subreddit forum r/AskDocs.
The forum has more than 450,000 members who post medical questions which are then answered by verified healthcare professionals.
Though any member can respond to questions, moderators of the subreddit verify the credentials of healthcare professionals and make them visible alongside their responses.
The US research team sampled 195 exchanges from the r/AskDocs forum in which a verified doctor responded to a public question posted by a member of the group.
They then posed this same question to ChatGPT - an increasingly popular and scarily impressive artificially intelligent chatbot developed by US company OpenAI - and asked it to write a response.
A panel of three licensed healthcare professionals then assessed each question alongside the relevant answers, without knowing which was submitted by a genuine doctor and which were written by ChatGPT.
The medical professionals then rated the responses based on information quality and empathy, noting which response they preferred.
The shocking results showed that the panel members preferred the ChatGPT responses over the doctors' eight out of ten times (79%).

The AI responses were also rated significantly higher in terms of quality than those of the doctors, with 'good' or 'very good' quality answers 3.6 times more likely to come from the ChatGPT bot (physicians 22.1% vs ChatGPT 78.5%).
The panel members also incredibly found the AI responses to be more empathetic than those of the human doctors - with 'empathetic' or 'very empathetic' responses nearly ten times more likely to come from ChatGPT (physicians 4.6% vs ChatGPT 45.1%).
Dr. John Ayers, the Qualcomm Institute within the University of California San Diego, said the study, published in the JAMA Internal Medicine journal, had huge implications for the future of medicine.
Dr. Ayers said: "The opportunities for improving healthcare with AI are massive.
"AI-augmented care is the future of medicine."
Jessica Kelley, a nurse practitioner with San Diego firm Human Longevity and study co-author, added: "ChatGPT messages responded with nuanced and accurate information that often addressed more aspects of the patient’s questions than physician responses."
Dr. Aaron Goodman, another co-author and associate clinical professor at UC San Diego School of Medicine, couldn't withhold his disbelief, saying: "I never imagined saying this, but ChatGPT is a prescription I’d like to give to my inbox.
"The tool will transform the way I support my patients."
However, the research team was quick to insist that though ChatGPT could offer significant help to doctors in relieving their ever-expanding workload - especially when it comes to giving online consultations - their implementation would not yet spell the end for doctors.
Dr. Adam Poliak, an assistant professor of Computer Science at Bryn Mawr College and study co-author, explained: "While our study pitted ChatGPT against physicians, the ultimate solution isn’t throwing your doctor out altogether.
"Instead, a physician harnessing ChatGPT is the answer for better and empathetic care."

Dr. Christopher Longhurst, Chief Medical Officer and Chief Digital Officer at UC San Diego Health said ChatGPT could be seen to give medical advice in the near future which would then be reviewed by doctors.
He said: "Our study is among the first to show how AI assistants can potentially solve real-world healthcare delivery problems.
"These results suggest that tools like ChatGPT can efficiently draft high quality, personalized medical advice for review by clinicians, and we are beginning that process at UCSD Health."
"It is important that integrating AI assistants into healthcare messaging be done in the context of a randomized controlled trial to judge how the use of AI assistants impacts outcomes for both physicians and patients," co-author Dr. Mike Hogarth added.
Doctors also pointed to the pandemic as leading to a complete change-up in how patients choose to seek medical advice.
Dr. Eric Leas, an assistant professor in the UC San Diego Herbert Wertheim School of Public Health and Human Longevity Science, argued: "The COVID-19 pandemic accelerated virtual healthcare adoption.
"While this made accessing care easier for patients, physicians are burdened by a barrage of electronic patient messages seeking medical advice that have contributed to record-breaking levels of physician burnout."
Dr. Mark Dredze, the John C Malone Associate Professor of Computer Science at Johns Hopkins and study co-author, concurred that the ChatGPT could be used to assist medical professionals.
He said: “We could use these technologies to train doctors in patient-centered communication, eliminate health disparities suffered by minority populations who often seek healthcare via messaging, build new medical safety systems, and assist doctors by delivering higher quality and more efficient care."
Stories and infographics by ‘Talker Research’ are available & ready to use. Stories and videos by ‘Talker News’ are managed by Talker Inc. For queries, please submit an inquiry via our contact form.
You may like

Bruce Lee’s business card for sale

Harry Potter fans can own original Golden Snitch for $10,000

World’s first micropub saved from closure after customer buys it

Three ultra-rare Marvel comics to fetch $34,000 at auction

Man breaks world record for having most Marvel comic tattoos

Want to buy Margaret Thatcher’s model ship?
Other Stories

Are Advent calendars really worth it?
Advent calendars have taken social media by storm this holiday season.

What is ‘pink noise’ and why do the best talks have it?
Scientists at Dartmouth College reveal that "pink noise" may be the answer to making your conversations better.

Thief caught after aping off with stolen orangutan
The stolen orangutan statue was valued at more than $1,000.

Do standing desks make you work harder?
Time to take a stand for or against standing desks?

Droughts so bad parts prepare for plans of rotating water cutoffs
Severe drought could see water supplies to households and businesses temporarily put on a rotating basis.
Top Talkers
Tech4 days agoShape-shifting bots inspired by elephant trunks can bend and grab
Parenting4 days agoDo teens know money better than their parents?
Sleep2 days agoAmericans feel mentally checked out nearly 2 months a year
Relationships2 days agoWhat is ‘pink noise’ and why do the best talks have it?
Parenting4 days agoKids who go to parks grow up with better mental health?
Holidays3 days agoNearly half of Gen Z skip rent to afford holiday costs
Travel3 days agoStudy finds how much forgetfulness costs travelers
Outer Space3 days agoDeep space system emitting signals every 8 minutes discovered
