Skip to main content

Can ChatGPT be Counted On?

Read Time: 2 minutes

Skyler Johnson smiling wearing white lab coat
Skyler Johnson, MD

A 研究Journal of The National Cancer Institute Cancer Spectrum looked at chatbots 和 artificial intelligence (AI), as they become popular resources for cancer information. They found these resources give accurate information when asked about common cancer myths 和 misconceptions. In the first 研究 of its kind, Skyler Johnson, MD, physician-scientist at Huntsman Cancer Institute 和 assistant professor 在 department of radiation oncology 在 University of Utah (the U), evaluated the reliability 和 accuracy of ChatGPT’s cancer information.

Using the National Cancer Institute’s (NCI) common myths 和 misconceptions about cancer, Johnson 和 his team found that 97% of the answers were correct. 然而, this finding comes with some important caveats, including a concern amongst the team that some of the ChatGPT answers could be interpreted incorrectly. “This could lead to some bad decisions by cancer patients. The team suggested caution when advising patients about whether they should use chatbots for information about cancer,” says Johnson.

The 研究 found reviewers were blinded, meaning they didn’t know whether the answers came from the chatbot or the NCI. Though the answers were accurate, reviewers found ChatGPT’s language was indirect, 模糊的, 和 in some cases, 不清楚.

“I recognize 和 underst和 how difficult it can feel for cancer patients 和 caregivers to access accurate information,” says Johnson. “These sources need to be studied so that we can help cancer patients navigate the murky waters that exist 在 online information environment as they try to seek answers about their diagnoses.”

Incorrect information can harm cancer patients. 在一个 previous 研究 by Johnson 和 his team published 在 Journal of the National Cancer Institute, they found that misinformation was common on social media 和 had the potential to harm cancer patients.

The next steps are to evaluate how often patients are using chatbots to seek out information about cancer, what questions they are asking, 和 whether AI chatbots provide accurate answers to  uncommon or unusual questions about cancer.

The 研究 was supported by the National Institutes of Health/National Cancer Institute including P30 CA042014 和 Huntsman Cancer Foundation.

Media Contact

Heather Simonsen
Public Affairs Senior Manager
Huntsman Cancer Institute
801 581-3194
公共.affairs@hci.犹他州.edu

About Huntsman Cancer Institute 在 University of Utah

Huntsman Cancer InstituteUniversity of Utah is the National Cancer Institute-designated Comprehensive Cancer Center for Utah, 爱达荷州, 蒙大拿, 内华达, 和 Wyoming. With a legacy of innovative cancer research, groundbreaking discoveries, 和 world-class patient care, we are transforming the way cancer is understood, prevented, diagnosed, 治疗, 和 survived. Huntsman Cancer Institute focuses on delivering the most advanced cancer healing 和 prevention through scientific breakthroughs 和 cutting-edge technology to advance cancer treatments of the future beyond the st和ard of care today. We have more than 300 open clinical trials250 research teams 研究ing cancer. More genes for inherited cancers have been discovered at Huntsman Cancer Institute than at any other cancer center. Our scientists are world-renowned for underst和ing how cancer begins 和 using that knowledge to develop innovative approaches to treat each patient’s unique disease. Huntsman Cancer Institute was founded by Jon M. 和 Karen Huntsman.

Resources for Media

Cancer touches all of us.