The researchers prompted the AI chatbot to offer remedy recommendation that aligned with pointers established by the National Comprehensive Cancer Network (NCCN), in line with the examine printed within the journal JAMA Oncology.
“ChatGPT responses can sound a lot like a human and can be quite convincing. But, when it comes to clinical decision-making, there are so many subtleties for every patient’s unique situation. A right answer can be very nuanced, and not necessarily something ChatGPT or another large language model can provide,” mentioned corresponding creator Danielle Bitterman, MD, of the Department of Radiation Oncology on the US-based Mass General Brigham.
The researchers centered on the three most typical cancers (breast, prostate and lung most cancers) and prompted ChatGPT to offer a remedy method for every most cancers primarily based on the severity of the illness.
In complete, they included 26 distinctive prognosis descriptions and used 4, barely completely different prompts.
According to the examine, almost all responses (98 per cent) included no less than one remedy method that agreed with NCCN pointers. However, the researchers discovered that 34 per cent of those responses additionally included a number of non-concordant suggestions, which have been typically tough to detect amidst in any other case sound steering.
Discover the tales of your curiosity
In 12.5 per cent of instances, ChatGPT produced “hallucinations,” or a remedy advice totally absent from NCCN pointers, which included suggestions of novel therapies, or healing therapies for non-curative cancers.The researchers said that this type of misinformation can incorrectly set sufferers’ expectations about remedy and probably affect the clinician-patient relationship.
“Users are likely to seek answers from the LLMs to educate themselves on health-related topics — similarly to how Google searches have been used. At the same time, we need to raise awareness that LLMs are not the equivalent of trained medical professionals,” mentioned first creator Shan Chen, MS, of the Artificial Intelligence in Medicine (AIM) Programme.
Source: economictimes.indiatimes.com