Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387208052> ?p ?o ?g. }
Showing items 1 to 74 of
74
with 100 items per page.
- W4387208052 endingPage "e383" @default.
- W4387208052 startingPage "e383" @default.
- W4387208052 abstract "To determine if ChatGPT, a popular deep learning text generation tool, accurately and comprehensively answers patient questions related to radiation oncology.A total of 28 common patient-centered questions were selected across various radiation oncology content domains, including diagnosis (4), workup (3), treatment (8), toxicity (4), and survivorship (9). To assess whether ChatGPT could detect inaccurate assumptions and/or respond negatively, we included two negative control questions in the treatment and toxicity domains. All questions were applied to common cancer types (breast, non-small cell lung, prostate, p16+ oropharyngeal, and rectal), uncommon cancer types (hypopharyngeal, medulloblastoma, and vulvar), and colon cancer as an additional negative control. The ChatGPT responses were graded as 0 for any incorrect information, 1 for missing essential content, and 2 for correct and appropriately comprehensive for the length of the response. Each response was graded by two blinded MD reviewers, with discordant answers resolved by a third MD reviewer. Score distribution was compared across content domains, question type (negative control vs other), cancer type, and cancer commonality using the Chi-squared test.Overall, a total of 252 questions were submitted to ChatGPT. A total of 86 (34.1%) answers were found to contain inaccurate information, 66 (26.2%) contained correct information but were found to be missing essential context, and 100 (39.7%) responses to questions were graded as correct and comprehensive. There was no significant difference in response score by question domains (p = 0.07). However, there was significant difference in response score across cancer type (p<0.001). The top scoring cancer types were breast (grade 0 = 10%; grade 1 = 21%, grade 2 = 68%) and prostate (grade 0 = 18%, grade 1 = 25%, grade 2 = 57%), while the two lowest scoring cancer types were colon (grade 0 = 61%, grade 1 = 21%, grade 2 = 18%) and vulvar (grade 0 = 50%, grade 1 = 25%, grade 2 = 25%). ChatGPT responses were also significantly different among common, uncommon and negative control questions, with the model performing best with responses to common cancer types (p = 0.003). ChatGPT performed significantly worse when responding to negative control questions (p<0.001).ChatGPT failed to consistently generate accurate and comprehensive responses to the majority of radiation oncology patient centered questions, particularly across less common cancers and with negative control questions that included incorrect assumptions. This raises concern for the possible ChatGPT mediated reinforcement of patient misperceptions regarding radiotherapy." @default.
- W4387208052 created "2023-09-30" @default.
- W4387208052 creator A5002800668 @default.
- W4387208052 creator A5018959179 @default.
- W4387208052 creator A5033979225 @default.
- W4387208052 creator A5036855109 @default.
- W4387208052 creator A5057078342 @default.
- W4387208052 creator A5066986846 @default.
- W4387208052 creator A5071806965 @default.
- W4387208052 creator A5075569712 @default.
- W4387208052 creator A5078462142 @default.
- W4387208052 creator A5085044774 @default.
- W4387208052 date "2023-10-01" @default.
- W4387208052 modified "2023-10-17" @default.
- W4387208052 title "Evaluating the Reliability of Chat-GPT Model Responses for Radiation Oncology Patient Inquiries" @default.
- W4387208052 doi "https://doi.org/10.1016/j.ijrobp.2023.06.2497" @default.
- W4387208052 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/37785294" @default.
- W4387208052 hasPublicationYear "2023" @default.
- W4387208052 type Work @default.
- W4387208052 citedByCount "0" @default.
- W4387208052 crossrefType "journal-article" @default.
- W4387208052 hasAuthorship W4387208052A5002800668 @default.
- W4387208052 hasAuthorship W4387208052A5018959179 @default.
- W4387208052 hasAuthorship W4387208052A5033979225 @default.
- W4387208052 hasAuthorship W4387208052A5036855109 @default.
- W4387208052 hasAuthorship W4387208052A5057078342 @default.
- W4387208052 hasAuthorship W4387208052A5066986846 @default.
- W4387208052 hasAuthorship W4387208052A5071806965 @default.
- W4387208052 hasAuthorship W4387208052A5075569712 @default.
- W4387208052 hasAuthorship W4387208052A5078462142 @default.
- W4387208052 hasAuthorship W4387208052A5085044774 @default.
- W4387208052 hasConcept C121608353 @default.
- W4387208052 hasConcept C126322002 @default.
- W4387208052 hasConcept C143998085 @default.
- W4387208052 hasConcept C151730666 @default.
- W4387208052 hasConcept C19527891 @default.
- W4387208052 hasConcept C2779343474 @default.
- W4387208052 hasConcept C2992520072 @default.
- W4387208052 hasConcept C509974204 @default.
- W4387208052 hasConcept C530470458 @default.
- W4387208052 hasConcept C71924100 @default.
- W4387208052 hasConcept C86803240 @default.
- W4387208052 hasConceptScore W4387208052C121608353 @default.
- W4387208052 hasConceptScore W4387208052C126322002 @default.
- W4387208052 hasConceptScore W4387208052C143998085 @default.
- W4387208052 hasConceptScore W4387208052C151730666 @default.
- W4387208052 hasConceptScore W4387208052C19527891 @default.
- W4387208052 hasConceptScore W4387208052C2779343474 @default.
- W4387208052 hasConceptScore W4387208052C2992520072 @default.
- W4387208052 hasConceptScore W4387208052C509974204 @default.
- W4387208052 hasConceptScore W4387208052C530470458 @default.
- W4387208052 hasConceptScore W4387208052C71924100 @default.
- W4387208052 hasConceptScore W4387208052C86803240 @default.
- W4387208052 hasIssue "2" @default.
- W4387208052 hasLocation W43872080521 @default.
- W4387208052 hasLocation W43872080522 @default.
- W4387208052 hasOpenAccess W4387208052 @default.
- W4387208052 hasPrimaryLocation W43872080521 @default.
- W4387208052 hasRelatedWork W160538095 @default.
- W4387208052 hasRelatedWork W2034719780 @default.
- W4387208052 hasRelatedWork W2039595483 @default.
- W4387208052 hasRelatedWork W2133747887 @default.
- W4387208052 hasRelatedWork W2224319365 @default.
- W4387208052 hasRelatedWork W2416525736 @default.
- W4387208052 hasRelatedWork W2469123345 @default.
- W4387208052 hasRelatedWork W2975836687 @default.
- W4387208052 hasRelatedWork W3031133862 @default.
- W4387208052 hasRelatedWork W2039805290 @default.
- W4387208052 hasVolume "117" @default.
- W4387208052 isParatext "false" @default.
- W4387208052 isRetracted "false" @default.
- W4387208052 workType "article" @default.