Matches in SemOpenAlex for { <https://semopenalex.org/work/W4367175039> ?p ?o ?g. }
Showing items 1 to 86 of
86
with 100 items per page.
- W4367175039 endingPage "589" @default.
- W4367175039 startingPage "589" @default.
- W4367175039 abstract "Importance ChatGPT is an artificial intelligence (AI) chatbot that has significant societal implications. Training curricula using AI are being developed in medicine, and the performance of chatbots in ophthalmology has not been characterized. Objective To assess the performance of ChatGPT in answering practice questions for board certification in ophthalmology. Design, Setting, and Participants This cross-sectional study used a consecutive sample of text-based multiple-choice questions provided by the OphthoQuestions practice question bank for board certification examination preparation. Of 166 available multiple-choice questions, 125 (75%) were text-based. Exposures ChatGPT answered questions from January 9 to 16, 2023, and on February 17, 2023. Main Outcomes and Measures Our primary outcome was the number of board certification examination practice questions that ChatGPT answered correctly. Our secondary outcomes were the proportion of questions for which ChatGPT provided additional explanations, the mean length of questions and responses provided by ChatGPT, the performance of ChatGPT in answering questions without multiple-choice options, and changes in performance over time. Results In January 2023, ChatGPT correctly answered 58 of 125 questions (46%). ChatGPT’s performance was the best in the category general medicine (11/14; 79%) and poorest in retina and vitreous (0%). The proportion of questions for which ChatGPT provided additional explanations was similar between questions answered correctly and incorrectly (difference, 5.82%; 95% CI, −11.0% to 22.0%; χ 2 1 = 0.45; P = .51). The mean length of questions was similar between questions answered correctly and incorrectly (difference, 21.4 characters; SE, 36.8; 95% CI, −51.4 to 94.3; t = 0.58; df = 123; P = .22). The mean length of responses was similar between questions answered correctly and incorrectly (difference, −80.0 characters; SE, 65.4; 95% CI, −209.5 to 49.5; t = −1.22; df = 123; P = .22). ChatGPT selected the same multiple-choice response as the most common answer provided by ophthalmology trainees on OphthoQuestions 44% of the time. In February 2023, ChatGPT provided a correct response to 73 of 125 multiple-choice questions (58%) and 42 of 78 stand-alone questions (54%) without multiple-choice options. Conclusions and Relevance ChatGPT answered approximately half of questions correctly in the OphthoQuestions free trial for ophthalmic board certification preparation. Medical professionals and trainees should appreciate the advances of AI in medicine while acknowledging that ChatGPT as used in this investigation did not answer sufficient multiple-choice questions correctly for it to provide substantial assistance in preparing for board certification at this time." @default.
- W4367175039 created "2023-04-28" @default.
- W4367175039 creator A5034211616 @default.
- W4367175039 creator A5035642316 @default.
- W4367175039 creator A5045497263 @default.
- W4367175039 date "2023-06-01" @default.
- W4367175039 modified "2023-10-11" @default.
- W4367175039 title "Performance of an Artificial Intelligence Chatbot in Ophthalmic Knowledge Assessment" @default.
- W4367175039 cites W2053606278 @default.
- W4367175039 cites W2118202495 @default.
- W4367175039 cites W2160927412 @default.
- W4367175039 cites W4249999102 @default.
- W4367175039 cites W4311824882 @default.
- W4367175039 cites W4312213844 @default.
- W4367175039 cites W4313232683 @default.
- W4367175039 cites W4313262066 @default.
- W4367175039 cites W4313451803 @default.
- W4367175039 cites W4319460874 @default.
- W4367175039 cites W4319662928 @default.
- W4367175039 doi "https://doi.org/10.1001/jamaophthalmol.2023.1144" @default.
- W4367175039 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/37103928" @default.
- W4367175039 hasPublicationYear "2023" @default.
- W4367175039 type Work @default.
- W4367175039 citedByCount "31" @default.
- W4367175039 countsByYear W43671750392023 @default.
- W4367175039 crossrefType "journal-article" @default.
- W4367175039 hasAuthorship W4367175039A5034211616 @default.
- W4367175039 hasAuthorship W4367175039A5035642316 @default.
- W4367175039 hasAuthorship W4367175039A5045497263 @default.
- W4367175039 hasConcept C126322002 @default.
- W4367175039 hasConcept C154945302 @default.
- W4367175039 hasConcept C15744967 @default.
- W4367175039 hasConcept C176730311 @default.
- W4367175039 hasConcept C17744445 @default.
- W4367175039 hasConcept C19417346 @default.
- W4367175039 hasConcept C199539241 @default.
- W4367175039 hasConcept C2776474047 @default.
- W4367175039 hasConcept C2777280699 @default.
- W4367175039 hasConcept C2779041454 @default.
- W4367175039 hasConcept C2988064887 @default.
- W4367175039 hasConcept C3018023364 @default.
- W4367175039 hasConcept C41008148 @default.
- W4367175039 hasConcept C46304622 @default.
- W4367175039 hasConcept C47177190 @default.
- W4367175039 hasConcept C509550671 @default.
- W4367175039 hasConcept C512399662 @default.
- W4367175039 hasConcept C71924100 @default.
- W4367175039 hasConceptScore W4367175039C126322002 @default.
- W4367175039 hasConceptScore W4367175039C154945302 @default.
- W4367175039 hasConceptScore W4367175039C15744967 @default.
- W4367175039 hasConceptScore W4367175039C176730311 @default.
- W4367175039 hasConceptScore W4367175039C17744445 @default.
- W4367175039 hasConceptScore W4367175039C19417346 @default.
- W4367175039 hasConceptScore W4367175039C199539241 @default.
- W4367175039 hasConceptScore W4367175039C2776474047 @default.
- W4367175039 hasConceptScore W4367175039C2777280699 @default.
- W4367175039 hasConceptScore W4367175039C2779041454 @default.
- W4367175039 hasConceptScore W4367175039C2988064887 @default.
- W4367175039 hasConceptScore W4367175039C3018023364 @default.
- W4367175039 hasConceptScore W4367175039C41008148 @default.
- W4367175039 hasConceptScore W4367175039C46304622 @default.
- W4367175039 hasConceptScore W4367175039C47177190 @default.
- W4367175039 hasConceptScore W4367175039C509550671 @default.
- W4367175039 hasConceptScore W4367175039C512399662 @default.
- W4367175039 hasConceptScore W4367175039C71924100 @default.
- W4367175039 hasIssue "6" @default.
- W4367175039 hasLocation W43671750391 @default.
- W4367175039 hasLocation W43671750392 @default.
- W4367175039 hasOpenAccess W4367175039 @default.
- W4367175039 hasPrimaryLocation W43671750391 @default.
- W4367175039 hasRelatedWork W186661980 @default.
- W4367175039 hasRelatedWork W1991810024 @default.
- W4367175039 hasRelatedWork W2073375187 @default.
- W4367175039 hasRelatedWork W2136831278 @default.
- W4367175039 hasRelatedWork W2899084033 @default.
- W4367175039 hasRelatedWork W2951002589 @default.
- W4367175039 hasRelatedWork W2977467574 @default.
- W4367175039 hasRelatedWork W3015818635 @default.
- W4367175039 hasRelatedWork W3086438674 @default.
- W4367175039 hasRelatedWork W4200386786 @default.
- W4367175039 hasVolume "141" @default.
- W4367175039 isParatext "false" @default.
- W4367175039 isRetracted "false" @default.
- W4367175039 workType "article" @default.