Matches in SemOpenAlex for { <https://semopenalex.org/work/W4226083953> ?p ?o ?g. }
- W4226083953 endingPage "e053566" @default.
- W4226083953 startingPage "e053566" @default.
- W4226083953 abstract "Assess the suitability of clinical vignettes in benchmarking the performance of online symptom checkers (OSCs).Observational study using a publicly available free OSC.Healthily OSC, which provided consultations in English, was used to record consultation outcomes from two lay and four expert inputters using 139 standardised patient vignettes. Each vignette included three diagnostic solutions and a triage recommendation in one of three categories of triage urgency. A panel of three independent general practitioners interpreted the vignettes to arrive at an alternative set of diagnostic and triage solutions. Both sets of diagnostic and triage solutions were consolidated to arrive at a final consolidated version for benchmarking.Six inputters simulated 834 standardised patient evaluations using Healthily OSC and recorded outputs (triage solution, signposting, and whether the correct diagnostic solution appeared first or within the first three differentials). We estimated Cohen's kappa to assess how interpretations by different inputters could lead to divergent OSC output even when using the same vignette or when compared with a separate panel of physicians.There was moderate agreement on triage recommendation (kappa=0.48), and substantial agreement on consultation outcomes between all inputters (kappa=0.73). OSC performance improved significantly from baseline when compared against the final consolidated diagnostic and triage solution (p<0.001).Clinical vignettes are inherently limited in their utility to benchmark the diagnostic accuracy or triage safety of OSC. Real-world evidence studies involving real patients are recommended to benchmark the performance of OSC against a panel of physicians." @default.
- W4226083953 created "2022-05-05" @default.
- W4226083953 creator A5006247972 @default.
- W4226083953 creator A5015302801 @default.
- W4226083953 creator A5022237963 @default.
- W4226083953 creator A5027148481 @default.
- W4226083953 creator A5063409714 @default.
- W4226083953 creator A5074159692 @default.
- W4226083953 creator A5087172542 @default.
- W4226083953 date "2022-04-01" @default.
- W4226083953 modified "2023-10-02" @default.
- W4226083953 title "What is the suitability of clinical vignettes in benchmarking the performance of online symptom checkers? An audit study" @default.
- W4226083953 cites W1745376035 @default.
- W4226083953 cites W1838071484 @default.
- W4226083953 cites W1992829832 @default.
- W4226083953 cites W1997828529 @default.
- W4226083953 cites W2000923669 @default.
- W4226083953 cites W2014804217 @default.
- W4226083953 cites W2018320790 @default.
- W4226083953 cites W2019462239 @default.
- W4226083953 cites W2037803098 @default.
- W4226083953 cites W2050607941 @default.
- W4226083953 cites W2097211559 @default.
- W4226083953 cites W2101764630 @default.
- W4226083953 cites W2111522975 @default.
- W4226083953 cites W2116604146 @default.
- W4226083953 cites W2125578086 @default.
- W4226083953 cites W2133425153 @default.
- W4226083953 cites W2138552254 @default.
- W4226083953 cites W2141222241 @default.
- W4226083953 cites W2333953997 @default.
- W4226083953 cites W2515318985 @default.
- W4226083953 cites W2899560923 @default.
- W4226083953 cites W2965593496 @default.
- W4226083953 cites W2982702361 @default.
- W4226083953 cites W3033478329 @default.
- W4226083953 cites W3082624039 @default.
- W4226083953 cites W3112185662 @default.
- W4226083953 cites W3158039857 @default.
- W4226083953 cites W3182482959 @default.
- W4226083953 cites W4242780009 @default.
- W4226083953 cites W4294214797 @default.
- W4226083953 doi "https://doi.org/10.1136/bmjopen-2021-053566" @default.
- W4226083953 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/35477872" @default.
- W4226083953 hasPublicationYear "2022" @default.
- W4226083953 type Work @default.
- W4226083953 citedByCount "7" @default.
- W4226083953 countsByYear W42260839532022 @default.
- W4226083953 countsByYear W42260839532023 @default.
- W4226083953 crossrefType "journal-article" @default.
- W4226083953 hasAuthorship W4226083953A5006247972 @default.
- W4226083953 hasAuthorship W4226083953A5015302801 @default.
- W4226083953 hasAuthorship W4226083953A5022237963 @default.
- W4226083953 hasAuthorship W4226083953A5027148481 @default.
- W4226083953 hasAuthorship W4226083953A5063409714 @default.
- W4226083953 hasAuthorship W4226083953A5074159692 @default.
- W4226083953 hasAuthorship W4226083953A5087172542 @default.
- W4226083953 hasBestOaLocation W42260839531 @default.
- W4226083953 hasConcept C13280743 @default.
- W4226083953 hasConcept C138885662 @default.
- W4226083953 hasConcept C142724271 @default.
- W4226083953 hasConcept C144133560 @default.
- W4226083953 hasConcept C15744967 @default.
- W4226083953 hasConcept C162324750 @default.
- W4226083953 hasConcept C162853370 @default.
- W4226083953 hasConcept C17744445 @default.
- W4226083953 hasConcept C185798385 @default.
- W4226083953 hasConcept C187736073 @default.
- W4226083953 hasConcept C199521495 @default.
- W4226083953 hasConcept C199539241 @default.
- W4226083953 hasConcept C205649164 @default.
- W4226083953 hasConcept C23131810 @default.
- W4226083953 hasConcept C2777120189 @default.
- W4226083953 hasConcept C2778724333 @default.
- W4226083953 hasConcept C2779473830 @default.
- W4226083953 hasConcept C41895202 @default.
- W4226083953 hasConcept C512399662 @default.
- W4226083953 hasConcept C545542383 @default.
- W4226083953 hasConcept C71924100 @default.
- W4226083953 hasConcept C77805123 @default.
- W4226083953 hasConcept C86251818 @default.
- W4226083953 hasConcept C9719361 @default.
- W4226083953 hasConceptScore W4226083953C13280743 @default.
- W4226083953 hasConceptScore W4226083953C138885662 @default.
- W4226083953 hasConceptScore W4226083953C142724271 @default.
- W4226083953 hasConceptScore W4226083953C144133560 @default.
- W4226083953 hasConceptScore W4226083953C15744967 @default.
- W4226083953 hasConceptScore W4226083953C162324750 @default.
- W4226083953 hasConceptScore W4226083953C162853370 @default.
- W4226083953 hasConceptScore W4226083953C17744445 @default.
- W4226083953 hasConceptScore W4226083953C185798385 @default.
- W4226083953 hasConceptScore W4226083953C187736073 @default.
- W4226083953 hasConceptScore W4226083953C199521495 @default.
- W4226083953 hasConceptScore W4226083953C199539241 @default.
- W4226083953 hasConceptScore W4226083953C205649164 @default.
- W4226083953 hasConceptScore W4226083953C23131810 @default.
- W4226083953 hasConceptScore W4226083953C2777120189 @default.
- W4226083953 hasConceptScore W4226083953C2778724333 @default.