Matches in SemOpenAlex for { <https://semopenalex.org/work/W2956052172> ?p ?o ?g. }
- W2956052172 endingPage "952" @default.
- W2956052172 startingPage "941" @default.
- W2956052172 abstract "Context Standard setting is critically important to assessment decisions in medical education. Recent research has demonstrated variations between medical schools in the standards set for shared items. Despite the centrality of judgement to criterion‐referenced standard setting methods, little is known about the individual or group processes that underpin them. This study aimed to explore the operation and interaction of these processes in order to illuminate potential sources of variability. Methods Using qualitative research, we purposively sampled across UK medical schools that set a low, medium or high standard on nationally shared items, collecting data by observation of graduation‐level standard‐setting meetings and semi‐structured interviews with standard‐setting judges. Data were analysed using thematic analysis based on the principles of grounded theory. Results Standard setting occurred through the complex interaction of institutional context, judges’ individual perspectives and group interactions. Schools’ procedures, panel members and atmosphere produced unique contexts. Individual judges formed varied understandings of the clinical and technical features of each question, relating these to their differing (sometimes contradictory) conceptions of minimally competent students, by balancing information and making suppositions. Conceptions of minimal competence variously comprised: limited attendance; limited knowledge; poor knowledge application; emotional responses to questions; ‘test‐savviness’, or a strategic focus on safety. Judges experienced tensions trying to situate these abstract conceptions in reality, revealing uncertainty. Groups constructively revised scores through debate, sharing information and often constructing detailed clinical representations of cases. Groups frequently displayed conformity, illustrating a belief that outlying judges were likely to be incorrect. Less frequently, judges resisted change, using emphatic language, bargaining or, rarely, ‘polarisation’ to influence colleagues. Conclusions Despite careful conduct through well‐established procedures, standard setting is judgementally complex and involves uncertainty. Understanding whether or how these varied processes produce the previously observed variations in outcomes may offer routes to enhance equivalence of criterion‐referenced standards." @default.
- W2956052172 created "2019-07-12" @default.
- W2956052172 creator A5006526767 @default.
- W2956052172 creator A5012945048 @default.
- W2956052172 creator A5047844189 @default.
- W2956052172 creator A5059241917 @default.
- W2956052172 creator A5086206984 @default.
- W2956052172 date "2019-07-02" @default.
- W2956052172 modified "2023-10-16" @default.
- W2956052172 title "Exploring differences in individual and group judgements in standard setting" @default.
- W2956052172 cites W1704942559 @default.
- W2956052172 cites W1972835464 @default.
- W2956052172 cites W2001981422 @default.
- W2956052172 cites W2009937332 @default.
- W2956052172 cites W2035515578 @default.
- W2956052172 cites W2054988168 @default.
- W2956052172 cites W2058154574 @default.
- W2956052172 cites W2077427001 @default.
- W2956052172 cites W2078241739 @default.
- W2956052172 cites W2082890162 @default.
- W2956052172 cites W2090039383 @default.
- W2956052172 cites W2092147963 @default.
- W2956052172 cites W2100922849 @default.
- W2956052172 cites W2101577705 @default.
- W2956052172 cites W2103281609 @default.
- W2956052172 cites W2129413219 @default.
- W2956052172 cites W2136049664 @default.
- W2956052172 cites W2141579028 @default.
- W2956052172 cites W2141967493 @default.
- W2956052172 cites W2145501277 @default.
- W2956052172 cites W2148141559 @default.
- W2956052172 cites W2154563310 @default.
- W2956052172 cites W2161254436 @default.
- W2956052172 cites W2161691555 @default.
- W2956052172 cites W2170016732 @default.
- W2956052172 cites W2175091510 @default.
- W2956052172 cites W2297657124 @default.
- W2956052172 cites W2337355331 @default.
- W2956052172 cites W2512748358 @default.
- W2956052172 cites W2521312816 @default.
- W2956052172 cites W2547602513 @default.
- W2956052172 cites W2562778769 @default.
- W2956052172 cites W2571094412 @default.
- W2956052172 cites W2604142611 @default.
- W2956052172 cites W2620382600 @default.
- W2956052172 cites W2807916740 @default.
- W2956052172 cites W651160335 @default.
- W2956052172 doi "https://doi.org/10.1111/medu.13915" @default.
- W2956052172 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/31264741" @default.
- W2956052172 hasPublicationYear "2019" @default.
- W2956052172 type Work @default.
- W2956052172 sameAs 2956052172 @default.
- W2956052172 citedByCount "4" @default.
- W2956052172 countsByYear W29560521722021 @default.
- W2956052172 countsByYear W29560521722022 @default.
- W2956052172 countsByYear W29560521722023 @default.
- W2956052172 crossrefType "journal-article" @default.
- W2956052172 hasAuthorship W2956052172A5006526767 @default.
- W2956052172 hasAuthorship W2956052172A5012945048 @default.
- W2956052172 hasAuthorship W2956052172A5047844189 @default.
- W2956052172 hasAuthorship W2956052172A5059241917 @default.
- W2956052172 hasAuthorship W2956052172A5086206984 @default.
- W2956052172 hasBestOaLocation W29560521722 @default.
- W2956052172 hasConcept C100521375 @default.
- W2956052172 hasConcept C111472728 @default.
- W2956052172 hasConcept C138885662 @default.
- W2956052172 hasConcept C142172996 @default.
- W2956052172 hasConcept C144024400 @default.
- W2956052172 hasConcept C151730666 @default.
- W2956052172 hasConcept C15744967 @default.
- W2956052172 hasConcept C177264268 @default.
- W2956052172 hasConcept C17744445 @default.
- W2956052172 hasConcept C190248442 @default.
- W2956052172 hasConcept C19165224 @default.
- W2956052172 hasConcept C199360897 @default.
- W2956052172 hasConcept C199539241 @default.
- W2956052172 hasConcept C2776548248 @default.
- W2956052172 hasConcept C2777267654 @default.
- W2956052172 hasConcept C2778173179 @default.
- W2956052172 hasConcept C2779343474 @default.
- W2956052172 hasConcept C36289849 @default.
- W2956052172 hasConcept C41008148 @default.
- W2956052172 hasConcept C509550671 @default.
- W2956052172 hasConcept C56995899 @default.
- W2956052172 hasConcept C71924100 @default.
- W2956052172 hasConcept C74196892 @default.
- W2956052172 hasConcept C77805123 @default.
- W2956052172 hasConcept C86803240 @default.
- W2956052172 hasConceptScore W2956052172C100521375 @default.
- W2956052172 hasConceptScore W2956052172C111472728 @default.
- W2956052172 hasConceptScore W2956052172C138885662 @default.
- W2956052172 hasConceptScore W2956052172C142172996 @default.
- W2956052172 hasConceptScore W2956052172C144024400 @default.
- W2956052172 hasConceptScore W2956052172C151730666 @default.
- W2956052172 hasConceptScore W2956052172C15744967 @default.
- W2956052172 hasConceptScore W2956052172C177264268 @default.
- W2956052172 hasConceptScore W2956052172C17744445 @default.
- W2956052172 hasConceptScore W2956052172C190248442 @default.