Matches in SemOpenAlex for { <https://semopenalex.org/work/W2205270322> ?p ?o ?g. }
- W2205270322 abstract "Evaluations of clinical assessments that use judgement-based methods have frequently shown them to have sub-optimal reliability and internal validity evidence for their interpretation and intended use. The aim of this study was to enhance that validity evidence by an evaluation of the internal validity and reliability of competency constructs from supervisors' end-of-term summative assessments for prevocational medical trainees.The populations were medical trainees preparing for full registration as a medical practitioner (74) and supervisors who undertook ≥2 end-of-term summative assessments (n = 349) from a single institution. Confirmatory Factor Analysis was used to evaluate assessment internal construct validity. The hypothesised competency construct model to be tested, identified by exploratory factor analysis, had a theoretical basis established in workplace-psychology literature. Comparisons were made with competing models of potential competency constructs including the competency construct model of the original assessment. The optimal model for the competency constructs was identified using model fit and measurement invariance analysis. Construct homogeneity was assessed by Cronbach's α. Reliability measures were variance components of individual competency items and the identified competency constructs, and the number of assessments needed to achieve adequate reliability of R > 0.80.The hypothesised competency constructs of general professional job performance, clinical skills and professional abilities provides a good model-fit to the data, and a better fit than all alternative models. Model fit indices were χ2/df = 2.8; RMSEA = 0.073 (CI 0.057-0.088); CFI = 0.93; TLI = 0.95; SRMR = 0.039; WRMR = 0.93; AIC = 3879; and BIC = 4018). The optimal model had adequate measurement invariance with nested analysis of important population subgroups supporting the presence of full metric invariance. Reliability estimates for the competency construct general professional job performance indicated a resource efficient and reliable assessment for such a construct (6 assessments for an R > 0.80). Item homogeneity was good (Cronbach's alpha = 0.899). Other competency constructs are resource intensive requiring ≥11 assessments for a reliable assessment score.Internal validity and reliability of clinical competence assessments using judgement-based methods are acceptable when actual competency constructs used by assessors are adequately identified. Validation for interpretation and use of supervisors' assessment in local training schemes is feasible using standard methods for gathering validity evidence." @default.
- W2205270322 created "2016-06-24" @default.
- W2205270322 creator A5035891540 @default.
- W2205270322 creator A5040463497 @default.
- W2205270322 creator A5083593088 @default.
- W2205270322 date "2015-12-01" @default.
- W2205270322 modified "2023-09-27" @default.
- W2205270322 title "Construct validation of judgement-based assessments of medical trainees’ competency in the workplace using a “Kanesian” approach to validation" @default.
- W2205270322 cites W1704942559 @default.
- W2205270322 cites W1738312775 @default.
- W2205270322 cites W1965085721 @default.
- W2205270322 cites W1969719348 @default.
- W2205270322 cites W1986178498 @default.
- W2205270322 cites W1994181127 @default.
- W2205270322 cites W2010863029 @default.
- W2205270322 cites W2025781576 @default.
- W2205270322 cites W2031522440 @default.
- W2205270322 cites W2040987372 @default.
- W2205270322 cites W2052778271 @default.
- W2205270322 cites W2054591926 @default.
- W2205270322 cites W2064399130 @default.
- W2205270322 cites W2068472948 @default.
- W2205270322 cites W2071666535 @default.
- W2205270322 cites W2077120921 @default.
- W2205270322 cites W2078965693 @default.
- W2205270322 cites W2084062768 @default.
- W2205270322 cites W2085146169 @default.
- W2205270322 cites W2093342083 @default.
- W2205270322 cites W2096020754 @default.
- W2205270322 cites W2096345012 @default.
- W2205270322 cites W2104882209 @default.
- W2205270322 cites W2106096361 @default.
- W2205270322 cites W2110380098 @default.
- W2205270322 cites W2126682084 @default.
- W2205270322 cites W2134770125 @default.
- W2205270322 cites W2158314856 @default.
- W2205270322 cites W2163175447 @default.
- W2205270322 cites W2169294797 @default.
- W2205270322 cites W2315461912 @default.
- W2205270322 cites W4213193087 @default.
- W2205270322 cites W4231079698 @default.
- W2205270322 cites W4361868648 @default.
- W2205270322 doi "https://doi.org/10.1186/s12909-015-0520-1" @default.
- W2205270322 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/4696206" @default.
- W2205270322 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/26715145" @default.
- W2205270322 hasPublicationYear "2015" @default.
- W2205270322 type Work @default.
- W2205270322 sameAs 2205270322 @default.
- W2205270322 citedByCount "4" @default.
- W2205270322 countsByYear W22052703222016 @default.
- W2205270322 countsByYear W22052703222019 @default.
- W2205270322 countsByYear W22052703222020 @default.
- W2205270322 countsByYear W22052703222022 @default.
- W2205270322 crossrefType "journal-article" @default.
- W2205270322 hasAuthorship W2205270322A5035891540 @default.
- W2205270322 hasAuthorship W2205270322A5040463497 @default.
- W2205270322 hasAuthorship W2205270322A5083593088 @default.
- W2205270322 hasBestOaLocation W22052703221 @default.
- W2205270322 hasConcept C100521375 @default.
- W2205270322 hasConcept C105795698 @default.
- W2205270322 hasConcept C106906290 @default.
- W2205270322 hasConcept C121332964 @default.
- W2205270322 hasConcept C121955636 @default.
- W2205270322 hasConcept C144133560 @default.
- W2205270322 hasConcept C145420912 @default.
- W2205270322 hasConcept C152747807 @default.
- W2205270322 hasConcept C15744967 @default.
- W2205270322 hasConcept C163258240 @default.
- W2205270322 hasConcept C165957694 @default.
- W2205270322 hasConcept C171606756 @default.
- W2205270322 hasConcept C17744445 @default.
- W2205270322 hasConcept C196083921 @default.
- W2205270322 hasConcept C199360897 @default.
- W2205270322 hasConcept C199539241 @default.
- W2205270322 hasConcept C2776548248 @default.
- W2205270322 hasConcept C2780801425 @default.
- W2205270322 hasConcept C33923547 @default.
- W2205270322 hasConcept C40722632 @default.
- W2205270322 hasConcept C41008148 @default.
- W2205270322 hasConcept C42525527 @default.
- W2205270322 hasConcept C43214815 @default.
- W2205270322 hasConcept C49453240 @default.
- W2205270322 hasConcept C509550671 @default.
- W2205270322 hasConcept C62520636 @default.
- W2205270322 hasConcept C70410870 @default.
- W2205270322 hasConcept C71104824 @default.
- W2205270322 hasConcept C71924100 @default.
- W2205270322 hasConcept C75630572 @default.
- W2205270322 hasConcept C77805123 @default.
- W2205270322 hasConceptScore W2205270322C100521375 @default.
- W2205270322 hasConceptScore W2205270322C105795698 @default.
- W2205270322 hasConceptScore W2205270322C106906290 @default.
- W2205270322 hasConceptScore W2205270322C121332964 @default.
- W2205270322 hasConceptScore W2205270322C121955636 @default.
- W2205270322 hasConceptScore W2205270322C144133560 @default.
- W2205270322 hasConceptScore W2205270322C145420912 @default.
- W2205270322 hasConceptScore W2205270322C152747807 @default.
- W2205270322 hasConceptScore W2205270322C15744967 @default.
- W2205270322 hasConceptScore W2205270322C163258240 @default.
- W2205270322 hasConceptScore W2205270322C165957694 @default.