Matches in SemOpenAlex for { <https://semopenalex.org/work/W1504126298> ?p ?o ?g. }
- W1504126298 abstract "Metaevaluation is the evaluation of evaluation. Metaevaluation may focus on particular evaluation cases, evaluation systems, or the discipline overall. Leading scholars within the discipline consider metaevaluation to be a professional imperative, demonstrating that evaluation is a reflexive enterprise. Various criteria have been set forth for what constitutes excellence in evaluation. In the context of educational program evaluation, the dominant criteria are the Program Evaluation Standards, developed by the Joint Committee on Standards for Educational Evaluation. There has been widespread acceptance and application of the Standards, and their use is advocated by major organizations and several of the leading scholars and textbooks in evaluation. Concurrently, metaevaluation has received increasing attention within the evaluation discipline. Despite these two important developments in the field, there has been little empirical study of the Standards and their role in metaevaluation practice. There is an implicit assumption concerning their use as a tool for metaevaluation that comparable judgments about a given evaluation would be reached by different individuals when they use the Standards as criteria for assessing the evaluation’s quality. This issue concerns interrater reliability among metaevaluators when they use the Standards as rating criteria. Since reliability is a prerequisite for validity, that is a critical assumption worthy of empirical investigation. The legitimacy of this assumption is investigated in this study by having thirty individuals—ten evaluation doctoral students, ten evaluation practitioners, and ten evaluation scholars—rate the same ten program evaluations using Standards as criteria. The overall purpose of the study is to assess interrater reliability in this context using multiple measures. The results show uniformly low interrater reliability, which has direct implications for how metaevaluations should be performed and how their results should be used." @default.
- W1504126298 created "2016-06-24" @default.
- W1504126298 creator A5090315839 @default.
- W1504126298 date "2009-10-16" @default.
- W1504126298 modified "2023-09-25" @default.
- W1504126298 title "The Program Evaluation Standards Applied for Metaevaluation Purposes: Investigating Interrater Reliability and Implications for Use." @default.
- W1504126298 cites W1496437928 @default.
- W1504126298 cites W150254843 @default.
- W1504126298 cites W1588803962 @default.
- W1504126298 cites W1830503403 @default.
- W1504126298 cites W1958015814 @default.
- W1504126298 cites W1970789972 @default.
- W1504126298 cites W1974110131 @default.
- W1504126298 cites W198348820 @default.
- W1504126298 cites W1985692141 @default.
- W1504126298 cites W1986224130 @default.
- W1504126298 cites W1991098395 @default.
- W1504126298 cites W1998359754 @default.
- W1504126298 cites W2002876409 @default.
- W1504126298 cites W2014391524 @default.
- W1504126298 cites W2018342601 @default.
- W1504126298 cites W2020666462 @default.
- W1504126298 cites W2023083058 @default.
- W1504126298 cites W2030670791 @default.
- W1504126298 cites W2031474628 @default.
- W1504126298 cites W2036008062 @default.
- W1504126298 cites W2041830139 @default.
- W1504126298 cites W2042233834 @default.
- W1504126298 cites W2055795168 @default.
- W1504126298 cites W2063709325 @default.
- W1504126298 cites W2065280877 @default.
- W1504126298 cites W2075928310 @default.
- W1504126298 cites W2078257123 @default.
- W1504126298 cites W2080920125 @default.
- W1504126298 cites W2081855353 @default.
- W1504126298 cites W2084105906 @default.
- W1504126298 cites W2106655545 @default.
- W1504126298 cites W2133190167 @default.
- W1504126298 cites W2139502469 @default.
- W1504126298 cites W2141403362 @default.
- W1504126298 cites W2157465318 @default.
- W1504126298 cites W2164777277 @default.
- W1504126298 cites W2170021941 @default.
- W1504126298 cites W2171992303 @default.
- W1504126298 cites W2734795950 @default.
- W1504126298 cites W2740219057 @default.
- W1504126298 cites W2973161645 @default.
- W1504126298 cites W3150281948 @default.
- W1504126298 hasPublicationYear "2009" @default.
- W1504126298 type Work @default.
- W1504126298 sameAs 1504126298 @default.
- W1504126298 citedByCount "4" @default.
- W1504126298 countsByYear W15041262982012 @default.
- W1504126298 countsByYear W15041262982015 @default.
- W1504126298 countsByYear W15041262982016 @default.
- W1504126298 crossrefType "book-chapter" @default.
- W1504126298 hasAuthorship W1504126298A5090315839 @default.
- W1504126298 hasConcept C111472728 @default.
- W1504126298 hasConcept C120936955 @default.
- W1504126298 hasConcept C121332964 @default.
- W1504126298 hasConcept C127413603 @default.
- W1504126298 hasConcept C138496976 @default.
- W1504126298 hasConcept C138885662 @default.
- W1504126298 hasConcept C151730666 @default.
- W1504126298 hasConcept C15744967 @default.
- W1504126298 hasConcept C163258240 @default.
- W1504126298 hasConcept C177264268 @default.
- W1504126298 hasConcept C17744445 @default.
- W1504126298 hasConcept C199360897 @default.
- W1504126298 hasConcept C199539241 @default.
- W1504126298 hasConcept C2776007630 @default.
- W1504126298 hasConcept C2777352838 @default.
- W1504126298 hasConcept C2779343474 @default.
- W1504126298 hasConcept C3116431 @default.
- W1504126298 hasConcept C41008148 @default.
- W1504126298 hasConcept C43214815 @default.
- W1504126298 hasConcept C5395021 @default.
- W1504126298 hasConcept C539667460 @default.
- W1504126298 hasConcept C61863361 @default.
- W1504126298 hasConcept C62520636 @default.
- W1504126298 hasConcept C75630572 @default.
- W1504126298 hasConcept C83849319 @default.
- W1504126298 hasConcept C86803240 @default.
- W1504126298 hasConceptScore W1504126298C111472728 @default.
- W1504126298 hasConceptScore W1504126298C120936955 @default.
- W1504126298 hasConceptScore W1504126298C121332964 @default.
- W1504126298 hasConceptScore W1504126298C127413603 @default.
- W1504126298 hasConceptScore W1504126298C138496976 @default.
- W1504126298 hasConceptScore W1504126298C138885662 @default.
- W1504126298 hasConceptScore W1504126298C151730666 @default.
- W1504126298 hasConceptScore W1504126298C15744967 @default.
- W1504126298 hasConceptScore W1504126298C163258240 @default.
- W1504126298 hasConceptScore W1504126298C177264268 @default.
- W1504126298 hasConceptScore W1504126298C17744445 @default.
- W1504126298 hasConceptScore W1504126298C199360897 @default.
- W1504126298 hasConceptScore W1504126298C199539241 @default.
- W1504126298 hasConceptScore W1504126298C2776007630 @default.
- W1504126298 hasConceptScore W1504126298C2777352838 @default.
- W1504126298 hasConceptScore W1504126298C2779343474 @default.
- W1504126298 hasConceptScore W1504126298C3116431 @default.