Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385551647> ?p ?o ?g. }
- W4385551647 abstract "Abstract Background For peer assessment, reliability (i.e., consistency in ratings across peers) and validity (i.e., consistency of peer ratings with instructors or experts) are frequently examined in the research literature to address a central concern of instructors and students. Although the average levels are generally promising, both reliability and validity can vary substantially from context to context. Meta‐analyses have identified a few moderators that are related to peer assessment reliability/validity, but they have lacked statistical power to systematically investigate many moderators or disentangle correlated moderators. Objectives The current study fills this gap by addressing what variables influence peer assessment reliability/validity using a large‐scale, cross‐context dataset from a shared online peer assessment platform. Methods Using multi‐level structural equation models, we examined three categories of variables: (1) variables related to the context of peer assessment; (2) variables related to the peer assessment task itself; and (3) variables related to rating rubrics of peer assessment. Results and Conclusions We found that the extent to which assessment documents varied in quality on the given rubric played a central role in mediating the effect from different predictors to peer assessment reliability/validity. Other variables that are significantly associated with reliability and validity included: Education Level, Language, Discipline, Average Ability of Peer Raters, Draft Number, Assignment Number, Class Size, Average Number of Raters, and Length of Rubric Description. The results provide information to guide practitioners on how to improve reliability and validity of peer assessments." @default.
- W4385551647 created "2023-08-04" @default.
- W4385551647 creator A5016157521 @default.
- W4385551647 creator A5034578094 @default.
- W4385551647 creator A5040485570 @default.
- W4385551647 date "2023-08-02" @default.
- W4385551647 modified "2023-09-27" @default.
- W4385551647 title "What predicts variation in reliability and validity of online peer assessment? A large‐scale cross‐context study" @default.
- W4385551647 cites W1976311664 @default.
- W4385551647 cites W1978092250 @default.
- W4385551647 cites W1983799571 @default.
- W4385551647 cites W1989213880 @default.
- W4385551647 cites W1996469193 @default.
- W4385551647 cites W2004170896 @default.
- W4385551647 cites W2012748169 @default.
- W4385551647 cites W2017343061 @default.
- W4385551647 cites W2048134839 @default.
- W4385551647 cites W2052634304 @default.
- W4385551647 cites W2071666535 @default.
- W4385551647 cites W2075116339 @default.
- W4385551647 cites W2075255191 @default.
- W4385551647 cites W2084997682 @default.
- W4385551647 cites W2086214690 @default.
- W4385551647 cites W2091931022 @default.
- W4385551647 cites W2097782859 @default.
- W4385551647 cites W2098992709 @default.
- W4385551647 cites W2106535847 @default.
- W4385551647 cites W2114256915 @default.
- W4385551647 cites W2115389369 @default.
- W4385551647 cites W2127376853 @default.
- W4385551647 cites W2140661853 @default.
- W4385551647 cites W2141413057 @default.
- W4385551647 cites W2142982766 @default.
- W4385551647 cites W2151242492 @default.
- W4385551647 cites W2154827584 @default.
- W4385551647 cites W2170582863 @default.
- W4385551647 cites W2342115973 @default.
- W4385551647 cites W2516204696 @default.
- W4385551647 cites W2573498121 @default.
- W4385551647 cites W2583660831 @default.
- W4385551647 cites W2596072174 @default.
- W4385551647 cites W2611357751 @default.
- W4385551647 cites W2775671504 @default.
- W4385551647 cites W2892447306 @default.
- W4385551647 cites W2948588714 @default.
- W4385551647 cites W2965283781 @default.
- W4385551647 cites W2979176094 @default.
- W4385551647 cites W2990390600 @default.
- W4385551647 cites W2996399622 @default.
- W4385551647 cites W3005296577 @default.
- W4385551647 cites W3021792676 @default.
- W4385551647 cites W3023739867 @default.
- W4385551647 cites W3042606639 @default.
- W4385551647 cites W3044104699 @default.
- W4385551647 cites W3174155365 @default.
- W4385551647 cites W3176997313 @default.
- W4385551647 cites W3177058820 @default.
- W4385551647 cites W3181407203 @default.
- W4385551647 cites W4236499275 @default.
- W4385551647 cites W564614949 @default.
- W4385551647 doi "https://doi.org/10.1111/jcal.12861" @default.
- W4385551647 hasPublicationYear "2023" @default.
- W4385551647 type Work @default.
- W4385551647 citedByCount "0" @default.
- W4385551647 crossrefType "journal-article" @default.
- W4385551647 hasAuthorship W4385551647A5016157521 @default.
- W4385551647 hasAuthorship W4385551647A5034578094 @default.
- W4385551647 hasAuthorship W4385551647A5040485570 @default.
- W4385551647 hasConcept C111640148 @default.
- W4385551647 hasConcept C121332964 @default.
- W4385551647 hasConcept C145420912 @default.
- W4385551647 hasConcept C151730666 @default.
- W4385551647 hasConcept C15744967 @default.
- W4385551647 hasConcept C163258240 @default.
- W4385551647 hasConcept C171606756 @default.
- W4385551647 hasConcept C2778755073 @default.
- W4385551647 hasConcept C2779343474 @default.
- W4385551647 hasConcept C43214815 @default.
- W4385551647 hasConcept C49453240 @default.
- W4385551647 hasConcept C53839665 @default.
- W4385551647 hasConcept C62520636 @default.
- W4385551647 hasConcept C70364389 @default.
- W4385551647 hasConcept C70410870 @default.
- W4385551647 hasConcept C75630572 @default.
- W4385551647 hasConcept C86803240 @default.
- W4385551647 hasConceptScore W4385551647C111640148 @default.
- W4385551647 hasConceptScore W4385551647C121332964 @default.
- W4385551647 hasConceptScore W4385551647C145420912 @default.
- W4385551647 hasConceptScore W4385551647C151730666 @default.
- W4385551647 hasConceptScore W4385551647C15744967 @default.
- W4385551647 hasConceptScore W4385551647C163258240 @default.
- W4385551647 hasConceptScore W4385551647C171606756 @default.
- W4385551647 hasConceptScore W4385551647C2778755073 @default.
- W4385551647 hasConceptScore W4385551647C2779343474 @default.
- W4385551647 hasConceptScore W4385551647C43214815 @default.
- W4385551647 hasConceptScore W4385551647C49453240 @default.
- W4385551647 hasConceptScore W4385551647C53839665 @default.
- W4385551647 hasConceptScore W4385551647C62520636 @default.
- W4385551647 hasConceptScore W4385551647C70364389 @default.
- W4385551647 hasConceptScore W4385551647C70410870 @default.