Matches in SemOpenAlex for { <https://semopenalex.org/work/W4247620399> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4247620399 abstract "Blinded review is often proposed as a solution to potential inequities in merit-based evaluations. Yet, an equitable merit-based evaluation should also be reliable and valid. We evaluated the equity of blinded and unblinded review in a high-stakes field experiment during peer-review of submissions for an academic conference. Each conference submission received double-blind peer-reviews with reviewer and author identities withheld and single-blind peer-reviews with only reviewer identities withheld. We found that both systems yielded evaluations with moderate reliability after averaging across three or more independent reviewers. This level of reliability resulted in the review systems agreeing on 40% of the top submissions. This agreement level suggests that some differences between review systems emerge from noisy human judgment. The comparison also revealed that single-blind reviews favored senior coauthors and disfavored Asian (versus White) authors more than double-blind review. Double-blind reviews slightly favored male authors more than single-blind reviews. For submissions selected for presentation, neither author characteristics nor the review process consistently predicted judged talk quality or popularity. Single- and double-blind review scores similarly predicted subsequent publication. These results imply that preferences based on authors’ characteristics during single-blind review were not based on well-calibrated beliefs, and there was no strong evidence to suggest that knowing the authors’ characteristics would improve peer-review. The results also suggest that double-blind review may also reduce the ability of reviewers to take into consideration when submissions are from under-represented groups. We discuss ways blind review may be adapted to create an equitable merit-based evaluation." @default.
- W4247620399 created "2022-05-12" @default.
- W4247620399 creator A5041381906 @default.
- W4247620399 creator A5043259467 @default.
- W4247620399 creator A5058051316 @default.
- W4247620399 creator A5072088321 @default.
- W4247620399 date "2021-04-23" @default.
- W4247620399 modified "2023-10-16" @default.
- W4247620399 title "Blinded versus unblinded review: A field study comparing the equity of peer review" @default.
- W4247620399 doi "https://doi.org/10.31234/osf.io/q2tkw" @default.
- W4247620399 hasPublicationYear "2021" @default.
- W4247620399 type Work @default.
- W4247620399 citedByCount "1" @default.
- W4247620399 countsByYear W42476203992023 @default.
- W4247620399 crossrefType "posted-content" @default.
- W4247620399 hasAuthorship W4247620399A5041381906 @default.
- W4247620399 hasAuthorship W4247620399A5043259467 @default.
- W4247620399 hasAuthorship W4247620399A5058051316 @default.
- W4247620399 hasAuthorship W4247620399A5072088321 @default.
- W4247620399 hasBestOaLocation W42476203991 @default.
- W4247620399 hasConcept C121332964 @default.
- W4247620399 hasConcept C126838900 @default.
- W4247620399 hasConcept C138368954 @default.
- W4247620399 hasConcept C141071460 @default.
- W4247620399 hasConcept C142724271 @default.
- W4247620399 hasConcept C15744967 @default.
- W4247620399 hasConcept C163258240 @default.
- W4247620399 hasConcept C168563851 @default.
- W4247620399 hasConcept C17744445 @default.
- W4247620399 hasConcept C199539241 @default.
- W4247620399 hasConcept C199728807 @default.
- W4247620399 hasConcept C204787440 @default.
- W4247620399 hasConcept C27081682 @default.
- W4247620399 hasConcept C2777601897 @default.
- W4247620399 hasConcept C2780586970 @default.
- W4247620399 hasConcept C2991744798 @default.
- W4247620399 hasConcept C3018954396 @default.
- W4247620399 hasConcept C43214815 @default.
- W4247620399 hasConcept C62520636 @default.
- W4247620399 hasConcept C71924100 @default.
- W4247620399 hasConcept C75630572 @default.
- W4247620399 hasConcept C77805123 @default.
- W4247620399 hasConceptScore W4247620399C121332964 @default.
- W4247620399 hasConceptScore W4247620399C126838900 @default.
- W4247620399 hasConceptScore W4247620399C138368954 @default.
- W4247620399 hasConceptScore W4247620399C141071460 @default.
- W4247620399 hasConceptScore W4247620399C142724271 @default.
- W4247620399 hasConceptScore W4247620399C15744967 @default.
- W4247620399 hasConceptScore W4247620399C163258240 @default.
- W4247620399 hasConceptScore W4247620399C168563851 @default.
- W4247620399 hasConceptScore W4247620399C17744445 @default.
- W4247620399 hasConceptScore W4247620399C199539241 @default.
- W4247620399 hasConceptScore W4247620399C199728807 @default.
- W4247620399 hasConceptScore W4247620399C204787440 @default.
- W4247620399 hasConceptScore W4247620399C27081682 @default.
- W4247620399 hasConceptScore W4247620399C2777601897 @default.
- W4247620399 hasConceptScore W4247620399C2780586970 @default.
- W4247620399 hasConceptScore W4247620399C2991744798 @default.
- W4247620399 hasConceptScore W4247620399C3018954396 @default.
- W4247620399 hasConceptScore W4247620399C43214815 @default.
- W4247620399 hasConceptScore W4247620399C62520636 @default.
- W4247620399 hasConceptScore W4247620399C71924100 @default.
- W4247620399 hasConceptScore W4247620399C75630572 @default.
- W4247620399 hasConceptScore W4247620399C77805123 @default.
- W4247620399 hasLocation W42476203991 @default.
- W4247620399 hasLocation W42476203992 @default.
- W4247620399 hasOpenAccess W4247620399 @default.
- W4247620399 hasPrimaryLocation W42476203991 @default.
- W4247620399 hasRelatedWork W2002712007 @default.
- W4247620399 hasRelatedWork W2002850263 @default.
- W4247620399 hasRelatedWork W2162108740 @default.
- W4247620399 hasRelatedWork W2748952813 @default.
- W4247620399 hasRelatedWork W2899084033 @default.
- W4247620399 hasRelatedWork W2994546353 @default.
- W4247620399 hasRelatedWork W3124230418 @default.
- W4247620399 hasRelatedWork W3156920532 @default.
- W4247620399 hasRelatedWork W3207977329 @default.
- W4247620399 hasRelatedWork W4247620399 @default.
- W4247620399 isParatext "false" @default.
- W4247620399 isRetracted "false" @default.
- W4247620399 workType "article" @default.