Matches in SemOpenAlex for { <https://semopenalex.org/work/W2071446250> ?p ?o ?g. }
- W2071446250 abstract "Human assessments of document relevance are needed for the construction of test collections, for ad-hoc evaluation, and for training text classifiers. Showing documents to assessors in different orderings, however, may lead to different assessment outcomes. We examine the effect that defineterm{threshold priming}, seeing varying degrees of relevant documents, has on people's calibration of relevance. Participants judged the relevance of a prologue of documents containing highly relevant, moderately relevant, or non-relevant ocuments, followed by a common epilogue of documents of mixed relevance. We observe that participants exposed to only non-relevant documents in the prologue assigned significantly higher average relevance scores to prologue and epilogue documents than participants exposed to moderately or highly relevant documents in the prologue. We also examine how defineterm{need for cognition}, an individual difference measure of the extent to which a person enjoys engaging in effortful cognitive activity, impacts relevance assessments. High need for cognition participants had a significantly higher level of agreement with expert assessors than low need for cognition participants did. Our findings indicate that assessors should be exposed to documents from multiple relevance levels early in the judging process, in order to calibrate their relevance thresholds in a balanced way, and that individual difference measures might be a useful way to screen assessors." @default.
- W2071446250 created "2016-06-24" @default.
- W2071446250 creator A5021633850 @default.
- W2071446250 creator A5024719664 @default.
- W2071446250 creator A5069419532 @default.
- W2071446250 creator A5085925326 @default.
- W2071446250 creator A5086443774 @default.
- W2071446250 date "2013-07-28" @default.
- W2071446250 modified "2023-09-30" @default.
- W2071446250 title "The effect of threshold priming and need for cognition on relevance calibration and assessment" @default.
- W2071446250 cites W1561661463 @default.
- W2071446250 cites W1963800712 @default.
- W2071446250 cites W1974548087 @default.
- W2071446250 cites W1979483312 @default.
- W2071446250 cites W1981065051 @default.
- W2071446250 cites W1982149803 @default.
- W2071446250 cites W1982343866 @default.
- W2071446250 cites W1991774506 @default.
- W2071446250 cites W2003371341 @default.
- W2071446250 cites W2017856924 @default.
- W2071446250 cites W2023292494 @default.
- W2071446250 cites W2029192830 @default.
- W2071446250 cites W2044361482 @default.
- W2071446250 cites W2048987619 @default.
- W2071446250 cites W2053528567 @default.
- W2071446250 cites W2062236692 @default.
- W2071446250 cites W2070204737 @default.
- W2071446250 cites W2092488901 @default.
- W2071446250 cites W2094607109 @default.
- W2071446250 cites W2120308175 @default.
- W2071446250 cites W2141062075 @default.
- W2071446250 cites W2141653139 @default.
- W2071446250 cites W2153763032 @default.
- W2071446250 cites W340682576 @default.
- W2071446250 doi "https://doi.org/10.1145/2484028.2484090" @default.
- W2071446250 hasPublicationYear "2013" @default.
- W2071446250 type Work @default.
- W2071446250 sameAs 2071446250 @default.
- W2071446250 citedByCount "51" @default.
- W2071446250 countsByYear W20714462502014 @default.
- W2071446250 countsByYear W20714462502015 @default.
- W2071446250 countsByYear W20714462502016 @default.
- W2071446250 countsByYear W20714462502017 @default.
- W2071446250 countsByYear W20714462502018 @default.
- W2071446250 countsByYear W20714462502019 @default.
- W2071446250 countsByYear W20714462502020 @default.
- W2071446250 countsByYear W20714462502021 @default.
- W2071446250 countsByYear W20714462502022 @default.
- W2071446250 countsByYear W20714462502023 @default.
- W2071446250 crossrefType "proceedings-article" @default.
- W2071446250 hasAuthorship W2071446250A5021633850 @default.
- W2071446250 hasAuthorship W2071446250A5024719664 @default.
- W2071446250 hasAuthorship W2071446250A5069419532 @default.
- W2071446250 hasAuthorship W2071446250A5085925326 @default.
- W2071446250 hasAuthorship W2071446250A5086443774 @default.
- W2071446250 hasConcept C100701293 @default.
- W2071446250 hasConcept C124952713 @default.
- W2071446250 hasConcept C142362112 @default.
- W2071446250 hasConcept C15744967 @default.
- W2071446250 hasConcept C158154518 @default.
- W2071446250 hasConcept C169760540 @default.
- W2071446250 hasConcept C169900460 @default.
- W2071446250 hasConcept C17744445 @default.
- W2071446250 hasConcept C180747234 @default.
- W2071446250 hasConcept C199539241 @default.
- W2071446250 hasConcept C2780627709 @default.
- W2071446250 hasConcept C41008148 @default.
- W2071446250 hasConcept C53371666 @default.
- W2071446250 hasConcept C59822182 @default.
- W2071446250 hasConcept C81444415 @default.
- W2071446250 hasConcept C86803240 @default.
- W2071446250 hasConceptScore W2071446250C100701293 @default.
- W2071446250 hasConceptScore W2071446250C124952713 @default.
- W2071446250 hasConceptScore W2071446250C142362112 @default.
- W2071446250 hasConceptScore W2071446250C15744967 @default.
- W2071446250 hasConceptScore W2071446250C158154518 @default.
- W2071446250 hasConceptScore W2071446250C169760540 @default.
- W2071446250 hasConceptScore W2071446250C169900460 @default.
- W2071446250 hasConceptScore W2071446250C17744445 @default.
- W2071446250 hasConceptScore W2071446250C180747234 @default.
- W2071446250 hasConceptScore W2071446250C199539241 @default.
- W2071446250 hasConceptScore W2071446250C2780627709 @default.
- W2071446250 hasConceptScore W2071446250C41008148 @default.
- W2071446250 hasConceptScore W2071446250C53371666 @default.
- W2071446250 hasConceptScore W2071446250C59822182 @default.
- W2071446250 hasConceptScore W2071446250C81444415 @default.
- W2071446250 hasConceptScore W2071446250C86803240 @default.
- W2071446250 hasLocation W20714462501 @default.
- W2071446250 hasOpenAccess W2071446250 @default.
- W2071446250 hasPrimaryLocation W20714462501 @default.
- W2071446250 hasRelatedWork W1977114553 @default.
- W2071446250 hasRelatedWork W2075127398 @default.
- W2071446250 hasRelatedWork W2079468847 @default.
- W2071446250 hasRelatedWork W2089840209 @default.
- W2071446250 hasRelatedWork W2093218896 @default.
- W2071446250 hasRelatedWork W2327269268 @default.
- W2071446250 hasRelatedWork W2438883561 @default.
- W2071446250 hasRelatedWork W2768082818 @default.
- W2071446250 hasRelatedWork W2806341460 @default.
- W2071446250 hasRelatedWork W4242772594 @default.