Matches in SemOpenAlex for { <https://semopenalex.org/work/W2084567515> ?p ?o ?g. }
Showing items 1 to 97 of
97
with 100 items per page.
- W2084567515 abstract "Document-level relevance judgments are a major component in the calculation of effectiveness metrics. Collecting high-quality judgments is therefore a critical step in information retrieval evaluation. However, the nature of and the assumptions underlying relevance judgment collection have not received much attention. In particular, relevance judgments are typically collected for each document in isolation, although users read each document in the context of other documents. In this work, we aim to investigate the nature of relevance judgment collection. We collect relevance labels in both isolated and conditional setting, and ask for judgments in various dimensions of relevance as well as overall relevance. Then we compare the relevance metrics based on various types of judgments with other metrics of quality such as user preference. Our analyses illuminate how these settings for judgment collection affect the quality and the characteristics of the judgments. We also find that the metrics based on conditional judgments show higher correlation with user preference than isolated judgments." @default.
- W2084567515 created "2016-06-24" @default.
- W2084567515 creator A5013836248 @default.
- W2084567515 creator A5042929783 @default.
- W2084567515 creator A5047199726 @default.
- W2084567515 creator A5062071958 @default.
- W2084567515 creator A5078962429 @default.
- W2084567515 date "2014-04-07" @default.
- W2084567515 modified "2023-10-18" @default.
- W2084567515 title "Contextual and dimensional relevance judgments for reusable SERP-level evaluation" @default.
- W2084567515 cites W1968927634 @default.
- W2084567515 cites W1982149803 @default.
- W2084567515 cites W1992549066 @default.
- W2084567515 cites W1993320088 @default.
- W2084567515 cites W2006811637 @default.
- W2084567515 cites W2027198686 @default.
- W2084567515 cites W2027382829 @default.
- W2084567515 cites W2046166484 @default.
- W2084567515 cites W2048987619 @default.
- W2084567515 cites W2058624977 @default.
- W2084567515 cites W2062236692 @default.
- W2084567515 cites W2069870183 @default.
- W2084567515 cites W2071446250 @default.
- W2084567515 cites W2082055394 @default.
- W2084567515 cites W2113640060 @default.
- W2084567515 cites W2116008435 @default.
- W2084567515 cites W2123937625 @default.
- W2084567515 cites W2130076000 @default.
- W2084567515 cites W2132314908 @default.
- W2084567515 cites W2133968343 @default.
- W2084567515 cites W2134366819 @default.
- W2084567515 cites W2138681605 @default.
- W2084567515 cites W2166426462 @default.
- W2084567515 cites W2171392812 @default.
- W2084567515 doi "https://doi.org/10.1145/2566486.2568015" @default.
- W2084567515 hasPublicationYear "2014" @default.
- W2084567515 type Work @default.
- W2084567515 sameAs 2084567515 @default.
- W2084567515 citedByCount "5" @default.
- W2084567515 countsByYear W20845675152015 @default.
- W2084567515 countsByYear W20845675152020 @default.
- W2084567515 countsByYear W20845675152021 @default.
- W2084567515 crossrefType "proceedings-article" @default.
- W2084567515 hasAuthorship W2084567515A5013836248 @default.
- W2084567515 hasAuthorship W2084567515A5042929783 @default.
- W2084567515 hasAuthorship W2084567515A5047199726 @default.
- W2084567515 hasAuthorship W2084567515A5062071958 @default.
- W2084567515 hasAuthorship W2084567515A5078962429 @default.
- W2084567515 hasConcept C105795698 @default.
- W2084567515 hasConcept C111472728 @default.
- W2084567515 hasConcept C138885662 @default.
- W2084567515 hasConcept C151730666 @default.
- W2084567515 hasConcept C15744967 @default.
- W2084567515 hasConcept C158154518 @default.
- W2084567515 hasConcept C17744445 @default.
- W2084567515 hasConcept C180747234 @default.
- W2084567515 hasConcept C199539241 @default.
- W2084567515 hasConcept C23123220 @default.
- W2084567515 hasConcept C2779343474 @default.
- W2084567515 hasConcept C2779530757 @default.
- W2084567515 hasConcept C2781249084 @default.
- W2084567515 hasConcept C33923547 @default.
- W2084567515 hasConcept C41008148 @default.
- W2084567515 hasConcept C86803240 @default.
- W2084567515 hasConceptScore W2084567515C105795698 @default.
- W2084567515 hasConceptScore W2084567515C111472728 @default.
- W2084567515 hasConceptScore W2084567515C138885662 @default.
- W2084567515 hasConceptScore W2084567515C151730666 @default.
- W2084567515 hasConceptScore W2084567515C15744967 @default.
- W2084567515 hasConceptScore W2084567515C158154518 @default.
- W2084567515 hasConceptScore W2084567515C17744445 @default.
- W2084567515 hasConceptScore W2084567515C180747234 @default.
- W2084567515 hasConceptScore W2084567515C199539241 @default.
- W2084567515 hasConceptScore W2084567515C23123220 @default.
- W2084567515 hasConceptScore W2084567515C2779343474 @default.
- W2084567515 hasConceptScore W2084567515C2779530757 @default.
- W2084567515 hasConceptScore W2084567515C2781249084 @default.
- W2084567515 hasConceptScore W2084567515C33923547 @default.
- W2084567515 hasConceptScore W2084567515C41008148 @default.
- W2084567515 hasConceptScore W2084567515C86803240 @default.
- W2084567515 hasLocation W20845675151 @default.
- W2084567515 hasOpenAccess W2084567515 @default.
- W2084567515 hasPrimaryLocation W20845675151 @default.
- W2084567515 hasRelatedWork W1967370444 @default.
- W2084567515 hasRelatedWork W1980762553 @default.
- W2084567515 hasRelatedWork W2085384747 @default.
- W2084567515 hasRelatedWork W2088166309 @default.
- W2084567515 hasRelatedWork W2106071040 @default.
- W2084567515 hasRelatedWork W2157408137 @default.
- W2084567515 hasRelatedWork W2276587472 @default.
- W2084567515 hasRelatedWork W4238976562 @default.
- W2084567515 hasRelatedWork W4312133475 @default.
- W2084567515 hasRelatedWork W4312252109 @default.
- W2084567515 isParatext "false" @default.
- W2084567515 isRetracted "false" @default.
- W2084567515 magId "2084567515" @default.
- W2084567515 workType "article" @default.