Matches in SemOpenAlex for { <https://semopenalex.org/work/W2007671364> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W2007671364 abstract "Soboroff, Nicholas and Cahan recently proposed a method for evaluating the performance of retrieval systems without relevance judgments. They demonstrated that the system evaluations produced by their methodology are correlated with actual evaluations using relevance judgments in the TREC competition. In this work, we propose an explanation for this phenomenon. We devise a simple measure for quantifying the similarity of retrieval systems by assessing the similarity of their retrieved results. Then, given a collection of retrieval systems and their retrieved results, we use this measure to assess the average similarity of a system to the other systems in the collection. We demonstrate that evaluating retrieval systems according to average similarity yields results quite similar to the methodology proposed by Soboroff et~al., and we further demonstrate that these two techniques are in fact highly correlated. Thus, the techniques are effectively evaluating and ranking retrieval systems by popularity as opposed to performance." @default.
- W2007671364 created "2016-06-24" @default.
- W2007671364 creator A5044225623 @default.
- W2007671364 creator A5067106906 @default.
- W2007671364 date "2003-07-28" @default.
- W2007671364 modified "2023-10-14" @default.
- W2007671364 title "On the effectiveness of evaluating retrieval systems in the absence of relevance judgments" @default.
- W2007671364 cites W1983595289 @default.
- W2007671364 cites W2057495142 @default.
- W2007671364 doi "https://doi.org/10.1145/860435.860501" @default.
- W2007671364 hasPublicationYear "2003" @default.
- W2007671364 type Work @default.
- W2007671364 sameAs 2007671364 @default.
- W2007671364 citedByCount "40" @default.
- W2007671364 countsByYear W20076713642012 @default.
- W2007671364 countsByYear W20076713642013 @default.
- W2007671364 countsByYear W20076713642014 @default.
- W2007671364 countsByYear W20076713642015 @default.
- W2007671364 countsByYear W20076713642016 @default.
- W2007671364 countsByYear W20076713642017 @default.
- W2007671364 countsByYear W20076713642018 @default.
- W2007671364 countsByYear W20076713642020 @default.
- W2007671364 countsByYear W20076713642022 @default.
- W2007671364 crossrefType "proceedings-article" @default.
- W2007671364 hasAuthorship W2007671364A5044225623 @default.
- W2007671364 hasAuthorship W2007671364A5067106906 @default.
- W2007671364 hasBestOaLocation W20076713642 @default.
- W2007671364 hasConcept C115961682 @default.
- W2007671364 hasConcept C154945302 @default.
- W2007671364 hasConcept C158154518 @default.
- W2007671364 hasConcept C1667742 @default.
- W2007671364 hasConcept C17744445 @default.
- W2007671364 hasConcept C199539241 @default.
- W2007671364 hasConcept C23123220 @default.
- W2007671364 hasConcept C2779532271 @default.
- W2007671364 hasConcept C41008148 @default.
- W2007671364 hasConceptScore W2007671364C115961682 @default.
- W2007671364 hasConceptScore W2007671364C154945302 @default.
- W2007671364 hasConceptScore W2007671364C158154518 @default.
- W2007671364 hasConceptScore W2007671364C1667742 @default.
- W2007671364 hasConceptScore W2007671364C17744445 @default.
- W2007671364 hasConceptScore W2007671364C199539241 @default.
- W2007671364 hasConceptScore W2007671364C23123220 @default.
- W2007671364 hasConceptScore W2007671364C2779532271 @default.
- W2007671364 hasConceptScore W2007671364C41008148 @default.
- W2007671364 hasLocation W20076713641 @default.
- W2007671364 hasLocation W20076713642 @default.
- W2007671364 hasOpenAccess W2007671364 @default.
- W2007671364 hasPrimaryLocation W20076713641 @default.
- W2007671364 hasRelatedWork W1518380457 @default.
- W2007671364 hasRelatedWork W1921936017 @default.
- W2007671364 hasRelatedWork W1968222678 @default.
- W2007671364 hasRelatedWork W1971071004 @default.
- W2007671364 hasRelatedWork W1973132420 @default.
- W2007671364 hasRelatedWork W2001985945 @default.
- W2007671364 hasRelatedWork W2009716188 @default.
- W2007671364 hasRelatedWork W2078482661 @default.
- W2007671364 hasRelatedWork W2157408137 @default.
- W2007671364 hasRelatedWork W2460037195 @default.
- W2007671364 isParatext "false" @default.
- W2007671364 isRetracted "false" @default.
- W2007671364 magId "2007671364" @default.
- W2007671364 workType "article" @default.