Matches in SemOpenAlex for { <https://semopenalex.org/work/W3035278698> ?p ?o ?g. }
Showing items 1 to 94 of
94
with 100 items per page.
- W3035278698 abstract "For offline evaluation of IR systems, some researchers have proposed to utilise pairwise document preference assessments instead of relevance assessments of individual documents, as it may be easier for assessors to make relative decisions rather than absolute ones. Simple preference-based evaluation measures such as ppref and wpref have been proposed, but the past decade did not see any wide use of such measures. One reason for this may be that, while these new measures have been reported to behave more or less similarly to traditional measures based on absolute assessments, whether they actually align with the users' perception of search engine result pages (SERPs) has been unknown. The present study addresses exactly this question, after formally defining two classes of preference-based measures called Pref measures and Δ-measures. We show that the best of these measures perform at least as well as an average assessor in terms of agreement with users' SERP preferences, and that implicit document preferences (i.e., those suggested by a SERP that retrieves one document but not the other) play a much more important role than explicit preferences (i.e., those suggested by a SERP that retrieves one document above the other). We have released our data set containing 119,646 document preferences, so that the feasibility of document preferenced-based evaluation can be further pursued by the IR community." @default.
- W3035278698 created "2020-06-19" @default.
- W3035278698 creator A5023595778 @default.
- W3035278698 creator A5074501708 @default.
- W3035278698 date "2020-07-25" @default.
- W3035278698 modified "2023-10-14" @default.
- W3035278698 title "Good Evaluation Measures based on Document Preferences" @default.
- W3035278698 cites W1592933613 @default.
- W3035278698 cites W1968927634 @default.
- W3035278698 cites W1974360117 @default.
- W3035278698 cites W1978658266 @default.
- W3035278698 cites W1988619666 @default.
- W3035278698 cites W1989344419 @default.
- W3035278698 cites W2000289953 @default.
- W3035278698 cites W2046166484 @default.
- W3035278698 cites W2049878702 @default.
- W3035278698 cites W2058624977 @default.
- W3035278698 cites W2068098598 @default.
- W3035278698 cites W2069870183 @default.
- W3035278698 cites W2082776908 @default.
- W3035278698 cites W2084567515 @default.
- W3035278698 cites W2112329501 @default.
- W3035278698 cites W2113640060 @default.
- W3035278698 cites W2116008435 @default.
- W3035278698 cites W2134366819 @default.
- W3035278698 cites W2135645798 @default.
- W3035278698 cites W2137274315 @default.
- W3035278698 cites W2156186232 @default.
- W3035278698 cites W2169783907 @default.
- W3035278698 cites W2338216121 @default.
- W3035278698 cites W2624553223 @default.
- W3035278698 cites W2767432246 @default.
- W3035278698 cites W3008748523 @default.
- W3035278698 cites W3132995484 @default.
- W3035278698 cites W4300175355 @default.
- W3035278698 doi "https://doi.org/10.1145/3397271.3401115" @default.
- W3035278698 hasPublicationYear "2020" @default.
- W3035278698 type Work @default.
- W3035278698 sameAs 3035278698 @default.
- W3035278698 citedByCount "11" @default.
- W3035278698 countsByYear W30352786982020 @default.
- W3035278698 countsByYear W30352786982021 @default.
- W3035278698 countsByYear W30352786982022 @default.
- W3035278698 countsByYear W30352786982023 @default.
- W3035278698 crossrefType "proceedings-article" @default.
- W3035278698 hasAuthorship W3035278698A5023595778 @default.
- W3035278698 hasAuthorship W3035278698A5074501708 @default.
- W3035278698 hasConcept C105795698 @default.
- W3035278698 hasConcept C154945302 @default.
- W3035278698 hasConcept C15744967 @default.
- W3035278698 hasConcept C158154518 @default.
- W3035278698 hasConcept C169760540 @default.
- W3035278698 hasConcept C177264268 @default.
- W3035278698 hasConcept C17744445 @default.
- W3035278698 hasConcept C184898388 @default.
- W3035278698 hasConcept C199360897 @default.
- W3035278698 hasConcept C199539241 @default.
- W3035278698 hasConcept C23123220 @default.
- W3035278698 hasConcept C26760741 @default.
- W3035278698 hasConcept C2781249084 @default.
- W3035278698 hasConcept C33923547 @default.
- W3035278698 hasConcept C41008148 @default.
- W3035278698 hasConceptScore W3035278698C105795698 @default.
- W3035278698 hasConceptScore W3035278698C154945302 @default.
- W3035278698 hasConceptScore W3035278698C15744967 @default.
- W3035278698 hasConceptScore W3035278698C158154518 @default.
- W3035278698 hasConceptScore W3035278698C169760540 @default.
- W3035278698 hasConceptScore W3035278698C177264268 @default.
- W3035278698 hasConceptScore W3035278698C17744445 @default.
- W3035278698 hasConceptScore W3035278698C184898388 @default.
- W3035278698 hasConceptScore W3035278698C199360897 @default.
- W3035278698 hasConceptScore W3035278698C199539241 @default.
- W3035278698 hasConceptScore W3035278698C23123220 @default.
- W3035278698 hasConceptScore W3035278698C26760741 @default.
- W3035278698 hasConceptScore W3035278698C2781249084 @default.
- W3035278698 hasConceptScore W3035278698C33923547 @default.
- W3035278698 hasConceptScore W3035278698C41008148 @default.
- W3035278698 hasLocation W30352786981 @default.
- W3035278698 hasOpenAccess W3035278698 @default.
- W3035278698 hasPrimaryLocation W30352786981 @default.
- W3035278698 hasRelatedWork W1604381474 @default.
- W3035278698 hasRelatedWork W1986805046 @default.
- W3035278698 hasRelatedWork W1996655143 @default.
- W3035278698 hasRelatedWork W2100046112 @default.
- W3035278698 hasRelatedWork W2165981566 @default.
- W3035278698 hasRelatedWork W2624560652 @default.
- W3035278698 hasRelatedWork W3094927943 @default.
- W3035278698 hasRelatedWork W3105737538 @default.
- W3035278698 hasRelatedWork W4205262062 @default.
- W3035278698 hasRelatedWork W54129904 @default.
- W3035278698 isParatext "false" @default.
- W3035278698 isRetracted "false" @default.
- W3035278698 magId "3035278698" @default.
- W3035278698 workType "article" @default.