Matches in SemOpenAlex for { <https://semopenalex.org/work/W4327644575> ?p ?o ?g. }
Showing items 1 to 85 of
85
with 100 items per page.
- W4327644575 endingPage "254" @default.
- W4327644575 startingPage "239" @default.
- W4327644575 abstract "In evaluation campaigns, participants often explore variations of popular, state-of-the-art baselines as a low-risk strategy to achieve competitive results. While effective, this can lead to local “hill climbing” rather than a more radical and innovative departure from standard methods. Moreover, if many participants build on similar baselines, the overall diversity of approaches considered may be limited. In this work, we propose a new class of IR evaluation metrics intended to promote greater diversity of approaches in evaluation campaigns. Whereas traditional IR metrics focus on user experience, our two “innovation” metrics instead reward exploration of more divergent, higher-risk strategies finding relevant documents missed by other systems. Experiments on four TREC collections show that our metrics do change system rankings by rewarding systems that find such rare, relevant documents. This result is further supported by a controlled, synthetic data experiment, and a qualitative analysis. In addition, we show that our metrics achieve higher evaluation stability and discriminative power than the standard metrics we modify. To support reproducibility, we share our source code." @default.
- W4327644575 created "2023-03-18" @default.
- W4327644575 creator A5015705660 @default.
- W4327644575 creator A5023397430 @default.
- W4327644575 creator A5086826049 @default.
- W4327644575 date "2023-01-01" @default.
- W4327644575 modified "2023-10-17" @default.
- W4327644575 title "New Metrics to Encourage Innovation and Diversity in Information Retrieval Approaches" @default.
- W4327644575 cites W1966835268 @default.
- W4327644575 cites W1967879792 @default.
- W4327644575 cites W1968927634 @default.
- W4327644575 cites W1970095591 @default.
- W4327644575 cites W1978394996 @default.
- W4327644575 cites W1983595289 @default.
- W4327644575 cites W1984827663 @default.
- W4327644575 cites W1985554184 @default.
- W4327644575 cites W1987442066 @default.
- W4327644575 cites W2027247989 @default.
- W4327644575 cites W2034173707 @default.
- W4327644575 cites W2057495142 @default.
- W4327644575 cites W2073722401 @default.
- W4327644575 cites W2104679989 @default.
- W4327644575 cites W2109244020 @default.
- W4327644575 cites W2113640060 @default.
- W4327644575 cites W2120308175 @default.
- W4327644575 cites W2124504084 @default.
- W4327644575 cites W2132314908 @default.
- W4327644575 cites W2136542423 @default.
- W4327644575 cites W2197919320 @default.
- W4327644575 cites W2609795610 @default.
- W4327644575 cites W2738227713 @default.
- W4327644575 cites W2774514250 @default.
- W4327644575 cites W4252577790 @default.
- W4327644575 doi "https://doi.org/10.1007/978-3-031-28238-6_16" @default.
- W4327644575 hasPublicationYear "2023" @default.
- W4327644575 type Work @default.
- W4327644575 citedByCount "0" @default.
- W4327644575 crossrefType "book-chapter" @default.
- W4327644575 hasAuthorship W4327644575A5015705660 @default.
- W4327644575 hasAuthorship W4327644575A5023397430 @default.
- W4327644575 hasAuthorship W4327644575A5086826049 @default.
- W4327644575 hasBestOaLocation W43276445752 @default.
- W4327644575 hasConcept C111919701 @default.
- W4327644575 hasConcept C112972136 @default.
- W4327644575 hasConcept C119857082 @default.
- W4327644575 hasConcept C144024400 @default.
- W4327644575 hasConcept C154945302 @default.
- W4327644575 hasConcept C19165224 @default.
- W4327644575 hasConcept C23123220 @default.
- W4327644575 hasConcept C2522767166 @default.
- W4327644575 hasConcept C2781316041 @default.
- W4327644575 hasConcept C41008148 @default.
- W4327644575 hasConcept C43126263 @default.
- W4327644575 hasConcept C97931131 @default.
- W4327644575 hasConceptScore W4327644575C111919701 @default.
- W4327644575 hasConceptScore W4327644575C112972136 @default.
- W4327644575 hasConceptScore W4327644575C119857082 @default.
- W4327644575 hasConceptScore W4327644575C144024400 @default.
- W4327644575 hasConceptScore W4327644575C154945302 @default.
- W4327644575 hasConceptScore W4327644575C19165224 @default.
- W4327644575 hasConceptScore W4327644575C23123220 @default.
- W4327644575 hasConceptScore W4327644575C2522767166 @default.
- W4327644575 hasConceptScore W4327644575C2781316041 @default.
- W4327644575 hasConceptScore W4327644575C41008148 @default.
- W4327644575 hasConceptScore W4327644575C43126263 @default.
- W4327644575 hasConceptScore W4327644575C97931131 @default.
- W4327644575 hasLocation W43276445751 @default.
- W4327644575 hasLocation W43276445752 @default.
- W4327644575 hasOpenAccess W4327644575 @default.
- W4327644575 hasPrimaryLocation W43276445751 @default.
- W4327644575 hasRelatedWork W2026121273 @default.
- W4327644575 hasRelatedWork W2102106825 @default.
- W4327644575 hasRelatedWork W2353457699 @default.
- W4327644575 hasRelatedWork W2801772698 @default.
- W4327644575 hasRelatedWork W2961085424 @default.
- W4327644575 hasRelatedWork W2983744209 @default.
- W4327644575 hasRelatedWork W3103844505 @default.
- W4327644575 hasRelatedWork W4226100662 @default.
- W4327644575 hasRelatedWork W4306674287 @default.
- W4327644575 hasRelatedWork W66955737 @default.
- W4327644575 isParatext "false" @default.
- W4327644575 isRetracted "false" @default.
- W4327644575 workType "book-chapter" @default.