Matches in SemOpenAlex for { <https://semopenalex.org/work/W2894621306> ?p ?o ?g. }
- W2894621306 endingPage "21" @default.
- W2894621306 startingPage "1" @default.
- W2894621306 abstract "Effectiveness evaluation of information retrieval systems by means of a test collection is a widely used methodology. However, it is rather expensive in terms of resources, time, and money; therefore, many researchers have proposed methods for a cheaper evaluation. One particular approach, on which we focus in this article, is to use fewer topics: in TREC-like initiatives, usually system effectiveness is evaluated as the average effectiveness on a set of n topics (usually, n =50, but more than 1,000 have been also adopted); instead of using the full set, it has been proposed to find the best subsets of a few good topics that evaluate the systems in the most similar way to the full set. The computational complexity of the task has so far limited the analysis that has been performed. We develop a novel and efficient approach based on a multi-objective evolutionary algorithm. The higher efficiency of our new implementation allows us to reproduce some notable results on topic set reduction, as well as perform new experiments to generalize and improve such results. We show that our approach is able to both reproduce the main state-of-the-art results and to allow us to analyze the effect of the collection, metric, and pool depth used for the evaluation. Finally, differently from previous studies, which have been mainly theoretical, we are also able to discuss some practical topic selection strategies, integrating results of automatic evaluation approaches." @default.
- W2894621306 created "2018-10-12" @default.
- W2894621306 creator A5005575421 @default.
- W2894621306 creator A5028918939 @default.
- W2894621306 creator A5050287516 @default.
- W2894621306 creator A5084062073 @default.
- W2894621306 date "2018-09-29" @default.
- W2894621306 modified "2023-10-13" @default.
- W2894621306 title "Reproduce and Improve" @default.
- W2894621306 cites W1512383952 @default.
- W2894621306 cites W1574528120 @default.
- W2894621306 cites W1579063438 @default.
- W2894621306 cites W1824124613 @default.
- W2894621306 cites W1976076261 @default.
- W2894621306 cites W1980161923 @default.
- W2894621306 cites W1983595289 @default.
- W2894621306 cites W1987690005 @default.
- W2894621306 cites W1994960885 @default.
- W2894621306 cites W2023217403 @default.
- W2894621306 cites W2027359109 @default.
- W2894621306 cites W2075893676 @default.
- W2894621306 cites W2083622154 @default.
- W2894621306 cites W2091524854 @default.
- W2894621306 cites W2100240666 @default.
- W2894621306 cites W2126105956 @default.
- W2894621306 cites W2138621811 @default.
- W2894621306 cites W2468776465 @default.
- W2894621306 cites W2469056188 @default.
- W2894621306 cites W2570788028 @default.
- W2894621306 cites W2605232020 @default.
- W2894621306 cites W4233760227 @default.
- W2894621306 doi "https://doi.org/10.1145/3239573" @default.
- W2894621306 hasPublicationYear "2018" @default.
- W2894621306 type Work @default.
- W2894621306 sameAs 2894621306 @default.
- W2894621306 citedByCount "5" @default.
- W2894621306 countsByYear W28946213062019 @default.
- W2894621306 countsByYear W28946213062020 @default.
- W2894621306 crossrefType "journal-article" @default.
- W2894621306 hasAuthorship W2894621306A5005575421 @default.
- W2894621306 hasAuthorship W2894621306A5028918939 @default.
- W2894621306 hasAuthorship W2894621306A5050287516 @default.
- W2894621306 hasAuthorship W2894621306A5084062073 @default.
- W2894621306 hasConcept C111335779 @default.
- W2894621306 hasConcept C119857082 @default.
- W2894621306 hasConcept C120665830 @default.
- W2894621306 hasConcept C121332964 @default.
- W2894621306 hasConcept C124101348 @default.
- W2894621306 hasConcept C154945302 @default.
- W2894621306 hasConcept C162324750 @default.
- W2894621306 hasConcept C176217482 @default.
- W2894621306 hasConcept C177264268 @default.
- W2894621306 hasConcept C187736073 @default.
- W2894621306 hasConcept C192209626 @default.
- W2894621306 hasConcept C199360897 @default.
- W2894621306 hasConcept C21547014 @default.
- W2894621306 hasConcept C23123220 @default.
- W2894621306 hasConcept C2522767166 @default.
- W2894621306 hasConcept C2524010 @default.
- W2894621306 hasConcept C2780451532 @default.
- W2894621306 hasConcept C33923547 @default.
- W2894621306 hasConcept C41008148 @default.
- W2894621306 hasConcept C81917197 @default.
- W2894621306 hasConceptScore W2894621306C111335779 @default.
- W2894621306 hasConceptScore W2894621306C119857082 @default.
- W2894621306 hasConceptScore W2894621306C120665830 @default.
- W2894621306 hasConceptScore W2894621306C121332964 @default.
- W2894621306 hasConceptScore W2894621306C124101348 @default.
- W2894621306 hasConceptScore W2894621306C154945302 @default.
- W2894621306 hasConceptScore W2894621306C162324750 @default.
- W2894621306 hasConceptScore W2894621306C176217482 @default.
- W2894621306 hasConceptScore W2894621306C177264268 @default.
- W2894621306 hasConceptScore W2894621306C187736073 @default.
- W2894621306 hasConceptScore W2894621306C192209626 @default.
- W2894621306 hasConceptScore W2894621306C199360897 @default.
- W2894621306 hasConceptScore W2894621306C21547014 @default.
- W2894621306 hasConceptScore W2894621306C23123220 @default.
- W2894621306 hasConceptScore W2894621306C2522767166 @default.
- W2894621306 hasConceptScore W2894621306C2524010 @default.
- W2894621306 hasConceptScore W2894621306C2780451532 @default.
- W2894621306 hasConceptScore W2894621306C33923547 @default.
- W2894621306 hasConceptScore W2894621306C41008148 @default.
- W2894621306 hasConceptScore W2894621306C81917197 @default.
- W2894621306 hasIssue "3" @default.
- W2894621306 hasLocation W28946213061 @default.
- W2894621306 hasOpenAccess W2894621306 @default.
- W2894621306 hasPrimaryLocation W28946213061 @default.
- W2894621306 hasRelatedWork W1488266984 @default.
- W2894621306 hasRelatedWork W1509467138 @default.
- W2894621306 hasRelatedWork W2095753442 @default.
- W2894621306 hasRelatedWork W2128719260 @default.
- W2894621306 hasRelatedWork W2160522558 @default.
- W2894621306 hasRelatedWork W2224692227 @default.
- W2894621306 hasRelatedWork W2328155895 @default.
- W2894621306 hasRelatedWork W2564531452 @default.
- W2894621306 hasRelatedWork W2915135611 @default.
- W2894621306 hasRelatedWork W563404 @default.
- W2894621306 hasVolume "10" @default.