Matches in SemOpenAlex for { <https://semopenalex.org/work/W4283762145> ?p ?o ?g. }
- W4283762145 endingPage "103007" @default.
- W4283762145 startingPage "103007" @default.
- W4283762145 abstract "Re-using research resources is essential for advancing knowledge and developing repeatable, empirically solid experiments in scientific fields, including interactive information retrieval (IIR). Despite recent efforts on standardizing research re-use and documentation, how to quantitatively measure the reusability of IIR resources still remains an open challenge. Inspired by the reusability evaluations on Cranfield experiments, our work proactively explores the problem of measuring IIR test collection reusability and makes threefold contributions: (1) constructing a novel usefulness-oriented framework with specific analytical methods for evaluating the reusability of IIR test collections consisting of query sets, document/page sets, and sets of task-document usefulness ( tuse ); (2) explaining the potential impacts of varying IIR-specific factors (e.g. search tasks, sessions, user characteristics) on test collection reusability; (3) proposing actionable methods for building reusable test collections in IIR and thereby amortizing the true cost of user-oriented evaluations. The Cranfield-inspired reusability assessment framework serves as an initial step towards accurately evaluating the reusability of IIR research resources and measuring the reproducibility of IIR evaluation results. It also demonstrates an innovative approach to integrating the insights from individual heterogeneous user studies with the evaluation techniques developed in standardized ad hoc retrieval experiments, which will facilitate the maturation of IIR fields and eventually benefits both sides of research." @default.
- W4283762145 created "2022-07-02" @default.
- W4283762145 creator A5088558868 @default.
- W4283762145 date "2022-09-01" @default.
- W4283762145 modified "2023-10-12" @default.
- W4283762145 title "Toward Cranfield-inspired reusability assessment in interactive information retrieval evaluation" @default.
- W4283762145 cites W1526134783 @default.
- W4283762145 cites W1580741461 @default.
- W4283762145 cites W1966758856 @default.
- W4283762145 cites W1966835268 @default.
- W4283762145 cites W1973066772 @default.
- W4283762145 cites W1981261334 @default.
- W4283762145 cites W1989220366 @default.
- W4283762145 cites W1995311669 @default.
- W4283762145 cites W1997260010 @default.
- W4283762145 cites W1999764269 @default.
- W4283762145 cites W2000572635 @default.
- W4283762145 cites W2037802158 @default.
- W4283762145 cites W2053584122 @default.
- W4283762145 cites W2059516109 @default.
- W4283762145 cites W2068098598 @default.
- W4283762145 cites W2071446250 @default.
- W4283762145 cites W2073887333 @default.
- W4283762145 cites W2075893676 @default.
- W4283762145 cites W2090655302 @default.
- W4283762145 cites W2092610223 @default.
- W4283762145 cites W2106177900 @default.
- W4283762145 cites W2106576032 @default.
- W4283762145 cites W2114875800 @default.
- W4283762145 cites W2121131916 @default.
- W4283762145 cites W2124108136 @default.
- W4283762145 cites W2135985057 @default.
- W4283762145 cites W2143445498 @default.
- W4283762145 cites W2150136235 @default.
- W4283762145 cites W2160019159 @default.
- W4283762145 cites W2312790349 @default.
- W4283762145 cites W2338216121 @default.
- W4283762145 cites W2357807807 @default.
- W4283762145 cites W2507134384 @default.
- W4283762145 cites W2561180920 @default.
- W4283762145 cites W2590842578 @default.
- W4283762145 cites W2614200015 @default.
- W4283762145 cites W2617906023 @default.
- W4283762145 cites W2739567684 @default.
- W4283762145 cites W2740136032 @default.
- W4283762145 cites W2740916867 @default.
- W4283762145 cites W2741619064 @default.
- W4283762145 cites W2765760827 @default.
- W4283762145 cites W2783668259 @default.
- W4283762145 cites W2789810536 @default.
- W4283762145 cites W2895814542 @default.
- W4283762145 cites W2911638099 @default.
- W4283762145 cites W2920914241 @default.
- W4283762145 cites W2922012916 @default.
- W4283762145 cites W2952667223 @default.
- W4283762145 cites W2955792106 @default.
- W4283762145 cites W2964020128 @default.
- W4283762145 cites W2996188425 @default.
- W4283762145 cites W3011445502 @default.
- W4283762145 cites W3015735329 @default.
- W4283762145 cites W3029352075 @default.
- W4283762145 cites W3035547741 @default.
- W4283762145 cites W3043886961 @default.
- W4283762145 cites W3117895913 @default.
- W4283762145 cites W3125969194 @default.
- W4283762145 cites W3135042056 @default.
- W4283762145 cites W3154112228 @default.
- W4283762145 cites W3155375847 @default.
- W4283762145 cites W3183408277 @default.
- W4283762145 cites W3193746305 @default.
- W4283762145 cites W3208649236 @default.
- W4283762145 cites W4205183540 @default.
- W4283762145 cites W4245852133 @default.
- W4283762145 cites W4252076394 @default.
- W4283762145 cites W4285113563 @default.
- W4283762145 cites W4288864658 @default.
- W4283762145 cites W4300410021 @default.
- W4283762145 cites W3012406565 @default.
- W4283762145 doi "https://doi.org/10.1016/j.ipm.2022.103007" @default.
- W4283762145 hasPublicationYear "2022" @default.
- W4283762145 type Work @default.
- W4283762145 citedByCount "10" @default.
- W4283762145 countsByYear W42837621452022 @default.
- W4283762145 countsByYear W42837621452023 @default.
- W4283762145 crossrefType "journal-article" @default.
- W4283762145 hasAuthorship W4283762145A5088558868 @default.
- W4283762145 hasBestOaLocation W42837621451 @default.
- W4283762145 hasConcept C137981799 @default.
- W4283762145 hasConcept C199360897 @default.
- W4283762145 hasConcept C23123220 @default.
- W4283762145 hasConcept C2777904410 @default.
- W4283762145 hasConcept C41008148 @default.
- W4283762145 hasConceptScore W4283762145C137981799 @default.
- W4283762145 hasConceptScore W4283762145C199360897 @default.
- W4283762145 hasConceptScore W4283762145C23123220 @default.
- W4283762145 hasConceptScore W4283762145C2777904410 @default.
- W4283762145 hasConceptScore W4283762145C41008148 @default.
- W4283762145 hasIssue "5" @default.