Matches in SemOpenAlex for { <https://semopenalex.org/work/W2388783363> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W2388783363 abstract "We describe the UQV100 test collection, designed to incorporate variability from users. Information need ?backstories? were written for 100 topics (or sub-topics) from the TREC 2013 and 2014 Web Tracks. Crowd workers were asked to read the backstories, and provide the queries they would use; plus effort estimates of how many useful documents they would have to read to satisfy the need. A total of 10,835 queries were collected from 263 workers. After normalization and spell-correction, 5,764 unique variations remained; these were then used to construct a document pool via Indri-BM25 over the ClueWeb12-B corpus. Qualified crowd workers made relevance judgments relative to the backstories, using a relevance scale similar to the original TREC approach; first to a pool depth of ten per query, then deeper on a set of targeted documents. The backstories, query variations, normalized and spell-corrected queries, effort estimates, run outputs, and relevance judgments are made available collectively as the UQV100 test collection. We also make available the judging guidelines and the gold hits we used for crowd-worker qualification and spam detection. We believe this test collection will unlock new opportunities for novel investigations and analysis, including for problems such as task-intent retrieval performance and consistency (independent of query variation), query clustering, query difficulty prediction, and relevance feedback, among others." @default.
- W2388783363 created "2016-06-24" @default.
- W2388783363 creator A5017503948 @default.
- W2388783363 creator A5046377370 @default.
- W2388783363 creator A5081861848 @default.
- W2388783363 creator A5085925326 @default.
- W2388783363 date "2016-07-07" @default.
- W2388783363 modified "2023-09-26" @default.
- W2388783363 title "UQV100" @default.
- W2388783363 cites W1963658069 @default.
- W2388783363 cites W1968927634 @default.
- W2388783363 cites W1977437814 @default.
- W2388783363 cites W2090035194 @default.
- W2388783363 cites W2141175968 @default.
- W2388783363 cites W2141649520 @default.
- W2388783363 cites W2171683557 @default.
- W2388783363 cites W2259592457 @default.
- W2388783363 cites W4231856373 @default.
- W2388783363 doi "https://doi.org/10.1145/2911451.2914671" @default.
- W2388783363 hasPublicationYear "2016" @default.
- W2388783363 type Work @default.
- W2388783363 sameAs 2388783363 @default.
- W2388783363 citedByCount "61" @default.
- W2388783363 countsByYear W23887833632016 @default.
- W2388783363 countsByYear W23887833632017 @default.
- W2388783363 countsByYear W23887833632018 @default.
- W2388783363 countsByYear W23887833632019 @default.
- W2388783363 countsByYear W23887833632020 @default.
- W2388783363 countsByYear W23887833632021 @default.
- W2388783363 countsByYear W23887833632022 @default.
- W2388783363 countsByYear W23887833632023 @default.
- W2388783363 crossrefType "proceedings-article" @default.
- W2388783363 hasAuthorship W2388783363A5017503948 @default.
- W2388783363 hasAuthorship W2388783363A5046377370 @default.
- W2388783363 hasAuthorship W2388783363A5081861848 @default.
- W2388783363 hasAuthorship W2388783363A5085925326 @default.
- W2388783363 hasConcept C124101348 @default.
- W2388783363 hasConcept C136886441 @default.
- W2388783363 hasConcept C144024400 @default.
- W2388783363 hasConcept C151730666 @default.
- W2388783363 hasConcept C154945302 @default.
- W2388783363 hasConcept C158154518 @default.
- W2388783363 hasConcept C162324750 @default.
- W2388783363 hasConcept C177264268 @default.
- W2388783363 hasConcept C17744445 @default.
- W2388783363 hasConcept C187736073 @default.
- W2388783363 hasConcept C19165224 @default.
- W2388783363 hasConcept C199360897 @default.
- W2388783363 hasConcept C199539241 @default.
- W2388783363 hasConcept C23123220 @default.
- W2388783363 hasConcept C2776436953 @default.
- W2388783363 hasConcept C2777267654 @default.
- W2388783363 hasConcept C2780451532 @default.
- W2388783363 hasConcept C2780801425 @default.
- W2388783363 hasConcept C2780957641 @default.
- W2388783363 hasConcept C41008148 @default.
- W2388783363 hasConcept C73555534 @default.
- W2388783363 hasConcept C86803240 @default.
- W2388783363 hasConcept C99016210 @default.
- W2388783363 hasConceptScore W2388783363C124101348 @default.
- W2388783363 hasConceptScore W2388783363C136886441 @default.
- W2388783363 hasConceptScore W2388783363C144024400 @default.
- W2388783363 hasConceptScore W2388783363C151730666 @default.
- W2388783363 hasConceptScore W2388783363C154945302 @default.
- W2388783363 hasConceptScore W2388783363C158154518 @default.
- W2388783363 hasConceptScore W2388783363C162324750 @default.
- W2388783363 hasConceptScore W2388783363C177264268 @default.
- W2388783363 hasConceptScore W2388783363C17744445 @default.
- W2388783363 hasConceptScore W2388783363C187736073 @default.
- W2388783363 hasConceptScore W2388783363C19165224 @default.
- W2388783363 hasConceptScore W2388783363C199360897 @default.
- W2388783363 hasConceptScore W2388783363C199539241 @default.
- W2388783363 hasConceptScore W2388783363C23123220 @default.
- W2388783363 hasConceptScore W2388783363C2776436953 @default.
- W2388783363 hasConceptScore W2388783363C2777267654 @default.
- W2388783363 hasConceptScore W2388783363C2780451532 @default.
- W2388783363 hasConceptScore W2388783363C2780801425 @default.
- W2388783363 hasConceptScore W2388783363C2780957641 @default.
- W2388783363 hasConceptScore W2388783363C41008148 @default.
- W2388783363 hasConceptScore W2388783363C73555534 @default.
- W2388783363 hasConceptScore W2388783363C86803240 @default.
- W2388783363 hasConceptScore W2388783363C99016210 @default.
- W2388783363 hasLocation W23887833631 @default.
- W2388783363 hasOpenAccess W2388783363 @default.
- W2388783363 hasPrimaryLocation W23887833631 @default.
- W2388783363 hasRelatedWork W1571228783 @default.
- W2388783363 hasRelatedWork W1984668040 @default.
- W2388783363 hasRelatedWork W2035415770 @default.
- W2388783363 hasRelatedWork W2128435021 @default.
- W2388783363 hasRelatedWork W2137843624 @default.
- W2388783363 hasRelatedWork W2379306402 @default.
- W2388783363 hasRelatedWork W2385468727 @default.
- W2388783363 hasRelatedWork W2793755527 @default.
- W2388783363 hasRelatedWork W4225985861 @default.
- W2388783363 hasRelatedWork W2501907530 @default.
- W2388783363 isParatext "false" @default.
- W2388783363 isRetracted "false" @default.
- W2388783363 magId "2388783363" @default.
- W2388783363 workType "article" @default.