Matches in SemOpenAlex for { <https://semopenalex.org/work/W4384659754> ?p ?o ?g. }
Showing items 1 to 84 of
84
with 100 items per page.
- W4384659754 abstract "The information retrieval community has observed significant performance improvements over various tasks due to the introduction of neural architectures. However, such improvements do not necessarily seem to have happened uniformly across a range of queries. As we will empirically show in this paper, the performance of neural rankers follow a long-tail distribution where there are many subsets of queries, which are not effectively satisfied by neural methods. Despite this observation, performance is often reported using standard retrieval metrics, such as MRR or nDCG, which capture average performance over all queries. As such, it is not clear whether reported improvements are due to incremental boost on a small subset of already well-performing queries or addressing queries that have been difficult to address by existing methods. In this paper, we propose the Task Subspace Coverage (TaSC /tAHsk/) metric, which systematically quantifies whether and to what extent improvements in retrieval effectiveness happen on similar or disparate query subspaces for different rankers. Our experiments show that the consideration of our proposed TaSC metric in conjunction with existing ranking metrics provides deeper insight into ranker performance and their contribution to overall advances on a given task." @default.
- W4384659754 created "2023-07-20" @default.
- W4384659754 creator A5025776243 @default.
- W4384659754 creator A5032496915 @default.
- W4384659754 creator A5049487742 @default.
- W4384659754 creator A5064660738 @default.
- W4384659754 date "2023-07-18" @default.
- W4384659754 modified "2023-09-23" @default.
- W4384659754 title "Quantifying Ranker Coverage of Different Query Subspaces" @default.
- W4384659754 cites W2143369964 @default.
- W4384659754 cites W2148972377 @default.
- W4384659754 cites W2156187881 @default.
- W4384659754 cites W2800576266 @default.
- W4384659754 cites W2887532538 @default.
- W4384659754 cites W3021397474 @default.
- W4384659754 cites W3195010973 @default.
- W4384659754 cites W3210436917 @default.
- W4384659754 cites W4362554832 @default.
- W4384659754 doi "https://doi.org/10.1145/3539618.3592045" @default.
- W4384659754 hasPublicationYear "2023" @default.
- W4384659754 type Work @default.
- W4384659754 citedByCount "0" @default.
- W4384659754 crossrefType "proceedings-article" @default.
- W4384659754 hasAuthorship W4384659754A5025776243 @default.
- W4384659754 hasAuthorship W4384659754A5032496915 @default.
- W4384659754 hasAuthorship W4384659754A5049487742 @default.
- W4384659754 hasAuthorship W4384659754A5064660738 @default.
- W4384659754 hasBestOaLocation W43846597541 @default.
- W4384659754 hasConcept C119857082 @default.
- W4384659754 hasConcept C12362212 @default.
- W4384659754 hasConcept C124101348 @default.
- W4384659754 hasConcept C154945302 @default.
- W4384659754 hasConcept C159985019 @default.
- W4384659754 hasConcept C162324750 @default.
- W4384659754 hasConcept C176217482 @default.
- W4384659754 hasConcept C187736073 @default.
- W4384659754 hasConcept C189430467 @default.
- W4384659754 hasConcept C192562407 @default.
- W4384659754 hasConcept C204323151 @default.
- W4384659754 hasConcept C21547014 @default.
- W4384659754 hasConcept C23123220 @default.
- W4384659754 hasConcept C2524010 @default.
- W4384659754 hasConcept C2780451532 @default.
- W4384659754 hasConcept C2780898871 @default.
- W4384659754 hasConcept C32834561 @default.
- W4384659754 hasConcept C33923547 @default.
- W4384659754 hasConcept C41008148 @default.
- W4384659754 hasConcept C86037889 @default.
- W4384659754 hasConceptScore W4384659754C119857082 @default.
- W4384659754 hasConceptScore W4384659754C12362212 @default.
- W4384659754 hasConceptScore W4384659754C124101348 @default.
- W4384659754 hasConceptScore W4384659754C154945302 @default.
- W4384659754 hasConceptScore W4384659754C159985019 @default.
- W4384659754 hasConceptScore W4384659754C162324750 @default.
- W4384659754 hasConceptScore W4384659754C176217482 @default.
- W4384659754 hasConceptScore W4384659754C187736073 @default.
- W4384659754 hasConceptScore W4384659754C189430467 @default.
- W4384659754 hasConceptScore W4384659754C192562407 @default.
- W4384659754 hasConceptScore W4384659754C204323151 @default.
- W4384659754 hasConceptScore W4384659754C21547014 @default.
- W4384659754 hasConceptScore W4384659754C23123220 @default.
- W4384659754 hasConceptScore W4384659754C2524010 @default.
- W4384659754 hasConceptScore W4384659754C2780451532 @default.
- W4384659754 hasConceptScore W4384659754C2780898871 @default.
- W4384659754 hasConceptScore W4384659754C32834561 @default.
- W4384659754 hasConceptScore W4384659754C33923547 @default.
- W4384659754 hasConceptScore W4384659754C41008148 @default.
- W4384659754 hasConceptScore W4384659754C86037889 @default.
- W4384659754 hasLocation W43846597541 @default.
- W4384659754 hasOpenAccess W4384659754 @default.
- W4384659754 hasPrimaryLocation W43846597541 @default.
- W4384659754 hasRelatedWork W2147619762 @default.
- W4384659754 hasRelatedWork W219090214 @default.
- W4384659754 hasRelatedWork W2293317945 @default.
- W4384659754 hasRelatedWork W2296244148 @default.
- W4384659754 hasRelatedWork W25098770 @default.
- W4384659754 hasRelatedWork W2898073868 @default.
- W4384659754 hasRelatedWork W2946120184 @default.
- W4384659754 hasRelatedWork W2954428433 @default.
- W4384659754 hasRelatedWork W3168154995 @default.
- W4384659754 hasRelatedWork W4283789472 @default.
- W4384659754 isParatext "false" @default.
- W4384659754 isRetracted "false" @default.
- W4384659754 workType "article" @default.