Matches in SemOpenAlex for { <https://semopenalex.org/work/W3119086747> ?p ?o ?g. }
- W3119086747 abstract "According to the Probability Ranking Principle (PRP), ranking documents in decreasing order of their probability of relevance leads to an optimal document ranking for ad-hoc retrieval. The PRP holds when two conditions are met: [C1] the models are well calibrated, and, [C2] the probabilities of relevance are reported with certainty. We know however that deep neural networks (DNNs) are often not well calibrated and have several sources of uncertainty, and thus [C1] and [C2] might not be satisfied by neural rankers. Given the success of neural Learning to Rank (L2R) approaches-and here, especially BERT-based approaches-we first analyze under which circumstances deterministic, i.e. outputs point estimates, neural rankers are calibrated. Then, motivated by our findings we use two techniques to model the uncertainty of neural rankers leading to the proposed stochastic rankers, which output a predictive distribution of relevance as opposed to point estimates. Our experimental results on the ad-hoc retrieval task of conversation response ranking reveal that (i) BERT-based rankers are not robustly calibrated and that stochastic BERT-based rankers yield better calibration; and (ii) uncertainty estimation is beneficial for both risk-aware neural ranking, i.e.taking into account the uncertainty when ranking documents, and for predicting unanswerable conversational contexts." @default.
- W3119086747 created "2021-01-18" @default.
- W3119086747 creator A5039590940 @default.
- W3119086747 creator A5084915697 @default.
- W3119086747 date "2021-01-12" @default.
- W3119086747 modified "2023-09-27" @default.
- W3119086747 title "On the Calibration and Uncertainty of Neural Learning to Rank Models." @default.
- W3119086747 cites W1522301498 @default.
- W3119086747 cites W1599263113 @default.
- W3119086747 cites W1751501637 @default.
- W3119086747 cites W1977081768 @default.
- W3119086747 cites W1980730196 @default.
- W3119086747 cites W2014415866 @default.
- W3119086747 cites W2048045485 @default.
- W3119086747 cites W2070030493 @default.
- W3119086747 cites W2095705004 @default.
- W3119086747 cites W2105831293 @default.
- W3119086747 cites W2111051539 @default.
- W3119086747 cites W2137556846 @default.
- W3119086747 cites W2141719669 @default.
- W3119086747 cites W2164411961 @default.
- W3119086747 cites W2254249950 @default.
- W3119086747 cites W2593864460 @default.
- W3119086747 cites W2626967530 @default.
- W3119086747 cites W2783624740 @default.
- W3119086747 cites W2891416139 @default.
- W3119086747 cites W2909544278 @default.
- W3119086747 cites W2912168444 @default.
- W3119086747 cites W2922386288 @default.
- W3119086747 cites W2923890923 @default.
- W3119086747 cites W2948194985 @default.
- W3119086747 cites W2951266961 @default.
- W3119086747 cites W2963206148 @default.
- W3119086747 cites W2963238274 @default.
- W3119086747 cites W2963341956 @default.
- W3119086747 cites W2964352131 @default.
- W3119086747 cites W2967674528 @default.
- W3119086747 cites W2970648534 @default.
- W3119086747 cites W2971130081 @default.
- W3119086747 cites W2986292373 @default.
- W3119086747 cites W2988299267 @default.
- W3119086747 cites W2989877482 @default.
- W3119086747 cites W2994846609 @default.
- W3119086747 cites W2996125274 @default.
- W3119086747 cites W3003352860 @default.
- W3119086747 cites W3016260913 @default.
- W3119086747 cites W3022840849 @default.
- W3119086747 cites W3023124993 @default.
- W3119086747 cites W3034975599 @default.
- W3119086747 cites W3035082574 @default.
- W3119086747 cites W3039431315 @default.
- W3119086747 cites W3045441970 @default.
- W3119086747 cites W56903235 @default.
- W3119086747 hasPublicationYear "2021" @default.
- W3119086747 type Work @default.
- W3119086747 sameAs 3119086747 @default.
- W3119086747 citedByCount "2" @default.
- W3119086747 countsByYear W31190867472021 @default.
- W3119086747 crossrefType "posted-content" @default.
- W3119086747 hasAuthorship W3119086747A5039590940 @default.
- W3119086747 hasAuthorship W3119086747A5084915697 @default.
- W3119086747 hasConcept C105795698 @default.
- W3119086747 hasConcept C114614502 @default.
- W3119086747 hasConcept C119857082 @default.
- W3119086747 hasConcept C124975894 @default.
- W3119086747 hasConcept C154945302 @default.
- W3119086747 hasConcept C158154518 @default.
- W3119086747 hasConcept C164226766 @default.
- W3119086747 hasConcept C165838908 @default.
- W3119086747 hasConcept C17744445 @default.
- W3119086747 hasConcept C189430467 @default.
- W3119086747 hasConcept C199539241 @default.
- W3119086747 hasConcept C2524010 @default.
- W3119086747 hasConcept C33923547 @default.
- W3119086747 hasConcept C41008148 @default.
- W3119086747 hasConcept C50644808 @default.
- W3119086747 hasConcept C7493553 @default.
- W3119086747 hasConcept C86037889 @default.
- W3119086747 hasConceptScore W3119086747C105795698 @default.
- W3119086747 hasConceptScore W3119086747C114614502 @default.
- W3119086747 hasConceptScore W3119086747C119857082 @default.
- W3119086747 hasConceptScore W3119086747C124975894 @default.
- W3119086747 hasConceptScore W3119086747C154945302 @default.
- W3119086747 hasConceptScore W3119086747C158154518 @default.
- W3119086747 hasConceptScore W3119086747C164226766 @default.
- W3119086747 hasConceptScore W3119086747C165838908 @default.
- W3119086747 hasConceptScore W3119086747C17744445 @default.
- W3119086747 hasConceptScore W3119086747C189430467 @default.
- W3119086747 hasConceptScore W3119086747C199539241 @default.
- W3119086747 hasConceptScore W3119086747C2524010 @default.
- W3119086747 hasConceptScore W3119086747C33923547 @default.
- W3119086747 hasConceptScore W3119086747C41008148 @default.
- W3119086747 hasConceptScore W3119086747C50644808 @default.
- W3119086747 hasConceptScore W3119086747C7493553 @default.
- W3119086747 hasConceptScore W3119086747C86037889 @default.
- W3119086747 hasLocation W31190867471 @default.
- W3119086747 hasOpenAccess W3119086747 @default.
- W3119086747 hasPrimaryLocation W31190867471 @default.
- W3119086747 hasRelatedWork W1526445072 @default.
- W3119086747 hasRelatedWork W1968917429 @default.