Matches in SemOpenAlex for { <https://semopenalex.org/work/W4284691245> ?p ?o ?g. }
- W4284691245 abstract "Recently, pre-training methods tailored for IR tasks have achieved great success. However, as the mechanisms behind the performance improvement remain under-investigated, the interpretability and robustness of these pre-trained models still need to be improved. Axiomatic IR aims to identify a set of desirable properties expressed mathematically as formal constraints to guide the design of ranking models. Existing studies have already shown that considering certain axioms may help improve the effectiveness and interpretability of IR models. However, there still lack efforts of incorporating these IR axioms into pre-training methodologies. To shed light on this research question, we propose a novel pre-training method with underlineA xiomatic underlineRe gularization for ad hoc underlineS earch (ARES). In the ARES framework, a number of existing IR axioms are re-organized to generate training samples to be fitted in the pre-training process. These training samples then guide neural rankers to learn the desirable ranking properties. Compared to existing pre-training approaches, ARES is more intuitive and explainable. Experimental results on multiple publicly available benchmark datasets have shown the effectiveness of ARES in both full-resource and low-resource (e.g., zero-shot and few-shot) settings. An intuitive case study also indicates that ARES has learned useful knowledge that existing pre-trained models (e.g., BERT and PROP) fail to possess. This work provides insights into improving the interpretability of pre-trained models and the guidance of incorporating IR axioms or human heuristics into pre-training methods." @default.
- W4284691245 created "2022-07-08" @default.
- W4284691245 creator A5033642702 @default.
- W4284691245 creator A5040969707 @default.
- W4284691245 creator A5040999162 @default.
- W4284691245 creator A5046565976 @default.
- W4284691245 creator A5053204257 @default.
- W4284691245 creator A5054079306 @default.
- W4284691245 creator A5070707679 @default.
- W4284691245 creator A5072119199 @default.
- W4284691245 creator A5084618257 @default.
- W4284691245 date "2022-07-06" @default.
- W4284691245 modified "2023-10-16" @default.
- W4284691245 title "Axiomatically Regularized Pre-training for Ad hoc Search" @default.
- W4284691245 cites W1598867694 @default.
- W4284691245 cites W2005545412 @default.
- W4284691245 cites W2032039936 @default.
- W4284691245 cites W2060890758 @default.
- W4284691245 cites W2082359527 @default.
- W4284691245 cites W2105157020 @default.
- W4284691245 cites W2134557008 @default.
- W4284691245 cites W2152228468 @default.
- W4284691245 cites W2152784831 @default.
- W4284691245 cites W2250539671 @default.
- W4284691245 cites W2534359342 @default.
- W4284691245 cites W2536015822 @default.
- W4284691245 cites W2648699835 @default.
- W4284691245 cites W2783640434 @default.
- W4284691245 cites W2955013659 @default.
- W4284691245 cites W2963165092 @default.
- W4284691245 cites W3015612646 @default.
- W4284691245 cites W3021397474 @default.
- W4284691245 cites W3083330919 @default.
- W4284691245 cites W3102286003 @default.
- W4284691245 cites W3102476541 @default.
- W4284691245 cites W3115195983 @default.
- W4284691245 cites W3159809086 @default.
- W4284691245 cites W3197223198 @default.
- W4284691245 cites W4206121183 @default.
- W4284691245 cites W4288072953 @default.
- W4284691245 cites W7333970 @default.
- W4284691245 doi "https://doi.org/10.1145/3477495.3531943" @default.
- W4284691245 hasPublicationYear "2022" @default.
- W4284691245 type Work @default.
- W4284691245 citedByCount "3" @default.
- W4284691245 countsByYear W42846912452023 @default.
- W4284691245 crossrefType "proceedings-article" @default.
- W4284691245 hasAuthorship W4284691245A5033642702 @default.
- W4284691245 hasAuthorship W4284691245A5040969707 @default.
- W4284691245 hasAuthorship W4284691245A5040999162 @default.
- W4284691245 hasAuthorship W4284691245A5046565976 @default.
- W4284691245 hasAuthorship W4284691245A5053204257 @default.
- W4284691245 hasAuthorship W4284691245A5054079306 @default.
- W4284691245 hasAuthorship W4284691245A5070707679 @default.
- W4284691245 hasAuthorship W4284691245A5072119199 @default.
- W4284691245 hasAuthorship W4284691245A5084618257 @default.
- W4284691245 hasBestOaLocation W42846912451 @default.
- W4284691245 hasConcept C104317684 @default.
- W4284691245 hasConcept C111919701 @default.
- W4284691245 hasConcept C119857082 @default.
- W4284691245 hasConcept C127705205 @default.
- W4284691245 hasConcept C13280743 @default.
- W4284691245 hasConcept C154945302 @default.
- W4284691245 hasConcept C167729594 @default.
- W4284691245 hasConcept C177264268 @default.
- W4284691245 hasConcept C185592680 @default.
- W4284691245 hasConcept C185798385 @default.
- W4284691245 hasConcept C189430467 @default.
- W4284691245 hasConcept C199360897 @default.
- W4284691245 hasConcept C205649164 @default.
- W4284691245 hasConcept C206345919 @default.
- W4284691245 hasConcept C2524010 @default.
- W4284691245 hasConcept C2781067378 @default.
- W4284691245 hasConcept C31258907 @default.
- W4284691245 hasConcept C33923547 @default.
- W4284691245 hasConcept C41008148 @default.
- W4284691245 hasConcept C51632099 @default.
- W4284691245 hasConcept C55493867 @default.
- W4284691245 hasConcept C63479239 @default.
- W4284691245 hasConceptScore W4284691245C104317684 @default.
- W4284691245 hasConceptScore W4284691245C111919701 @default.
- W4284691245 hasConceptScore W4284691245C119857082 @default.
- W4284691245 hasConceptScore W4284691245C127705205 @default.
- W4284691245 hasConceptScore W4284691245C13280743 @default.
- W4284691245 hasConceptScore W4284691245C154945302 @default.
- W4284691245 hasConceptScore W4284691245C167729594 @default.
- W4284691245 hasConceptScore W4284691245C177264268 @default.
- W4284691245 hasConceptScore W4284691245C185592680 @default.
- W4284691245 hasConceptScore W4284691245C185798385 @default.
- W4284691245 hasConceptScore W4284691245C189430467 @default.
- W4284691245 hasConceptScore W4284691245C199360897 @default.
- W4284691245 hasConceptScore W4284691245C205649164 @default.
- W4284691245 hasConceptScore W4284691245C206345919 @default.
- W4284691245 hasConceptScore W4284691245C2524010 @default.
- W4284691245 hasConceptScore W4284691245C2781067378 @default.
- W4284691245 hasConceptScore W4284691245C31258907 @default.
- W4284691245 hasConceptScore W4284691245C33923547 @default.
- W4284691245 hasConceptScore W4284691245C41008148 @default.
- W4284691245 hasConceptScore W4284691245C51632099 @default.
- W4284691245 hasConceptScore W4284691245C55493867 @default.