Matches in SemOpenAlex for { <https://semopenalex.org/work/W4366559947> ?p ?o ?g. }
- W4366559947 abstract "A well-known problem when learning from user clicks are inherent biases prevalent in the data, such as position or trust bias. Click models are a common method for extracting information from user clicks, such as document relevance in web search, or to estimate click biases for downstream applications such as counterfactual learning-to-rank, ad placement, or fair ranking. Recent work shows that the current evaluation practices in the community fail to guarantee that a well-performing click model generalizes well to downstream tasks in which the ranking distribution differs from the training distribution, i.e., under covariate shift. In this work, we propose an evaluation metric based on conditional independence testing to detect a lack of robustness to covariate shift in click models. We introduce the concept of debiasedness and a metric for measuring it. We prove that debiasedness is a necessary condition for recovering unbiased and consistent relevance scores and for the invariance of click prediction under covariate shift. In extensive semi-synthetic experiments, we show that our proposed metric helps to predict the downstream performance of click models under covariate shift and is useful in an off-policy model selection setting." @default.
- W4366559947 created "2023-04-22" @default.
- W4366559947 creator A5000019810 @default.
- W4366559947 creator A5031439294 @default.
- W4366559947 creator A5075357420 @default.
- W4366559947 creator A5077706553 @default.
- W4366559947 date "2023-07-18" @default.
- W4366559947 modified "2023-10-16" @default.
- W4366559947 title "An Offline Metric for the Debiasedness of Click Models" @default.
- W4366559947 cites W1804792716 @default.
- W4366559947 cites W1972802558 @default.
- W4366559947 cites W1992549066 @default.
- W4366559947 cites W2045509016 @default.
- W4366559947 cites W2074694452 @default.
- W4366559947 cites W2083730062 @default.
- W4366559947 cites W2092701055 @default.
- W4366559947 cites W2099213975 @default.
- W4366559947 cites W2113640060 @default.
- W4366559947 cites W2143891888 @default.
- W4366559947 cites W2152314154 @default.
- W4366559947 cites W2339829457 @default.
- W4366559947 cites W2402441596 @default.
- W4366559947 cites W2507134384 @default.
- W4366559947 cites W2798492560 @default.
- W4366559947 cites W2976307459 @default.
- W4366559947 cites W2994069334 @default.
- W4366559947 cites W2997919341 @default.
- W4366559947 cites W3012600133 @default.
- W4366559947 cites W3044556022 @default.
- W4366559947 cites W30853191 @default.
- W4366559947 cites W3099404779 @default.
- W4366559947 cites W3130740428 @default.
- W4366559947 cites W3153981876 @default.
- W4366559947 cites W3155333579 @default.
- W4366559947 cites W3155690528 @default.
- W4366559947 cites W3156055390 @default.
- W4366559947 cites W4206275166 @default.
- W4366559947 cites W4283654062 @default.
- W4366559947 cites W4288079518 @default.
- W4366559947 cites W4302322961 @default.
- W4366559947 doi "https://doi.org/10.1145/3539618.3591639" @default.
- W4366559947 hasPublicationYear "2023" @default.
- W4366559947 type Work @default.
- W4366559947 citedByCount "0" @default.
- W4366559947 crossrefType "proceedings-article" @default.
- W4366559947 hasAuthorship W4366559947A5000019810 @default.
- W4366559947 hasAuthorship W4366559947A5031439294 @default.
- W4366559947 hasAuthorship W4366559947A5075357420 @default.
- W4366559947 hasAuthorship W4366559947A5077706553 @default.
- W4366559947 hasBestOaLocation W43665599471 @default.
- W4366559947 hasConcept C104317684 @default.
- W4366559947 hasConcept C110875604 @default.
- W4366559947 hasConcept C11392498 @default.
- W4366559947 hasConcept C119043178 @default.
- W4366559947 hasConcept C119857082 @default.
- W4366559947 hasConcept C124101348 @default.
- W4366559947 hasConcept C127613066 @default.
- W4366559947 hasConcept C136764020 @default.
- W4366559947 hasConcept C138744977 @default.
- W4366559947 hasConcept C154945302 @default.
- W4366559947 hasConcept C158154518 @default.
- W4366559947 hasConcept C162324750 @default.
- W4366559947 hasConcept C176217482 @default.
- W4366559947 hasConcept C17744445 @default.
- W4366559947 hasConcept C185592680 @default.
- W4366559947 hasConcept C189430467 @default.
- W4366559947 hasConcept C199539241 @default.
- W4366559947 hasConcept C21547014 @default.
- W4366559947 hasConcept C23123220 @default.
- W4366559947 hasConcept C41008148 @default.
- W4366559947 hasConcept C55493867 @default.
- W4366559947 hasConcept C63479239 @default.
- W4366559947 hasConcept C79772020 @default.
- W4366559947 hasConcept C86037889 @default.
- W4366559947 hasConceptScore W4366559947C104317684 @default.
- W4366559947 hasConceptScore W4366559947C110875604 @default.
- W4366559947 hasConceptScore W4366559947C11392498 @default.
- W4366559947 hasConceptScore W4366559947C119043178 @default.
- W4366559947 hasConceptScore W4366559947C119857082 @default.
- W4366559947 hasConceptScore W4366559947C124101348 @default.
- W4366559947 hasConceptScore W4366559947C127613066 @default.
- W4366559947 hasConceptScore W4366559947C136764020 @default.
- W4366559947 hasConceptScore W4366559947C138744977 @default.
- W4366559947 hasConceptScore W4366559947C154945302 @default.
- W4366559947 hasConceptScore W4366559947C158154518 @default.
- W4366559947 hasConceptScore W4366559947C162324750 @default.
- W4366559947 hasConceptScore W4366559947C176217482 @default.
- W4366559947 hasConceptScore W4366559947C17744445 @default.
- W4366559947 hasConceptScore W4366559947C185592680 @default.
- W4366559947 hasConceptScore W4366559947C189430467 @default.
- W4366559947 hasConceptScore W4366559947C199539241 @default.
- W4366559947 hasConceptScore W4366559947C21547014 @default.
- W4366559947 hasConceptScore W4366559947C23123220 @default.
- W4366559947 hasConceptScore W4366559947C41008148 @default.
- W4366559947 hasConceptScore W4366559947C55493867 @default.
- W4366559947 hasConceptScore W4366559947C63479239 @default.
- W4366559947 hasConceptScore W4366559947C79772020 @default.
- W4366559947 hasConceptScore W4366559947C86037889 @default.
- W4366559947 hasLocation W43665599471 @default.
- W4366559947 hasLocation W43665599472 @default.