Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287604889> ?p ?o ?g. }
Showing items 1 to 67 of
67
with 100 items per page.
- W4287604889 abstract "Recommender systems operate in an inherently dynamical setting. Past recommendations influence future behavior, including which data points are observed and how user preferences change. However, experimenting in production systems with real user dynamics is often infeasible, and existing simulation-based approaches have limited scale. As a result, many state-of-the-art algorithms are designed to solve supervised learning problems, and progress is judged only by offline metrics. In this work we investigate the extent to which offline metrics predict online performance by evaluating eleven recommenders across six controlled simulated environments. We observe that offline metrics are correlated with online performance over a range of environments. However, improvements in offline metrics lead to diminishing returns in online performance. Furthermore, we observe that the ranking of recommenders varies depending on the amount of initial offline data available. We study the impact of adding exploration strategies, and observe that their effectiveness, when compared to greedy recommendation, is highly dependent on the recommendation algorithm. We provide the environments and recommenders described in this paper as Reclab: an extensible ready-to-use simulation framework at https://github.com/berkeley-reclab/RecLab." @default.
- W4287604889 created "2022-07-25" @default.
- W4287604889 creator A5012870568 @default.
- W4287604889 creator A5025723886 @default.
- W4287604889 creator A5034027561 @default.
- W4287604889 creator A5038920548 @default.
- W4287604889 creator A5049812527 @default.
- W4287604889 creator A5083397947 @default.
- W4287604889 creator A5086117005 @default.
- W4287604889 date "2020-11-06" @default.
- W4287604889 modified "2023-10-16" @default.
- W4287604889 title "Do Offline Metrics Predict Online Performance in Recommender Systems?" @default.
- W4287604889 doi "https://doi.org/10.48550/arxiv.2011.07931" @default.
- W4287604889 hasPublicationYear "2020" @default.
- W4287604889 type Work @default.
- W4287604889 citedByCount "0" @default.
- W4287604889 crossrefType "posted-content" @default.
- W4287604889 hasAuthorship W4287604889A5012870568 @default.
- W4287604889 hasAuthorship W4287604889A5025723886 @default.
- W4287604889 hasAuthorship W4287604889A5034027561 @default.
- W4287604889 hasAuthorship W4287604889A5038920548 @default.
- W4287604889 hasAuthorship W4287604889A5049812527 @default.
- W4287604889 hasAuthorship W4287604889A5083397947 @default.
- W4287604889 hasAuthorship W4287604889A5086117005 @default.
- W4287604889 hasBestOaLocation W42876048891 @default.
- W4287604889 hasConcept C111919701 @default.
- W4287604889 hasConcept C11413529 @default.
- W4287604889 hasConcept C119857082 @default.
- W4287604889 hasConcept C124101348 @default.
- W4287604889 hasConcept C154945302 @default.
- W4287604889 hasConcept C159985019 @default.
- W4287604889 hasConcept C189430467 @default.
- W4287604889 hasConcept C192562407 @default.
- W4287604889 hasConcept C196921405 @default.
- W4287604889 hasConcept C204323151 @default.
- W4287604889 hasConcept C2780102126 @default.
- W4287604889 hasConcept C41008148 @default.
- W4287604889 hasConcept C557471498 @default.
- W4287604889 hasConceptScore W4287604889C111919701 @default.
- W4287604889 hasConceptScore W4287604889C11413529 @default.
- W4287604889 hasConceptScore W4287604889C119857082 @default.
- W4287604889 hasConceptScore W4287604889C124101348 @default.
- W4287604889 hasConceptScore W4287604889C154945302 @default.
- W4287604889 hasConceptScore W4287604889C159985019 @default.
- W4287604889 hasConceptScore W4287604889C189430467 @default.
- W4287604889 hasConceptScore W4287604889C192562407 @default.
- W4287604889 hasConceptScore W4287604889C196921405 @default.
- W4287604889 hasConceptScore W4287604889C204323151 @default.
- W4287604889 hasConceptScore W4287604889C2780102126 @default.
- W4287604889 hasConceptScore W4287604889C41008148 @default.
- W4287604889 hasConceptScore W4287604889C557471498 @default.
- W4287604889 hasLocation W42876048891 @default.
- W4287604889 hasOpenAccess W4287604889 @default.
- W4287604889 hasPrimaryLocation W42876048891 @default.
- W4287604889 hasRelatedWork W215090888 @default.
- W4287604889 hasRelatedWork W2572507559 @default.
- W4287604889 hasRelatedWork W2575238773 @default.
- W4287604889 hasRelatedWork W2995919494 @default.
- W4287604889 hasRelatedWork W3104309036 @default.
- W4287604889 hasRelatedWork W3210268599 @default.
- W4287604889 hasRelatedWork W4280536103 @default.
- W4287604889 hasRelatedWork W4286905735 @default.
- W4287604889 hasRelatedWork W4287604889 @default.
- W4287604889 hasRelatedWork W4312347104 @default.
- W4287604889 isParatext "false" @default.
- W4287604889 isRetracted "false" @default.
- W4287604889 workType "article" @default.