Matches in SemOpenAlex for { <https://semopenalex.org/work/W2805596211> ?p ?o ?g. }
- W2805596211 abstract "Online learning algorithms, widely used to power search and content optimization on the web, must balance exploration and exploitation, potentially sacrificing the experience of current users for information that will lead to better decisions in the future. Recently, concerns have been raised about whether the process of exploration could be viewed as unfair, placing too much burden on certain individuals or groups. Motivated by these concerns, we initiate the study of the externalities of exploration - the undesirable side effects that the presence of one party may impose on another - under the linear contextual bandits model. We introduce the notion of a group externality, measuring the extent to which the presence of one population of users impacts the rewards of another. We show that this impact can in some cases be negative, and that, in a certain sense, no algorithm can avoid it. We then study externalities at the individual level, interpreting the act of exploration as an externality imposed on the current user of a system by future users. This drives us to ask under what conditions inherent diversity in the data makes explicit exploration unnecessary. We build on a recent line of work on the smoothed analysis of the greedy algorithm that always chooses the action that currently looks optimal, improving on prior results to show that a greedy approach almost matches the best possible Bayesian regret rate of any other algorithm on the same problem instance whenever the diversity conditions hold, and that this regret is at most $tilde{O}(T^{1/3})$. Returning to group-level effects, we show that under the same conditions, negative group externalities essentially vanish under the greedy algorithm. Together, our results uncover a sharp contrast between the high externalities that exist in the worst case, and the ability to remove all externalities if the data is sufficiently diverse." @default.
- W2805596211 created "2018-06-13" @default.
- W2805596211 creator A5001070941 @default.
- W2805596211 creator A5043117896 @default.
- W2805596211 creator A5052541789 @default.
- W2805596211 creator A5058550942 @default.
- W2805596211 date "2023-09-07" @default.
- W2805596211 modified "2023-10-18" @default.
- W2805596211 title "The Externalities of Exploration and How Data Diversity Helps Exploitation" @default.
- W2805596211 cites W1490055774 @default.
- W2805596211 cites W1496624418 @default.
- W2805596211 cites W1511694993 @default.
- W2805596211 cites W1648303880 @default.
- W2805596211 cites W1819662813 @default.
- W2805596211 cites W1858733141 @default.
- W2805596211 cites W1894997507 @default.
- W2805596211 cites W1961345416 @default.
- W2805596211 cites W1965514675 @default.
- W2805596211 cites W1966912382 @default.
- W2805596211 cites W1972976939 @default.
- W2805596211 cites W1974338814 @default.
- W2805596211 cites W1977100096 @default.
- W2805596211 cites W1977590536 @default.
- W2805596211 cites W1983916796 @default.
- W2805596211 cites W1984716187 @default.
- W2805596211 cites W1985514943 @default.
- W2805596211 cites W1986767499 @default.
- W2805596211 cites W198744195 @default.
- W2805596211 cites W1993286459 @default.
- W2805596211 cites W2008098735 @default.
- W2805596211 cites W2014352947 @default.
- W2805596211 cites W2017310792 @default.
- W2805596211 cites W2019387816 @default.
- W2805596211 cites W2023703390 @default.
- W2805596211 cites W2023943903 @default.
- W2805596211 cites W2025380177 @default.
- W2805596211 cites W2026019770 @default.
- W2805596211 cites W2027739325 @default.
- W2805596211 cites W2028333242 @default.
- W2805596211 cites W2028781966 @default.
- W2805596211 cites W2033442452 @default.
- W2805596211 cites W2034053794 @default.
- W2805596211 cites W2034730278 @default.
- W2805596211 cites W2038435918 @default.
- W2805596211 cites W2046430198 @default.
- W2805596211 cites W2060824655 @default.
- W2805596211 cites W2063445365 @default.
- W2805596211 cites W2065915312 @default.
- W2805596211 cites W2066394140 @default.
- W2805596211 cites W2076393035 @default.
- W2805596211 cites W2088658556 @default.
- W2805596211 cites W2093915960 @default.
- W2805596211 cites W2095068691 @default.
- W2805596211 cites W2095932468 @default.
- W2805596211 cites W2096400920 @default.
- W2805596211 cites W2097246321 @default.
- W2805596211 cites W2098824882 @default.
- W2805596211 cites W2100960835 @default.
- W2805596211 cites W2104094955 @default.
- W2805596211 cites W2104734156 @default.
- W2805596211 cites W2105998493 @default.
- W2805596211 cites W2106580408 @default.
- W2805596211 cites W2110912171 @default.
- W2805596211 cites W2112420033 @default.
- W2805596211 cites W2115747715 @default.
- W2805596211 cites W2132736842 @default.
- W2805596211 cites W2134445663 @default.
- W2805596211 cites W2135473047 @default.
- W2805596211 cites W2147427185 @default.
- W2805596211 cites W2147453867 @default.
- W2805596211 cites W2149033360 @default.
- W2805596211 cites W2149247676 @default.
- W2805596211 cites W2149902237 @default.
- W2805596211 cites W2157096064 @default.
- W2805596211 cites W2157928966 @default.
- W2805596211 cites W2161009717 @default.
- W2805596211 cites W2168405694 @default.
- W2805596211 cites W2170081454 @default.
- W2805596211 cites W2182689800 @default.
- W2805596211 cites W2258717291 @default.
- W2805596211 cites W2278131185 @default.
- W2805596211 cites W2281090488 @default.
- W2805596211 cites W2282821441 @default.
- W2805596211 cites W2293768274 @default.
- W2805596211 cites W2363129255 @default.
- W2805596211 cites W2489098841 @default.
- W2805596211 cites W2544318541 @default.
- W2805596211 cites W2550925836 @default.
- W2805596211 cites W2551317447 @default.
- W2805596211 cites W2553650922 @default.
- W2805596211 cites W256241773 @default.
- W2805596211 cites W2584805976 @default.
- W2805596211 cites W2599025709 @default.
- W2805596211 cites W2608418064 @default.
- W2805596211 cites W2704480242 @default.
- W2805596211 cites W2744883502 @default.
- W2805596211 cites W2752617332 @default.
- W2805596211 cites W2756054281 @default.
- W2805596211 cites W2770363731 @default.
- W2805596211 cites W2773444500 @default.