Matches in SemOpenAlex for { <https://semopenalex.org/work/W2401264332> ?p ?o ?g. }
- W2401264332 endingPage "702" @default.
- W2401264332 startingPage "679" @default.
- W2401264332 abstract "In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small strategy sets is by now well-understood, a lot of recent work has focused on MAB problems with exponentially or infinitely large strategy sets, where one needs to assume extra structure in order to make the problem tractable. In particular, recent literature considered information on similarity between arms.We consider similarity information in the setting of contextual bandits, a natural extension of the basic MAB problem where before each round an algorithm is given the context--a hint about the payoffs in this round. Contextual bandits are directly motivated by placing advertisements on web pages, one of the crucial problems in sponsored search. A particularly simple way to represent similarity information in the contextual bandit setting is via a similarity distance between the context-arm pairs which bounds from above the difference between the respective expected payoffs.Prior work on contextual bandits with similarity uses uniform partitions of the similarity space, so that each context-arm pair is approximated by the closest pair in the partition. Algorithms based on uniform partitions disregard the structure of the payoffs and the context arrivals, which is potentially wasteful. We present algorithms that are based on adaptive partitions, and take advantage of benign payoffs and context arrivals without sacrificing the worst-case performance. The central idea is to maintain a finer partition in high-payoff regions of the similarity space and in popular regions of the context space. Our results apply to several other settings, e.g., MAB with constrained temporal change (Slivkins and Upfal, 2008) and sleeping bandits (Kleinberg et al., 2008a)." @default.
- W2401264332 created "2016-06-24" @default.
- W2401264332 creator A5058550942 @default.
- W2401264332 date "2011-12-21" @default.
- W2401264332 modified "2023-09-23" @default.
- W2401264332 title "Contextual Bandits with Similarity Information." @default.
- W2401264332 cites W1488797257 @default.
- W2401264332 cites W1570963478 @default.
- W2401264332 cites W1608015248 @default.
- W2401264332 cites W172143579 @default.
- W2401264332 cites W1998498767 @default.
- W2401264332 cites W2004001705 @default.
- W2401264332 cites W2010189695 @default.
- W2401264332 cites W2012731843 @default.
- W2401264332 cites W2077902449 @default.
- W2401264332 cites W2097487180 @default.
- W2401264332 cites W2120745256 @default.
- W2401264332 cites W2127248062 @default.
- W2401264332 cites W2138859735 @default.
- W2401264332 cites W2168405694 @default.
- W2401264332 cites W2307171036 @default.
- W2401264332 cites W2950320358 @default.
- W2401264332 cites W77456527 @default.
- W2401264332 hasPublicationYear "2011" @default.
- W2401264332 type Work @default.
- W2401264332 sameAs 2401264332 @default.
- W2401264332 citedByCount "36" @default.
- W2401264332 countsByYear W24012643322012 @default.
- W2401264332 countsByYear W24012643322013 @default.
- W2401264332 countsByYear W24012643322014 @default.
- W2401264332 countsByYear W24012643322015 @default.
- W2401264332 countsByYear W24012643322017 @default.
- W2401264332 countsByYear W24012643322018 @default.
- W2401264332 countsByYear W24012643322019 @default.
- W2401264332 countsByYear W24012643322020 @default.
- W2401264332 countsByYear W24012643322021 @default.
- W2401264332 crossrefType "proceedings-article" @default.
- W2401264332 hasAuthorship W2401264332A5058550942 @default.
- W2401264332 hasConcept C103278499 @default.
- W2401264332 hasConcept C114614502 @default.
- W2401264332 hasConcept C115961682 @default.
- W2401264332 hasConcept C144237770 @default.
- W2401264332 hasConcept C151730666 @default.
- W2401264332 hasConcept C154945302 @default.
- W2401264332 hasConcept C177264268 @default.
- W2401264332 hasConcept C199360897 @default.
- W2401264332 hasConcept C22171661 @default.
- W2401264332 hasConcept C2778112365 @default.
- W2401264332 hasConcept C2779343474 @default.
- W2401264332 hasConcept C33923547 @default.
- W2401264332 hasConcept C41008148 @default.
- W2401264332 hasConcept C42812 @default.
- W2401264332 hasConcept C54355233 @default.
- W2401264332 hasConcept C80444323 @default.
- W2401264332 hasConcept C86803240 @default.
- W2401264332 hasConceptScore W2401264332C103278499 @default.
- W2401264332 hasConceptScore W2401264332C114614502 @default.
- W2401264332 hasConceptScore W2401264332C115961682 @default.
- W2401264332 hasConceptScore W2401264332C144237770 @default.
- W2401264332 hasConceptScore W2401264332C151730666 @default.
- W2401264332 hasConceptScore W2401264332C154945302 @default.
- W2401264332 hasConceptScore W2401264332C177264268 @default.
- W2401264332 hasConceptScore W2401264332C199360897 @default.
- W2401264332 hasConceptScore W2401264332C22171661 @default.
- W2401264332 hasConceptScore W2401264332C2778112365 @default.
- W2401264332 hasConceptScore W2401264332C2779343474 @default.
- W2401264332 hasConceptScore W2401264332C33923547 @default.
- W2401264332 hasConceptScore W2401264332C41008148 @default.
- W2401264332 hasConceptScore W2401264332C42812 @default.
- W2401264332 hasConceptScore W2401264332C54355233 @default.
- W2401264332 hasConceptScore W2401264332C80444323 @default.
- W2401264332 hasConceptScore W2401264332C86803240 @default.
- W2401264332 hasLocation W24012643321 @default.
- W2401264332 hasOpenAccess W2401264332 @default.
- W2401264332 hasPrimaryLocation W24012643321 @default.
- W2401264332 hasRelatedWork W1487320471 @default.
- W2401264332 hasRelatedWork W1570963478 @default.
- W2401264332 hasRelatedWork W1917528016 @default.
- W2401264332 hasRelatedWork W1998498767 @default.
- W2401264332 hasRelatedWork W2009551863 @default.
- W2401264332 hasRelatedWork W2039522160 @default.
- W2401264332 hasRelatedWork W2049934117 @default.
- W2401264332 hasRelatedWork W2077902449 @default.
- W2401264332 hasRelatedWork W2097487180 @default.
- W2401264332 hasRelatedWork W2103715332 @default.
- W2401264332 hasRelatedWork W2112420033 @default.
- W2401264332 hasRelatedWork W2115519224 @default.
- W2401264332 hasRelatedWork W2119850747 @default.
- W2401264332 hasRelatedWork W2120090487 @default.
- W2401264332 hasRelatedWork W2123681024 @default.
- W2401264332 hasRelatedWork W2168405694 @default.
- W2401264332 hasRelatedWork W2268509491 @default.
- W2401264332 hasRelatedWork W2519411794 @default.
- W2401264332 hasRelatedWork W2950631210 @default.
- W2401264332 hasRelatedWork W50486269 @default.
- W2401264332 isParatext "false" @default.
- W2401264332 isRetracted "false" @default.
- W2401264332 magId "2401264332" @default.