Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385707941> ?p ?o ?g. }
Showing items 1 to 72 of
72
with 100 items per page.
- W4385707941 abstract "We consider the classic stochastic multiarmed bandit problem with a constraint that limits the total cost incurred by switching between actions to be no larger than a given switching budget. For this problem, we prove matching upper and lower bounds on the optimal (i.e., minimax) regret and provide efficient rate-optimal algorithms. Surprisingly, the optimal regret of this problem exhibits a nonconventional growth rate in terms of the time horizon and the number of arms. Consequently, we discover surprising “phase transitions” regarding how the optimal regret rate changes with respect to the switching budget: when the number of arms is fixed, there are equal-length phases, in which the optimal regret rate remains (almost) the same within each phase and exhibits abrupt changes between phases; when the number of arms grows with the time horizon, such abrupt changes become subtler and may disappear, but a generalized notion of phase transitions involving certain new measurements still exists. The results enable us to fully characterize the trade-off between the regret rate and the incurred switching cost in the stochastic multiarmed bandit problem, contributing new insights to this fundamental problem. Under the general switching cost structure, the results reveal interesting connections between bandit problems and graph traversal problems, such as the shortest Hamiltonian path problem. This paper was accepted by J. George Shanthikumar, data science. Supplemental Material: The online appendix and data are available at https://doi.org/10.1287/mnsc.2023.4755 ." @default.
- W4385707941 created "2023-08-10" @default.
- W4385707941 creator A5071385934 @default.
- W4385707941 creator A5078130712 @default.
- W4385707941 date "2023-08-09" @default.
- W4385707941 modified "2023-09-26" @default.
- W4385707941 title "Phase Transitions in Bandits with Switching Constraints" @default.
- W4385707941 cites W1958090791 @default.
- W4385707941 cites W1970041563 @default.
- W4385707941 cites W1973476981 @default.
- W4385707941 cites W1995017317 @default.
- W4385707941 cites W2009551863 @default.
- W4385707941 cites W2017413905 @default.
- W4385707941 cites W2021622496 @default.
- W4385707941 cites W2023954497 @default.
- W4385707941 cites W2067038358 @default.
- W4385707941 cites W2076313409 @default.
- W4385707941 cites W2119840952 @default.
- W4385707941 cites W2127300249 @default.
- W4385707941 cites W2128421120 @default.
- W4385707941 cites W2165607537 @default.
- W4385707941 cites W2168405694 @default.
- W4385707941 cites W2168709337 @default.
- W4385707941 cites W2740158290 @default.
- W4385707941 cites W2901560753 @default.
- W4385707941 cites W2963137451 @default.
- W4385707941 cites W2972989214 @default.
- W4385707941 cites W3085291675 @default.
- W4385707941 cites W3088838138 @default.
- W4385707941 cites W3123482145 @default.
- W4385707941 cites W4206530644 @default.
- W4385707941 doi "https://doi.org/10.1287/mnsc.2023.4755" @default.
- W4385707941 hasPublicationYear "2023" @default.
- W4385707941 type Work @default.
- W4385707941 citedByCount "0" @default.
- W4385707941 crossrefType "journal-article" @default.
- W4385707941 hasAuthorship W4385707941A5071385934 @default.
- W4385707941 hasAuthorship W4385707941A5078130712 @default.
- W4385707941 hasBestOaLocation W43857079412 @default.
- W4385707941 hasConcept C119857082 @default.
- W4385707941 hasConcept C126255220 @default.
- W4385707941 hasConcept C144237770 @default.
- W4385707941 hasConcept C149728462 @default.
- W4385707941 hasConcept C28761237 @default.
- W4385707941 hasConcept C33923547 @default.
- W4385707941 hasConcept C41008148 @default.
- W4385707941 hasConcept C50817715 @default.
- W4385707941 hasConceptScore W4385707941C119857082 @default.
- W4385707941 hasConceptScore W4385707941C126255220 @default.
- W4385707941 hasConceptScore W4385707941C144237770 @default.
- W4385707941 hasConceptScore W4385707941C149728462 @default.
- W4385707941 hasConceptScore W4385707941C28761237 @default.
- W4385707941 hasConceptScore W4385707941C33923547 @default.
- W4385707941 hasConceptScore W4385707941C41008148 @default.
- W4385707941 hasConceptScore W4385707941C50817715 @default.
- W4385707941 hasLocation W43857079411 @default.
- W4385707941 hasLocation W43857079412 @default.
- W4385707941 hasOpenAccess W4385707941 @default.
- W4385707941 hasPrimaryLocation W43857079411 @default.
- W4385707941 hasRelatedWork W1841788933 @default.
- W4385707941 hasRelatedWork W2025490963 @default.
- W4385707941 hasRelatedWork W2126742889 @default.
- W4385707941 hasRelatedWork W3111617249 @default.
- W4385707941 hasRelatedWork W3123181337 @default.
- W4385707941 hasRelatedWork W3176362036 @default.
- W4385707941 hasRelatedWork W3211773207 @default.
- W4385707941 hasRelatedWork W4287555357 @default.
- W4385707941 hasRelatedWork W93304149 @default.
- W4385707941 hasRelatedWork W2051523430 @default.
- W4385707941 isParatext "false" @default.
- W4385707941 isRetracted "false" @default.
- W4385707941 workType "article" @default.