FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3025159743> ?p ?o ?g. }

• W3025159743 abstract "In this paper, we consider a multi-armed bandit in which each arm is a Markov process evolving on a finite state space. The state space is common across the arms, and the arms are independent of each other. The transition probability matrix of one of the arms (the odd arm) is different from the common transition probability matrix of all the other arms. A decision maker, who knows these transition probability matrices, wishes to identify the odd arm as quickly as possible, while keeping the probability of decision error small. To do so, the decision maker collects observations from the arms by pulling the arms in a sequential manner, one at each discrete time instant. However, the decision maker has a trembling hand, and the arm that is actually pulled at any given time differs, with a small probability, from the one he intended to pull. The observation at any given time is the arm that is actually pulled and its current state. The Markov processes of the unobserved arms continue to evolve. This makes the arms restless. For the above setting, we derive the first known asymptotic lower bound on the expected time required to identify the odd arm, where the asymptotics is of vanishing error probability. The continued evolution of each arm adds a new dimension to the problem, leading to a family of Markov decision problems (MDPs) on a countable state space. We then stitch together certain parameterised solutions to these MDPs and obtain a sequence of strategies whose expected times to identify the odd arm come arbitrarily close to the lower bound in the regime of vanishing error probability. Prior works dealt with independent and identically distributed (across time) arms and rested Markov arms, whereas our work deals with restless Markov arms." @default.
• W3025159743 created "2020-05-21" @default.
• W3025159743 creator A5052907722 @default.
• W3025159743 creator A5065705720 @default.
• W3025159743 date "2020-05-13" @default.
• W3025159743 modified "2023-10-16" @default.
• W3025159743 title "Detecting an Odd Restless Markov Arm with a Trembling Hand" @default.
• W3025159743 cites W1506859583 @default.
• W3025159743 cites W1600293573 @default.
• W3025159743 cites W1932033405 @default.
• W3025159743 cites W1971031270 @default.
• W3025159743 cites W1994757874 @default.
• W3025159743 cites W2001839774 @default.
• W3025159743 cites W2056921512 @default.
• W3025159743 cites W2108794978 @default.
• W3025159743 cites W2119567691 @default.
• W3025159743 cites W2129462326 @default.
• W3025159743 cites W2150328967 @default.
• W3025159743 cites W2168405694 @default.
• W3025159743 cites W2170341113 @default.
• W3025159743 cites W2171671264 @default.
• W3025159743 cites W2805824795 @default.
• W3025159743 cites W2918531990 @default.
• W3025159743 cites W2952099252 @default.
• W3025159743 cites W2963123428 @default.
• W3025159743 cites W2964046421 @default.
• W3025159743 cites W2964198003 @default.
• W3025159743 cites W2971177868 @default.
• W3025159743 cites W2982216380 @default.
• W3025159743 cites W3006008293 @default.
• W3025159743 cites W3022217175 @default.
• W3025159743 cites W3044446985 @default.
• W3025159743 cites W3125634603 @default.
• W3025159743 doi "https://doi.org/10.48550/arxiv.2005.06255" @default.
• W3025159743 hasPublicationYear "2020" @default.
• W3025159743 type Work @default.
• W3025159743 sameAs 3025159743 @default.
• W3025159743 citedByCount "0" @default.
• W3025159743 crossrefType "posted-content" @default.
• W3025159743 hasAuthorship W3025159743A5052907722 @default.
• W3025159743 hasAuthorship W3025159743A5065705720 @default.
• W3025159743 hasBestOaLocation W30251597431 @default.
• W3025159743 hasConcept C105795698 @default.
• W3025159743 hasConcept C106189395 @default.
• W3025159743 hasConcept C106487976 @default.
• W3025159743 hasConcept C111919701 @default.
• W3025159743 hasConcept C11413529 @default.
• W3025159743 hasConcept C114614502 @default.
• W3025159743 hasConcept C159886148 @default.
• W3025159743 hasConcept C159985019 @default.
• W3025159743 hasConcept C192562407 @default.
• W3025159743 hasConcept C2778112365 @default.
• W3025159743 hasConcept C2778572836 @default.
• W3025159743 hasConcept C33676613 @default.
• W3025159743 hasConcept C33923547 @default.
• W3025159743 hasConcept C41008148 @default.
• W3025159743 hasConcept C48103436 @default.
• W3025159743 hasConcept C49555168 @default.
• W3025159743 hasConcept C54355233 @default.
• W3025159743 hasConcept C72434380 @default.
• W3025159743 hasConcept C86803240 @default.
• W3025159743 hasConcept C98763669 @default.
• W3025159743 hasConceptScore W3025159743C105795698 @default.
• W3025159743 hasConceptScore W3025159743C106189395 @default.
• W3025159743 hasConceptScore W3025159743C106487976 @default.
• W3025159743 hasConceptScore W3025159743C111919701 @default.
• W3025159743 hasConceptScore W3025159743C11413529 @default.
• W3025159743 hasConceptScore W3025159743C114614502 @default.
• W3025159743 hasConceptScore W3025159743C159886148 @default.
• W3025159743 hasConceptScore W3025159743C159985019 @default.
• W3025159743 hasConceptScore W3025159743C192562407 @default.
• W3025159743 hasConceptScore W3025159743C2778112365 @default.
• W3025159743 hasConceptScore W3025159743C2778572836 @default.
• W3025159743 hasConceptScore W3025159743C33676613 @default.
• W3025159743 hasConceptScore W3025159743C33923547 @default.
• W3025159743 hasConceptScore W3025159743C41008148 @default.
• W3025159743 hasConceptScore W3025159743C48103436 @default.
• W3025159743 hasConceptScore W3025159743C49555168 @default.
• W3025159743 hasConceptScore W3025159743C54355233 @default.
• W3025159743 hasConceptScore W3025159743C72434380 @default.
• W3025159743 hasConceptScore W3025159743C86803240 @default.
• W3025159743 hasConceptScore W3025159743C98763669 @default.
• W3025159743 hasLocation W30251597431 @default.
• W3025159743 hasOpenAccess W3025159743 @default.
• W3025159743 hasPrimaryLocation W30251597431 @default.
• W3025159743 hasRelatedWork W1965382857 @default.
• W3025159743 hasRelatedWork W2016503522 @default.
• W3025159743 hasRelatedWork W2117282672 @default.
• W3025159743 hasRelatedWork W2313728779 @default.
• W3025159743 hasRelatedWork W2314068453 @default.
• W3025159743 hasRelatedWork W2331988240 @default.
• W3025159743 hasRelatedWork W4235334478 @default.
• W3025159743 hasRelatedWork W4244281465 @default.
• W3025159743 hasRelatedWork W4246015605 @default.
• W3025159743 hasRelatedWork W627086943 @default.
• W3025159743 isParatext "false" @default.
• W3025159743 isRetracted "false" @default.
• W3025159743 magId "3025159743" @default.
• W3025159743 workType "article" @default.