Matches in SemOpenAlex for { <https://semopenalex.org/work/W2198341036> ?p ?o ?g. }
- W2198341036 endingPage "637" @default.
- W2198341036 startingPage "632" @default.
- W2198341036 abstract "The Partially Observable Markov Decision Process (POMDP) provides a rich mathematical model for designing agents that have to formulate plans under uncertainty. The curses of dimensionality and history associated with solving POMDPs have lead to numerous refinements of the value iteration algorithm. Several exact methods with different pruning strategies have been devised, yet, limited scalability has lead research to focus on ways to approximate the optimal value function. One set of approximations relies on point-based value iteration, which maintains a fixed-size value function, and is typically executed offline. Another set of approximations relies on tree search, which explores the implicit tree defined by the value iteration equation, and is typically executed online. In this paper we present a hybrid value iteration algorithm that combines the benefits of point-based value iteration and tree search. Using our approach, a hybrid agent executes tree search online, and occasionally updates its offline-computed lower bound on the optimal value function, resulting in improved lookahead and higher obtained reward, while meeting real-time constraints. Thus, unlike other hybrid algorithms that use an invariant value function computed offline, our proposed scheme uses information from the real-time tree search process to reason whether to perform a point-based backup online. Keeping track of partial results obtained during online planning makes the computation of point-based backups less prohibitive. We report preliminary results that support our approach." @default.
- W2198341036 created "2016-06-24" @default.
- W2198341036 creator A5026822519 @default.
- W2198341036 creator A5031621026 @default.
- W2198341036 date "2011-03-21" @default.
- W2198341036 modified "2023-09-24" @default.
- W2198341036 title "Hybrid value iteration for POMDPs" @default.
- W2198341036 cites W1484113995 @default.
- W2198341036 cites W1491973539 @default.
- W2198341036 cites W1494689917 @default.
- W2198341036 cites W1498235675 @default.
- W2198341036 cites W1532688806 @default.
- W2198341036 cites W1539216098 @default.
- W2198341036 cites W158205031 @default.
- W2198341036 cites W2034725503 @default.
- W2198341036 cites W2061226732 @default.
- W2198341036 cites W2101984404 @default.
- W2198341036 cites W2144913588 @default.
- W2198341036 cites W2168359464 @default.
- W2198341036 cites W2169294731 @default.
- W2198341036 cites W2287282975 @default.
- W2198341036 cites W90673796 @default.
- W2198341036 hasPublicationYear "2011" @default.
- W2198341036 type Work @default.
- W2198341036 sameAs 2198341036 @default.
- W2198341036 citedByCount "3" @default.
- W2198341036 countsByYear W21983410362013 @default.
- W2198341036 countsByYear W21983410362014 @default.
- W2198341036 countsByYear W21983410362017 @default.
- W2198341036 crossrefType "proceedings-article" @default.
- W2198341036 hasAuthorship W2198341036A5026822519 @default.
- W2198341036 hasAuthorship W2198341036A5031621026 @default.
- W2198341036 hasConcept C105795698 @default.
- W2198341036 hasConcept C106189395 @default.
- W2198341036 hasConcept C108010975 @default.
- W2198341036 hasConcept C111030470 @default.
- W2198341036 hasConcept C113174947 @default.
- W2198341036 hasConcept C11413529 @default.
- W2198341036 hasConcept C119857082 @default.
- W2198341036 hasConcept C126255220 @default.
- W2198341036 hasConcept C134306372 @default.
- W2198341036 hasConcept C14036430 @default.
- W2198341036 hasConcept C14646407 @default.
- W2198341036 hasConcept C154945302 @default.
- W2198341036 hasConcept C159886148 @default.
- W2198341036 hasConcept C163836022 @default.
- W2198341036 hasConcept C17098449 @default.
- W2198341036 hasConcept C33923547 @default.
- W2198341036 hasConcept C41008148 @default.
- W2198341036 hasConcept C48044578 @default.
- W2198341036 hasConcept C6557445 @default.
- W2198341036 hasConcept C77088390 @default.
- W2198341036 hasConcept C78458016 @default.
- W2198341036 hasConcept C86803240 @default.
- W2198341036 hasConcept C98763669 @default.
- W2198341036 hasConceptScore W2198341036C105795698 @default.
- W2198341036 hasConceptScore W2198341036C106189395 @default.
- W2198341036 hasConceptScore W2198341036C108010975 @default.
- W2198341036 hasConceptScore W2198341036C111030470 @default.
- W2198341036 hasConceptScore W2198341036C113174947 @default.
- W2198341036 hasConceptScore W2198341036C11413529 @default.
- W2198341036 hasConceptScore W2198341036C119857082 @default.
- W2198341036 hasConceptScore W2198341036C126255220 @default.
- W2198341036 hasConceptScore W2198341036C134306372 @default.
- W2198341036 hasConceptScore W2198341036C14036430 @default.
- W2198341036 hasConceptScore W2198341036C14646407 @default.
- W2198341036 hasConceptScore W2198341036C154945302 @default.
- W2198341036 hasConceptScore W2198341036C159886148 @default.
- W2198341036 hasConceptScore W2198341036C163836022 @default.
- W2198341036 hasConceptScore W2198341036C17098449 @default.
- W2198341036 hasConceptScore W2198341036C33923547 @default.
- W2198341036 hasConceptScore W2198341036C41008148 @default.
- W2198341036 hasConceptScore W2198341036C48044578 @default.
- W2198341036 hasConceptScore W2198341036C6557445 @default.
- W2198341036 hasConceptScore W2198341036C77088390 @default.
- W2198341036 hasConceptScore W2198341036C78458016 @default.
- W2198341036 hasConceptScore W2198341036C86803240 @default.
- W2198341036 hasConceptScore W2198341036C98763669 @default.
- W2198341036 hasLocation W21983410361 @default.
- W2198341036 hasOpenAccess W2198341036 @default.
- W2198341036 hasPrimaryLocation W21983410361 @default.
- W2198341036 hasRelatedWork W1521795138 @default.
- W2198341036 hasRelatedWork W1533557532 @default.
- W2198341036 hasRelatedWork W1570678512 @default.
- W2198341036 hasRelatedWork W1591479894 @default.
- W2198341036 hasRelatedWork W1864118766 @default.
- W2198341036 hasRelatedWork W2143031849 @default.
- W2198341036 hasRelatedWork W2295037001 @default.
- W2198341036 hasRelatedWork W2366275748 @default.
- W2198341036 hasRelatedWork W2517422952 @default.
- W2198341036 hasRelatedWork W2547176509 @default.
- W2198341036 hasRelatedWork W2579288433 @default.
- W2198341036 hasRelatedWork W2735021239 @default.
- W2198341036 hasRelatedWork W2769602321 @default.
- W2198341036 hasRelatedWork W2913902948 @default.
- W2198341036 hasRelatedWork W2963889160 @default.
- W2198341036 hasRelatedWork W2983787646 @default.
- W2198341036 hasRelatedWork W2988846212 @default.