Matches in SemOpenAlex for { <https://semopenalex.org/work/W1553182805> ?p ?o ?g. }
- W1553182805 endingPage "131" @default.
- W1553182805 startingPage "124" @default.
- W1553182805 abstract "We present a method for solving implicit (factored) Markov decision processes (MDPs) with very large state spaces. We introduce a property of state space partitions which we call e-homogeneity. Intuitively, an e-homogeneous partition groups together states that behave the same under all or some subset of policies. Borrowing from recent work on model minimization in computer-aided software verification, we present an algorithm that takes a factored representation of an and an 0 ≤ e ≤ 1 and computes a factored e-homogeneous partition of the state space.This partition defines a family of related MDPs--those MDP's with state space equal to the blocks of the partition, and transition probabilities approximately like those of any (original MDP) state in the source block. To formally study such families of MDPs, we introduce the new notion of a bounded parameter MDP (BMDP), which is a family of (traditional) MDPs defined by specifying upper and lower bounds on the transition probabilities and rewards. We describe algorithms that operate on BMDPs to find policies that are optimal with respect to the original MDP.In combination, our method for reducing a large implicit to a possibly much smaller BMDP using an e-homogeneous partition, and our methods for selecting actions in BMDP's constitute a new approach for analyzing large implicit MDP's. Among its advantages, this new approach provides insight into existing algorithms to solving implicit MDPs, provides useful connections to work in automata theory and model minimization, and suggests methods, which involve varying e, to trade time and space (specifically in terms of the size of the corresponding state space) for solution quality." @default.
- W1553182805 created "2016-06-24" @default.
- W1553182805 creator A5007751369 @default.
- W1553182805 creator A5041931115 @default.
- W1553182805 creator A5088683816 @default.
- W1553182805 date "1997-08-01" @default.
- W1553182805 modified "2023-09-25" @default.
- W1553182805 title "Model reduction techniques for computing approximately optimal solutions for Markov decision processes" @default.
- W1553182805 cites W151521611 @default.
- W1553182805 cites W1566007944 @default.
- W1553182805 cites W1608119595 @default.
- W1553182805 cites W1650504995 @default.
- W1553182805 cites W1688218840 @default.
- W1553182805 cites W1993711637 @default.
- W1553182805 cites W2016079448 @default.
- W1553182805 cites W2020294948 @default.
- W1553182805 cites W2028145673 @default.
- W1553182805 cites W2054726834 @default.
- W1553182805 cites W2071152819 @default.
- W1553182805 cites W2099120582 @default.
- W1553182805 cites W2101167844 @default.
- W1553182805 cites W2121723232 @default.
- W1553182805 cites W2159080219 @default.
- W1553182805 cites W2160805324 @default.
- W1553182805 cites W2323009482 @default.
- W1553182805 cites W2334782222 @default.
- W1553182805 cites W2341171179 @default.
- W1553182805 hasPublicationYear "1997" @default.
- W1553182805 type Work @default.
- W1553182805 sameAs 1553182805 @default.
- W1553182805 citedByCount "73" @default.
- W1553182805 countsByYear W15531828052012 @default.
- W1553182805 countsByYear W15531828052013 @default.
- W1553182805 countsByYear W15531828052014 @default.
- W1553182805 countsByYear W15531828052016 @default.
- W1553182805 countsByYear W15531828052017 @default.
- W1553182805 countsByYear W15531828052018 @default.
- W1553182805 countsByYear W15531828052019 @default.
- W1553182805 countsByYear W15531828052020 @default.
- W1553182805 countsByYear W15531828052021 @default.
- W1553182805 crossrefType "proceedings-article" @default.
- W1553182805 hasAuthorship W1553182805A5007751369 @default.
- W1553182805 hasAuthorship W1553182805A5041931115 @default.
- W1553182805 hasAuthorship W1553182805A5088683816 @default.
- W1553182805 hasConcept C105795698 @default.
- W1553182805 hasConcept C106189395 @default.
- W1553182805 hasConcept C110251889 @default.
- W1553182805 hasConcept C11413529 @default.
- W1553182805 hasConcept C114614502 @default.
- W1553182805 hasConcept C119857082 @default.
- W1553182805 hasConcept C126255220 @default.
- W1553182805 hasConcept C134306372 @default.
- W1553182805 hasConcept C159886148 @default.
- W1553182805 hasConcept C33923547 @default.
- W1553182805 hasConcept C34388435 @default.
- W1553182805 hasConcept C41008148 @default.
- W1553182805 hasConcept C42812 @default.
- W1553182805 hasConcept C72434380 @default.
- W1553182805 hasConcept C80444323 @default.
- W1553182805 hasConcept C98763669 @default.
- W1553182805 hasConceptScore W1553182805C105795698 @default.
- W1553182805 hasConceptScore W1553182805C106189395 @default.
- W1553182805 hasConceptScore W1553182805C110251889 @default.
- W1553182805 hasConceptScore W1553182805C11413529 @default.
- W1553182805 hasConceptScore W1553182805C114614502 @default.
- W1553182805 hasConceptScore W1553182805C119857082 @default.
- W1553182805 hasConceptScore W1553182805C126255220 @default.
- W1553182805 hasConceptScore W1553182805C134306372 @default.
- W1553182805 hasConceptScore W1553182805C159886148 @default.
- W1553182805 hasConceptScore W1553182805C33923547 @default.
- W1553182805 hasConceptScore W1553182805C34388435 @default.
- W1553182805 hasConceptScore W1553182805C41008148 @default.
- W1553182805 hasConceptScore W1553182805C42812 @default.
- W1553182805 hasConceptScore W1553182805C72434380 @default.
- W1553182805 hasConceptScore W1553182805C80444323 @default.
- W1553182805 hasConceptScore W1553182805C98763669 @default.
- W1553182805 hasLocation W15531828051 @default.
- W1553182805 hasOpenAccess W1553182805 @default.
- W1553182805 hasPrimaryLocation W15531828051 @default.
- W1553182805 hasRelatedWork W1530444831 @default.
- W1553182805 hasRelatedWork W1576452626 @default.
- W1553182805 hasRelatedWork W1650504995 @default.
- W1553182805 hasRelatedWork W1688218840 @default.
- W1553182805 hasRelatedWork W1988217924 @default.
- W1553182805 hasRelatedWork W1997477668 @default.
- W1553182805 hasRelatedWork W2020294948 @default.
- W1553182805 hasRelatedWork W2058735307 @default.
- W1553182805 hasRelatedWork W2061504687 @default.
- W1553182805 hasRelatedWork W2101167844 @default.
- W1553182805 hasRelatedWork W2107726111 @default.
- W1553182805 hasRelatedWork W2109910161 @default.
- W1553182805 hasRelatedWork W2118022839 @default.
- W1553182805 hasRelatedWork W2119567691 @default.
- W1553182805 hasRelatedWork W2121517924 @default.
- W1553182805 hasRelatedWork W2121863487 @default.
- W1553182805 hasRelatedWork W2334782222 @default.
- W1553182805 hasRelatedWork W2341171179 @default.
- W1553182805 hasRelatedWork W2397240726 @default.