Matches in SemOpenAlex for { <https://semopenalex.org/work/W185442395> ?p ?o ?g. }
- W185442395 abstract "Constrained Markov decision processes (MDPs) are MDPs optimizing an objective function while satisfying additional constraints. We study a class of infinite-horizon constrained MDPs with nonstationary problem data, finite state space, and discounted cost criterion. This problem can equivalently be formulated as a countably infinite linear program (CILP), i.e., a linear program (LP) with a countably infinite number of variables and constraints. Unlike finite LPs, CILPs can fail to satisfy useful theoretical properties such as duality, and to date there does not exist a general solution method for such problems. Specifically, the characterization of extreme points as basic feasible solutions in finite LPs does not extend to general CILPs. In this paper, we provide duality results and a complete characterization of extreme points of the CILP formulation of constrained nonstationary MDPs with finite state space, and illustrate the characterization for special cases. As a corollary, we obtain the existence of a K-randomized optimal policy, where K is the number of constraints." @default.
- W185442395 created "2016-06-24" @default.
- W185442395 creator A5004083650 @default.
- W185442395 creator A5013764577 @default.
- W185442395 creator A5024605078 @default.
- W185442395 creator A5030795316 @default.
- W185442395 date "2013-03-06" @default.
- W185442395 modified "2023-09-27" @default.
- W185442395 title "A linear programming approach to constrained nonstationary infinite-horizon Markov decision processes" @default.
- W185442395 cites W1494436834 @default.
- W185442395 cites W1515687042 @default.
- W185442395 cites W1518931405 @default.
- W185442395 cites W1593542532 @default.
- W185442395 cites W1973396645 @default.
- W185442395 cites W1979870779 @default.
- W185442395 cites W1980102442 @default.
- W185442395 cites W1988560007 @default.
- W185442395 cites W1991591460 @default.
- W185442395 cites W2001139238 @default.
- W185442395 cites W2047062244 @default.
- W185442395 cites W2047485015 @default.
- W185442395 cites W2052851812 @default.
- W185442395 cites W2083045496 @default.
- W185442395 cites W2123649906 @default.
- W185442395 cites W2127533431 @default.
- W185442395 cites W2155502195 @default.
- W185442395 cites W2165882932 @default.
- W185442395 cites W564963347 @default.
- W185442395 hasPublicationYear "2013" @default.
- W185442395 type Work @default.
- W185442395 sameAs 185442395 @default.
- W185442395 citedByCount "0" @default.
- W185442395 crossrefType "journal-article" @default.
- W185442395 hasAuthorship W185442395A5004083650 @default.
- W185442395 hasAuthorship W185442395A5013764577 @default.
- W185442395 hasAuthorship W185442395A5024605078 @default.
- W185442395 hasAuthorship W185442395A5030795316 @default.
- W185442395 hasConcept C105795698 @default.
- W185442395 hasConcept C106189395 @default.
- W185442395 hasConcept C118615104 @default.
- W185442395 hasConcept C126255220 @default.
- W185442395 hasConcept C134306372 @default.
- W185442395 hasConcept C154945302 @default.
- W185442395 hasConcept C159886148 @default.
- W185442395 hasConcept C162392398 @default.
- W185442395 hasConcept C171250308 @default.
- W185442395 hasConcept C192562407 @default.
- W185442395 hasConcept C2777212361 @default.
- W185442395 hasConcept C2778023678 @default.
- W185442395 hasConcept C2780012671 @default.
- W185442395 hasConcept C2780841128 @default.
- W185442395 hasConcept C28826006 @default.
- W185442395 hasConcept C33923547 @default.
- W185442395 hasConcept C41008148 @default.
- W185442395 hasConcept C41045048 @default.
- W185442395 hasConcept C72434380 @default.
- W185442395 hasConceptScore W185442395C105795698 @default.
- W185442395 hasConceptScore W185442395C106189395 @default.
- W185442395 hasConceptScore W185442395C118615104 @default.
- W185442395 hasConceptScore W185442395C126255220 @default.
- W185442395 hasConceptScore W185442395C134306372 @default.
- W185442395 hasConceptScore W185442395C154945302 @default.
- W185442395 hasConceptScore W185442395C159886148 @default.
- W185442395 hasConceptScore W185442395C162392398 @default.
- W185442395 hasConceptScore W185442395C171250308 @default.
- W185442395 hasConceptScore W185442395C192562407 @default.
- W185442395 hasConceptScore W185442395C2777212361 @default.
- W185442395 hasConceptScore W185442395C2778023678 @default.
- W185442395 hasConceptScore W185442395C2780012671 @default.
- W185442395 hasConceptScore W185442395C2780841128 @default.
- W185442395 hasConceptScore W185442395C28826006 @default.
- W185442395 hasConceptScore W185442395C33923547 @default.
- W185442395 hasConceptScore W185442395C41008148 @default.
- W185442395 hasConceptScore W185442395C41045048 @default.
- W185442395 hasConceptScore W185442395C72434380 @default.
- W185442395 hasLocation W1854423951 @default.
- W185442395 hasOpenAccess W185442395 @default.
- W185442395 hasPrimaryLocation W1854423951 @default.
- W185442395 hasRelatedWork W187740018 @default.
- W185442395 hasRelatedWork W1979882689 @default.
- W185442395 hasRelatedWork W1995828591 @default.
- W185442395 hasRelatedWork W2018547763 @default.
- W185442395 hasRelatedWork W2072495903 @default.
- W185442395 hasRelatedWork W2076661948 @default.
- W185442395 hasRelatedWork W207911197 @default.
- W185442395 hasRelatedWork W2126534522 @default.
- W185442395 hasRelatedWork W214691752 @default.
- W185442395 hasRelatedWork W2156021013 @default.
- W185442395 hasRelatedWork W2329023457 @default.
- W185442395 hasRelatedWork W2397872162 @default.
- W185442395 hasRelatedWork W2572605899 @default.
- W185442395 hasRelatedWork W2950872739 @default.
- W185442395 hasRelatedWork W2980952253 @default.
- W185442395 hasRelatedWork W3092690983 @default.
- W185442395 hasRelatedWork W3212676150 @default.
- W185442395 hasRelatedWork W5133103 @default.
- W185442395 hasRelatedWork W2160343662 @default.
- W185442395 hasRelatedWork W2180243668 @default.
- W185442395 isParatext "false" @default.
- W185442395 isRetracted "false" @default.