Matches in SemOpenAlex for { <https://semopenalex.org/work/W2003308588> ?p ?o ?g. }
- W2003308588 endingPage "45" @default.
- W2003308588 startingPage "27" @default.
- W2003308588 abstract "This paper develops an a.s. convergence theory for a class of projected stochastic approximations driven by finite-state Markov chains. The conditions are mild and are given explicitly in terms of the model data, mainly the Lipschitz continuity of the one-step transition probabilities. The approach used here is a version of the ODE method as proposed by Métivier and Priouret. It combines the Kushner-Clark Lemma with properties of the Poisson equation associated with the underlying family of Markov chains. The class of algorithms studied here was motivated by implementation issues for constrained Markov decision problems, where the policies of interest often depend on quantities not readily available due either to insufficient knowledge of the model parameters or to computational difficulties. This naturally leads to the on-line estimation (or computation) problem investigated here. Several examples from the area of queueing systems are discussed." @default.
- W2003308588 created "2016-06-24" @default.
- W2003308588 creator A5008351529 @default.
- W2003308588 creator A5037696481 @default.
- W2003308588 creator A5060530181 @default.
- W2003308588 date "1990-06-01" @default.
- W2003308588 modified "2023-10-17" @default.
- W2003308588 title "Stochastic approximations for finite-state Markov chains" @default.
- W2003308588 cites W1979870779 @default.
- W2003308588 cites W1994616650 @default.
- W2003308588 cites W1997020095 @default.
- W2003308588 cites W2004964364 @default.
- W2003308588 cites W2007854530 @default.
- W2003308588 cites W2045334340 @default.
- W2003308588 cites W2054860096 @default.
- W2003308588 cites W2083045496 @default.
- W2003308588 cites W2102753660 @default.
- W2003308588 cites W2158941555 @default.
- W2003308588 cites W2165882932 @default.
- W2003308588 cites W2320680700 @default.
- W2003308588 cites W2331002104 @default.
- W2003308588 doi "https://doi.org/10.1016/0304-4149(90)90120-h" @default.
- W2003308588 hasPublicationYear "1990" @default.
- W2003308588 type Work @default.
- W2003308588 sameAs 2003308588 @default.
- W2003308588 citedByCount "28" @default.
- W2003308588 countsByYear W20033085882012 @default.
- W2003308588 countsByYear W20033085882015 @default.
- W2003308588 countsByYear W20033085882016 @default.
- W2003308588 countsByYear W20033085882017 @default.
- W2003308588 countsByYear W20033085882018 @default.
- W2003308588 countsByYear W20033085882020 @default.
- W2003308588 countsByYear W20033085882021 @default.
- W2003308588 countsByYear W20033085882022 @default.
- W2003308588 crossrefType "journal-article" @default.
- W2003308588 hasAuthorship W2003308588A5008351529 @default.
- W2003308588 hasAuthorship W2003308588A5037696481 @default.
- W2003308588 hasAuthorship W2003308588A5060530181 @default.
- W2003308588 hasBestOaLocation W20033085882 @default.
- W2003308588 hasConcept C105795698 @default.
- W2003308588 hasConcept C106189395 @default.
- W2003308588 hasConcept C106666656 @default.
- W2003308588 hasConcept C11413529 @default.
- W2003308588 hasConcept C126255220 @default.
- W2003308588 hasConcept C134306372 @default.
- W2003308588 hasConcept C154945302 @default.
- W2003308588 hasConcept C159886148 @default.
- W2003308588 hasConcept C162324750 @default.
- W2003308588 hasConcept C163836022 @default.
- W2003308588 hasConcept C18903297 @default.
- W2003308588 hasConcept C22324862 @default.
- W2003308588 hasConcept C2777212361 @default.
- W2003308588 hasConcept C2777303404 @default.
- W2003308588 hasConcept C2777759810 @default.
- W2003308588 hasConcept C28826006 @default.
- W2003308588 hasConcept C33923547 @default.
- W2003308588 hasConcept C34862557 @default.
- W2003308588 hasConcept C41008148 @default.
- W2003308588 hasConcept C45374587 @default.
- W2003308588 hasConcept C46757340 @default.
- W2003308588 hasConcept C50522688 @default.
- W2003308588 hasConcept C54907487 @default.
- W2003308588 hasConcept C86803240 @default.
- W2003308588 hasConcept C98763669 @default.
- W2003308588 hasConceptScore W2003308588C105795698 @default.
- W2003308588 hasConceptScore W2003308588C106189395 @default.
- W2003308588 hasConceptScore W2003308588C106666656 @default.
- W2003308588 hasConceptScore W2003308588C11413529 @default.
- W2003308588 hasConceptScore W2003308588C126255220 @default.
- W2003308588 hasConceptScore W2003308588C134306372 @default.
- W2003308588 hasConceptScore W2003308588C154945302 @default.
- W2003308588 hasConceptScore W2003308588C159886148 @default.
- W2003308588 hasConceptScore W2003308588C162324750 @default.
- W2003308588 hasConceptScore W2003308588C163836022 @default.
- W2003308588 hasConceptScore W2003308588C18903297 @default.
- W2003308588 hasConceptScore W2003308588C22324862 @default.
- W2003308588 hasConceptScore W2003308588C2777212361 @default.
- W2003308588 hasConceptScore W2003308588C2777303404 @default.
- W2003308588 hasConceptScore W2003308588C2777759810 @default.
- W2003308588 hasConceptScore W2003308588C28826006 @default.
- W2003308588 hasConceptScore W2003308588C33923547 @default.
- W2003308588 hasConceptScore W2003308588C34862557 @default.
- W2003308588 hasConceptScore W2003308588C41008148 @default.
- W2003308588 hasConceptScore W2003308588C45374587 @default.
- W2003308588 hasConceptScore W2003308588C46757340 @default.
- W2003308588 hasConceptScore W2003308588C50522688 @default.
- W2003308588 hasConceptScore W2003308588C54907487 @default.
- W2003308588 hasConceptScore W2003308588C86803240 @default.
- W2003308588 hasConceptScore W2003308588C98763669 @default.
- W2003308588 hasIssue "1" @default.
- W2003308588 hasLocation W20033085881 @default.
- W2003308588 hasLocation W20033085882 @default.
- W2003308588 hasLocation W20033085883 @default.
- W2003308588 hasOpenAccess W2003308588 @default.
- W2003308588 hasPrimaryLocation W20033085881 @default.
- W2003308588 hasRelatedWork W1505355523 @default.
- W2003308588 hasRelatedWork W1551379884 @default.
- W2003308588 hasRelatedWork W2003308588 @default.