Matches in SemOpenAlex for { <https://semopenalex.org/work/W2476491844> ?p ?o ?g. }
Showing items 1 to 90 of
90
with 100 items per page.
- W2476491844 endingPage "1247" @default.
- W2476491844 startingPage "1222" @default.
- W2476491844 abstract "Quasi-open-loop policies consist of sequences of Markovian decision rules that are insensitive to one component of the state space. Given a semi-Markov decision process (SMDP), we distinguish between exogenous and endogenous state components as follows: (i) the decision-maker’s actions do not impact the evolution of an exogenous state component, and (ii) between consecutive decision epochs, the exogenous and endogenous state components are conditionally independent given the decision-maker’s latest action. For simplicity, we consider an SMDP with one exogenous and one endogenous state component. When transition times between epochs are conditionally independent of the exogenous state given the most recent action, and the exogenous component is a multiplicative compound Poisson process, we provide an almost-everywhere condition on the reward function sufficient for the optimality of a quasi-open-loop policy. After adjusting the discount factor to account for the statistical properties of the exogenous state process, obtaining this policy amounts to solving a reduced SMDP in which the exogenous state is static. Depending on the relationship between the structure of the exogenous state process and the shape of the reward function, we can replace the almost-everywhere condition with one that applies only in expectation. Quasi-open-loop optimality holds even if the times between decision epochs depend on the Poisson process underlying the exogenous state component, and/or the Poisson process is replaced with a generic counting process." @default.
- W2476491844 created "2016-08-23" @default.
- W2476491844 creator A5013221361 @default.
- W2476491844 creator A5016025574 @default.
- W2476491844 date "2016-11-01" @default.
- W2476491844 modified "2023-09-24" @default.
- W2476491844 title "Optimality of Quasi-Open-Loop Policies for Discounted Semi-Markov Decision Processes" @default.
- W2476491844 cites W1966386359 @default.
- W2476491844 cites W1973515330 @default.
- W2476491844 cites W1985315411 @default.
- W2476491844 cites W2010654234 @default.
- W2476491844 cites W2023072134 @default.
- W2476491844 cites W2031417855 @default.
- W2476491844 cites W2051245359 @default.
- W2476491844 cites W2106014125 @default.
- W2476491844 cites W2111021828 @default.
- W2476491844 cites W2122658534 @default.
- W2476491844 cites W2131081003 @default.
- W2476491844 cites W2136768128 @default.
- W2476491844 cites W2147695137 @default.
- W2476491844 cites W2149968347 @default.
- W2476491844 cites W2329686829 @default.
- W2476491844 cites W2521873792 @default.
- W2476491844 cites W2802739963 @default.
- W2476491844 cites W3121240870 @default.
- W2476491844 cites W3121917333 @default.
- W2476491844 cites W4241198186 @default.
- W2476491844 doi "https://doi.org/10.1287/moor.2015.0775" @default.
- W2476491844 hasPublicationYear "2016" @default.
- W2476491844 type Work @default.
- W2476491844 sameAs 2476491844 @default.
- W2476491844 citedByCount "5" @default.
- W2476491844 countsByYear W24764918442016 @default.
- W2476491844 countsByYear W24764918442019 @default.
- W2476491844 countsByYear W24764918442020 @default.
- W2476491844 countsByYear W24764918442023 @default.
- W2476491844 crossrefType "journal-article" @default.
- W2476491844 hasAuthorship W2476491844A5013221361 @default.
- W2476491844 hasAuthorship W2476491844A5016025574 @default.
- W2476491844 hasConcept C105795698 @default.
- W2476491844 hasConcept C106189395 @default.
- W2476491844 hasConcept C11413529 @default.
- W2476491844 hasConcept C121332964 @default.
- W2476491844 hasConcept C126255220 @default.
- W2476491844 hasConcept C134306372 @default.
- W2476491844 hasConcept C144237770 @default.
- W2476491844 hasConcept C159886148 @default.
- W2476491844 hasConcept C168167062 @default.
- W2476491844 hasConcept C33923547 @default.
- W2476491844 hasConcept C42747912 @default.
- W2476491844 hasConcept C48103436 @default.
- W2476491844 hasConcept C72434380 @default.
- W2476491844 hasConcept C84839998 @default.
- W2476491844 hasConcept C97355855 @default.
- W2476491844 hasConceptScore W2476491844C105795698 @default.
- W2476491844 hasConceptScore W2476491844C106189395 @default.
- W2476491844 hasConceptScore W2476491844C11413529 @default.
- W2476491844 hasConceptScore W2476491844C121332964 @default.
- W2476491844 hasConceptScore W2476491844C126255220 @default.
- W2476491844 hasConceptScore W2476491844C134306372 @default.
- W2476491844 hasConceptScore W2476491844C144237770 @default.
- W2476491844 hasConceptScore W2476491844C159886148 @default.
- W2476491844 hasConceptScore W2476491844C168167062 @default.
- W2476491844 hasConceptScore W2476491844C33923547 @default.
- W2476491844 hasConceptScore W2476491844C42747912 @default.
- W2476491844 hasConceptScore W2476491844C48103436 @default.
- W2476491844 hasConceptScore W2476491844C72434380 @default.
- W2476491844 hasConceptScore W2476491844C84839998 @default.
- W2476491844 hasConceptScore W2476491844C97355855 @default.
- W2476491844 hasIssue "4" @default.
- W2476491844 hasLocation W24764918441 @default.
- W2476491844 hasOpenAccess W2476491844 @default.
- W2476491844 hasPrimaryLocation W24764918441 @default.
- W2476491844 hasRelatedWork W1969719302 @default.
- W2476491844 hasRelatedWork W1973492905 @default.
- W2476491844 hasRelatedWork W1996326480 @default.
- W2476491844 hasRelatedWork W2002454365 @default.
- W2476491844 hasRelatedWork W2034589494 @default.
- W2476491844 hasRelatedWork W2126300853 @default.
- W2476491844 hasRelatedWork W2133764300 @default.
- W2476491844 hasRelatedWork W2149476049 @default.
- W2476491844 hasRelatedWork W2169324952 @default.
- W2476491844 hasRelatedWork W2977937868 @default.
- W2476491844 hasVolume "41" @default.
- W2476491844 isParatext "false" @default.
- W2476491844 isRetracted "false" @default.
- W2476491844 magId "2476491844" @default.
- W2476491844 workType "article" @default.