Matches in SemOpenAlex for { <https://semopenalex.org/work/W2282582912> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W2282582912 abstract "Providing realistic performance indicators of online algorithms for a given online optimization problem is a difficult task in general. Due to significant drawbacks of other concepts like competitive analysis, Markov decision problems (MDPs) may yield an attractive alternative whenever reasonable stochastic information about future requests is available. However, the number of states in MDPs emerging from real applications is usually exponential in the original input parameters. Therefore, the standard methods for analyzing policies, i.e., online algorithms in our context, are infeasible. In this thesis we propose a new computational tool to evaluate the behavior of policies for discounted MDPs locally, i.e., depending on aparticular initial state. The method is based on a column generation algorithm for approximating the total expected discounted cost of anunknown optimal policy, a concrete policy, or a single action (which assumes actions at other states to be made according to an optimal policy). The algorithm determines an $varepsilon$-approximation byinspecting only relatively small local parts of the total state space. We prove that the number of states required for providing the approximation is independent of the total number of states, which underlines the practicability of the algorithm. The approximationsobtained by our algorithm are typically much better than thetheoretical bounds obtained by other approaches.We investigate the pricing problem and the structure of the linear programs encountered in the column generation. Moreover, we propose and analyze different extensions of the basic algorithm in order to achieve good approximations fast.The potential of our analysis tool is exemplified for discounted MDPs emerging from different online optimization problems, namely online bin coloring, online target date assignment, and online elevator control. The results of the experiments are quite encouraging: our method is mostly capable to provide performance indicators for online algorithms that much better reflect observations made in simulations than competitive analysis does. Moreover, the analysis allows to reveal weaknesses of the considered online algorithms. This way, we developed a new online algorithm for the online bin coloring problem that outperforms existing ones in our analyses and simulations." @default.
- W2282582912 created "2016-06-24" @default.
- W2282582912 creator A5009828906 @default.
- W2282582912 date "2010-12-15" @default.
- W2282582912 modified "2023-09-23" @default.
- W2282582912 title "Local Evaluation of Policies for Discounted Markov Decision Problems" @default.
- W2282582912 cites W1997761849 @default.
- W2282582912 cites W2039439610 @default.
- W2282582912 cites W2052294974 @default.
- W2282582912 cites W2134932665 @default.
- W2282582912 cites W2167471538 @default.
- W2282582912 doi "https://doi.org/10.14279/depositonce-2661" @default.
- W2282582912 hasPublicationYear "2010" @default.
- W2282582912 type Work @default.
- W2282582912 sameAs 2282582912 @default.
- W2282582912 citedByCount "1" @default.
- W2282582912 crossrefType "journal-article" @default.
- W2282582912 hasAuthorship W2282582912A5009828906 @default.
- W2282582912 hasConcept C105795698 @default.
- W2282582912 hasConcept C106189395 @default.
- W2282582912 hasConcept C11413529 @default.
- W2282582912 hasConcept C119857082 @default.
- W2282582912 hasConcept C126255220 @default.
- W2282582912 hasConcept C151730666 @default.
- W2282582912 hasConcept C159886148 @default.
- W2282582912 hasConcept C162324750 @default.
- W2282582912 hasConcept C168956720 @default.
- W2282582912 hasConcept C187736073 @default.
- W2282582912 hasConcept C2779343474 @default.
- W2282582912 hasConcept C2780451532 @default.
- W2282582912 hasConcept C33923547 @default.
- W2282582912 hasConcept C41008148 @default.
- W2282582912 hasConcept C48103436 @default.
- W2282582912 hasConcept C72434380 @default.
- W2282582912 hasConcept C86803240 @default.
- W2282582912 hasConcept C98763669 @default.
- W2282582912 hasConceptScore W2282582912C105795698 @default.
- W2282582912 hasConceptScore W2282582912C106189395 @default.
- W2282582912 hasConceptScore W2282582912C11413529 @default.
- W2282582912 hasConceptScore W2282582912C119857082 @default.
- W2282582912 hasConceptScore W2282582912C126255220 @default.
- W2282582912 hasConceptScore W2282582912C151730666 @default.
- W2282582912 hasConceptScore W2282582912C159886148 @default.
- W2282582912 hasConceptScore W2282582912C162324750 @default.
- W2282582912 hasConceptScore W2282582912C168956720 @default.
- W2282582912 hasConceptScore W2282582912C187736073 @default.
- W2282582912 hasConceptScore W2282582912C2779343474 @default.
- W2282582912 hasConceptScore W2282582912C2780451532 @default.
- W2282582912 hasConceptScore W2282582912C33923547 @default.
- W2282582912 hasConceptScore W2282582912C41008148 @default.
- W2282582912 hasConceptScore W2282582912C48103436 @default.
- W2282582912 hasConceptScore W2282582912C72434380 @default.
- W2282582912 hasConceptScore W2282582912C86803240 @default.
- W2282582912 hasConceptScore W2282582912C98763669 @default.
- W2282582912 hasLocation W22825829121 @default.
- W2282582912 hasOpenAccess W2282582912 @default.
- W2282582912 hasPrimaryLocation W22825829121 @default.
- W2282582912 hasRelatedWork W1512407760 @default.
- W2282582912 hasRelatedWork W1530301508 @default.
- W2282582912 hasRelatedWork W1946365831 @default.
- W2282582912 hasRelatedWork W1996313212 @default.
- W2282582912 hasRelatedWork W2010356296 @default.
- W2282582912 hasRelatedWork W2028143206 @default.
- W2282582912 hasRelatedWork W2049396938 @default.
- W2282582912 hasRelatedWork W2094964720 @default.
- W2282582912 hasRelatedWork W2103541323 @default.
- W2282582912 hasRelatedWork W2105357975 @default.
- W2282582912 hasRelatedWork W2135826251 @default.
- W2282582912 hasRelatedWork W2144908562 @default.
- W2282582912 hasRelatedWork W2155018502 @default.
- W2282582912 hasRelatedWork W2243343380 @default.
- W2282582912 hasRelatedWork W2299935480 @default.
- W2282582912 hasRelatedWork W2963057120 @default.
- W2282582912 hasRelatedWork W3035046675 @default.
- W2282582912 hasRelatedWork W3040962183 @default.
- W2282582912 hasRelatedWork W3092202067 @default.
- W2282582912 hasRelatedWork W3154499329 @default.
- W2282582912 isParatext "false" @default.
- W2282582912 isRetracted "false" @default.
- W2282582912 magId "2282582912" @default.
- W2282582912 workType "article" @default.