FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2935842085> ?p ?o ?g. }

• W2935842085 abstract "This Ph.D. thesis studies structured Markov models (SMMs) in the context of applied probability, stochastic modelling and applied statistics. SMMs are Markov chains on countable state spaces, whose transition rate matrices have particular structures, such as bidiagonal or tridiagonal block matrices. From a modelling point of view, applicability, robustness, simplicity, and tractability of SMMs make them a very important tool for studying complex systems. This is mainly due to the fact that for evaluation of performance measures of SMMs, there are efficient numerical analysis methods, commonly called matrix analytic methods (MAM). Some popular classes of SMMs are phase-type (PH) distributions, Markovian arrival processes (MAPs) and quasi-birth-and-death (QBD) processes. This thesis describes the outcomes of three research projects dealing with SMMs and their applications in stochastic modelling and applied statistics.In the first project, we introduce the notion of burstiness for a MAP. We call a stationary MAP bursty if both the squared coefficient of variation of inter-arrival times and the asymptotic index of dispersion of counts (IDC) are greater than unity. The simplest bursty MAP is a Hyperexponential renewal process with further classes, as we establish, being the Markov modulated Poisson process (MMPP), the Markov transition counting process (MTCP) and the Markov switched Poisson process (MSPP). Of these, MMPP has been used most often in applications for modelling bursty phenomena. Much of the popularity of MMPP stems from the intuition that it serves as a good model of bursty traffic. However, when MMPPs are viewed through the lens of the inter-arrival process, there is no proof to show that MMPPs are bursty. We provide analytical proofs to show that all of the MAPs mentioned above are bursty.Further, we investigate relations between these bursty MAPs. One of our main results is establishing a duality in terms of first and second moments of counts between MTCPs and a rich class of MMPPs which we refer to as slow-MMPPs (modulation is slower than the arrivals). Such a duality further confirms the applicability of MTCP as an alternative to MMPP. We augment our analytic results with numerical illustrations.In the second project, we consider a simple discrete-time controlled queueing system, where the controller has a choice of which server to use at each time slot, and server performance varies according to a Markov modulated random environment. We explore the role of information on the system stability region. At the extreme cases of information availability, that is when there is either full information or no information, stability regions and maximally stabilizing policies are trivial. But in the more realistic cases where only the environment state of the selected server is observed, only the service successes are observed or only the queue length is observed, finding throughput maximizing control laws is a challenge. To handle these situations, we devise a partially observable Markov decision process (POMDP) formulation of the problem and illustrate properties of its solution. We further model the system under given decision rules, using a QBD structure to find a matrix analytic expression for the stability bound. We use this formulation to illustrate how the stability region grows as the number of controller belief states increases.The third project focuses on the statistical methodology of semi-Markov processes, as motivated by the study of the trajectory of patients in intensive care units (ICUs) in hospitals. The main result of this project is the comparison of two approaches for defining and estimating semi-Markov models that are applied in ICUs. One approach is based on sojourn times, and the other approach is based on transition rates of the Markov jump process. We show that the second model has fewer parameters and its likelihood can be considered as the product of likelihoods of simpler two-state models. The comparison of these approaches helps to build models for predicting risks and chances of expected trajectories of patients through ICUs. Moreover, we extend the model to the case of having a multi-absorption PH distribution as the sojourn time distribution or intensity distribution of the semi-Markov model.The result of the projects mentioned above have been published or submitted to prestigious journals and peer-reviewed conferences, see [8–11, 146]. Further papers are currently in final stages of preparation." @default.
• W2935842085 created "2019-04-25" @default.
• W2935842085 creator A5017350554 @default.
• W2935842085 date "2018-09-14" @default.
• W2935842085 modified "2023-09-24" @default.
• W2935842085 title "Control and inference of structured Markov models" @default.
• W2935842085 cites W1940207832 @default.
• W2935842085 cites W1978942630 @default.
• W2935842085 cites W1986814402 @default.
• W2935842085 cites W2056921512 @default.
• W2935842085 cites W2108209260 @default.
• W2935842085 cites W2156464932 @default.
• W2935842085 cites W2167395111 @default.
• W2935842085 cites W2486403688 @default.
• W2935842085 cites W2511028367 @default.
• W2935842085 doi "https://doi.org/10.14264/uql.2018.600" @default.
• W2935842085 hasPublicationYear "2018" @default.
• W2935842085 type Work @default.
• W2935842085 sameAs 2935842085 @default.
• W2935842085 citedByCount "0" @default.
• W2935842085 crossrefType "dissertation" @default.
• W2935842085 hasAuthorship W2935842085A5017350554 @default.
• W2935842085 hasBestOaLocation W29358420852 @default.
• W2935842085 hasConcept C105795698 @default.
• W2935842085 hasConcept C11413529 @default.
• W2935842085 hasConcept C119857082 @default.
• W2935842085 hasConcept C120375044 @default.
• W2935842085 hasConcept C126255220 @default.
• W2935842085 hasConcept C158379750 @default.
• W2935842085 hasConcept C159886148 @default.
• W2935842085 hasConcept C163836022 @default.
• W2935842085 hasConcept C192163390 @default.
• W2935842085 hasConcept C2781023610 @default.
• W2935842085 hasConcept C28826006 @default.
• W2935842085 hasConcept C31258907 @default.
• W2935842085 hasConcept C33923547 @default.
• W2935842085 hasConcept C41008148 @default.
• W2935842085 hasConcept C54907487 @default.
• W2935842085 hasConcept C8272713 @default.
• W2935842085 hasConcept C98763669 @default.
• W2935842085 hasConceptScore W2935842085C105795698 @default.
• W2935842085 hasConceptScore W2935842085C11413529 @default.
• W2935842085 hasConceptScore W2935842085C119857082 @default.
• W2935842085 hasConceptScore W2935842085C120375044 @default.
• W2935842085 hasConceptScore W2935842085C126255220 @default.
• W2935842085 hasConceptScore W2935842085C158379750 @default.
• W2935842085 hasConceptScore W2935842085C159886148 @default.
• W2935842085 hasConceptScore W2935842085C163836022 @default.
• W2935842085 hasConceptScore W2935842085C192163390 @default.
• W2935842085 hasConceptScore W2935842085C2781023610 @default.
• W2935842085 hasConceptScore W2935842085C28826006 @default.
• W2935842085 hasConceptScore W2935842085C31258907 @default.
• W2935842085 hasConceptScore W2935842085C33923547 @default.
• W2935842085 hasConceptScore W2935842085C41008148 @default.
• W2935842085 hasConceptScore W2935842085C54907487 @default.
• W2935842085 hasConceptScore W2935842085C8272713 @default.
• W2935842085 hasConceptScore W2935842085C98763669 @default.
• W2935842085 hasLocation W29358420851 @default.
• W2935842085 hasLocation W29358420852 @default.
• W2935842085 hasOpenAccess W2935842085 @default.
• W2935842085 hasPrimaryLocation W29358420851 @default.
• W2935842085 hasRelatedWork W2211820962 @default.
• W2935842085 hasRelatedWork W2389529561 @default.
• W2935842085 hasRelatedWork W2519528544 @default.
• W2935842085 hasRelatedWork W2613547875 @default.
• W2935842085 hasRelatedWork W2908756996 @default.
• W2935842085 hasRelatedWork W3016364280 @default.
• W2935842085 hasRelatedWork W3018542065 @default.
• W2935842085 hasRelatedWork W3090764769 @default.
• W2935842085 hasRelatedWork W3107474891 @default.
• W2935842085 hasRelatedWork W3136652852 @default.
• W2935842085 isParatext "false" @default.
• W2935842085 isRetracted "false" @default.
• W2935842085 magId "2935842085" @default.
• W2935842085 workType "dissertation" @default.