Matches in SemOpenAlex for { <https://semopenalex.org/work/W2601588759> ?p ?o ?g. }
- W2601588759 abstract "Bayes sequential decision problems are an extensive problem class with wide application. They involve taking actions in sequence in a system which has characteristics which are unknown or only partially known. These characteristics can be learnt over time as a result of our actions. Therefore we are faced with a trade-off between choosing actions that give desirable short term outcomes (exploitation) and actions that yield useful information about the system which can be used to improve longer term outcomes (exploration). Gittins indices provide an optimal method for a small but important subclass of these problems. Unfortunately the optimality of index methods does not hold generally and Gittins indices can be impractical to calculate for many problems. This has motivated the search for easy-to-calculate heuristics with general application. One such non-index method is the knowledge gradient heuristic. A thorough investigation of the method is made which identifies crucial weaknesses. Index and non-index variants are developed which avoid these weaknesses. The problem of choosing multiple website elements to present to user is an important problem relevant to many major web-based businesses. A Bayesian multi-armed bandit model is developed which captures the interactions between elements and the dual uncertainties of both user preferences and element quality. The problem has many challenging features but solution methods are proposed that are both easy to implement and which can be adapted to particular applications. Finally, easy-to-use software to calculate Gittins indices for Bernoulli and normal rewards has been developed as part of this thesis and has been made publicly available. The methodology used is presented together with a study of accuracy and speed." @default.
- W2601588759 created "2017-04-07" @default.
- W2601588759 creator A5083623983 @default.
- W2601588759 date "2016-01-01" @default.
- W2601588759 modified "2023-10-16" @default.
- W2601588759 title "Exploration and exploitation in Bayes sequential decision problems" @default.
- W2601588759 cites W104909430 @default.
- W2601588759 cites W1509562192 @default.
- W2601588759 cites W1510052597 @default.
- W2601588759 cites W1601081659 @default.
- W2601588759 cites W1618543586 @default.
- W2601588759 cites W166250193 @default.
- W2601588759 cites W1686266550 @default.
- W2601588759 cites W1931792391 @default.
- W2601588759 cites W1965288387 @default.
- W2601588759 cites W1967787801 @default.
- W2601588759 cites W1983962754 @default.
- W2601588759 cites W1986389067 @default.
- W2601588759 cites W1993320088 @default.
- W2601588759 cites W1995408121 @default.
- W2601588759 cites W1996859119 @default.
- W2601588759 cites W1997783781 @default.
- W2601588759 cites W1998498767 @default.
- W2601588759 cites W2008098735 @default.
- W2601588759 cites W2025702744 @default.
- W2601588759 cites W2036803464 @default.
- W2601588759 cites W2039522160 @default.
- W2601588759 cites W2044502527 @default.
- W2601588759 cites W2046495522 @default.
- W2601588759 cites W2049687551 @default.
- W2601588759 cites W2054387444 @default.
- W2601588759 cites W2055421030 @default.
- W2601588759 cites W2056921512 @default.
- W2601588759 cites W2061753713 @default.
- W2601588759 cites W2069034916 @default.
- W2601588759 cites W2072302356 @default.
- W2601588759 cites W2083305840 @default.
- W2601588759 cites W2089425220 @default.
- W2601588759 cites W2098432798 @default.
- W2601588759 cites W2107822634 @default.
- W2601588759 cites W2110632090 @default.
- W2601588759 cites W2110674418 @default.
- W2601588759 cites W2116772603 @default.
- W2601588759 cites W2118309135 @default.
- W2601588759 cites W2119567691 @default.
- W2601588759 cites W2121863487 @default.
- W2601588759 cites W2127536498 @default.
- W2601588759 cites W2141645258 @default.
- W2601588759 cites W2144002623 @default.
- W2601588759 cites W2144807535 @default.
- W2601588759 cites W2145075441 @default.
- W2601588759 cites W2149721706 @default.
- W2601588759 cites W2151323275 @default.
- W2601588759 cites W2155927283 @default.
- W2601588759 cites W2157128462 @default.
- W2601588759 cites W2159471113 @default.
- W2601588759 cites W2162174737 @default.
- W2601588759 cites W2162979096 @default.
- W2601588759 cites W2165607537 @default.
- W2601588759 cites W2168405694 @default.
- W2601588759 cites W2168709337 @default.
- W2601588759 cites W2170585566 @default.
- W2601588759 cites W2181317554 @default.
- W2601588759 cites W2297707299 @default.
- W2601588759 cites W2319178748 @default.
- W2601588759 cites W2321552568 @default.
- W2601588759 cites W2327833721 @default.
- W2601588759 cites W2330729926 @default.
- W2601588759 cites W2341171179 @default.
- W2601588759 cites W2490159962 @default.
- W2601588759 cites W2500139799 @default.
- W2601588759 cites W2795495912 @default.
- W2601588759 cites W2905455557 @default.
- W2601588759 cites W2914156981 @default.
- W2601588759 cites W2964143446 @default.
- W2601588759 cites W2964296255 @default.
- W2601588759 cites W3011120880 @default.
- W2601588759 cites W3123857276 @default.
- W2601588759 cites W3125634603 @default.
- W2601588759 cites W35251828 @default.
- W2601588759 cites W50486269 @default.
- W2601588759 cites W832055537 @default.
- W2601588759 hasPublicationYear "2016" @default.
- W2601588759 type Work @default.
- W2601588759 sameAs 2601588759 @default.
- W2601588759 citedByCount "1" @default.
- W2601588759 countsByYear W26015887592019 @default.
- W2601588759 crossrefType "dissertation" @default.
- W2601588759 hasAuthorship W2601588759A5083623983 @default.
- W2601588759 hasConcept C107673813 @default.
- W2601588759 hasConcept C111472728 @default.
- W2601588759 hasConcept C111919701 @default.
- W2601588759 hasConcept C119857082 @default.
- W2601588759 hasConcept C124101348 @default.
- W2601588759 hasConcept C126255220 @default.
- W2601588759 hasConcept C127705205 @default.
- W2601588759 hasConcept C136764020 @default.
- W2601588759 hasConcept C138885662 @default.
- W2601588759 hasConcept C154945302 @default.
- W2601588759 hasConcept C173801870 @default.