Matches in SemOpenAlex for { <https://semopenalex.org/work/W2396906324> ?p ?o ?g. }
- W2396906324 endingPage "61" @default.
- W2396906324 startingPage "52" @default.
- W2396906324 abstract "We consider the problem of budget (or other resource) allocation in sequential decision problems involving a large number of concurrently running sub-processes, whose only interaction is through their consumption of budget. Our first contribution is the introduction of budgeted MDPs (BMDPs), an MDP model in which policies/values are a function of available budget, (c.f. constrained MDPs which are solved given a fixed budget). BMDPs allow one to explicitly trade off allocated budget and expected value. We show that optimal value functions are concave, non-decreasing in budget, and piecewise-linear in the finite horizon case, and can be computed by dynamic programming (and support ready approximation). Our second contribution is a method that exploits BMDP solutions to allocate budget to a large number of independent BMDPs, coupled only by their common budget pool. The problem can be cast as a multiple-choice knapsack problem, which admits an efficient, optimal greedy algorithm. Empirical results in an online advertising domain confirm the efficacy of our methods." @default.
- W2396906324 created "2016-06-24" @default.
- W2396906324 creator A5036934218 @default.
- W2396906324 creator A5086690493 @default.
- W2396906324 date "2016-06-25" @default.
- W2396906324 modified "2023-09-23" @default.
- W2396906324 title "Budget allocation using weakly coupled, constrained Markov decision processes" @default.
- W2396906324 cites W110588614 @default.
- W2396906324 cites W1518931405 @default.
- W2396906324 cites W1597160459 @default.
- W2396906324 cites W1823541154 @default.
- W2396906324 cites W1848630723 @default.
- W2396906324 cites W1911847039 @default.
- W2396906324 cites W1956354821 @default.
- W2396906324 cites W197450994 @default.
- W2396906324 cites W1974714155 @default.
- W2396906324 cites W1996312099 @default.
- W2396906324 cites W2002409029 @default.
- W2396906324 cites W2011485152 @default.
- W2396906324 cites W2017460389 @default.
- W2396906324 cites W2022907857 @default.
- W2396906324 cites W2023815876 @default.
- W2396906324 cites W2025299767 @default.
- W2396906324 cites W2044069028 @default.
- W2396906324 cites W2055822187 @default.
- W2396906324 cites W2061504687 @default.
- W2396906324 cites W2077789482 @default.
- W2396906324 cites W2082967074 @default.
- W2396906324 cites W2092195356 @default.
- W2396906324 cites W2104921433 @default.
- W2396906324 cites W2107726111 @default.
- W2396906324 cites W2114958204 @default.
- W2396906324 cites W2116600741 @default.
- W2396906324 cites W2119567691 @default.
- W2396906324 cites W2119914577 @default.
- W2396906324 cites W2128814508 @default.
- W2396906324 cites W2129307307 @default.
- W2396906324 cites W2135814502 @default.
- W2396906324 cites W2137034368 @default.
- W2396906324 cites W2142620093 @default.
- W2396906324 cites W2188273680 @default.
- W2396906324 cites W2250285668 @default.
- W2396906324 cites W2275802500 @default.
- W2396906324 cites W2564127794 @default.
- W2396906324 cites W2951545777 @default.
- W2396906324 cites W3122305203 @default.
- W2396906324 cites W1658377931 @default.
- W2396906324 hasPublicationYear "2016" @default.
- W2396906324 type Work @default.
- W2396906324 sameAs 2396906324 @default.
- W2396906324 citedByCount "23" @default.
- W2396906324 countsByYear W23969063242016 @default.
- W2396906324 countsByYear W23969063242017 @default.
- W2396906324 countsByYear W23969063242018 @default.
- W2396906324 countsByYear W23969063242019 @default.
- W2396906324 countsByYear W23969063242020 @default.
- W2396906324 countsByYear W23969063242021 @default.
- W2396906324 crossrefType "proceedings-article" @default.
- W2396906324 hasAuthorship W2396906324A5036934218 @default.
- W2396906324 hasAuthorship W2396906324A5086690493 @default.
- W2396906324 hasConcept C105795698 @default.
- W2396906324 hasConcept C106189395 @default.
- W2396906324 hasConcept C113138325 @default.
- W2396906324 hasConcept C126255220 @default.
- W2396906324 hasConcept C134306372 @default.
- W2396906324 hasConcept C14646407 @default.
- W2396906324 hasConcept C159886148 @default.
- W2396906324 hasConcept C162324750 @default.
- W2396906324 hasConcept C164660894 @default.
- W2396906324 hasConcept C17095337 @default.
- W2396906324 hasConcept C175444787 @default.
- W2396906324 hasConcept C2524010 @default.
- W2396906324 hasConcept C28761237 @default.
- W2396906324 hasConcept C29202148 @default.
- W2396906324 hasConcept C31258907 @default.
- W2396906324 hasConcept C33923547 @default.
- W2396906324 hasConcept C37404715 @default.
- W2396906324 hasConcept C41008148 @default.
- W2396906324 hasConcept C51823790 @default.
- W2396906324 hasConcept C8505890 @default.
- W2396906324 hasConceptScore W2396906324C105795698 @default.
- W2396906324 hasConceptScore W2396906324C106189395 @default.
- W2396906324 hasConceptScore W2396906324C113138325 @default.
- W2396906324 hasConceptScore W2396906324C126255220 @default.
- W2396906324 hasConceptScore W2396906324C134306372 @default.
- W2396906324 hasConceptScore W2396906324C14646407 @default.
- W2396906324 hasConceptScore W2396906324C159886148 @default.
- W2396906324 hasConceptScore W2396906324C162324750 @default.
- W2396906324 hasConceptScore W2396906324C164660894 @default.
- W2396906324 hasConceptScore W2396906324C17095337 @default.
- W2396906324 hasConceptScore W2396906324C175444787 @default.
- W2396906324 hasConceptScore W2396906324C2524010 @default.
- W2396906324 hasConceptScore W2396906324C28761237 @default.
- W2396906324 hasConceptScore W2396906324C29202148 @default.
- W2396906324 hasConceptScore W2396906324C31258907 @default.
- W2396906324 hasConceptScore W2396906324C33923547 @default.
- W2396906324 hasConceptScore W2396906324C37404715 @default.
- W2396906324 hasConceptScore W2396906324C41008148 @default.