Matches in SemOpenAlex for { <https://semopenalex.org/work/W2298052207> ?p ?o ?g. }
- W2298052207 abstract "Stochastic Gradient Descent (SGD) is one of the most widely used techniques for online optimization in machine learning. In this work, we accelerate SGD by adaptively learning how to sample the most useful training examples at each time step. First, we show that SGD can be used to learn the best possible sampling distribution of an importance sampling estimator. Second, we show that the sampling distribution of an SGD algorithm can be estimated online by incrementally minimizing the variance of the gradient. The resulting algorithm - called Adaptive Weighted SGD (AW-SGD) - maintains a set of parameters to optimize, as well as a set of parameters to sample learning examples. We show that AWSGD yields faster convergence in three different applications: (i) image classification with deep features, where the sampling of images depends on their labels, (ii) matrix factorization, where rows and columns are not sampled uniformly, and (iii) reinforcement learning, where the optimized and exploration policies are estimated at the same time, where our approach corresponds to an off-policy gradient algorithm." @default.
- W2298052207 created "2016-06-24" @default.
- W2298052207 creator A5032987388 @default.
- W2298052207 creator A5052382513 @default.
- W2298052207 creator A5075018873 @default.
- W2298052207 creator A5090750283 @default.
- W2298052207 date "2015-06-30" @default.
- W2298052207 modified "2023-09-27" @default.
- W2298052207 title "Online Learning to Sample" @default.
- W2298052207 cites W1516903196 @default.
- W2298052207 cites W1568229137 @default.
- W2298052207 cites W1994616650 @default.
- W2298052207 cites W2023640363 @default.
- W2298052207 cites W2086161653 @default.
- W2298052207 cites W2096192494 @default.
- W2298052207 cites W2102605133 @default.
- W2298052207 cites W2109982223 @default.
- W2298052207 cites W2112796928 @default.
- W2298052207 cites W2113651538 @default.
- W2298052207 cites W2119196781 @default.
- W2298052207 cites W2143803054 @default.
- W2298052207 cites W2146502635 @default.
- W2298052207 cites W2152306708 @default.
- W2298052207 cites W2152808281 @default.
- W2298052207 cites W2155541015 @default.
- W2298052207 cites W2156779765 @default.
- W2298052207 cites W2161381512 @default.
- W2298052207 cites W2161969291 @default.
- W2298052207 cites W2166851633 @default.
- W2298052207 cites W2171671424 @default.
- W2298052207 hasPublicationYear "2015" @default.
- W2298052207 type Work @default.
- W2298052207 sameAs 2298052207 @default.
- W2298052207 citedByCount "12" @default.
- W2298052207 countsByYear W22980522072016 @default.
- W2298052207 countsByYear W22980522072018 @default.
- W2298052207 countsByYear W22980522072019 @default.
- W2298052207 countsByYear W22980522072020 @default.
- W2298052207 countsByYear W22980522072021 @default.
- W2298052207 crossrefType "posted-content" @default.
- W2298052207 hasAuthorship W2298052207A5032987388 @default.
- W2298052207 hasAuthorship W2298052207A5052382513 @default.
- W2298052207 hasAuthorship W2298052207A5075018873 @default.
- W2298052207 hasAuthorship W2298052207A5090750283 @default.
- W2298052207 hasConcept C105795698 @default.
- W2298052207 hasConcept C106131492 @default.
- W2298052207 hasConcept C11413529 @default.
- W2298052207 hasConcept C119857082 @default.
- W2298052207 hasConcept C121955636 @default.
- W2298052207 hasConcept C126255220 @default.
- W2298052207 hasConcept C140779682 @default.
- W2298052207 hasConcept C144133560 @default.
- W2298052207 hasConcept C154945302 @default.
- W2298052207 hasConcept C162324750 @default.
- W2298052207 hasConcept C167723999 @default.
- W2298052207 hasConcept C177264268 @default.
- W2298052207 hasConcept C185429906 @default.
- W2298052207 hasConcept C185592680 @default.
- W2298052207 hasConcept C19499675 @default.
- W2298052207 hasConcept C196083921 @default.
- W2298052207 hasConcept C198531522 @default.
- W2298052207 hasConcept C199360897 @default.
- W2298052207 hasConcept C206688291 @default.
- W2298052207 hasConcept C2777303404 @default.
- W2298052207 hasConcept C31972630 @default.
- W2298052207 hasConcept C33923547 @default.
- W2298052207 hasConcept C41008148 @default.
- W2298052207 hasConcept C43617362 @default.
- W2298052207 hasConcept C50522688 @default.
- W2298052207 hasConcept C50644808 @default.
- W2298052207 hasConcept C52740198 @default.
- W2298052207 hasConcept C97541855 @default.
- W2298052207 hasConceptScore W2298052207C105795698 @default.
- W2298052207 hasConceptScore W2298052207C106131492 @default.
- W2298052207 hasConceptScore W2298052207C11413529 @default.
- W2298052207 hasConceptScore W2298052207C119857082 @default.
- W2298052207 hasConceptScore W2298052207C121955636 @default.
- W2298052207 hasConceptScore W2298052207C126255220 @default.
- W2298052207 hasConceptScore W2298052207C140779682 @default.
- W2298052207 hasConceptScore W2298052207C144133560 @default.
- W2298052207 hasConceptScore W2298052207C154945302 @default.
- W2298052207 hasConceptScore W2298052207C162324750 @default.
- W2298052207 hasConceptScore W2298052207C167723999 @default.
- W2298052207 hasConceptScore W2298052207C177264268 @default.
- W2298052207 hasConceptScore W2298052207C185429906 @default.
- W2298052207 hasConceptScore W2298052207C185592680 @default.
- W2298052207 hasConceptScore W2298052207C19499675 @default.
- W2298052207 hasConceptScore W2298052207C196083921 @default.
- W2298052207 hasConceptScore W2298052207C198531522 @default.
- W2298052207 hasConceptScore W2298052207C199360897 @default.
- W2298052207 hasConceptScore W2298052207C206688291 @default.
- W2298052207 hasConceptScore W2298052207C2777303404 @default.
- W2298052207 hasConceptScore W2298052207C31972630 @default.
- W2298052207 hasConceptScore W2298052207C33923547 @default.
- W2298052207 hasConceptScore W2298052207C41008148 @default.
- W2298052207 hasConceptScore W2298052207C43617362 @default.
- W2298052207 hasConceptScore W2298052207C50522688 @default.
- W2298052207 hasConceptScore W2298052207C50644808 @default.
- W2298052207 hasConceptScore W2298052207C52740198 @default.
- W2298052207 hasConceptScore W2298052207C97541855 @default.