FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W1512309675> ?p ?o ?g. }

• W1512309675 abstract "Uniform sampling of training data has been commonly used in traditional stochastic optimization algorithms such as Proximal Stochastic Gradient Descent (prox-SGD) and Proximal Stochastic Dual Coordinate Ascent (prox-SDCA). Although uniform sampling can guarantee that the sampled stochastic quantity is an unbiased estimate of the corresponding true quantity, the resulting estimator may have a rather high variance, which negatively affects the convergence of the underlying optimization procedure. In this paper we study stochastic optimization with importance sampling, which improves the convergence rate by reducing the stochastic variance. Specifically, we study prox-SGD (actually, stochastic mirror descent) with importance sampling and prox-SDCA with importance sampling. For prox-SGD, instead of adopting uniform sampling throughout the training process, the proposed algorithm employs importance sampling to minimize the variance of the stochastic gradient. For prox-SDCA, the proposed importance sampling scheme aims to achieve higher expected dual value at each dual coordinate ascent step. We provide extensive theoretical analysis to show that the convergence rates with the proposed importance sampling methods can be significantly improved under suitable conditions both for prox-SGD and for prox-SDCA. Experiments are provided to verify the theoretical analysis." @default.
• W1512309675 created "2016-06-24" @default.
• W1512309675 creator A5015991234 @default.
• W1512309675 creator A5037709424 @default.
• W1512309675 date "2014-01-13" @default.
• W1512309675 modified "2023-10-17" @default.
• W1512309675 title "Stochastic Optimization with Importance Sampling" @default.
• W1512309675 cites W1499021337 @default.
• W1512309675 cites W1509803206 @default.
• W1512309675 cites W1516903196 @default.
• W1512309675 cites W1570963478 @default.
• W1512309675 cites W1890144115 @default.
• W1512309675 cites W1939652453 @default.
• W1512309675 cites W1969048569 @default.
• W1512309675 cites W2048305372 @default.
• W1512309675 cites W2091825929 @default.
• W1512309675 cites W2095984592 @default.
• W1512309675 cites W2100038678 @default.
• W1512309675 cites W2105875671 @default.
• W1512309675 cites W2107438106 @default.
• W1512309675 cites W2112269233 @default.
• W1512309675 cites W2117686388 @default.
• W1512309675 cites W2118378735 @default.
• W1512309675 cites W2118545728 @default.
• W1512309675 cites W2132162087 @default.
• W1512309675 cites W2142623206 @default.
• W1512309675 cites W2162287622 @default.
• W1512309675 cites W2164301055 @default.
• W1512309675 cites W2949382400 @default.
• W1512309675 cites W2950132609 @default.
• W1512309675 cites W2951833684 @default.
• W1512309675 cites W2963541115 @default.
• W1512309675 doi "https://doi.org/10.48550/arxiv.1401.2753" @default.
• W1512309675 hasPublicationYear "2014" @default.
• W1512309675 type Work @default.
• W1512309675 sameAs 1512309675 @default.
• W1512309675 citedByCount "51" @default.
• W1512309675 countsByYear W15123096752013 @default.
• W1512309675 countsByYear W15123096752014 @default.
• W1512309675 countsByYear W15123096752015 @default.
• W1512309675 countsByYear W15123096752016 @default.
• W1512309675 countsByYear W15123096752017 @default.
• W1512309675 countsByYear W15123096752018 @default.
• W1512309675 countsByYear W15123096752019 @default.
• W1512309675 countsByYear W15123096752020 @default.
• W1512309675 countsByYear W15123096752021 @default.
• W1512309675 crossrefType "posted-content" @default.
• W1512309675 hasAuthorship W1512309675A5015991234 @default.
• W1512309675 hasAuthorship W1512309675A5037709424 @default.
• W1512309675 hasBestOaLocation W15123096751 @default.
• W1512309675 hasConcept C105795698 @default.
• W1512309675 hasConcept C106131492 @default.
• W1512309675 hasConcept C121955636 @default.
• W1512309675 hasConcept C124952713 @default.
• W1512309675 hasConcept C126255220 @default.
• W1512309675 hasConcept C127162648 @default.
• W1512309675 hasConcept C140779682 @default.
• W1512309675 hasConcept C142362112 @default.
• W1512309675 hasConcept C144133560 @default.
• W1512309675 hasConcept C154945302 @default.
• W1512309675 hasConcept C162324750 @default.
• W1512309675 hasConcept C185429906 @default.
• W1512309675 hasConcept C194387892 @default.
• W1512309675 hasConcept C19499675 @default.
• W1512309675 hasConcept C196083921 @default.
• W1512309675 hasConcept C206688291 @default.
• W1512309675 hasConcept C2777303404 @default.
• W1512309675 hasConcept C2780980858 @default.
• W1512309675 hasConcept C31258907 @default.
• W1512309675 hasConcept C31972630 @default.
• W1512309675 hasConcept C33923547 @default.
• W1512309675 hasConcept C41008148 @default.
• W1512309675 hasConcept C50522688 @default.
• W1512309675 hasConcept C50644808 @default.
• W1512309675 hasConcept C52740198 @default.
• W1512309675 hasConcept C57869625 @default.
• W1512309675 hasConcept C62644790 @default.
• W1512309675 hasConceptScore W1512309675C105795698 @default.
• W1512309675 hasConceptScore W1512309675C106131492 @default.
• W1512309675 hasConceptScore W1512309675C121955636 @default.
• W1512309675 hasConceptScore W1512309675C124952713 @default.
• W1512309675 hasConceptScore W1512309675C126255220 @default.
• W1512309675 hasConceptScore W1512309675C127162648 @default.
• W1512309675 hasConceptScore W1512309675C140779682 @default.
• W1512309675 hasConceptScore W1512309675C142362112 @default.
• W1512309675 hasConceptScore W1512309675C144133560 @default.
• W1512309675 hasConceptScore W1512309675C154945302 @default.
• W1512309675 hasConceptScore W1512309675C162324750 @default.
• W1512309675 hasConceptScore W1512309675C185429906 @default.
• W1512309675 hasConceptScore W1512309675C194387892 @default.
• W1512309675 hasConceptScore W1512309675C19499675 @default.
• W1512309675 hasConceptScore W1512309675C196083921 @default.
• W1512309675 hasConceptScore W1512309675C206688291 @default.
• W1512309675 hasConceptScore W1512309675C2777303404 @default.
• W1512309675 hasConceptScore W1512309675C2780980858 @default.
• W1512309675 hasConceptScore W1512309675C31258907 @default.
• W1512309675 hasConceptScore W1512309675C31972630 @default.
• W1512309675 hasConceptScore W1512309675C33923547 @default.
• W1512309675 hasConceptScore W1512309675C41008148 @default.
• W1512309675 hasConceptScore W1512309675C50522688 @default.

• next