Matches in SemOpenAlex for { <https://semopenalex.org/work/W2894459442> ?p ?o ?g. }
Showing items 1 to 85 of
85
with 100 items per page.
- W2894459442 abstract "Accelerated coordinate descent is a widely popular optimization algorithm due to its efficiency on large-dimensional problems. It achieves state-of-the-art complexity on an important class of empirical risk minimization problems. In this paper we design and analyze an accelerated coordinate descent (ACD) method which in each iteration updates a random subset of coordinates according to an arbitrary but fixed probability law, which is a parameter of the method. If all coordinates are updated in each iteration, our method reduces to the classical accelerated gradient descent method AGD of Nesterov. If a single coordinate is updated in each iteration, and we pick probabilities proportional to the square roots of the coordinate-wise Lipschitz constants, our method reduces to the currently fastest coordinate descent method NUACDM of Allen-Zhu, Qu, Richtarik and Yuan. While mini-batch variants of ACD are more popular and relevant in practice, there is no importance sampling for ACD that outperforms the standard uniform mini-batch sampling. Through insights enabled by our general analysis, we design new importance sampling for mini-batch ACD which significantly outperforms previous state-of-the-art minibatch ACD in practice. We prove a rate that is at most ${cal O}(sqrt{tau})$ times worse than the rate of minibatch ACD with uniform sampling, but can be ${cal O}(n/tau)$ times better, where $tau$ is the minibatch size. Since in modern supervised learning training systems it is standard practice to choose $tau ll n$, and often $tau={cal O}(1)$, our method can lead to dramatic speedups. Lastly, we obtain similar results for minibatch nonaccelerated CD as well, achieving improvements on previous best rates." @default.
- W2894459442 created "2018-10-05" @default.
- W2894459442 creator A5036598221 @default.
- W2894459442 creator A5089882896 @default.
- W2894459442 date "2018-09-25" @default.
- W2894459442 modified "2023-09-27" @default.
- W2894459442 title "Accelerated Coordinate Descent with Arbitrary Sampling and Best Rates for Minibatches" @default.
- W2894459442 cites W1871644925 @default.
- W2894459442 cites W2119200797 @default.
- W2894459442 cites W2263395988 @default.
- W2894459442 cites W2663450581 @default.
- W2894459442 cites W2949090471 @default.
- W2894459442 cites W2951563002 @default.
- W2894459442 hasPublicationYear "2018" @default.
- W2894459442 type Work @default.
- W2894459442 sameAs 2894459442 @default.
- W2894459442 citedByCount "3" @default.
- W2894459442 countsByYear W28944594422019 @default.
- W2894459442 countsByYear W28944594422020 @default.
- W2894459442 crossrefType "posted-content" @default.
- W2894459442 hasAuthorship W2894459442A5036598221 @default.
- W2894459442 hasAuthorship W2894459442A5089882896 @default.
- W2894459442 hasConcept C106131492 @default.
- W2894459442 hasConcept C107321475 @default.
- W2894459442 hasConcept C11413529 @default.
- W2894459442 hasConcept C114614502 @default.
- W2894459442 hasConcept C126255220 @default.
- W2894459442 hasConcept C140779682 @default.
- W2894459442 hasConcept C147764199 @default.
- W2894459442 hasConcept C153258448 @default.
- W2894459442 hasConcept C154945302 @default.
- W2894459442 hasConcept C157553263 @default.
- W2894459442 hasConcept C202444582 @default.
- W2894459442 hasConcept C206688291 @default.
- W2894459442 hasConcept C22324862 @default.
- W2894459442 hasConcept C28826006 @default.
- W2894459442 hasConcept C31972630 @default.
- W2894459442 hasConcept C33923547 @default.
- W2894459442 hasConcept C41008148 @default.
- W2894459442 hasConcept C50644808 @default.
- W2894459442 hasConceptScore W2894459442C106131492 @default.
- W2894459442 hasConceptScore W2894459442C107321475 @default.
- W2894459442 hasConceptScore W2894459442C11413529 @default.
- W2894459442 hasConceptScore W2894459442C114614502 @default.
- W2894459442 hasConceptScore W2894459442C126255220 @default.
- W2894459442 hasConceptScore W2894459442C140779682 @default.
- W2894459442 hasConceptScore W2894459442C147764199 @default.
- W2894459442 hasConceptScore W2894459442C153258448 @default.
- W2894459442 hasConceptScore W2894459442C154945302 @default.
- W2894459442 hasConceptScore W2894459442C157553263 @default.
- W2894459442 hasConceptScore W2894459442C202444582 @default.
- W2894459442 hasConceptScore W2894459442C206688291 @default.
- W2894459442 hasConceptScore W2894459442C22324862 @default.
- W2894459442 hasConceptScore W2894459442C28826006 @default.
- W2894459442 hasConceptScore W2894459442C31972630 @default.
- W2894459442 hasConceptScore W2894459442C33923547 @default.
- W2894459442 hasConceptScore W2894459442C41008148 @default.
- W2894459442 hasConceptScore W2894459442C50644808 @default.
- W2894459442 hasLocation W28944594421 @default.
- W2894459442 hasOpenAccess W2894459442 @default.
- W2894459442 hasPrimaryLocation W28944594421 @default.
- W2894459442 hasRelatedWork W1604285897 @default.
- W2894459442 hasRelatedWork W1994550052 @default.
- W2894459442 hasRelatedWork W1997616626 @default.
- W2894459442 hasRelatedWork W2099119387 @default.
- W2894459442 hasRelatedWork W2172943111 @default.
- W2894459442 hasRelatedWork W2195435876 @default.
- W2894459442 hasRelatedWork W2223328134 @default.
- W2894459442 hasRelatedWork W2524580019 @default.
- W2894459442 hasRelatedWork W2886596322 @default.
- W2894459442 hasRelatedWork W2890096867 @default.
- W2894459442 hasRelatedWork W2950019067 @default.
- W2894459442 hasRelatedWork W2951713178 @default.
- W2894459442 hasRelatedWork W2951771125 @default.
- W2894459442 hasRelatedWork W2963108795 @default.
- W2894459442 hasRelatedWork W2963649887 @default.
- W2894459442 hasRelatedWork W2967639855 @default.
- W2894459442 hasRelatedWork W3165494599 @default.
- W2894459442 hasRelatedWork W3170460381 @default.
- W2894459442 hasRelatedWork W3183593932 @default.
- W2894459442 hasRelatedWork W2963821730 @default.
- W2894459442 isParatext "false" @default.
- W2894459442 isRetracted "false" @default.
- W2894459442 magId "2894459442" @default.
- W2894459442 workType "article" @default.