Matches in SemOpenAlex for { <https://semopenalex.org/work/W2997803752> ?p ?o ?g. }
- W2997803752 endingPage "622" @default.
- W2997803752 startingPage "611" @default.
- W2997803752 abstract "We consider composition problems of the form (1/n)∑i = 1n Fi (1/m)∑j = 1m Gj(x) , which are important for machine learning. Although gradient descent and stochastic gradient descent are straightforward solutions, the essential computation of G (x) = (1/m)∑j = 1mGj(x) in each single iteration is expensive, let alone for large m . In this article, we devise a stochastically controlled compositional gradient algorithm. Specifically, we introduce two variants of stochastically controlled technique to estimate the inner function G(x) and the gradient of the objective function, respectively. The computational cost is largely reduced. However, the natural needs of two stochastic subsets D1 and D2 form direct barriers to guarantee the convergence of the algorithm, especially the theoretical proof of the convergence. To this end, we present a general convergence analysis by proving | D1|=min{1/ϵ,m} and | D2|=min{1/ϵ,n } , through which the proposed method significantly improve composition algorithms under low target accuracy (i.e., 1/ϵ << m or n ) in both strongly convex and nonconvex settings. Comprehensive experiments demonstrate the superiority of the proposed method over existing methods." @default.
- W2997803752 created "2020-01-10" @default.
- W2997803752 creator A5004075655 @default.
- W2997803752 creator A5010841999 @default.
- W2997803752 creator A5049225160 @default.
- W2997803752 creator A5074103823 @default.
- W2997803752 date "2023-02-01" @default.
- W2997803752 modified "2023-09-27" @default.
- W2997803752 title "Stochastically Controlled Compositional Gradient for Composition Problems" @default.
- W2997803752 cites W1494085563 @default.
- W2997803752 cites W1770943136 @default.
- W2997803752 cites W1987083649 @default.
- W2997803752 cites W2047152541 @default.
- W2997803752 cites W2050728566 @default.
- W2997803752 cites W2124541940 @default.
- W2997803752 cites W2163786124 @default.
- W2997803752 cites W2217490359 @default.
- W2997803752 cites W2580133360 @default.
- W2997803752 cites W2584304370 @default.
- W2997803752 cites W2741379673 @default.
- W2997803752 cites W2767614206 @default.
- W2997803752 cites W2884414611 @default.
- W2997803752 cites W2962890301 @default.
- W2997803752 cites W2963231446 @default.
- W2997803752 cites W2963313444 @default.
- W2997803752 cites W2963607709 @default.
- W2997803752 cites W3011766119 @default.
- W2997803752 cites W4214717370 @default.
- W2997803752 cites W4292363360 @default.
- W2997803752 doi "https://doi.org/10.1109/tnnls.2021.3098222" @default.
- W2997803752 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/34383655" @default.
- W2997803752 hasPublicationYear "2023" @default.
- W2997803752 type Work @default.
- W2997803752 sameAs 2997803752 @default.
- W2997803752 citedByCount "1" @default.
- W2997803752 countsByYear W29978037522023 @default.
- W2997803752 crossrefType "journal-article" @default.
- W2997803752 hasAuthorship W2997803752A5004075655 @default.
- W2997803752 hasAuthorship W2997803752A5010841999 @default.
- W2997803752 hasAuthorship W2997803752A5049225160 @default.
- W2997803752 hasAuthorship W2997803752A5074103823 @default.
- W2997803752 hasConcept C10494615 @default.
- W2997803752 hasConcept C112680207 @default.
- W2997803752 hasConcept C11413529 @default.
- W2997803752 hasConcept C115680565 @default.
- W2997803752 hasConcept C126255220 @default.
- W2997803752 hasConcept C138885662 @default.
- W2997803752 hasConcept C14036430 @default.
- W2997803752 hasConcept C145446738 @default.
- W2997803752 hasConcept C153258448 @default.
- W2997803752 hasConcept C154945302 @default.
- W2997803752 hasConcept C162324750 @default.
- W2997803752 hasConcept C206688291 @default.
- W2997803752 hasConcept C2524010 @default.
- W2997803752 hasConcept C2777303404 @default.
- W2997803752 hasConcept C28826006 @default.
- W2997803752 hasConcept C33923547 @default.
- W2997803752 hasConcept C40231798 @default.
- W2997803752 hasConcept C41008148 @default.
- W2997803752 hasConcept C41895202 @default.
- W2997803752 hasConcept C45374587 @default.
- W2997803752 hasConcept C50522688 @default.
- W2997803752 hasConcept C50644808 @default.
- W2997803752 hasConcept C78458016 @default.
- W2997803752 hasConcept C86803240 @default.
- W2997803752 hasConceptScore W2997803752C10494615 @default.
- W2997803752 hasConceptScore W2997803752C112680207 @default.
- W2997803752 hasConceptScore W2997803752C11413529 @default.
- W2997803752 hasConceptScore W2997803752C115680565 @default.
- W2997803752 hasConceptScore W2997803752C126255220 @default.
- W2997803752 hasConceptScore W2997803752C138885662 @default.
- W2997803752 hasConceptScore W2997803752C14036430 @default.
- W2997803752 hasConceptScore W2997803752C145446738 @default.
- W2997803752 hasConceptScore W2997803752C153258448 @default.
- W2997803752 hasConceptScore W2997803752C154945302 @default.
- W2997803752 hasConceptScore W2997803752C162324750 @default.
- W2997803752 hasConceptScore W2997803752C206688291 @default.
- W2997803752 hasConceptScore W2997803752C2524010 @default.
- W2997803752 hasConceptScore W2997803752C2777303404 @default.
- W2997803752 hasConceptScore W2997803752C28826006 @default.
- W2997803752 hasConceptScore W2997803752C33923547 @default.
- W2997803752 hasConceptScore W2997803752C40231798 @default.
- W2997803752 hasConceptScore W2997803752C41008148 @default.
- W2997803752 hasConceptScore W2997803752C41895202 @default.
- W2997803752 hasConceptScore W2997803752C45374587 @default.
- W2997803752 hasConceptScore W2997803752C50522688 @default.
- W2997803752 hasConceptScore W2997803752C50644808 @default.
- W2997803752 hasConceptScore W2997803752C78458016 @default.
- W2997803752 hasConceptScore W2997803752C86803240 @default.
- W2997803752 hasFunder F4320334704 @default.
- W2997803752 hasIssue "2" @default.
- W2997803752 hasLocation W29978037521 @default.
- W2997803752 hasLocation W29978037522 @default.
- W2997803752 hasOpenAccess W2997803752 @default.
- W2997803752 hasPrimaryLocation W29978037521 @default.
- W2997803752 hasRelatedWork W1526607502 @default.
- W2997803752 hasRelatedWork W1983212821 @default.
- W2997803752 hasRelatedWork W25321933 @default.