Matches in SemOpenAlex for { <https://semopenalex.org/work/W3132234706> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W3132234706 endingPage "114749" @default.
- W3132234706 startingPage "114749" @default.
- W3132234706 abstract "The efficacy and simplicity of using only function evaluations in zeroth-order stochastic optimization (ZOSO) makes it achieve great attention in solving large scale learning tasks. However, the question of how to choose an appropriate step size sequence timely for ZOSO has been less researched. To fill this defect, this paper provides a fast automatic step size selection approach by using an improved Barzilai-Borwein (IBB) technique with the zeroth-order (ZO) gradient estimator for ZOSO. In detail, this work shows the efficacy of the IBB technique by applying it into the advanced ZOSO method, i.e., zeroth-order stochastic variance reduced gradient (ZO-SVRG) method, which leads to a method: ZO-SVRG-IBB. We theoretically analyze the convergence of the ZO-SVRG-IBB method under the random gradient estimator and the coordinate-wise gradient estimator settings, respectively, and show that the convergence rate of ZO-SVRG-IBB matches the best-known convergence rate of advanced ZOSO methods on nonconvex functions. We further show that the query complexity of ZO-SVRG-IBB is comparable to advanced ZOSO methods. Extensive numerical experiments performed on different datasets show that the proposed method outperforms or matches state-of-the-art ZOSO methods." @default.
- W3132234706 created "2021-03-01" @default.
- W3132234706 creator A5000518767 @default.
- W3132234706 date "2021-07-01" @default.
- W3132234706 modified "2023-09-27" @default.
- W3132234706 title "Fast automatic step size selection for zeroth-order nonconvex stochastic optimization" @default.
- W3132234706 cites W2012117977 @default.
- W3132234706 cites W2076605490 @default.
- W3132234706 cites W2089724169 @default.
- W3132234706 cites W2114973703 @default.
- W3132234706 cites W2149479912 @default.
- W3132234706 cites W2171830216 @default.
- W3132234706 cites W2768217841 @default.
- W3132234706 cites W2772692493 @default.
- W3132234706 cites W2796479735 @default.
- W3132234706 cites W2807787263 @default.
- W3132234706 cites W2810910646 @default.
- W3132234706 cites W2905310250 @default.
- W3132234706 cites W2913966198 @default.
- W3132234706 cites W2963470657 @default.
- W3132234706 cites W2963875731 @default.
- W3132234706 cites W2964205597 @default.
- W3132234706 cites W2964305565 @default.
- W3132234706 cites W2969215180 @default.
- W3132234706 cites W2998347911 @default.
- W3132234706 cites W3098950984 @default.
- W3132234706 doi "https://doi.org/10.1016/j.eswa.2021.114749" @default.
- W3132234706 hasPublicationYear "2021" @default.
- W3132234706 type Work @default.
- W3132234706 sameAs 3132234706 @default.
- W3132234706 citedByCount "2" @default.
- W3132234706 countsByYear W31322347062022 @default.
- W3132234706 crossrefType "journal-article" @default.
- W3132234706 hasAuthorship W3132234706A5000518767 @default.
- W3132234706 hasConcept C105795698 @default.
- W3132234706 hasConcept C11413529 @default.
- W3132234706 hasConcept C121955636 @default.
- W3132234706 hasConcept C126255220 @default.
- W3132234706 hasConcept C14036430 @default.
- W3132234706 hasConcept C144133560 @default.
- W3132234706 hasConcept C154945302 @default.
- W3132234706 hasConcept C162324750 @default.
- W3132234706 hasConcept C185429906 @default.
- W3132234706 hasConcept C19499675 @default.
- W3132234706 hasConcept C196083921 @default.
- W3132234706 hasConcept C26517878 @default.
- W3132234706 hasConcept C2777303404 @default.
- W3132234706 hasConcept C33923547 @default.
- W3132234706 hasConcept C38652104 @default.
- W3132234706 hasConcept C41008148 @default.
- W3132234706 hasConcept C50522688 @default.
- W3132234706 hasConcept C57869625 @default.
- W3132234706 hasConcept C62644790 @default.
- W3132234706 hasConcept C78458016 @default.
- W3132234706 hasConcept C81917197 @default.
- W3132234706 hasConcept C86803240 @default.
- W3132234706 hasConceptScore W3132234706C105795698 @default.
- W3132234706 hasConceptScore W3132234706C11413529 @default.
- W3132234706 hasConceptScore W3132234706C121955636 @default.
- W3132234706 hasConceptScore W3132234706C126255220 @default.
- W3132234706 hasConceptScore W3132234706C14036430 @default.
- W3132234706 hasConceptScore W3132234706C144133560 @default.
- W3132234706 hasConceptScore W3132234706C154945302 @default.
- W3132234706 hasConceptScore W3132234706C162324750 @default.
- W3132234706 hasConceptScore W3132234706C185429906 @default.
- W3132234706 hasConceptScore W3132234706C19499675 @default.
- W3132234706 hasConceptScore W3132234706C196083921 @default.
- W3132234706 hasConceptScore W3132234706C26517878 @default.
- W3132234706 hasConceptScore W3132234706C2777303404 @default.
- W3132234706 hasConceptScore W3132234706C33923547 @default.
- W3132234706 hasConceptScore W3132234706C38652104 @default.
- W3132234706 hasConceptScore W3132234706C41008148 @default.
- W3132234706 hasConceptScore W3132234706C50522688 @default.
- W3132234706 hasConceptScore W3132234706C57869625 @default.
- W3132234706 hasConceptScore W3132234706C62644790 @default.
- W3132234706 hasConceptScore W3132234706C78458016 @default.
- W3132234706 hasConceptScore W3132234706C81917197 @default.
- W3132234706 hasConceptScore W3132234706C86803240 @default.
- W3132234706 hasFunder F4320321543 @default.
- W3132234706 hasLocation W31322347061 @default.
- W3132234706 hasOpenAccess W3132234706 @default.
- W3132234706 hasPrimaryLocation W31322347061 @default.
- W3132234706 hasRelatedWork W2022918713 @default.
- W3132234706 hasRelatedWork W2125625044 @default.
- W3132234706 hasRelatedWork W2372527200 @default.
- W3132234706 hasRelatedWork W2555886989 @default.
- W3132234706 hasRelatedWork W2951226321 @default.
- W3132234706 hasRelatedWork W2980964960 @default.
- W3132234706 hasRelatedWork W3031816500 @default.
- W3132234706 hasRelatedWork W3034780828 @default.
- W3132234706 hasRelatedWork W2607196238 @default.
- W3132234706 hasRelatedWork W2774535164 @default.
- W3132234706 hasVolume "174" @default.
- W3132234706 isParatext "false" @default.
- W3132234706 isRetracted "false" @default.
- W3132234706 magId "3132234706" @default.
- W3132234706 workType "article" @default.