FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3048505912> ?p ?o ?g. }

• W3048505912 abstract "In centralized settings, it is well known that stochastic gradient descent (SGD) avoids saddle points and converges to local minima in nonconvex problems. However, similar guarantees are lacking for distributed first-order algorithms. The paper studies distributed stochastic gradient descent (D-SGD)--a simple network-based implementation of SGD. Conditions under which D-SGD avoids saddle points and converges to local minima are studied. First, we consider the problem of computing critical points. Assuming loss functions are nonconvex and possibly nonsmooth, it is shown that, for each fixed initialization, D-SGD converges to critical points of the loss with probability one. Next, we consider the problem of avoiding saddle points. In this case, we again assume that loss functions may be nonconvex and nonsmooth, but are smooth in a neighborhood of a saddle point. It is shown that, for any fixed initialization, D-SGD avoids such saddle points with probability one. Results are proved by studying the underlying (distributed) gradient flow, using the ordinary differential equation (ODE) method of stochastic approximation, and extending classical techniques from dynamical systems theory such as stable manifolds. Results are proved in the general context of subspace-constrained optimization, for which D-SGD is a special case." @default.
• W3048505912 created "2020-08-18" @default.
• W3048505912 creator A5042307561 @default.
• W3048505912 creator A5073143742 @default.
• W3048505912 creator A5077268766 @default.
• W3048505912 creator A5089919262 @default.
• W3048505912 date "2020-03-05" @default.
• W3048505912 modified "2023-09-27" @default.
• W3048505912 title "Distributed Stochastic Gradient Descent: Nonconvexity, Nonsmoothness, and Convergence to Local Minima" @default.
• W3048505912 cites W1518854728 @default.
• W3048505912 cites W1522301498 @default.
• W3048505912 cites W1550918041 @default.
• W3048505912 cites W1551360398 @default.
• W3048505912 cites W1575147392 @default.
• W3048505912 cites W1578099820 @default.
• W3048505912 cites W1593038947 @default.
• W3048505912 cites W1602844557 @default.
• W3048505912 cites W1964757264 @default.
• W3048505912 cites W1967049706 @default.
• W3048505912 cites W1982545958 @default.
• W3048505912 cites W2015836240 @default.
• W3048505912 cites W2029080014 @default.
• W3048505912 cites W2044212084 @default.
• W3048505912 cites W2066332749 @default.
• W3048505912 cites W2067265108 @default.
• W3048505912 cites W2108306501 @default.
• W3048505912 cites W2116612304 @default.
• W3048505912 cites W2117412539 @default.
• W3048505912 cites W2129122308 @default.
• W3048505912 cites W2137435346 @default.
• W3048505912 cites W2184596805 @default.
• W3048505912 cites W2216483973 @default.
• W3048505912 cites W2266148951 @default.
• W3048505912 cites W2416799949 @default.
• W3048505912 cites W2474090883 @default.
• W3048505912 cites W2528062157 @default.
• W3048505912 cites W2602608495 @default.
• W3048505912 cites W2617691536 @default.
• W3048505912 cites W2772283936 @default.
• W3048505912 cites W2782375002 @default.
• W3048505912 cites W2788706426 @default.
• W3048505912 cites W2795577721 @default.
• W3048505912 cites W2891050651 @default.
• W3048505912 cites W2892002891 @default.
• W3048505912 cites W2901889632 @default.
• W3048505912 cites W2911327153 @default.
• W3048505912 cites W2911344305 @default.
• W3048505912 cites W2912544891 @default.
• W3048505912 cites W2915116423 @default.
• W3048505912 cites W2953881522 @default.
• W3048505912 cites W2955291764 @default.
• W3048505912 cites W2963090384 @default.
• W3048505912 cites W2963228337 @default.
• W3048505912 cites W2963318081 @default.
• W3048505912 cites W2963430672 @default.
• W3048505912 cites W2963446564 @default.
• W3048505912 cites W2963687412 @default.
• W3048505912 cites W2963744427 @default.
• W3048505912 cites W2963755123 @default.
• W3048505912 cites W2963794891 @default.
• W3048505912 cites W2963886613 @default.
• W3048505912 cites W2964004607 @default.
• W3048505912 cites W2964106499 @default.
• W3048505912 cites W2964137440 @default.
• W3048505912 cites W2964161337 @default.
• W3048505912 cites W2964210434 @default.
• W3048505912 cites W2969215180 @default.
• W3048505912 cites W2969244409 @default.
• W3048505912 cites W2972203720 @default.
• W3048505912 cites W2985925593 @default.
• W3048505912 cites W2989361410 @default.
• W3048505912 cites W2993018199 @default.
• W3048505912 cites W2997208636 @default.
• W3048505912 cites W3004184337 @default.
• W3048505912 cites W3012207869 @default.
• W3048505912 cites W3015771480 @default.
• W3048505912 cites W3016897523 @default.
• W3048505912 cites W3017195594 @default.
• W3048505912 cites W3023930869 @default.
• W3048505912 cites W3048790388 @default.
• W3048505912 cites W3087736320 @default.
• W3048505912 cites W3099104659 @default.
• W3048505912 cites W3101017602 @default.
• W3048505912 cites W3104871901 @default.
• W3048505912 cites W3123272904 @default.
• W3048505912 hasPublicationYear "2020" @default.
• W3048505912 type Work @default.
• W3048505912 sameAs 3048505912 @default.
• W3048505912 citedByCount "8" @default.
• W3048505912 countsByYear W30485059122020 @default.
• W3048505912 countsByYear W30485059122021 @default.
• W3048505912 crossrefType "posted-content" @default.
• W3048505912 hasAuthorship W3048505912A5042307561 @default.
• W3048505912 hasAuthorship W3048505912A5073143742 @default.
• W3048505912 hasAuthorship W3048505912A5077268766 @default.
• W3048505912 hasAuthorship W3048505912A5089919262 @default.
• W3048505912 hasConcept C114466953 @default.
• W3048505912 hasConcept C116149140 @default.
• W3048505912 hasConcept C119857082 @default.
• W3048505912 hasConcept C126255220 @default.

• next