Matches in SemOpenAlex for { <https://semopenalex.org/work/W2971384159> ?p ?o ?g. }
- W2971384159 abstract "This paper studies a decentralized stochastic gradient tracking (DSGT) algorithm for non-convex empirical risk minimization problems over a peer-to-peer network of nodes, which is in sharp contrast to the existing DSGT only for convex problems. To ensure exact convergence and handle the variance among decentralized datasets, each node performs a stochastic gradient (SG) tracking step by using a mini-batch of samples, where the batch size is designed to be proportional to the size of the local dataset. We explicitly evaluate the convergence rate of DSGT with respect to the number of iterations in terms of algebraic connectivity of the network, mini-batch size, gradient variance, etc. Under certain conditions, we further show that DSGT has a network independence property in the sense that the network topology only affects the convergence rate up to a constant factor. Hence, the convergence rate of DSGT can be comparable to the centralized SGD method. Moreover, a linear speedup of DSGT with respect to the number of nodes is achievable for some scenarios. Numerical experiments for neural networks and logistic regression problems on CIFAR-10 finally illustrate the advantages of DSGT." @default.
- W2971384159 created "2019-09-12" @default.
- W2971384159 creator A5020285133 @default.
- W2971384159 creator A5088962631 @default.
- W2971384159 date "2019-09-06" @default.
- W2971384159 modified "2023-09-29" @default.
- W2971384159 title "Decentralized Stochastic Gradient Tracking for Empirical Risk Minimization" @default.
- W2971384159 cites W1992208280 @default.
- W2971384159 cites W2072566913 @default.
- W2971384159 cites W2074796812 @default.
- W2971384159 cites W2107438106 @default.
- W2971384159 cites W2112796928 @default.
- W2971384159 cites W2120293976 @default.
- W2971384159 cites W2129123449 @default.
- W2971384159 cites W2168231600 @default.
- W2971384159 cites W2216483973 @default.
- W2971384159 cites W2591577911 @default.
- W2971384159 cites W2789243870 @default.
- W2971384159 cites W2911327153 @default.
- W2971384159 cites W2944542720 @default.
- W2971384159 cites W2952215077 @default.
- W2971384159 cites W2962863496 @default.
- W2971384159 cites W2963023064 @default.
- W2971384159 cites W2963156126 @default.
- W2971384159 cites W2963228337 @default.
- W2971384159 cites W2963247030 @default.
- W2971384159 cites W2963433607 @default.
- W2971384159 cites W2963649943 @default.
- W2971384159 cites W2963903325 @default.
- W2971384159 cites W3099715789 @default.
- W2971384159 cites W3100513551 @default.
- W2971384159 hasPublicationYear "2019" @default.
- W2971384159 type Work @default.
- W2971384159 sameAs 2971384159 @default.
- W2971384159 citedByCount "5" @default.
- W2971384159 countsByYear W29713841592019 @default.
- W2971384159 countsByYear W29713841592020 @default.
- W2971384159 countsByYear W29713841592023 @default.
- W2971384159 crossrefType "posted-content" @default.
- W2971384159 hasAuthorship W2971384159A5020285133 @default.
- W2971384159 hasAuthorship W2971384159A5088962631 @default.
- W2971384159 hasConcept C105795698 @default.
- W2971384159 hasConcept C111919701 @default.
- W2971384159 hasConcept C121955636 @default.
- W2971384159 hasConcept C126255220 @default.
- W2971384159 hasConcept C127162648 @default.
- W2971384159 hasConcept C127413603 @default.
- W2971384159 hasConcept C144133560 @default.
- W2971384159 hasConcept C147764199 @default.
- W2971384159 hasConcept C162324750 @default.
- W2971384159 hasConcept C196083921 @default.
- W2971384159 hasConcept C199845137 @default.
- W2971384159 hasConcept C2777303404 @default.
- W2971384159 hasConcept C31258907 @default.
- W2971384159 hasConcept C33923547 @default.
- W2971384159 hasConcept C35651441 @default.
- W2971384159 hasConcept C41008148 @default.
- W2971384159 hasConcept C50522688 @default.
- W2971384159 hasConcept C57869625 @default.
- W2971384159 hasConcept C62611344 @default.
- W2971384159 hasConcept C66938386 @default.
- W2971384159 hasConceptScore W2971384159C105795698 @default.
- W2971384159 hasConceptScore W2971384159C111919701 @default.
- W2971384159 hasConceptScore W2971384159C121955636 @default.
- W2971384159 hasConceptScore W2971384159C126255220 @default.
- W2971384159 hasConceptScore W2971384159C127162648 @default.
- W2971384159 hasConceptScore W2971384159C127413603 @default.
- W2971384159 hasConceptScore W2971384159C144133560 @default.
- W2971384159 hasConceptScore W2971384159C147764199 @default.
- W2971384159 hasConceptScore W2971384159C162324750 @default.
- W2971384159 hasConceptScore W2971384159C196083921 @default.
- W2971384159 hasConceptScore W2971384159C199845137 @default.
- W2971384159 hasConceptScore W2971384159C2777303404 @default.
- W2971384159 hasConceptScore W2971384159C31258907 @default.
- W2971384159 hasConceptScore W2971384159C33923547 @default.
- W2971384159 hasConceptScore W2971384159C35651441 @default.
- W2971384159 hasConceptScore W2971384159C41008148 @default.
- W2971384159 hasConceptScore W2971384159C50522688 @default.
- W2971384159 hasConceptScore W2971384159C57869625 @default.
- W2971384159 hasConceptScore W2971384159C62611344 @default.
- W2971384159 hasConceptScore W2971384159C66938386 @default.
- W2971384159 hasLocation W29713841591 @default.
- W2971384159 hasOpenAccess W2971384159 @default.
- W2971384159 hasPrimaryLocation W29713841591 @default.
- W2971384159 hasRelatedWork W1571416372 @default.
- W2971384159 hasRelatedWork W2246576978 @default.
- W2971384159 hasRelatedWork W2777212642 @default.
- W2971384159 hasRelatedWork W2789243870 @default.
- W2971384159 hasRelatedWork W2898399115 @default.
- W2971384159 hasRelatedWork W2902410171 @default.
- W2971384159 hasRelatedWork W2947064482 @default.
- W2971384159 hasRelatedWork W2950371374 @default.
- W2971384159 hasRelatedWork W2963228337 @default.
- W2971384159 hasRelatedWork W2963649943 @default.
- W2971384159 hasRelatedWork W2963831642 @default.
- W2971384159 hasRelatedWork W2981831462 @default.
- W2971384159 hasRelatedWork W2993087438 @default.
- W2971384159 hasRelatedWork W3011020921 @default.
- W2971384159 hasRelatedWork W3024910038 @default.
- W2971384159 hasRelatedWork W3037299979 @default.