Matches in SemOpenAlex for { <https://semopenalex.org/work/W4288288344> ?p ?o ?g. }
Showing items 1 to 72 of
72
with 100 items per page.
- W4288288344 abstract "Driven by the need to solve increasingly complex optimization problems in signal processing and machine learning, there has been increasing interest in understanding the behavior of gradient-descent algorithms in non-convex environments. Most available works on distributed non-convex optimization problems focus on the deterministic setting where exact gradients are available at each agent. In this work and its Part II, we consider stochastic cost functions, where exact gradients are replaced by stochastic approximations and the resulting gradient noise persistently seeps into the dynamics of the algorithm. We establish that the diffusion learning strategy continues to yield meaningful estimates non-convex scenarios in the sense that the iterates by the individual agents will cluster in a small region around the network centroid. We use this insight to motivate a short-term model for network evolution over a finite-horizon. In Part II [2] of this work, we leverage this model to establish descent of the diffusion strategy through saddle points in O(1/$mu$) steps and the return of approximately second-order stationary points in a polynomial number of iterations." @default.
- W4288288344 created "2022-07-28" @default.
- W4288288344 creator A5083805703 @default.
- W4288288344 creator A5091103447 @default.
- W4288288344 date "2019-07-03" @default.
- W4288288344 modified "2023-09-29" @default.
- W4288288344 title "Distributed Learning in Non-Convex Environments -- Part I: Agreement at a Linear Rate" @default.
- W4288288344 doi "https://doi.org/10.48550/arxiv.1907.01848" @default.
- W4288288344 hasPublicationYear "2019" @default.
- W4288288344 type Work @default.
- W4288288344 citedByCount "0" @default.
- W4288288344 crossrefType "posted-content" @default.
- W4288288344 hasAuthorship W4288288344A5083805703 @default.
- W4288288344 hasAuthorship W4288288344A5091103447 @default.
- W4288288344 hasBestOaLocation W42882883441 @default.
- W4288288344 hasConcept C112680207 @default.
- W4288288344 hasConcept C120665830 @default.
- W4288288344 hasConcept C121332964 @default.
- W4288288344 hasConcept C126255220 @default.
- W4288288344 hasConcept C134306372 @default.
- W4288288344 hasConcept C140479938 @default.
- W4288288344 hasConcept C145446738 @default.
- W4288288344 hasConcept C146599234 @default.
- W4288288344 hasConcept C153083717 @default.
- W4288288344 hasConcept C153258448 @default.
- W4288288344 hasConcept C154945302 @default.
- W4288288344 hasConcept C157972887 @default.
- W4288288344 hasConcept C189237950 @default.
- W4288288344 hasConcept C192209626 @default.
- W4288288344 hasConcept C2524010 @default.
- W4288288344 hasConcept C2681867 @default.
- W4288288344 hasConcept C28826006 @default.
- W4288288344 hasConcept C33923547 @default.
- W4288288344 hasConcept C41008148 @default.
- W4288288344 hasConcept C50644808 @default.
- W4288288344 hasConceptScore W4288288344C112680207 @default.
- W4288288344 hasConceptScore W4288288344C120665830 @default.
- W4288288344 hasConceptScore W4288288344C121332964 @default.
- W4288288344 hasConceptScore W4288288344C126255220 @default.
- W4288288344 hasConceptScore W4288288344C134306372 @default.
- W4288288344 hasConceptScore W4288288344C140479938 @default.
- W4288288344 hasConceptScore W4288288344C145446738 @default.
- W4288288344 hasConceptScore W4288288344C146599234 @default.
- W4288288344 hasConceptScore W4288288344C153083717 @default.
- W4288288344 hasConceptScore W4288288344C153258448 @default.
- W4288288344 hasConceptScore W4288288344C154945302 @default.
- W4288288344 hasConceptScore W4288288344C157972887 @default.
- W4288288344 hasConceptScore W4288288344C189237950 @default.
- W4288288344 hasConceptScore W4288288344C192209626 @default.
- W4288288344 hasConceptScore W4288288344C2524010 @default.
- W4288288344 hasConceptScore W4288288344C2681867 @default.
- W4288288344 hasConceptScore W4288288344C28826006 @default.
- W4288288344 hasConceptScore W4288288344C33923547 @default.
- W4288288344 hasConceptScore W4288288344C41008148 @default.
- W4288288344 hasConceptScore W4288288344C50644808 @default.
- W4288288344 hasLocation W42882883441 @default.
- W4288288344 hasLocation W42882883442 @default.
- W4288288344 hasOpenAccess W4288288344 @default.
- W4288288344 hasPrimaryLocation W42882883441 @default.
- W4288288344 hasRelatedWork W1501254820 @default.
- W4288288344 hasRelatedWork W1989626574 @default.
- W4288288344 hasRelatedWork W2560848383 @default.
- W4288288344 hasRelatedWork W2898626956 @default.
- W4288288344 hasRelatedWork W2920022891 @default.
- W4288288344 hasRelatedWork W2949123328 @default.
- W4288288344 hasRelatedWork W2953881522 @default.
- W4288288344 hasRelatedWork W3120430922 @default.
- W4288288344 hasRelatedWork W4221163907 @default.
- W4288288344 hasRelatedWork W2495214103 @default.
- W4288288344 isParatext "false" @default.
- W4288288344 isRetracted "false" @default.
- W4288288344 workType "article" @default.