Matches in SemOpenAlex for { <https://semopenalex.org/work/W2890721294> ?p ?o ?g. }
- W2890721294 abstract "We examine fundamental tradeoffs in iterative distributed zeroth and first order stochastic optimization in multi-agent networks in terms of emph{communication cost} (number of per-node transmissions) and emph{computational cost}, measured by the number of per-node noisy function (respectively, gradient) evaluations with zeroth order (respectively, first order) methods. Specifically, we develop novel distributed stochastic optimization methods for zeroth and first order strongly convex optimization by utilizing a probabilistic inter-agent communication protocol that increasingly sparsifies communications among agents as time progresses. Under standard assumptions on the cost functions and the noise statistics, we establish with the proposed method the $O(1/(C_{mathrm{comm}})^{4/3-zeta})$ and $O(1/(C_{mathrm{comm}})^{8/9-zeta})$ mean square error convergence rates, for the first and zeroth order optimization, respectively, where $C_{mathrm{comm}}$ is the expected number of network communications and $zeta>0$ is arbitrarily small. The methods are shown to achieve order-optimal convergence rates in terms of computational cost~$C_{mathrm{comp}}$, $O(1/C_{mathrm{comp}})$ (first order optimization) and $O(1/(C_{mathrm{comp}})^{2/3})$ (zeroth order optimization), while achieving the order-optimal convergence rates in terms of iterations. Experiments on real-life datasets illustrate the efficacy of the proposed algorithms." @default.
- W2890721294 created "2018-09-27" @default.
- W2890721294 creator A5019965945 @default.
- W2890721294 creator A5070836307 @default.
- W2890721294 creator A5077197425 @default.
- W2890721294 creator A5077268766 @default.
- W2890721294 date "2018-09-09" @default.
- W2890721294 modified "2023-10-17" @default.
- W2890721294 title "Communication-Efficient Distributed Strongly Convex Stochastic Optimization: Non-Asymptotic Rates" @default.
- W2890721294 cites W1511263746 @default.
- W2890721294 cites W1571416372 @default.
- W2890721294 cites W1616857247 @default.
- W2890721294 cites W2009797711 @default.
- W2890721294 cites W2106901427 @default.
- W2890721294 cites W2124289529 @default.
- W2890721294 cites W2129122308 @default.
- W2890721294 cites W2136517470 @default.
- W2890721294 cites W2143375189 @default.
- W2890721294 cites W2148603752 @default.
- W2890721294 cites W2164278908 @default.
- W2890721294 cites W2168803043 @default.
- W2890721294 cites W2171830216 @default.
- W2890721294 cites W2216483973 @default.
- W2890721294 cites W2541688248 @default.
- W2890721294 cites W2590635385 @default.
- W2890721294 cites W2742134852 @default.
- W2890721294 cites W2765166321 @default.
- W2890721294 cites W2783546842 @default.
- W2890721294 cites W2789912105 @default.
- W2890721294 cites W2790770692 @default.
- W2890721294 cites W2963076621 @default.
- W2890721294 cites W2963156126 @default.
- W2890721294 cites W2963515790 @default.
- W2890721294 cites W2963627197 @default.
- W2890721294 cites W2963855576 @default.
- W2890721294 cites W2964191394 @default.
- W2890721294 hasPublicationYear "2018" @default.
- W2890721294 type Work @default.
- W2890721294 sameAs 2890721294 @default.
- W2890721294 citedByCount "6" @default.
- W2890721294 countsByYear W28907212942019 @default.
- W2890721294 countsByYear W28907212942020 @default.
- W2890721294 countsByYear W28907212942021 @default.
- W2890721294 crossrefType "posted-content" @default.
- W2890721294 hasAuthorship W2890721294A5019965945 @default.
- W2890721294 hasAuthorship W2890721294A5070836307 @default.
- W2890721294 hasAuthorship W2890721294A5077197425 @default.
- W2890721294 hasAuthorship W2890721294A5077268766 @default.
- W2890721294 hasConcept C10138342 @default.
- W2890721294 hasConcept C112680207 @default.
- W2890721294 hasConcept C11413529 @default.
- W2890721294 hasConcept C121332964 @default.
- W2890721294 hasConcept C126255220 @default.
- W2890721294 hasConcept C127162648 @default.
- W2890721294 hasConcept C145446738 @default.
- W2890721294 hasConcept C157972887 @default.
- W2890721294 hasConcept C162324750 @default.
- W2890721294 hasConcept C182306322 @default.
- W2890721294 hasConcept C194387892 @default.
- W2890721294 hasConcept C2524010 @default.
- W2890721294 hasConcept C2777303404 @default.
- W2890721294 hasConcept C33923547 @default.
- W2890721294 hasConcept C41008148 @default.
- W2890721294 hasConcept C50522688 @default.
- W2890721294 hasConcept C57869625 @default.
- W2890721294 hasConcept C62520636 @default.
- W2890721294 hasConcept C62611344 @default.
- W2890721294 hasConcept C68755742 @default.
- W2890721294 hasConcept C76155785 @default.
- W2890721294 hasConceptScore W2890721294C10138342 @default.
- W2890721294 hasConceptScore W2890721294C112680207 @default.
- W2890721294 hasConceptScore W2890721294C11413529 @default.
- W2890721294 hasConceptScore W2890721294C121332964 @default.
- W2890721294 hasConceptScore W2890721294C126255220 @default.
- W2890721294 hasConceptScore W2890721294C127162648 @default.
- W2890721294 hasConceptScore W2890721294C145446738 @default.
- W2890721294 hasConceptScore W2890721294C157972887 @default.
- W2890721294 hasConceptScore W2890721294C162324750 @default.
- W2890721294 hasConceptScore W2890721294C182306322 @default.
- W2890721294 hasConceptScore W2890721294C194387892 @default.
- W2890721294 hasConceptScore W2890721294C2524010 @default.
- W2890721294 hasConceptScore W2890721294C2777303404 @default.
- W2890721294 hasConceptScore W2890721294C33923547 @default.
- W2890721294 hasConceptScore W2890721294C41008148 @default.
- W2890721294 hasConceptScore W2890721294C50522688 @default.
- W2890721294 hasConceptScore W2890721294C57869625 @default.
- W2890721294 hasConceptScore W2890721294C62520636 @default.
- W2890721294 hasConceptScore W2890721294C62611344 @default.
- W2890721294 hasConceptScore W2890721294C68755742 @default.
- W2890721294 hasConceptScore W2890721294C76155785 @default.
- W2890721294 hasLocation W28907212941 @default.
- W2890721294 hasOpenAccess W2890721294 @default.
- W2890721294 hasPrimaryLocation W28907212941 @default.
- W2890721294 hasRelatedWork W1571416372 @default.
- W2890721294 hasRelatedWork W1616481901 @default.
- W2890721294 hasRelatedWork W1708022953 @default.
- W2890721294 hasRelatedWork W2044212084 @default.
- W2890721294 hasRelatedWork W2066332749 @default.
- W2890721294 hasRelatedWork W2075181955 @default.
- W2890721294 hasRelatedWork W2120350480 @default.