FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3201168031> ?p ?o ?g. }

• W3201168031 abstract "The communication of gradients is a key bottleneck in distributed training of large scale machine learning models. In order to reduce the communication cost, gradient compression (e.g., sparsification and quantization) and error compensation techniques are often used. In this paper, we propose and study three new efficient methods in this space: error compensated loopless SVRG method (EC-LSVRG), error compensated Quartz (EC-Quartz), and error compensated SDCA (EC-SDCA). Our method is capable of working with any contraction compressor (e.g., TopK compressor), and we perform analysis for convex optimization problems in the composite case and smooth case for EC-LSVRG. We prove linear convergence rates for both cases and show that in the smooth case the rate has a better dependence on the parameter associated with the contraction compressor. Further, we show that in the smooth case, and under some certain conditions, error compensated loopless SVRG has the same convergence rate as the vanilla loopless SVRG method. Then we show that the convergence rates of EC-Quartz and EC-SDCA in the composite case are as good as EC-LSVRG in the smooth case. Finally, numerical experiments are presented to illustrate the efficiency of our methods." @default.
• W3201168031 created "2021-09-27" @default.
• W3201168031 creator A5014152561 @default.
• W3201168031 creator A5036598221 @default.
• W3201168031 creator A5037709424 @default.
• W3201168031 creator A5061778641 @default.
• W3201168031 date "2021-09-21" @default.
• W3201168031 modified "2023-09-27" @default.
• W3201168031 title "Error Compensated Loopless SVRG, Quartz, and SDCA for Distributed Optimization" @default.
• W3201168031 cites W1939652453 @default.
• W3201168031 cites W2138243089 @default.
• W3201168031 cites W2153635508 @default.
• W3201168031 cites W2195435876 @default.
• W3201168031 cites W2199097987 @default.
• W3201168031 cites W2407022425 @default.
• W3201168031 cites W2622263826 @default.
• W3201168031 cites W2749988060 @default.
• W3201168031 cites W2769644379 @default.
• W3201168031 cites W2889676205 @default.
• W3201168031 cites W2890924858 @default.
• W3201168031 cites W2914138317 @default.
• W3201168031 cites W2935990182 @default.
• W3201168031 cites W2946198813 @default.
• W3201168031 cites W2946815927 @default.
• W3201168031 cites W2948628224 @default.
• W3201168031 cites W2950826569 @default.
• W3201168031 cites W2951781666 @default.
• W3201168031 cites W2952033860 @default.
• W3201168031 cites W2963179579 @default.
• W3201168031 cites W2963664311 @default.
• W3201168031 cites W2963766684 @default.
• W3201168031 cites W2963903325 @default.
• W3201168031 cites W2964004663 @default.
• W3201168031 cites W2964163156 @default.
• W3201168031 cites W2964289555 @default.
• W3201168031 cites W2973096819 @default.
• W3201168031 cites W3007528421 @default.
• W3201168031 cites W3037568070 @default.
• W3201168031 cites W3093577692 @default.
• W3201168031 hasPublicationYear "2021" @default.
• W3201168031 type Work @default.
• W3201168031 sameAs 3201168031 @default.
• W3201168031 citedByCount "1" @default.
• W3201168031 countsByYear W32011680312021 @default.
• W3201168031 crossrefType "posted-content" @default.
• W3201168031 hasAuthorship W3201168031A5014152561 @default.
• W3201168031 hasAuthorship W3201168031A5036598221 @default.
• W3201168031 hasAuthorship W3201168031A5037709424 @default.
• W3201168031 hasAuthorship W3201168031A5061778641 @default.
• W3201168031 hasConcept C11171543 @default.
• W3201168031 hasConcept C11413529 @default.
• W3201168031 hasConcept C126255220 @default.
• W3201168031 hasConcept C126322002 @default.
• W3201168031 hasConcept C149635348 @default.
• W3201168031 hasConcept C154945302 @default.
• W3201168031 hasConcept C15744967 @default.
• W3201168031 hasConcept C159985019 @default.
• W3201168031 hasConcept C163415756 @default.
• W3201168031 hasConcept C192562407 @default.
• W3201168031 hasConcept C26517878 @default.
• W3201168031 hasConcept C2779870107 @default.
• W3201168031 hasConcept C2780023022 @default.
• W3201168031 hasConcept C2780513914 @default.
• W3201168031 hasConcept C33923547 @default.
• W3201168031 hasConcept C38652104 @default.
• W3201168031 hasConcept C40969351 @default.
• W3201168031 hasConcept C41008148 @default.
• W3201168031 hasConcept C57869625 @default.
• W3201168031 hasConcept C71924100 @default.
• W3201168031 hasConceptScore W3201168031C11171543 @default.
• W3201168031 hasConceptScore W3201168031C11413529 @default.
• W3201168031 hasConceptScore W3201168031C126255220 @default.
• W3201168031 hasConceptScore W3201168031C126322002 @default.
• W3201168031 hasConceptScore W3201168031C149635348 @default.
• W3201168031 hasConceptScore W3201168031C154945302 @default.
• W3201168031 hasConceptScore W3201168031C15744967 @default.
• W3201168031 hasConceptScore W3201168031C159985019 @default.
• W3201168031 hasConceptScore W3201168031C163415756 @default.
• W3201168031 hasConceptScore W3201168031C192562407 @default.
• W3201168031 hasConceptScore W3201168031C26517878 @default.
• W3201168031 hasConceptScore W3201168031C2779870107 @default.
• W3201168031 hasConceptScore W3201168031C2780023022 @default.
• W3201168031 hasConceptScore W3201168031C2780513914 @default.
• W3201168031 hasConceptScore W3201168031C33923547 @default.
• W3201168031 hasConceptScore W3201168031C38652104 @default.
• W3201168031 hasConceptScore W3201168031C40969351 @default.
• W3201168031 hasConceptScore W3201168031C41008148 @default.
• W3201168031 hasConceptScore W3201168031C57869625 @default.
• W3201168031 hasConceptScore W3201168031C71924100 @default.
• W3201168031 hasLocation W32011680311 @default.
• W3201168031 hasOpenAccess W3201168031 @default.
• W3201168031 hasPrimaryLocation W32011680311 @default.
• W3201168031 hasRelatedWork W1430782836 @default.
• W3201168031 hasRelatedWork W1904659079 @default.
• W3201168031 hasRelatedWork W1982072775 @default.
• W3201168031 hasRelatedWork W2246112431 @default.
• W3201168031 hasRelatedWork W2384770231 @default.
• W3201168031 hasRelatedWork W2574426558 @default.
• W3201168031 hasRelatedWork W2807114324 @default.
• W3201168031 hasRelatedWork W2937070862 @default.

• next