FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3204432893> ?p ?o ?g. }

• W3204432893 abstract "First proposed by Seide (2014) as a heuristic, error feedback (EF) is a very popular mechanism for enforcing convergence of distributed gradient-based optimization methods enhanced with communication compression strategies based on the application of contractive compression operators. However, existing theory of EF relies on very strong assumptions (e.g., bounded gradients), and provides pessimistic convergence rates (e.g., while the best known rate for EF in the smooth nonconvex regime, and when full gradients are compressed, is $O(1/T^{2/3})$, the rate of gradient descent in the same regime is $O(1/T)$). Recently, Richt'{a}rik et al. (2021) proposed a new error feedback mechanism, EF21, based on the construction of a Markov compressor induced by a contractive compressor. EF21 removes the aforementioned theoretical deficiencies of EF and at the same time works better in practice. In this work we propose six practical extensions of EF21, all supported by strong convergence theory: partial participation, stochastic approximation, variance reduction, proximal setting, momentum and bidirectional compression. Several of these techniques were never analyzed in conjunction with EF before, and in cases where they were (e.g., bidirectional compression), our rates are vastly superior." @default.
• W3204432893 created "2021-10-11" @default.
• W3204432893 creator A5003899242 @default.
• W3204432893 creator A5036598221 @default.
• W3204432893 creator A5060340617 @default.
• W3204432893 creator A5087594198 @default.
• W3204432893 creator A5090088069 @default.
• W3204432893 date "2021-10-07" @default.
• W3204432893 modified "2023-09-27" @default.
• W3204432893 title "EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback" @default.
• W3204432893 cites W1522301498 @default.
• W3204432893 cites W1851745115 @default.
• W3204432893 cites W1955857676 @default.
• W3204432893 cites W1981042292 @default.
• W3204432893 cites W1988720110 @default.
• W3204432893 cites W2123694203 @default.
• W3204432893 cites W2153635508 @default.
• W3204432893 cites W2194775991 @default.
• W3204432893 cites W2337540838 @default.
• W3204432893 cites W2407022425 @default.
• W3204432893 cites W2535838896 @default.
• W3204432893 cites W2622263826 @default.
• W3204432893 cites W2763081248 @default.
• W3204432893 cites W2808495300 @default.
• W3204432893 cites W2890924858 @default.
• W3204432893 cites W2911863041 @default.
• W3204432893 cites W2914138317 @default.
• W3204432893 cites W2935990182 @default.
• W3204432893 cites W2946198813 @default.
• W3204432893 cites W2946815927 @default.
• W3204432893 cites W2954365017 @default.
• W3204432893 cites W2963376662 @default.
• W3204432893 cites W2963607709 @default.
• W3204432893 cites W2963614065 @default.
• W3204432893 cites W2963766684 @default.
• W3204432893 cites W2964725673 @default.
• W3204432893 cites W2969945254 @default.
• W3204432893 cites W2970289928 @default.
• W3204432893 cites W2970850035 @default.
• W3204432893 cites W2970971581 @default.
• W3204432893 cites W2972453513 @default.
• W3204432893 cites W2993258424 @default.
• W3204432893 cites W2995022099 @default.
• W3204432893 cites W2995435108 @default.
• W3204432893 cites W2996118901 @default.
• W3204432893 cites W3005128411 @default.
• W3204432893 cites W3007528421 @default.
• W3204432893 cites W3024655380 @default.
• W3204432893 cites W3034553394 @default.
• W3204432893 cites W3034666238 @default.
• W3204432893 cites W3037842861 @default.
• W3204432893 cites W3088745370 @default.
• W3204432893 cites W3089426191 @default.
• W3204432893 cites W3096562082 @default.
• W3204432893 cites W3099852766 @default.
• W3204432893 cites W3100770245 @default.
• W3204432893 cites W3101271792 @default.
• W3204432893 cites W3113984671 @default.
• W3204432893 cites W3118608800 @default.
• W3204432893 cites W3125944278 @default.
• W3204432893 cites W3130457203 @default.
• W3204432893 cites W3132163419 @default.
• W3204432893 cites W3133646186 @default.
• W3204432893 cites W3135176055 @default.
• W3204432893 cites W3137382134 @default.
• W3204432893 cites W3166972615 @default.
• W3204432893 cites W3169778642 @default.
• W3204432893 cites W3171665446 @default.
• W3204432893 cites W3171765558 @default.
• W3204432893 cites W3186943716 @default.
• W3204432893 cites W3193203888 @default.
• W3204432893 cites W607505555 @default.
• W3204432893 cites W3089975361 @default.
• W3204432893 hasPublicationYear "2021" @default.
• W3204432893 type Work @default.
• W3204432893 sameAs 3204432893 @default.
• W3204432893 citedByCount "1" @default.
• W3204432893 countsByYear W32044328932021 @default.
• W3204432893 crossrefType "posted-content" @default.
• W3204432893 hasAuthorship W3204432893A5003899242 @default.
• W3204432893 hasAuthorship W3204432893A5036598221 @default.
• W3204432893 hasAuthorship W3204432893A5060340617 @default.
• W3204432893 hasAuthorship W3204432893A5087594198 @default.
• W3204432893 hasAuthorship W3204432893A5090088069 @default.
• W3204432893 hasConcept C11413529 @default.
• W3204432893 hasConcept C121332964 @default.
• W3204432893 hasConcept C121955636 @default.
• W3204432893 hasConcept C126255220 @default.
• W3204432893 hasConcept C127162648 @default.
• W3204432893 hasConcept C131097465 @default.
• W3204432893 hasConcept C153258448 @default.
• W3204432893 hasConcept C154945302 @default.
• W3204432893 hasConcept C162324750 @default.
• W3204432893 hasConcept C173801870 @default.
• W3204432893 hasConcept C180016635 @default.
• W3204432893 hasConcept C196083921 @default.
• W3204432893 hasConcept C2777303404 @default.
• W3204432893 hasConcept C28826006 @default.
• W3204432893 hasConcept C33923547 @default.
• W3204432893 hasConcept C40969351 @default.

• next