Matches in SemOpenAlex for { <https://semopenalex.org/work/W3204450046> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W3204450046 abstract "Massive amounts of data have led to the training of large-scale machine learning models on a single worker inefficient. Distributed machine learning methods such as Parallel-SGD have received significant interest as a solution to tackle this problem. However, the performance of distributed systems does not scale linearly with the number of workers due to the high network communication cost for synchronizing gradients and parameters. Researchers have proposed techniques such as quantization and sparsification to alleviate this problem by compressing the gradients. Most of the compression schemes result in compressed gradients that cannot be directly aggregated with efficient protocols such as all-reduce. In this paper, we present a set of all-reduce compatible gradient compression schemes which significantly reduce the communication overhead while maintaining the performance of vanilla SGD. We present the results of our experiments with the CIFAR10 dataset and observations derived during the process. Our compression methods perform better than the in-built methods currently offered by the deep learning frameworks. Code is available at the repository: url{this https URL}." @default.
- W3204450046 created "2021-10-11" @default.
- W3204450046 creator A5044595517 @default.
- W3204450046 date "2021-09-26" @default.
- W3204450046 modified "2023-09-27" @default.
- W3204450046 title "Quantization for Distributed Optimization." @default.
- W3204450046 cites W1442374986 @default.
- W3204450046 cites W2009537245 @default.
- W3204450046 cites W2405578611 @default.
- W3204450046 cites W2407022425 @default.
- W3204450046 cites W2563343794 @default.
- W3204450046 cites W2769644379 @default.
- W3204450046 cites W2908007030 @default.
- W3204450046 cites W2914138317 @default.
- W3204450046 cites W2949650786 @default.
- W3204450046 cites W2951781666 @default.
- W3204450046 cites W2963381607 @default.
- W3204450046 cites W2963540381 @default.
- W3204450046 cites W2963766684 @default.
- W3204450046 cites W2963803379 @default.
- W3204450046 cites W2964004663 @default.
- W3204450046 cites W2970289928 @default.
- W3204450046 cites W2970971581 @default.
- W3204450046 cites W3101036738 @default.
- W3204450046 cites W3118608800 @default.
- W3204450046 hasPublicationYear "2021" @default.
- W3204450046 type Work @default.
- W3204450046 sameAs 3204450046 @default.
- W3204450046 citedByCount "0" @default.
- W3204450046 crossrefType "posted-content" @default.
- W3204450046 hasAuthorship W3204450046A5044595517 @default.
- W3204450046 hasConcept C111919701 @default.
- W3204450046 hasConcept C113775141 @default.
- W3204450046 hasConcept C11413529 @default.
- W3204450046 hasConcept C119857082 @default.
- W3204450046 hasConcept C120314980 @default.
- W3204450046 hasConcept C121332964 @default.
- W3204450046 hasConcept C154945302 @default.
- W3204450046 hasConcept C162932704 @default.
- W3204450046 hasConcept C177264268 @default.
- W3204450046 hasConcept C199360897 @default.
- W3204450046 hasConcept C2776760102 @default.
- W3204450046 hasConcept C2778755073 @default.
- W3204450046 hasConcept C2779960059 @default.
- W3204450046 hasConcept C28855332 @default.
- W3204450046 hasConcept C41008148 @default.
- W3204450046 hasConcept C62520636 @default.
- W3204450046 hasConcept C761482 @default.
- W3204450046 hasConcept C76155785 @default.
- W3204450046 hasConcept C98045186 @default.
- W3204450046 hasConceptScore W3204450046C111919701 @default.
- W3204450046 hasConceptScore W3204450046C113775141 @default.
- W3204450046 hasConceptScore W3204450046C11413529 @default.
- W3204450046 hasConceptScore W3204450046C119857082 @default.
- W3204450046 hasConceptScore W3204450046C120314980 @default.
- W3204450046 hasConceptScore W3204450046C121332964 @default.
- W3204450046 hasConceptScore W3204450046C154945302 @default.
- W3204450046 hasConceptScore W3204450046C162932704 @default.
- W3204450046 hasConceptScore W3204450046C177264268 @default.
- W3204450046 hasConceptScore W3204450046C199360897 @default.
- W3204450046 hasConceptScore W3204450046C2776760102 @default.
- W3204450046 hasConceptScore W3204450046C2778755073 @default.
- W3204450046 hasConceptScore W3204450046C2779960059 @default.
- W3204450046 hasConceptScore W3204450046C28855332 @default.
- W3204450046 hasConceptScore W3204450046C41008148 @default.
- W3204450046 hasConceptScore W3204450046C62520636 @default.
- W3204450046 hasConceptScore W3204450046C761482 @default.
- W3204450046 hasConceptScore W3204450046C76155785 @default.
- W3204450046 hasConceptScore W3204450046C98045186 @default.
- W3204450046 hasLocation W32044500461 @default.
- W3204450046 hasOpenAccess W3204450046 @default.
- W3204450046 hasPrimaryLocation W32044500461 @default.
- W3204450046 hasRelatedWork W2617019596 @default.
- W3204450046 hasRelatedWork W2901028208 @default.
- W3204450046 hasRelatedWork W2946198813 @default.
- W3204450046 hasRelatedWork W2950819300 @default.
- W3204450046 hasRelatedWork W2952369090 @default.
- W3204450046 hasRelatedWork W2962710991 @default.
- W3204450046 hasRelatedWork W3011763294 @default.
- W3204450046 hasRelatedWork W3024699729 @default.
- W3204450046 hasRelatedWork W3048804513 @default.
- W3204450046 hasRelatedWork W3087165870 @default.
- W3204450046 hasRelatedWork W3096004388 @default.
- W3204450046 hasRelatedWork W3098228191 @default.
- W3204450046 hasRelatedWork W3105148963 @default.
- W3204450046 hasRelatedWork W3131685502 @default.
- W3204450046 hasRelatedWork W3131880614 @default.
- W3204450046 hasRelatedWork W3170507245 @default.
- W3204450046 hasRelatedWork W3174871729 @default.
- W3204450046 hasRelatedWork W3198707348 @default.
- W3204450046 hasRelatedWork W3204507145 @default.
- W3204450046 hasRelatedWork W3212271975 @default.
- W3204450046 isParatext "false" @default.
- W3204450046 isRetracted "false" @default.
- W3204450046 magId "3204450046" @default.
- W3204450046 workType "article" @default.