Matches in SemOpenAlex for { <https://semopenalex.org/work/W3088147970> ?p ?o ?g. }
- W3088147970 abstract "Efficient construction of checkpoints/snapshots is a critical tool for training and diagnosing deep learning models. In this paper, we propose a lossy compression scheme for checkpoint constructions (called LC-Checkpoint). LC-Checkpoint simultaneously maximizes the compression rate and optimizes the recovery speed, under the assumption that SGD is used to train the model. LC-Checkpointuses quantization and priority promotion to store the most crucial information for SGD to recover, and then uses a Huffman coding to leverage the non-uniform distribution of the gradient scales. Our extensive experiments show that LC-Checkpoint achieves a compression rate up to $28times$ and recovery speedup up to $5.77times$ over a state-of-the-art algorithm (SCAR)." @default.
- W3088147970 created "2020-10-01" @default.
- W3088147970 creator A5049692186 @default.
- W3088147970 creator A5052676364 @default.
- W3088147970 creator A5058025888 @default.
- W3088147970 creator A5070648432 @default.
- W3088147970 date "2020-09-28" @default.
- W3088147970 modified "2023-09-23" @default.
- W3088147970 title "On Efficient Constructions of Checkpoints." @default.
- W3088147970 cites W11483397 @default.
- W3088147970 cites W1499021337 @default.
- W3088147970 cites W1902934009 @default.
- W3088147970 cites W2083842231 @default.
- W3088147970 cites W2112796928 @default.
- W3088147970 cites W2157988812 @default.
- W3088147970 cites W2219888463 @default.
- W3088147970 cites W2233116163 @default.
- W3088147970 cites W2271840356 @default.
- W3088147970 cites W2286365479 @default.
- W3088147970 cites W2295652899 @default.
- W3088147970 cites W2300242332 @default.
- W3088147970 cites W2319920447 @default.
- W3088147970 cites W2557283755 @default.
- W3088147970 cites W2593245696 @default.
- W3088147970 cites W2605643718 @default.
- W3088147970 cites W2619096655 @default.
- W3088147970 cites W2748818695 @default.
- W3088147970 cites W2750384547 @default.
- W3088147970 cites W2764800686 @default.
- W3088147970 cites W2769644379 @default.
- W3088147970 cites W2885836230 @default.
- W3088147970 cites W2949117887 @default.
- W3088147970 cites W2949364482 @default.
- W3088147970 cites W2962833442 @default.
- W3088147970 cites W2963319203 @default.
- W3088147970 cites W2963674932 @default.
- W3088147970 cites W2963981420 @default.
- W3088147970 cites W2964299589 @default.
- W3088147970 cites W2970421227 @default.
- W3088147970 cites W80079294 @default.
- W3088147970 hasPublicationYear "2020" @default.
- W3088147970 type Work @default.
- W3088147970 sameAs 3088147970 @default.
- W3088147970 citedByCount "0" @default.
- W3088147970 crossrefType "posted-content" @default.
- W3088147970 hasAuthorship W3088147970A5049692186 @default.
- W3088147970 hasAuthorship W3088147970A5052676364 @default.
- W3088147970 hasAuthorship W3088147970A5058025888 @default.
- W3088147970 hasAuthorship W3088147970A5070648432 @default.
- W3088147970 hasConcept C105795698 @default.
- W3088147970 hasConcept C113775141 @default.
- W3088147970 hasConcept C11413529 @default.
- W3088147970 hasConcept C115961682 @default.
- W3088147970 hasConcept C13481523 @default.
- W3088147970 hasConcept C153083717 @default.
- W3088147970 hasConcept C154945302 @default.
- W3088147970 hasConcept C165021410 @default.
- W3088147970 hasConcept C173608175 @default.
- W3088147970 hasConcept C179518139 @default.
- W3088147970 hasConcept C28855332 @default.
- W3088147970 hasConcept C33923547 @default.
- W3088147970 hasConcept C41008148 @default.
- W3088147970 hasConcept C46900642 @default.
- W3088147970 hasConcept C68339613 @default.
- W3088147970 hasConcept C78548338 @default.
- W3088147970 hasConcept C9417928 @default.
- W3088147970 hasConcept C94835093 @default.
- W3088147970 hasConceptScore W3088147970C105795698 @default.
- W3088147970 hasConceptScore W3088147970C113775141 @default.
- W3088147970 hasConceptScore W3088147970C11413529 @default.
- W3088147970 hasConceptScore W3088147970C115961682 @default.
- W3088147970 hasConceptScore W3088147970C13481523 @default.
- W3088147970 hasConceptScore W3088147970C153083717 @default.
- W3088147970 hasConceptScore W3088147970C154945302 @default.
- W3088147970 hasConceptScore W3088147970C165021410 @default.
- W3088147970 hasConceptScore W3088147970C173608175 @default.
- W3088147970 hasConceptScore W3088147970C179518139 @default.
- W3088147970 hasConceptScore W3088147970C28855332 @default.
- W3088147970 hasConceptScore W3088147970C33923547 @default.
- W3088147970 hasConceptScore W3088147970C41008148 @default.
- W3088147970 hasConceptScore W3088147970C46900642 @default.
- W3088147970 hasConceptScore W3088147970C68339613 @default.
- W3088147970 hasConceptScore W3088147970C78548338 @default.
- W3088147970 hasConceptScore W3088147970C9417928 @default.
- W3088147970 hasConceptScore W3088147970C94835093 @default.
- W3088147970 hasOpenAccess W3088147970 @default.
- W3088147970 hasRelatedWork W1501508358 @default.
- W3088147970 hasRelatedWork W1503452384 @default.
- W3088147970 hasRelatedWork W2133941677 @default.
- W3088147970 hasRelatedWork W2177501142 @default.
- W3088147970 hasRelatedWork W2357608825 @default.
- W3088147970 hasRelatedWork W2758162718 @default.
- W3088147970 hasRelatedWork W2780033725 @default.
- W3088147970 hasRelatedWork W2789197829 @default.
- W3088147970 hasRelatedWork W2890976079 @default.
- W3088147970 hasRelatedWork W2891800530 @default.
- W3088147970 hasRelatedWork W2921917212 @default.
- W3088147970 hasRelatedWork W2942142338 @default.
- W3088147970 hasRelatedWork W2946900926 @default.
- W3088147970 hasRelatedWork W2952634710 @default.