Matches in SemOpenAlex for { <https://semopenalex.org/work/W4293658473> ?p ?o ?g. }
- W4293658473 abstract "Abstract Although more layers and more parameters generally improve the accuracy of the models, such big models generally have high computational complexity and require big memory, which exceed the capacity of small devices for inference and incurs long training time. In addition, it is difficult to afford long training time and inference time of big models even in high performance servers, as well. As an efficient approach to compress a large deep model (a teacher model) to a compact model (a student model), knowledge distillation emerges as a promising approach to deal with the big models. Existing knowledge distillation methods cannot exploit the elastic available computing resources and correspond to low efficiency. In this paper, we propose an Elastic Deep Learning framework for knowledge Distillation, that is, EDL‐Dist. The advantages of EDL‐Dist are threefold. First, the inference and the training process is separated. Second, elastic available computing resources can be utilized to improve the efficiency. Third, fault‐tolerance of the training and inference processes is supported. We take extensive experimentation to show that the throughput of EDL‐Dist is up to 3.125 times faster than the baseline method (online knowledge distillation) while the accuracy is similar or higher." @default.
- W4293658473 created "2022-08-31" @default.
- W4293658473 creator A5021332177 @default.
- W4293658473 creator A5027969886 @default.
- W4293658473 creator A5031178158 @default.
- W4293658473 creator A5041964026 @default.
- W4293658473 creator A5046434641 @default.
- W4293658473 creator A5084125013 @default.
- W4293658473 creator A5084155236 @default.
- W4293658473 creator A5088395705 @default.
- W4293658473 date "2022-08-28" @default.
- W4293658473 modified "2023-10-14" @default.
- W4293658473 title "Large‐scale knowledge distillation with elastic heterogeneous computing resources" @default.
- W4293658473 cites W1502629466 @default.
- W4293658473 cites W1996796871 @default.
- W4293658473 cites W2045271686 @default.
- W4293658473 cites W2097117768 @default.
- W4293658473 cites W2108598243 @default.
- W4293658473 cites W2194775991 @default.
- W4293658473 cites W2294370754 @default.
- W4293658473 cites W2620998106 @default.
- W4293658473 cites W2889369110 @default.
- W4293658473 cites W2912213068 @default.
- W4293658473 cites W2966825072 @default.
- W4293658473 cites W2969388332 @default.
- W4293658473 cites W2996970889 @default.
- W4293658473 cites W3035748372 @default.
- W4293658473 cites W3048083653 @default.
- W4293658473 cites W3189252217 @default.
- W4293658473 cites W4200630381 @default.
- W4293658473 cites W4220738117 @default.
- W4293658473 cites W4256080149 @default.
- W4293658473 cites W4285603559 @default.
- W4293658473 cites W4320067864 @default.
- W4293658473 doi "https://doi.org/10.1002/cpe.7272" @default.
- W4293658473 hasPublicationYear "2022" @default.
- W4293658473 type Work @default.
- W4293658473 citedByCount "2" @default.
- W4293658473 countsByYear W42936584732023 @default.
- W4293658473 crossrefType "journal-article" @default.
- W4293658473 hasAuthorship W4293658473A5021332177 @default.
- W4293658473 hasAuthorship W4293658473A5027969886 @default.
- W4293658473 hasAuthorship W4293658473A5031178158 @default.
- W4293658473 hasAuthorship W4293658473A5041964026 @default.
- W4293658473 hasAuthorship W4293658473A5046434641 @default.
- W4293658473 hasAuthorship W4293658473A5084125013 @default.
- W4293658473 hasAuthorship W4293658473A5084155236 @default.
- W4293658473 hasAuthorship W4293658473A5088395705 @default.
- W4293658473 hasBestOaLocation W42936584732 @default.
- W4293658473 hasConcept C108583219 @default.
- W4293658473 hasConcept C111335779 @default.
- W4293658473 hasConcept C111919701 @default.
- W4293658473 hasConcept C119857082 @default.
- W4293658473 hasConcept C120314980 @default.
- W4293658473 hasConcept C121332964 @default.
- W4293658473 hasConcept C124101348 @default.
- W4293658473 hasConcept C136764020 @default.
- W4293658473 hasConcept C154945302 @default.
- W4293658473 hasConcept C157764524 @default.
- W4293658473 hasConcept C165696696 @default.
- W4293658473 hasConcept C178790620 @default.
- W4293658473 hasConcept C185592680 @default.
- W4293658473 hasConcept C204030448 @default.
- W4293658473 hasConcept C2524010 @default.
- W4293658473 hasConcept C2776214188 @default.
- W4293658473 hasConcept C2778755073 @default.
- W4293658473 hasConcept C33923547 @default.
- W4293658473 hasConcept C38652104 @default.
- W4293658473 hasConcept C41008148 @default.
- W4293658473 hasConcept C555944384 @default.
- W4293658473 hasConcept C62520636 @default.
- W4293658473 hasConcept C75684735 @default.
- W4293658473 hasConcept C76155785 @default.
- W4293658473 hasConcept C93996380 @default.
- W4293658473 hasConcept C98045186 @default.
- W4293658473 hasConceptScore W4293658473C108583219 @default.
- W4293658473 hasConceptScore W4293658473C111335779 @default.
- W4293658473 hasConceptScore W4293658473C111919701 @default.
- W4293658473 hasConceptScore W4293658473C119857082 @default.
- W4293658473 hasConceptScore W4293658473C120314980 @default.
- W4293658473 hasConceptScore W4293658473C121332964 @default.
- W4293658473 hasConceptScore W4293658473C124101348 @default.
- W4293658473 hasConceptScore W4293658473C136764020 @default.
- W4293658473 hasConceptScore W4293658473C154945302 @default.
- W4293658473 hasConceptScore W4293658473C157764524 @default.
- W4293658473 hasConceptScore W4293658473C165696696 @default.
- W4293658473 hasConceptScore W4293658473C178790620 @default.
- W4293658473 hasConceptScore W4293658473C185592680 @default.
- W4293658473 hasConceptScore W4293658473C204030448 @default.
- W4293658473 hasConceptScore W4293658473C2524010 @default.
- W4293658473 hasConceptScore W4293658473C2776214188 @default.
- W4293658473 hasConceptScore W4293658473C2778755073 @default.
- W4293658473 hasConceptScore W4293658473C33923547 @default.
- W4293658473 hasConceptScore W4293658473C38652104 @default.
- W4293658473 hasConceptScore W4293658473C41008148 @default.
- W4293658473 hasConceptScore W4293658473C555944384 @default.
- W4293658473 hasConceptScore W4293658473C62520636 @default.
- W4293658473 hasConceptScore W4293658473C75684735 @default.
- W4293658473 hasConceptScore W4293658473C76155785 @default.
- W4293658473 hasConceptScore W4293658473C93996380 @default.