FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2990735210> ?p ?o ?g. }

• W2990735210 abstract "Model compression has been widely adopted to obtain light-weighted deep neural networks. Most prevalent methods, however, require fine-tuning with sufficient training data to ensure accuracy, which could be challenged by privacy and security issues. As a compromise between privacy and performance, in this paper we investigate few shot network compression: given few samples per class, how can we effectively compress the network with negligible performance drop? The core challenge of few shot network compression lies in high estimation errors from the original network during inference, since the compressed network can easily over-fits on the few training instances. The estimation errors could propagate and accumulate layer-wisely and finally deteriorate the network output. To address the problem, we propose cross distillation, a novel layer-wise knowledge distillation approach. By interweaving hidden layers of teacher and student network, layer-wisely accumulated estimation errors can be effectively reduced.The proposed method offers a general framework compatible with prevalent network compression techniques such as pruning. Extensive experiments on benchmark datasets demonstrate that cross distillation can significantly improve the student network's accuracy when only a few training instances are available." @default.
• W2990735210 created "2019-12-05" @default.
• W2990735210 creator A5039977782 @default.
• W2990735210 creator A5042209817 @default.
• W2990735210 creator A5042251906 @default.
• W2990735210 creator A5080943673 @default.
• W2990735210 date "2019-11-21" @default.
• W2990735210 modified "2023-10-16" @default.
• W2990735210 title "Few Shot Network Compression via Cross Distillation" @default.
• W2990735210 cites W1686810756 @default.
• W2990735210 cites W1690739335 @default.
• W2990735210 cites W1821462560 @default.
• W2990735210 cites W2092554297 @default.
• W2990735210 cites W2194775991 @default.
• W2990735210 cites W2233116163 @default.
• W2990735210 cites W2242818861 @default.
• W2990735210 cites W2515385951 @default.
• W2990735210 cites W2737121650 @default.
• W2990735210 cites W2766966408 @default.
• W2990735210 cites W2896409484 @default.
• W2990735210 cites W2903045253 @default.
• W2990735210 cites W2905102070 @default.
• W2990735210 cites W2907468472 @default.
• W2990735210 cites W2913535645 @default.
• W2990735210 cites W2929164058 @default.
• W2990735210 cites W2946830201 @default.
• W2990735210 cites W2951574208 @default.
• W2990735210 cites W2952344559 @default.
• W2990735210 cites W2952786571 @default.
• W2990735210 cites W2963162885 @default.
• W2990735210 cites W2963399829 @default.
• W2990735210 cites W2963452728 @default.
• W2990735210 cites W2963709416 @default.
• W2990735210 cites W2963838731 @default.
• W2990735210 cites W2964233199 @default.
• W2990735210 cites W2964299589 @default.
• W2990735210 cites W2965502995 @default.
• W2990735210 cites W2997394738 @default.
• W2990735210 cites W753847829 @default.
• W2990735210 doi "https://doi.org/10.48550/arxiv.1911.09450" @default.
• W2990735210 hasPublicationYear "2019" @default.
• W2990735210 type Work @default.
• W2990735210 sameAs 2990735210 @default.
• W2990735210 citedByCount "3" @default.
• W2990735210 countsByYear W29907352102019 @default.
• W2990735210 countsByYear W29907352102020 @default.
• W2990735210 countsByYear W29907352102021 @default.
• W2990735210 crossrefType "posted-content" @default.
• W2990735210 hasAuthorship W2990735210A5039977782 @default.
• W2990735210 hasAuthorship W2990735210A5042209817 @default.
• W2990735210 hasAuthorship W2990735210A5042251906 @default.
• W2990735210 hasAuthorship W2990735210A5080943673 @default.
• W2990735210 hasBestOaLocation W29907352101 @default.
• W2990735210 hasConcept C108010975 @default.
• W2990735210 hasConcept C119857082 @default.
• W2990735210 hasConcept C124101348 @default.
• W2990735210 hasConcept C13280743 @default.
• W2990735210 hasConcept C154945302 @default.
• W2990735210 hasConcept C159985019 @default.
• W2990735210 hasConcept C178790620 @default.
• W2990735210 hasConcept C180016635 @default.
• W2990735210 hasConcept C185592680 @default.
• W2990735210 hasConcept C185798385 @default.
• W2990735210 hasConcept C192562407 @default.
• W2990735210 hasConcept C204030448 @default.
• W2990735210 hasConcept C205649164 @default.
• W2990735210 hasConcept C2776214188 @default.
• W2990735210 hasConcept C2779227376 @default.
• W2990735210 hasConcept C41008148 @default.
• W2990735210 hasConcept C50644808 @default.
• W2990735210 hasConcept C6557445 @default.
• W2990735210 hasConcept C86803240 @default.
• W2990735210 hasConceptScore W2990735210C108010975 @default.
• W2990735210 hasConceptScore W2990735210C119857082 @default.
• W2990735210 hasConceptScore W2990735210C124101348 @default.
• W2990735210 hasConceptScore W2990735210C13280743 @default.
• W2990735210 hasConceptScore W2990735210C154945302 @default.
• W2990735210 hasConceptScore W2990735210C159985019 @default.
• W2990735210 hasConceptScore W2990735210C178790620 @default.
• W2990735210 hasConceptScore W2990735210C180016635 @default.
• W2990735210 hasConceptScore W2990735210C185592680 @default.
• W2990735210 hasConceptScore W2990735210C185798385 @default.
• W2990735210 hasConceptScore W2990735210C192562407 @default.
• W2990735210 hasConceptScore W2990735210C204030448 @default.
• W2990735210 hasConceptScore W2990735210C205649164 @default.
• W2990735210 hasConceptScore W2990735210C2776214188 @default.
• W2990735210 hasConceptScore W2990735210C2779227376 @default.
• W2990735210 hasConceptScore W2990735210C41008148 @default.
• W2990735210 hasConceptScore W2990735210C50644808 @default.
• W2990735210 hasConceptScore W2990735210C6557445 @default.
• W2990735210 hasConceptScore W2990735210C86803240 @default.
• W2990735210 hasLocation W29907352101 @default.
• W2990735210 hasLocation W29907352102 @default.
• W2990735210 hasOpenAccess W2990735210 @default.
• W2990735210 hasPrimaryLocation W29907352101 @default.
• W2990735210 hasRelatedWork W112744582 @default.
• W2990735210 hasRelatedWork W1485630101 @default.
• W2990735210 hasRelatedWork W2498017833 @default.
• W2990735210 hasRelatedWork W2961085424 @default.
• W2990735210 hasRelatedWork W3047144510 @default.

• next