FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313229653> ?p ?o ?g. }

• W4313229653 endingPage "1585" @default.
• W4313229653 startingPage "1574" @default.
• W4313229653 abstract "As a simple yet effective model compression method, knowledge distillation (or KD) is used to learn a small lightweight student network by transferring valuable knowledge from a pretrained cumbersome teacher network. However, existing KD methods usually consider the feature knowledge either in different layers or individual samples, failing to explore more detailed information in different channels from the perspective of sample relationships. Meanwhile, the negative influences contained in the teacher knowledge are also not well investigated, especially, when using the response-based knowledge. To address the above-mentioned issues, we devise a novel KD approach entitled channel correlation-based selective KD (or CCSKD). Specifically, to distill rich knowledge from feature representations, we not only consider the feature knowledge from different channels for individual samples but also take into account the relational knowledge based on per-channel features for different samples. Furthermore, to further distill positive response-based knowledge, a selective strategy is developed, i.e., selective KD, to progressively correct the negative influences from the teacher knowledge during the distillation process. We perform extensive experiments on three image classification data sets, CIFAR-100, Stanford Cars, and Tiny-ImageNet, to demonstrate the effectiveness of the proposed CCSKD, which outperforms recent state-of-the-art methods with a clear margin. Our codes are publicly available at <uri xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>https://github.com/gjplab/CCSKD</uri> ." @default.
• W4313229653 created "2023-01-06" @default.
• W4313229653 creator A5026069869 @default.
• W4313229653 creator A5034930296 @default.
• W4313229653 creator A5035363985 @default.
• W4313229653 creator A5074672983 @default.
• W4313229653 creator A5085309099 @default.
• W4313229653 date "2023-09-01" @default.
• W4313229653 modified "2023-10-10" @default.
• W4313229653 title "Channel-Correlation-Based Selective Knowledge Distillation" @default.
• W4313229653 cites W2108598243 @default.
• W4313229653 cites W2620998106 @default.
• W4313229653 cites W2752782242 @default.
• W4313229653 cites W2783538964 @default.
• W4313229653 cites W2887783173 @default.
• W4313229653 cites W2955192706 @default.
• W4313229653 cites W2962949934 @default.
• W4313229653 cites W2963140444 @default.
• W4313229653 cites W2964005298 @default.
• W4313229653 cites W2986015886 @default.
• W4313229653 cites W2989071526 @default.
• W4313229653 cites W2997006708 @default.
• W4313229653 cites W2998081460 @default.
• W4313229653 cites W2999026992 @default.
• W4313229653 cites W2999921958 @default.
• W4313229653 cites W3004127093 @default.
• W4313229653 cites W3034169498 @default.
• W4313229653 cites W3034368386 @default.
• W4313229653 cites W3034695001 @default.
• W4313229653 cites W3034756453 @default.
• W4313229653 cites W3035099063 @default.
• W4313229653 cites W3035321581 @default.
• W4313229653 cites W3035515732 @default.
• W4313229653 cites W3091981646 @default.
• W4313229653 cites W3093439844 @default.
• W4313229653 cites W3106970856 @default.
• W4313229653 cites W3106974277 @default.
• W4313229653 cites W3107129693 @default.
• W4313229653 cites W3148722043 @default.
• W4313229653 cites W3164443777 @default.
• W4313229653 cites W3173270634 @default.
• W4313229653 cites W3174102142 @default.
• W4313229653 cites W3174803757 @default.
• W4313229653 cites W3176403475 @default.
• W4313229653 cites W3176779063 @default.
• W4313229653 cites W3177008256 @default.
• W4313229653 cites W3187295906 @default.
• W4313229653 cites W3193378134 @default.
• W4313229653 cites W3204510963 @default.
• W4313229653 cites W3209572141 @default.
• W4313229653 cites W3216889993 @default.
• W4313229653 cites W4205581758 @default.
• W4313229653 cites W4226426325 @default.
• W4313229653 cites W4306874801 @default.
• W4313229653 cites W4306914511 @default.
• W4313229653 cites W4312544276 @default.
• W4313229653 cites W4312929415 @default.
• W4313229653 doi "https://doi.org/10.1109/tcds.2022.3232569" @default.
• W4313229653 hasPublicationYear "2023" @default.
• W4313229653 type Work @default.
• W4313229653 citedByCount "0" @default.
• W4313229653 crossrefType "journal-article" @default.
• W4313229653 hasAuthorship W4313229653A5026069869 @default.
• W4313229653 hasAuthorship W4313229653A5034930296 @default.
• W4313229653 hasAuthorship W4313229653A5035363985 @default.
• W4313229653 hasAuthorship W4313229653A5074672983 @default.
• W4313229653 hasAuthorship W4313229653A5085309099 @default.
• W4313229653 hasConcept C119857082 @default.
• W4313229653 hasConcept C124101348 @default.
• W4313229653 hasConcept C127162648 @default.
• W4313229653 hasConcept C138885662 @default.
• W4313229653 hasConcept C153180895 @default.
• W4313229653 hasConcept C154945302 @default.
• W4313229653 hasConcept C178790620 @default.
• W4313229653 hasConcept C185592680 @default.
• W4313229653 hasConcept C204030448 @default.
• W4313229653 hasConcept C23123220 @default.
• W4313229653 hasConcept C2776401178 @default.
• W4313229653 hasConcept C31258907 @default.
• W4313229653 hasConcept C41008148 @default.
• W4313229653 hasConcept C41895202 @default.
• W4313229653 hasConcept C774472 @default.
• W4313229653 hasConceptScore W4313229653C119857082 @default.
• W4313229653 hasConceptScore W4313229653C124101348 @default.
• W4313229653 hasConceptScore W4313229653C127162648 @default.
• W4313229653 hasConceptScore W4313229653C138885662 @default.
• W4313229653 hasConceptScore W4313229653C153180895 @default.
• W4313229653 hasConceptScore W4313229653C154945302 @default.
• W4313229653 hasConceptScore W4313229653C178790620 @default.
• W4313229653 hasConceptScore W4313229653C185592680 @default.
• W4313229653 hasConceptScore W4313229653C204030448 @default.
• W4313229653 hasConceptScore W4313229653C23123220 @default.
• W4313229653 hasConceptScore W4313229653C2776401178 @default.
• W4313229653 hasConceptScore W4313229653C31258907 @default.
• W4313229653 hasConceptScore W4313229653C41008148 @default.
• W4313229653 hasConceptScore W4313229653C41895202 @default.
• W4313229653 hasConceptScore W4313229653C774472 @default.
• W4313229653 hasFunder F4320321001 @default.

• next