Matches in SemOpenAlex for { <https://semopenalex.org/work/W2895977466> ?p ?o ?g. }
- W2895977466 abstract "To reduce the large computation and storage cost of a deep convolutional neural network, the knowledge distillation based methods have pioneered to transfer the generalization ability of a large (teacher) deep network to a light-weight (student) network. However, these methods mostly focus on transferring the probability distribution of the softmax layer in a teacher network and thus neglect the intermediate representations. In this paper, we propose a knowledge transfer adversarial network to better train a student network. Our technique holistically considers both intermediate representations and probability distributions of a teacher network. To transfer the knowledge of intermediate representations, we set high-level teacher feature maps as a target, toward which the student feature maps are trained. Specifically, we arrange a Teacher-to-Student layer for enabling our framework suitable for various student structures. The intermediate representation helps the student network better understand the transferred generalization as compared to the probability distribution only. Furthermore, we infuse an adversarial learning process by employing a discriminator network, which can fully exploit the spatial correlation of feature maps in training a student network. The experimental results demonstrate that the proposed method can significantly improve the performance of a student network on both image classification and object detection tasks." @default.
- W2895977466 created "2018-10-26" @default.
- W2895977466 creator A5008182432 @default.
- W2895977466 creator A5011887658 @default.
- W2895977466 creator A5019923186 @default.
- W2895977466 creator A5054452935 @default.
- W2895977466 creator A5070508316 @default.
- W2895977466 date "2018-10-18" @default.
- W2895977466 modified "2023-09-28" @default.
- W2895977466 title "KTAN: Knowledge Transfer Adversarial Network" @default.
- W2895977466 cites W1686810756 @default.
- W2895977466 cites W1690739335 @default.
- W2895977466 cites W1821462560 @default.
- W2895977466 cites W1849277567 @default.
- W2895977466 cites W2031489346 @default.
- W2895977466 cites W2099471712 @default.
- W2895977466 cites W2119144962 @default.
- W2895977466 cites W2302255633 @default.
- W2895977466 cites W2319920447 @default.
- W2895977466 cites W2543539599 @default.
- W2895977466 cites W2555751471 @default.
- W2895977466 cites W2593245696 @default.
- W2895977466 cites W2612445135 @default.
- W2895977466 cites W2612860663 @default.
- W2895977466 cites W2750666066 @default.
- W2895977466 cites W2766839578 @default.
- W2895977466 cites W2949117887 @default.
- W2895977466 cites W2949650786 @default.
- W2895977466 cites W2949829435 @default.
- W2895977466 cites W2951548327 @default.
- W2895977466 cites W2964040697 @default.
- W2895977466 doi "https://doi.org/10.48550/arxiv.1810.08126" @default.
- W2895977466 hasPublicationYear "2018" @default.
- W2895977466 type Work @default.
- W2895977466 sameAs 2895977466 @default.
- W2895977466 citedByCount "8" @default.
- W2895977466 countsByYear W28959774662019 @default.
- W2895977466 countsByYear W28959774662020 @default.
- W2895977466 crossrefType "posted-content" @default.
- W2895977466 hasAuthorship W2895977466A5008182432 @default.
- W2895977466 hasAuthorship W2895977466A5011887658 @default.
- W2895977466 hasAuthorship W2895977466A5019923186 @default.
- W2895977466 hasAuthorship W2895977466A5054452935 @default.
- W2895977466 hasAuthorship W2895977466A5070508316 @default.
- W2895977466 hasBestOaLocation W28959774661 @default.
- W2895977466 hasConcept C119857082 @default.
- W2895977466 hasConcept C13280743 @default.
- W2895977466 hasConcept C134306372 @default.
- W2895977466 hasConcept C138885662 @default.
- W2895977466 hasConcept C150899416 @default.
- W2895977466 hasConcept C154945302 @default.
- W2895977466 hasConcept C165696696 @default.
- W2895977466 hasConcept C177148314 @default.
- W2895977466 hasConcept C185798385 @default.
- W2895977466 hasConcept C188441871 @default.
- W2895977466 hasConcept C193415008 @default.
- W2895977466 hasConcept C205649164 @default.
- W2895977466 hasConcept C2776401178 @default.
- W2895977466 hasConcept C2776960227 @default.
- W2895977466 hasConcept C2779803651 @default.
- W2895977466 hasConcept C31258907 @default.
- W2895977466 hasConcept C33923547 @default.
- W2895977466 hasConcept C37736160 @default.
- W2895977466 hasConcept C38652104 @default.
- W2895977466 hasConcept C41008148 @default.
- W2895977466 hasConcept C41895202 @default.
- W2895977466 hasConcept C56739046 @default.
- W2895977466 hasConcept C59404180 @default.
- W2895977466 hasConcept C76155785 @default.
- W2895977466 hasConcept C81363708 @default.
- W2895977466 hasConcept C94915269 @default.
- W2895977466 hasConceptScore W2895977466C119857082 @default.
- W2895977466 hasConceptScore W2895977466C13280743 @default.
- W2895977466 hasConceptScore W2895977466C134306372 @default.
- W2895977466 hasConceptScore W2895977466C138885662 @default.
- W2895977466 hasConceptScore W2895977466C150899416 @default.
- W2895977466 hasConceptScore W2895977466C154945302 @default.
- W2895977466 hasConceptScore W2895977466C165696696 @default.
- W2895977466 hasConceptScore W2895977466C177148314 @default.
- W2895977466 hasConceptScore W2895977466C185798385 @default.
- W2895977466 hasConceptScore W2895977466C188441871 @default.
- W2895977466 hasConceptScore W2895977466C193415008 @default.
- W2895977466 hasConceptScore W2895977466C205649164 @default.
- W2895977466 hasConceptScore W2895977466C2776401178 @default.
- W2895977466 hasConceptScore W2895977466C2776960227 @default.
- W2895977466 hasConceptScore W2895977466C2779803651 @default.
- W2895977466 hasConceptScore W2895977466C31258907 @default.
- W2895977466 hasConceptScore W2895977466C33923547 @default.
- W2895977466 hasConceptScore W2895977466C37736160 @default.
- W2895977466 hasConceptScore W2895977466C38652104 @default.
- W2895977466 hasConceptScore W2895977466C41008148 @default.
- W2895977466 hasConceptScore W2895977466C41895202 @default.
- W2895977466 hasConceptScore W2895977466C56739046 @default.
- W2895977466 hasConceptScore W2895977466C59404180 @default.
- W2895977466 hasConceptScore W2895977466C76155785 @default.
- W2895977466 hasConceptScore W2895977466C81363708 @default.
- W2895977466 hasConceptScore W2895977466C94915269 @default.
- W2895977466 hasLocation W28959774661 @default.
- W2895977466 hasOpenAccess W2895977466 @default.
- W2895977466 hasPrimaryLocation W28959774661 @default.