Matches in SemOpenAlex for { <https://semopenalex.org/work/W3136272401> ?p ?o ?g. }
- W3136272401 abstract "Knowledge distillation provides an effective way to transfer knowledge via teacher-student learning, where most existing distillation approaches apply a fixed pre-trained model as teacher to supervise the learning of student network. This manner usually brings in a big capability gap between teacher and student networks during learning. Recent researches have observed that a small teacher-student capability gap can facilitate knowledge transfer. Inspired by that, we propose an evolutionary knowledge distillation approach to improve the transfer effectiveness of teacher knowledge. Instead of a fixed pre-trained teacher, an evolutionary teacher is learned online and consistently transfers intermediate knowledge to supervise student network learning on-the-fly. To enhance intermediate knowledge representation and mimicking, several simple guided modules are introduced between corresponding teacher-student blocks. In this way, the student can simultaneously obtain rich internal knowledge and capture its growth process, leading to effective student network learning. Extensive experiments clearly demonstrate the effectiveness of our approach as well as good adaptability in the low-resolution and few-sample visual recognition scenarios." @default.
- W3136272401 created "2021-03-29" @default.
- W3136272401 creator A5005407838 @default.
- W3136272401 creator A5033254559 @default.
- W3136272401 creator A5045983404 @default.
- W3136272401 creator A5049362669 @default.
- W3136272401 creator A5077769312 @default.
- W3136272401 date "2021-03-22" @default.
- W3136272401 modified "2023-09-26" @default.
- W3136272401 title "Student Network Learning via Evolutionary Knowledge Distillation" @default.
- W3136272401 cites W1821462560 @default.
- W3136272401 cites W1955857676 @default.
- W3136272401 cites W2134797427 @default.
- W3136272401 cites W2187089797 @default.
- W3136272401 cites W2194775991 @default.
- W3136272401 cites W2294370754 @default.
- W3136272401 cites W2295634579 @default.
- W3136272401 cites W2401231614 @default.
- W3136272401 cites W2561238782 @default.
- W3136272401 cites W2586087033 @default.
- W3136272401 cites W2609296554 @default.
- W3136272401 cites W2620998106 @default.
- W3136272401 cites W2739879705 @default.
- W3136272401 cites W2743289088 @default.
- W3136272401 cites W2768086131 @default.
- W3136272401 cites W2786817236 @default.
- W3136272401 cites W2787017828 @default.
- W3136272401 cites W2787752464 @default.
- W3136272401 cites W2803023299 @default.
- W3136272401 cites W2803985397 @default.
- W3136272401 cites W2883603666 @default.
- W3136272401 cites W2887783173 @default.
- W3136272401 cites W2900595477 @default.
- W3136272401 cites W2901505625 @default.
- W3136272401 cites W2911803042 @default.
- W3136272401 cites W2937282529 @default.
- W3136272401 cites W2939524044 @default.
- W3136272401 cites W2951513317 @default.
- W3136272401 cites W2952787292 @default.
- W3136272401 cites W2952841512 @default.
- W3136272401 cites W2955192706 @default.
- W3136272401 cites W2962835968 @default.
- W3136272401 cites W2962935923 @default.
- W3136272401 cites W2963125010 @default.
- W3136272401 cites W2963278718 @default.
- W3136272401 cites W2963373431 @default.
- W3136272401 cites W2963397674 @default.
- W3136272401 cites W2963534679 @default.
- W3136272401 cites W2963839617 @default.
- W3136272401 cites W2963959597 @default.
- W3136272401 cites W2963986095 @default.
- W3136272401 cites W2964111476 @default.
- W3136272401 cites W2964118293 @default.
- W3136272401 cites W2969985801 @default.
- W3136272401 cites W2972093541 @default.
- W3136272401 cites W2977057439 @default.
- W3136272401 cites W2982242214 @default.
- W3136272401 cites W2986015886 @default.
- W3136272401 cites W2987861506 @default.
- W3136272401 cites W2995607862 @default.
- W3136272401 cites W2996970889 @default.
- W3136272401 cites W2997224071 @default.
- W3136272401 cites W3010101499 @default.
- W3136272401 cites W3015036596 @default.
- W3136272401 cites W3021893287 @default.
- W3136272401 cites W3033243768 @default.
- W3136272401 cites W3084937072 @default.
- W3136272401 cites W3118608800 @default.
- W3136272401 cites W3124601500 @default.
- W3136272401 cites W3127215335 @default.
- W3136272401 cites W3130394099 @default.
- W3136272401 cites W2551176409 @default.
- W3136272401 doi "https://doi.org/10.48550/arxiv.2103.13811" @default.
- W3136272401 hasPublicationYear "2021" @default.
- W3136272401 type Work @default.
- W3136272401 sameAs 3136272401 @default.
- W3136272401 citedByCount "0" @default.
- W3136272401 crossrefType "posted-content" @default.
- W3136272401 hasAuthorship W3136272401A5005407838 @default.
- W3136272401 hasAuthorship W3136272401A5033254559 @default.
- W3136272401 hasAuthorship W3136272401A5045983404 @default.
- W3136272401 hasAuthorship W3136272401A5049362669 @default.
- W3136272401 hasAuthorship W3136272401A5077769312 @default.
- W3136272401 hasBestOaLocation W31362724011 @default.
- W3136272401 hasConcept C111919701 @default.
- W3136272401 hasConcept C138885662 @default.
- W3136272401 hasConcept C150899416 @default.
- W3136272401 hasConcept C154945302 @default.
- W3136272401 hasConcept C177606310 @default.
- W3136272401 hasConcept C178790620 @default.
- W3136272401 hasConcept C185592680 @default.
- W3136272401 hasConcept C18903297 @default.
- W3136272401 hasConcept C204030448 @default.
- W3136272401 hasConcept C2776960227 @default.
- W3136272401 hasConcept C2780310539 @default.
- W3136272401 hasConcept C41008148 @default.
- W3136272401 hasConcept C41895202 @default.
- W3136272401 hasConcept C56739046 @default.
- W3136272401 hasConcept C86803240 @default.
- W3136272401 hasConcept C98045186 @default.