Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386852221> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W4386852221 endingPage "102543" @default.
- W4386852221 startingPage "102543" @default.
- W4386852221 abstract "Knowledge distillation is an emerging method for acquiring efficient, small-scale networks. The main idea is to transfer knowledge from a complex teacher model with high learning capacity to a simple student model. To this end, various approaches to knowledge distillation have been proposed in the past few years, focusing mainly on modifications to student learning styles and less on changes to teacher teaching styles. Therefore, our new approach to knowledge distillation teacher training involves adapting the trained teachers to the knowledge distillation model in order to minimize the gap between the student model and the teacher model. We introduced the idea of a “Trained Teacher”: Our approach involves using a specially trained teacher network that, by incorporating knowledge distillation constraints during its own training, adapts to the teaching model in advance and performs nearly identically to a typical teacher network. This allows students to absorb the teacher's knowledge more effectively, thereby increasing their competence. In addition, the methods of mainstream knowledge distillation currently in use are equally appropriate to our educated teachers. Extensive tests on numerous datasets reveal that our technique outperforms the original knowledge distillation in accuracy on standard KD by 2%. Our code and pre-trained models can be found at https://github.com/JSJ515-Group/Trained_teacher." @default.
- W4386852221 created "2023-09-20" @default.
- W4386852221 creator A5022557444 @default.
- W4386852221 creator A5030845033 @default.
- W4386852221 creator A5057571786 @default.
- W4386852221 creator A5065002936 @default.
- W4386852221 creator A5071805794 @default.
- W4386852221 creator A5087739571 @default.
- W4386852221 date "2023-12-01" @default.
- W4386852221 modified "2023-09-30" @default.
- W4386852221 title "Trained Teacher: who is good at teaching" @default.
- W4386852221 cites W2964137095 @default.
- W4386852221 cites W2990200213 @default.
- W4386852221 cites W3116402441 @default.
- W4386852221 cites W3134119092 @default.
- W4386852221 cites W3191459272 @default.
- W4386852221 cites W4211024504 @default.
- W4386852221 cites W4318954855 @default.
- W4386852221 cites W4360616363 @default.
- W4386852221 doi "https://doi.org/10.1016/j.displa.2023.102543" @default.
- W4386852221 hasPublicationYear "2023" @default.
- W4386852221 type Work @default.
- W4386852221 citedByCount "0" @default.
- W4386852221 crossrefType "journal-article" @default.
- W4386852221 hasAuthorship W4386852221A5022557444 @default.
- W4386852221 hasAuthorship W4386852221A5030845033 @default.
- W4386852221 hasAuthorship W4386852221A5057571786 @default.
- W4386852221 hasAuthorship W4386852221A5065002936 @default.
- W4386852221 hasAuthorship W4386852221A5071805794 @default.
- W4386852221 hasAuthorship W4386852221A5087739571 @default.
- W4386852221 hasConcept C100521375 @default.
- W4386852221 hasConcept C119857082 @default.
- W4386852221 hasConcept C138885662 @default.
- W4386852221 hasConcept C145420912 @default.
- W4386852221 hasConcept C154945302 @default.
- W4386852221 hasConcept C15744967 @default.
- W4386852221 hasConcept C177264268 @default.
- W4386852221 hasConcept C185592680 @default.
- W4386852221 hasConcept C199360897 @default.
- W4386852221 hasConcept C204030448 @default.
- W4386852221 hasConcept C27206212 @default.
- W4386852221 hasConcept C2776760102 @default.
- W4386852221 hasConcept C2777617010 @default.
- W4386852221 hasConcept C33923547 @default.
- W4386852221 hasConcept C41008148 @default.
- W4386852221 hasConcept C43617362 @default.
- W4386852221 hasConcept C77805123 @default.
- W4386852221 hasConceptScore W4386852221C100521375 @default.
- W4386852221 hasConceptScore W4386852221C119857082 @default.
- W4386852221 hasConceptScore W4386852221C138885662 @default.
- W4386852221 hasConceptScore W4386852221C145420912 @default.
- W4386852221 hasConceptScore W4386852221C154945302 @default.
- W4386852221 hasConceptScore W4386852221C15744967 @default.
- W4386852221 hasConceptScore W4386852221C177264268 @default.
- W4386852221 hasConceptScore W4386852221C185592680 @default.
- W4386852221 hasConceptScore W4386852221C199360897 @default.
- W4386852221 hasConceptScore W4386852221C204030448 @default.
- W4386852221 hasConceptScore W4386852221C27206212 @default.
- W4386852221 hasConceptScore W4386852221C2776760102 @default.
- W4386852221 hasConceptScore W4386852221C2777617010 @default.
- W4386852221 hasConceptScore W4386852221C33923547 @default.
- W4386852221 hasConceptScore W4386852221C41008148 @default.
- W4386852221 hasConceptScore W4386852221C43617362 @default.
- W4386852221 hasConceptScore W4386852221C77805123 @default.
- W4386852221 hasLocation W43868522211 @default.
- W4386852221 hasOpenAccess W4386852221 @default.
- W4386852221 hasPrimaryLocation W43868522211 @default.
- W4386852221 hasRelatedWork W2961085424 @default.
- W4386852221 hasRelatedWork W3046775127 @default.
- W4386852221 hasRelatedWork W3170094116 @default.
- W4386852221 hasRelatedWork W4205958290 @default.
- W4386852221 hasRelatedWork W4285260836 @default.
- W4386852221 hasRelatedWork W4286629047 @default.
- W4386852221 hasRelatedWork W4306321456 @default.
- W4386852221 hasRelatedWork W4306674287 @default.
- W4386852221 hasRelatedWork W4386462264 @default.
- W4386852221 hasRelatedWork W4224009465 @default.
- W4386852221 hasVolume "80" @default.
- W4386852221 isParatext "false" @default.
- W4386852221 isRetracted "false" @default.
- W4386852221 workType "article" @default.