Matches in SemOpenAlex for { <https://semopenalex.org/work/W3009804902> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W3009804902 abstract "There is a need for an on-the-fly computational process with very low performance system such as system-on-chip (SoC) and embedded device etc. This paper presents pacemaker knowledge distillation as intermediate ensemble teacher to use convolutional neural network in these systems. For on-the-fly system, we consider student model using 1xN shape on-the-fly filter and teacher model using normal NxN shape filter. We note three points about training student model, caused by applying on-the-fly filter. First, same depth but unavoidable thin model compression. Second, the large capacity gap and parameter size gap due to only the horizontal field must be selected not the vertical receptive. Third, the performance instability and degradation of direct distilling. To solve these problems, we propose intermediate teacher, named pacemaker, for an on-the-fly student. So, student can be trained from pacemaker and original teacher step by step. Experiments prove our proposed method make significant performance (accuracy) improvements: on CIFAR100, 5.39% increased in WRN-40-4 than conventional knowledge distillation which shows even low performance than baseline. And we solve train instability, occurred when conventional knowledge distillation was applied without proposed method, by reducing deviation range by applying proposed method pacemaker knowledge distillation." @default.
- W3009804902 created "2020-03-13" @default.
- W3009804902 creator A5004363128 @default.
- W3009804902 creator A5009176756 @default.
- W3009804902 creator A5016930939 @default.
- W3009804902 creator A5020815483 @default.
- W3009804902 creator A5051265821 @default.
- W3009804902 date "2020-03-09" @default.
- W3009804902 modified "2023-09-27" @default.
- W3009804902 title "Pacemaker: Intermediate Teacher Knowledge Distillation For On-The-Fly Convolutional Neural Network." @default.
- W3009804902 cites W1585038360 @default.
- W3009804902 cites W1745334888 @default.
- W3009804902 cites W1821462560 @default.
- W3009804902 cites W2163605009 @default.
- W3009804902 cites W2194775991 @default.
- W3009804902 cites W2233116163 @default.
- W3009804902 cites W2279098554 @default.
- W3009804902 cites W2294059674 @default.
- W3009804902 cites W2300242332 @default.
- W3009804902 cites W2335728318 @default.
- W3009804902 cites W2561238782 @default.
- W3009804902 cites W2570343428 @default.
- W3009804902 cites W2612445135 @default.
- W3009804902 cites W2613718673 @default.
- W3009804902 cites W2962835968 @default.
- W3009804902 cites W2962982906 @default.
- W3009804902 cites W2963674932 @default.
- W3009804902 cites W2964118293 @default.
- W3009804902 cites W2964137095 @default.
- W3009804902 cites W2964288706 @default.
- W3009804902 cites W2964299589 @default.
- W3009804902 cites W3004127093 @default.
- W3009804902 cites W3118608800 @default.
- W3009804902 hasPublicationYear "2020" @default.
- W3009804902 type Work @default.
- W3009804902 sameAs 3009804902 @default.
- W3009804902 citedByCount "0" @default.
- W3009804902 crossrefType "posted-content" @default.
- W3009804902 hasAuthorship W3009804902A5004363128 @default.
- W3009804902 hasAuthorship W3009804902A5009176756 @default.
- W3009804902 hasAuthorship W3009804902A5016930939 @default.
- W3009804902 hasAuthorship W3009804902A5020815483 @default.
- W3009804902 hasAuthorship W3009804902A5051265821 @default.
- W3009804902 hasConcept C106131492 @default.
- W3009804902 hasConcept C111919701 @default.
- W3009804902 hasConcept C127413603 @default.
- W3009804902 hasConcept C146978453 @default.
- W3009804902 hasConcept C154945302 @default.
- W3009804902 hasConcept C178790620 @default.
- W3009804902 hasConcept C185592680 @default.
- W3009804902 hasConcept C204030448 @default.
- W3009804902 hasConcept C204323151 @default.
- W3009804902 hasConcept C2781020372 @default.
- W3009804902 hasConcept C31972630 @default.
- W3009804902 hasConcept C41008148 @default.
- W3009804902 hasConcept C50644808 @default.
- W3009804902 hasConcept C81363708 @default.
- W3009804902 hasConcept C98045186 @default.
- W3009804902 hasConceptScore W3009804902C106131492 @default.
- W3009804902 hasConceptScore W3009804902C111919701 @default.
- W3009804902 hasConceptScore W3009804902C127413603 @default.
- W3009804902 hasConceptScore W3009804902C146978453 @default.
- W3009804902 hasConceptScore W3009804902C154945302 @default.
- W3009804902 hasConceptScore W3009804902C178790620 @default.
- W3009804902 hasConceptScore W3009804902C185592680 @default.
- W3009804902 hasConceptScore W3009804902C204030448 @default.
- W3009804902 hasConceptScore W3009804902C204323151 @default.
- W3009804902 hasConceptScore W3009804902C2781020372 @default.
- W3009804902 hasConceptScore W3009804902C31972630 @default.
- W3009804902 hasConceptScore W3009804902C41008148 @default.
- W3009804902 hasConceptScore W3009804902C50644808 @default.
- W3009804902 hasConceptScore W3009804902C81363708 @default.
- W3009804902 hasConceptScore W3009804902C98045186 @default.
- W3009804902 hasLocation W30098049021 @default.
- W3009804902 hasOpenAccess W3009804902 @default.
- W3009804902 hasPrimaryLocation W30098049021 @default.
- W3009804902 hasRelatedWork W2175545897 @default.
- W3009804902 hasRelatedWork W2310293554 @default.
- W3009804902 hasRelatedWork W2597402993 @default.
- W3009804902 hasRelatedWork W2743693791 @default.
- W3009804902 hasRelatedWork W2787752464 @default.
- W3009804902 hasRelatedWork W2901523331 @default.
- W3009804902 hasRelatedWork W2938974662 @default.
- W3009804902 hasRelatedWork W2940669070 @default.
- W3009804902 hasRelatedWork W2964186069 @default.
- W3009804902 hasRelatedWork W2997913318 @default.
- W3009804902 hasRelatedWork W3034342078 @default.
- W3009804902 hasRelatedWork W3091295092 @default.
- W3009804902 hasRelatedWork W3091736716 @default.
- W3009804902 hasRelatedWork W3119699820 @default.
- W3009804902 hasRelatedWork W3132207543 @default.
- W3009804902 hasRelatedWork W3197292393 @default.
- W3009804902 hasRelatedWork W3211555016 @default.
- W3009804902 hasRelatedWork W2830167870 @default.
- W3009804902 hasRelatedWork W2957207846 @default.
- W3009804902 hasRelatedWork W79084438 @default.
- W3009804902 isParatext "false" @default.
- W3009804902 isRetracted "false" @default.
- W3009804902 magId "3009804902" @default.
- W3009804902 workType "article" @default.