FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3138211846> ?p ?o ?g. }

• W3138211846 abstract "Feature-based student-teacher learning, a training method that encourages the student's hidden features to mimic those of the teacher network, is empirically successful in transferring the knowledge from a pre-trained teacher network to the student network. Furthermore, recent empirical results demonstrate that, the teacher's features can boost the student network's generalization even when the student's input sample is corrupted by noise. However, there is a lack of theoretical insights into why and when this method of transferring knowledge can be successful between such heterogeneous tasks. We analyze this method theoretically using deep linear networks, and experimentally using nonlinear networks. We identify three vital factors to the success of the method: (1) whether the student is trained to zero training loss; (2) how knowledgeable the teacher is on the clean-input problem; (3) how the teacher decomposes its knowledge in its hidden features. Lack of proper control in any of the three factors leads to failure of the student-teacher learning method." @default.
• W3138211846 created "2021-03-29" @default.
• W3138211846 creator A5007938446 @default.
• W3138211846 creator A5042895565 @default.
• W3138211846 creator A5075090942 @default.
• W3138211846 creator A5082208896 @default.
• W3138211846 date "2021-03-12" @default.
• W3138211846 modified "2023-09-23" @default.
• W3138211846 title "Student-Teacher Learning from Clean Inputs to Noisy Inputs" @default.
• W3138211846 cites W1482235099 @default.
• W3138211846 cites W1523985187 @default.
• W3138211846 cites W1533861849 @default.
• W3138211846 cites W1677182931 @default.
• W3138211846 cites W1821462560 @default.
• W3138211846 cites W1985488135 @default.
• W3138211846 cites W2004026774 @default.
• W3138211846 cites W2127300249 @default.
• W3138211846 cites W2147656689 @default.
• W3138211846 cites W2173379916 @default.
• W3138211846 cites W2809090039 @default.
• W3138211846 cites W2894972989 @default.
• W3138211846 cites W2945289329 @default.
• W3138211846 cites W2959289524 @default.
• W3138211846 cites W2963376662 @default.
• W3138211846 cites W2963446085 @default.
• W3138211846 cites W2963504252 @default.
• W3138211846 cites W2963534679 @default.
• W3138211846 cites W2963921882 @default.
• W3138211846 cites W2964118293 @default.
• W3138211846 cites W2970259623 @default.
• W3138211846 cites W2971043187 @default.
• W3138211846 cites W2981819252 @default.
• W3138211846 cites W2982157312 @default.
• W3138211846 cites W2982242214 @default.
• W3138211846 cites W2997666887 @default.
• W3138211846 cites W3008374555 @default.
• W3138211846 cites W3013255770 @default.
• W3138211846 cites W3034308492 @default.
• W3138211846 cites W3034368386 @default.
• W3138211846 cites W3035631962 @default.
• W3138211846 cites W3106266785 @default.
• W3138211846 cites W3106912575 @default.
• W3138211846 cites W3107481791 @default.
• W3138211846 cites W3204510963 @default.
• W3138211846 cites W340056678 @default.
• W3138211846 doi "https://doi.org/10.48550/arxiv.2103.07600" @default.
• W3138211846 hasPublicationYear "2021" @default.
• W3138211846 type Work @default.
• W3138211846 sameAs 3138211846 @default.
• W3138211846 citedByCount "0" @default.
• W3138211846 crossrefType "posted-content" @default.
• W3138211846 hasAuthorship W3138211846A5007938446 @default.
• W3138211846 hasAuthorship W3138211846A5042895565 @default.
• W3138211846 hasAuthorship W3138211846A5075090942 @default.
• W3138211846 hasAuthorship W3138211846A5082208896 @default.
• W3138211846 hasBestOaLocation W31382118461 @default.
• W3138211846 hasConcept C105795698 @default.
• W3138211846 hasConcept C115961682 @default.
• W3138211846 hasConcept C119857082 @default.
• W3138211846 hasConcept C120936955 @default.
• W3138211846 hasConcept C121332964 @default.
• W3138211846 hasConcept C134306372 @default.
• W3138211846 hasConcept C138885662 @default.
• W3138211846 hasConcept C145420912 @default.
• W3138211846 hasConcept C154945302 @default.
• W3138211846 hasConcept C158622935 @default.
• W3138211846 hasConcept C177148314 @default.
• W3138211846 hasConcept C185592680 @default.
• W3138211846 hasConcept C198531522 @default.
• W3138211846 hasConcept C2775924081 @default.
• W3138211846 hasConcept C2776401178 @default.
• W3138211846 hasConcept C33923547 @default.
• W3138211846 hasConcept C41008148 @default.
• W3138211846 hasConcept C41895202 @default.
• W3138211846 hasConcept C43617362 @default.
• W3138211846 hasConcept C50644808 @default.
• W3138211846 hasConcept C62520636 @default.
• W3138211846 hasConcept C99498987 @default.
• W3138211846 hasConceptScore W3138211846C105795698 @default.
• W3138211846 hasConceptScore W3138211846C115961682 @default.
• W3138211846 hasConceptScore W3138211846C119857082 @default.
• W3138211846 hasConceptScore W3138211846C120936955 @default.
• W3138211846 hasConceptScore W3138211846C121332964 @default.
• W3138211846 hasConceptScore W3138211846C134306372 @default.
• W3138211846 hasConceptScore W3138211846C138885662 @default.
• W3138211846 hasConceptScore W3138211846C145420912 @default.
• W3138211846 hasConceptScore W3138211846C154945302 @default.
• W3138211846 hasConceptScore W3138211846C158622935 @default.
• W3138211846 hasConceptScore W3138211846C177148314 @default.
• W3138211846 hasConceptScore W3138211846C185592680 @default.
• W3138211846 hasConceptScore W3138211846C198531522 @default.
• W3138211846 hasConceptScore W3138211846C2775924081 @default.
• W3138211846 hasConceptScore W3138211846C2776401178 @default.
• W3138211846 hasConceptScore W3138211846C33923547 @default.
• W3138211846 hasConceptScore W3138211846C41008148 @default.
• W3138211846 hasConceptScore W3138211846C41895202 @default.
• W3138211846 hasConceptScore W3138211846C43617362 @default.
• W3138211846 hasConceptScore W3138211846C50644808 @default.
• W3138211846 hasConceptScore W3138211846C62520636 @default.
• W3138211846 hasConceptScore W3138211846C99498987 @default.

• next