Matches in SemOpenAlex for { <https://semopenalex.org/work/W3186007981> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W3186007981 abstract "Feature-based student-teacher learning, a training method that encourages the student’s hidden features to mimic those of the teacher network, is empirically successful in transferring the knowledge from a pre-trained teacher network to the student network. Furthermore, recent empirical results demonstrate that, the teacher’s features can boost the student network’s generalization even when the student’s input sample is corrupted by noise. However, there is a lack of theoretical insights into why and when this method of transferring knowledge can be successful between such heterogeneous tasks. We analyze this method theoretically using deep linear networks, and experimentally using nonlinear networks. We identify three vital factors to the success of the method: (1) whether the student is trained to zero training loss; (2) how knowledgeable the teacher is on the clean-input problem; (3) how the teacher decomposes its knowledge in its hidden features. Lack of proper control in any of the three factors leads to failure of the student-teacher learning method." @default.
- W3186007981 created "2021-08-02" @default.
- W3186007981 creator A5007938446 @default.
- W3186007981 creator A5042895565 @default.
- W3186007981 creator A5075090942 @default.
- W3186007981 creator A5082208896 @default.
- W3186007981 date "2021-06-01" @default.
- W3186007981 modified "2023-09-30" @default.
- W3186007981 title "Student-Teacher Learning from Clean Inputs to Noisy Inputs" @default.
- W3186007981 cites W1523985187 @default.
- W3186007981 cites W1677182931 @default.
- W3186007981 cites W2739879705 @default.
- W3186007981 cites W2959289524 @default.
- W3186007981 cites W2981819252 @default.
- W3186007981 cites W2982157312 @default.
- W3186007981 cites W2982242214 @default.
- W3186007981 cites W2997666887 @default.
- W3186007981 cites W3034308492 @default.
- W3186007981 cites W3035631962 @default.
- W3186007981 cites W3106912575 @default.
- W3186007981 cites W4246362381 @default.
- W3186007981 cites W4247571494 @default.
- W3186007981 doi "https://doi.org/10.1109/cvpr46437.2021.01190" @default.
- W3186007981 hasPublicationYear "2021" @default.
- W3186007981 type Work @default.
- W3186007981 sameAs 3186007981 @default.
- W3186007981 citedByCount "5" @default.
- W3186007981 countsByYear W31860079812021 @default.
- W3186007981 countsByYear W31860079812022 @default.
- W3186007981 countsByYear W31860079812023 @default.
- W3186007981 crossrefType "proceedings-article" @default.
- W3186007981 hasAuthorship W3186007981A5007938446 @default.
- W3186007981 hasAuthorship W3186007981A5042895565 @default.
- W3186007981 hasAuthorship W3186007981A5075090942 @default.
- W3186007981 hasAuthorship W3186007981A5082208896 @default.
- W3186007981 hasBestOaLocation W31860079812 @default.
- W3186007981 hasConcept C105795698 @default.
- W3186007981 hasConcept C115961682 @default.
- W3186007981 hasConcept C119857082 @default.
- W3186007981 hasConcept C120936955 @default.
- W3186007981 hasConcept C121332964 @default.
- W3186007981 hasConcept C134306372 @default.
- W3186007981 hasConcept C138885662 @default.
- W3186007981 hasConcept C154945302 @default.
- W3186007981 hasConcept C158622935 @default.
- W3186007981 hasConcept C177148314 @default.
- W3186007981 hasConcept C185592680 @default.
- W3186007981 hasConcept C198531522 @default.
- W3186007981 hasConcept C2775924081 @default.
- W3186007981 hasConcept C2776401178 @default.
- W3186007981 hasConcept C33923547 @default.
- W3186007981 hasConcept C41008148 @default.
- W3186007981 hasConcept C41895202 @default.
- W3186007981 hasConcept C43617362 @default.
- W3186007981 hasConcept C50644808 @default.
- W3186007981 hasConcept C62520636 @default.
- W3186007981 hasConcept C99498987 @default.
- W3186007981 hasConceptScore W3186007981C105795698 @default.
- W3186007981 hasConceptScore W3186007981C115961682 @default.
- W3186007981 hasConceptScore W3186007981C119857082 @default.
- W3186007981 hasConceptScore W3186007981C120936955 @default.
- W3186007981 hasConceptScore W3186007981C121332964 @default.
- W3186007981 hasConceptScore W3186007981C134306372 @default.
- W3186007981 hasConceptScore W3186007981C138885662 @default.
- W3186007981 hasConceptScore W3186007981C154945302 @default.
- W3186007981 hasConceptScore W3186007981C158622935 @default.
- W3186007981 hasConceptScore W3186007981C177148314 @default.
- W3186007981 hasConceptScore W3186007981C185592680 @default.
- W3186007981 hasConceptScore W3186007981C198531522 @default.
- W3186007981 hasConceptScore W3186007981C2775924081 @default.
- W3186007981 hasConceptScore W3186007981C2776401178 @default.
- W3186007981 hasConceptScore W3186007981C33923547 @default.
- W3186007981 hasConceptScore W3186007981C41008148 @default.
- W3186007981 hasConceptScore W3186007981C41895202 @default.
- W3186007981 hasConceptScore W3186007981C43617362 @default.
- W3186007981 hasConceptScore W3186007981C50644808 @default.
- W3186007981 hasConceptScore W3186007981C62520636 @default.
- W3186007981 hasConceptScore W3186007981C99498987 @default.
- W3186007981 hasLocation W31860079811 @default.
- W3186007981 hasLocation W31860079812 @default.
- W3186007981 hasOpenAccess W3186007981 @default.
- W3186007981 hasPrimaryLocation W31860079811 @default.
- W3186007981 hasRelatedWork W2885094885 @default.
- W3186007981 hasRelatedWork W2961085424 @default.
- W3186007981 hasRelatedWork W3046775127 @default.
- W3186007981 hasRelatedWork W3170094116 @default.
- W3186007981 hasRelatedWork W4205958290 @default.
- W3186007981 hasRelatedWork W4285260836 @default.
- W3186007981 hasRelatedWork W4286629047 @default.
- W3186007981 hasRelatedWork W4306321456 @default.
- W3186007981 hasRelatedWork W4306674287 @default.
- W3186007981 hasRelatedWork W4224009465 @default.
- W3186007981 isParatext "false" @default.
- W3186007981 isRetracted "false" @default.
- W3186007981 magId "3186007981" @default.
- W3186007981 workType "article" @default.