Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387430797> ?p ?o ?g. }
Showing items 1 to 87 of
87
with 100 items per page.
- W4387430797 abstract "In knowledge distillation research, feature-based methods have dominated due to their ability to effectively tap into extensive teacher models. In contrast, logit-based approaches are considered to be less adept at extracting hidden 'dark knowledge' from teachers. To bridge this gap, we present LumiNet, a novel knowledge-transfer algorithm designed to enhance logit-based distillation. We introduce a perception matrix that aims to recalibrate logits through adjustments based on the model's representation capability. By meticulously analyzing intra-class dynamics, LumiNet reconstructs more granular inter-class relationships, enabling the student model to learn a richer breadth of knowledge. Both teacher and student models are mapped onto this refined matrix, with the student's goal being to minimize representational discrepancies. Rigorous testing on benchmark datasets (CIFAR-100, ImageNet, and MSCOCO) attests to LumiNet's efficacy, revealing its competitive edge over leading feature-based methods. Moreover, in exploring the realm of transfer learning, we assess how effectively the student model, trained using our method, adapts to downstream tasks. Notably, when applied to Tiny ImageNet, the transferred features exhibit remarkable performance, further underscoring LumiNet's versatility and robustness in diverse settings. With LumiNet, we hope to steer the research discourse towards a renewed interest in the latent capabilities of logit-based knowledge distillation." @default.
- W4387430797 created "2023-10-08" @default.
- W4387430797 creator A5007895165 @default.
- W4387430797 creator A5011438074 @default.
- W4387430797 creator A5018484407 @default.
- W4387430797 creator A5029426102 @default.
- W4387430797 creator A5047166819 @default.
- W4387430797 creator A5062072064 @default.
- W4387430797 creator A5081372547 @default.
- W4387430797 date "2023-10-05" @default.
- W4387430797 modified "2023-10-09" @default.
- W4387430797 title "LumiNet: The Bright Side of Perceptual Knowledge Distillation" @default.
- W4387430797 doi "https://doi.org/10.48550/arxiv.2310.03669" @default.
- W4387430797 hasPublicationYear "2023" @default.
- W4387430797 type Work @default.
- W4387430797 citedByCount "0" @default.
- W4387430797 crossrefType "posted-content" @default.
- W4387430797 hasAuthorship W4387430797A5007895165 @default.
- W4387430797 hasAuthorship W4387430797A5011438074 @default.
- W4387430797 hasAuthorship W4387430797A5018484407 @default.
- W4387430797 hasAuthorship W4387430797A5029426102 @default.
- W4387430797 hasAuthorship W4387430797A5047166819 @default.
- W4387430797 hasAuthorship W4387430797A5062072064 @default.
- W4387430797 hasAuthorship W4387430797A5081372547 @default.
- W4387430797 hasBestOaLocation W43874307971 @default.
- W4387430797 hasConcept C104317684 @default.
- W4387430797 hasConcept C119857082 @default.
- W4387430797 hasConcept C13280743 @default.
- W4387430797 hasConcept C140331021 @default.
- W4387430797 hasConcept C154945302 @default.
- W4387430797 hasConcept C169760540 @default.
- W4387430797 hasConcept C17744445 @default.
- W4387430797 hasConcept C178790620 @default.
- W4387430797 hasConcept C185592680 @default.
- W4387430797 hasConcept C185798385 @default.
- W4387430797 hasConcept C199539241 @default.
- W4387430797 hasConcept C204030448 @default.
- W4387430797 hasConcept C205649164 @default.
- W4387430797 hasConcept C26760741 @default.
- W4387430797 hasConcept C2776359362 @default.
- W4387430797 hasConcept C2776960227 @default.
- W4387430797 hasConcept C2777212361 @default.
- W4387430797 hasConcept C41008148 @default.
- W4387430797 hasConcept C55493867 @default.
- W4387430797 hasConcept C56739046 @default.
- W4387430797 hasConcept C63479239 @default.
- W4387430797 hasConcept C86803240 @default.
- W4387430797 hasConcept C94625758 @default.
- W4387430797 hasConceptScore W4387430797C104317684 @default.
- W4387430797 hasConceptScore W4387430797C119857082 @default.
- W4387430797 hasConceptScore W4387430797C13280743 @default.
- W4387430797 hasConceptScore W4387430797C140331021 @default.
- W4387430797 hasConceptScore W4387430797C154945302 @default.
- W4387430797 hasConceptScore W4387430797C169760540 @default.
- W4387430797 hasConceptScore W4387430797C17744445 @default.
- W4387430797 hasConceptScore W4387430797C178790620 @default.
- W4387430797 hasConceptScore W4387430797C185592680 @default.
- W4387430797 hasConceptScore W4387430797C185798385 @default.
- W4387430797 hasConceptScore W4387430797C199539241 @default.
- W4387430797 hasConceptScore W4387430797C204030448 @default.
- W4387430797 hasConceptScore W4387430797C205649164 @default.
- W4387430797 hasConceptScore W4387430797C26760741 @default.
- W4387430797 hasConceptScore W4387430797C2776359362 @default.
- W4387430797 hasConceptScore W4387430797C2776960227 @default.
- W4387430797 hasConceptScore W4387430797C2777212361 @default.
- W4387430797 hasConceptScore W4387430797C41008148 @default.
- W4387430797 hasConceptScore W4387430797C55493867 @default.
- W4387430797 hasConceptScore W4387430797C56739046 @default.
- W4387430797 hasConceptScore W4387430797C63479239 @default.
- W4387430797 hasConceptScore W4387430797C86803240 @default.
- W4387430797 hasConceptScore W4387430797C94625758 @default.
- W4387430797 hasLocation W43874307971 @default.
- W4387430797 hasOpenAccess W4387430797 @default.
- W4387430797 hasPrimaryLocation W43874307971 @default.
- W4387430797 hasRelatedWork W2028665553 @default.
- W4387430797 hasRelatedWork W2086519370 @default.
- W4387430797 hasRelatedWork W2087343574 @default.
- W4387430797 hasRelatedWork W2105860728 @default.
- W4387430797 hasRelatedWork W2130974462 @default.
- W4387430797 hasRelatedWork W2378211422 @default.
- W4387430797 hasRelatedWork W2535915176 @default.
- W4387430797 hasRelatedWork W3099502074 @default.
- W4387430797 hasRelatedWork W4321353415 @default.
- W4387430797 hasRelatedWork W972276598 @default.
- W4387430797 isParatext "false" @default.
- W4387430797 isRetracted "false" @default.
- W4387430797 workType "article" @default.