Matches in SemOpenAlex for { <https://semopenalex.org/work/W4288055056> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4288055056 abstract "Knowledge distillation (KD) is an efficient approach to transfer the knowledge from a large teacher network to a smaller student network. Traditional KD methods require lots of labeled training samples and a white-box teacher (parameters are accessible) to train a good student. However, these resources are not always available in real-world applications. The distillation process often happens at an external party side where we do not have access to much data, and the teacher does not disclose its parameters due to security and privacy concerns. To overcome these challenges, we propose a black-box few-shot KD method to train the student with few unlabeled training samples and a black-box teacher. Our main idea is to expand the training set by generating a diverse set of out-of-distribution synthetic images using MixUp and a conditional variational auto-encoder. These synthetic images along with their labels obtained from the teacher are used to train the student. We conduct extensive experiments to show that our method significantly outperforms recent SOTA few/zero-shot KD methods on image classification tasks. The code and models are available at: https://github.com/nphdang/FS-BBT" @default.
- W4288055056 created "2022-07-28" @default.
- W4288055056 creator A5001806269 @default.
- W4288055056 creator A5045540854 @default.
- W4288055056 creator A5067185856 @default.
- W4288055056 creator A5067711217 @default.
- W4288055056 date "2022-07-25" @default.
- W4288055056 modified "2023-09-30" @default.
- W4288055056 title "Black-box Few-shot Knowledge Distillation" @default.
- W4288055056 doi "https://doi.org/10.48550/arxiv.2207.12106" @default.
- W4288055056 hasPublicationYear "2022" @default.
- W4288055056 type Work @default.
- W4288055056 citedByCount "0" @default.
- W4288055056 crossrefType "posted-content" @default.
- W4288055056 hasAuthorship W4288055056A5001806269 @default.
- W4288055056 hasAuthorship W4288055056A5045540854 @default.
- W4288055056 hasAuthorship W4288055056A5067185856 @default.
- W4288055056 hasAuthorship W4288055056A5067711217 @default.
- W4288055056 hasBestOaLocation W42880550561 @default.
- W4288055056 hasConcept C111919701 @default.
- W4288055056 hasConcept C115961682 @default.
- W4288055056 hasConcept C118505674 @default.
- W4288055056 hasConcept C119857082 @default.
- W4288055056 hasConcept C154945302 @default.
- W4288055056 hasConcept C177264268 @default.
- W4288055056 hasConcept C178790620 @default.
- W4288055056 hasConcept C185592680 @default.
- W4288055056 hasConcept C199360897 @default.
- W4288055056 hasConcept C204030448 @default.
- W4288055056 hasConcept C2776760102 @default.
- W4288055056 hasConcept C2778344882 @default.
- W4288055056 hasConcept C41008148 @default.
- W4288055056 hasConcept C43617362 @default.
- W4288055056 hasConcept C51632099 @default.
- W4288055056 hasConcept C94966114 @default.
- W4288055056 hasConcept C98045186 @default.
- W4288055056 hasConceptScore W4288055056C111919701 @default.
- W4288055056 hasConceptScore W4288055056C115961682 @default.
- W4288055056 hasConceptScore W4288055056C118505674 @default.
- W4288055056 hasConceptScore W4288055056C119857082 @default.
- W4288055056 hasConceptScore W4288055056C154945302 @default.
- W4288055056 hasConceptScore W4288055056C177264268 @default.
- W4288055056 hasConceptScore W4288055056C178790620 @default.
- W4288055056 hasConceptScore W4288055056C185592680 @default.
- W4288055056 hasConceptScore W4288055056C199360897 @default.
- W4288055056 hasConceptScore W4288055056C204030448 @default.
- W4288055056 hasConceptScore W4288055056C2776760102 @default.
- W4288055056 hasConceptScore W4288055056C2778344882 @default.
- W4288055056 hasConceptScore W4288055056C41008148 @default.
- W4288055056 hasConceptScore W4288055056C43617362 @default.
- W4288055056 hasConceptScore W4288055056C51632099 @default.
- W4288055056 hasConceptScore W4288055056C94966114 @default.
- W4288055056 hasConceptScore W4288055056C98045186 @default.
- W4288055056 hasLocation W42880550561 @default.
- W4288055056 hasOpenAccess W4288055056 @default.
- W4288055056 hasPrimaryLocation W42880550561 @default.
- W4288055056 hasRelatedWork W10719664 @default.
- W4288055056 hasRelatedWork W11356396 @default.
- W4288055056 hasRelatedWork W12803709 @default.
- W4288055056 hasRelatedWork W13451536 @default.
- W4288055056 hasRelatedWork W13607926 @default.
- W4288055056 hasRelatedWork W14471487 @default.
- W4288055056 hasRelatedWork W193554 @default.
- W4288055056 hasRelatedWork W5518722 @default.
- W4288055056 hasRelatedWork W5769024 @default.
- W4288055056 hasRelatedWork W7982726 @default.
- W4288055056 isParatext "false" @default.
- W4288055056 isRetracted "false" @default.
- W4288055056 workType "article" @default.