Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386075852> ?p ?o ?g. }
Showing items 1 to 95 of
95
with 100 items per page.
- W4386075852 abstract "Despite the tremendous progress on data-free knowledge distillation (DFKD) based on synthetic data generation, there are still limitations in diverse and efficient data synthesis. It is naive to expect that a simple combination of generative network-based data synthesis and data augmentation will solve these issues. Therefore, this paper proposes a novel data-free knowledge distillation method (Spaceship-Net) based on channel-wise feature exchange (CFE) and multi-scale spatial activation region consistency (mSARC) constraint. Specifically, CFE allows our generative network to better sample from the feature space and efficiently synthesize diverse images for learning the student network. However, using CFE alone can severely amplify the unwanted noises in the synthesized images, which may result in failure to improve distillation learning and even have negative effects. Therefore, we propose mSARC to assure the student network can imitate not only the logit output but also the spatial activation region of the teacher network in order to alleviate the influence of unwanted noises in diverse synthetic images on distillation learning. Extensive experiments on CIFAR-10, CIFAR-100, Tiny-ImageNet, Imagenette, and ImageNet100 show that our method can work well with different backbone networks, and outperform the state-of-the-art DFKD methods. Code will be available at: https://github.com/skgyu/Spaceship-Net." @default.
- W4386075852 created "2023-08-23" @default.
- W4386075852 creator A5029228698 @default.
- W4386075852 creator A5076695496 @default.
- W4386075852 creator A5085719285 @default.
- W4386075852 creator A5091049278 @default.
- W4386075852 date "2023-06-01" @default.
- W4386075852 modified "2023-10-16" @default.
- W4386075852 title "Data-Free Knowledge Distillation via Feature Exchange and Activation Region Constraint" @default.
- W4386075852 cites W1641498739 @default.
- W4386075852 cites W2076829102 @default.
- W4386075852 cites W2108598243 @default.
- W4386075852 cites W2194775991 @default.
- W4386075852 cites W2295107390 @default.
- W4386075852 cites W2751069891 @default.
- W4386075852 cites W2962843773 @default.
- W4386075852 cites W2962858109 @default.
- W4386075852 cites W2963622428 @default.
- W4386075852 cites W2981751377 @default.
- W4386075852 cites W2982157312 @default.
- W4386075852 cites W2982802130 @default.
- W4386075852 cites W2992308087 @default.
- W4386075852 cites W3021476631 @default.
- W4386075852 cites W3034957837 @default.
- W4386075852 cites W3034997257 @default.
- W4386075852 cites W3113223504 @default.
- W4386075852 cites W3141637546 @default.
- W4386075852 cites W3156892778 @default.
- W4386075852 cites W3157615104 @default.
- W4386075852 cites W3175695077 @default.
- W4386075852 cites W3204480651 @default.
- W4386075852 cites W4281571140 @default.
- W4386075852 cites W4283808136 @default.
- W4386075852 cites W4316035834 @default.
- W4386075852 doi "https://doi.org/10.1109/cvpr52729.2023.02324" @default.
- W4386075852 hasPublicationYear "2023" @default.
- W4386075852 type Work @default.
- W4386075852 citedByCount "0" @default.
- W4386075852 crossrefType "proceedings-article" @default.
- W4386075852 hasAuthorship W4386075852A5029228698 @default.
- W4386075852 hasAuthorship W4386075852A5076695496 @default.
- W4386075852 hasAuthorship W4386075852A5085719285 @default.
- W4386075852 hasAuthorship W4386075852A5091049278 @default.
- W4386075852 hasConcept C119857082 @default.
- W4386075852 hasConcept C124101348 @default.
- W4386075852 hasConcept C138885662 @default.
- W4386075852 hasConcept C154945302 @default.
- W4386075852 hasConcept C160920958 @default.
- W4386075852 hasConcept C167966045 @default.
- W4386075852 hasConcept C178790620 @default.
- W4386075852 hasConcept C185592680 @default.
- W4386075852 hasConcept C204030448 @default.
- W4386075852 hasConcept C2524010 @default.
- W4386075852 hasConcept C2776036281 @default.
- W4386075852 hasConcept C2776401178 @default.
- W4386075852 hasConcept C2776436953 @default.
- W4386075852 hasConcept C33923547 @default.
- W4386075852 hasConcept C39890363 @default.
- W4386075852 hasConcept C41008148 @default.
- W4386075852 hasConcept C41895202 @default.
- W4386075852 hasConceptScore W4386075852C119857082 @default.
- W4386075852 hasConceptScore W4386075852C124101348 @default.
- W4386075852 hasConceptScore W4386075852C138885662 @default.
- W4386075852 hasConceptScore W4386075852C154945302 @default.
- W4386075852 hasConceptScore W4386075852C160920958 @default.
- W4386075852 hasConceptScore W4386075852C167966045 @default.
- W4386075852 hasConceptScore W4386075852C178790620 @default.
- W4386075852 hasConceptScore W4386075852C185592680 @default.
- W4386075852 hasConceptScore W4386075852C204030448 @default.
- W4386075852 hasConceptScore W4386075852C2524010 @default.
- W4386075852 hasConceptScore W4386075852C2776036281 @default.
- W4386075852 hasConceptScore W4386075852C2776401178 @default.
- W4386075852 hasConceptScore W4386075852C2776436953 @default.
- W4386075852 hasConceptScore W4386075852C33923547 @default.
- W4386075852 hasConceptScore W4386075852C39890363 @default.
- W4386075852 hasConceptScore W4386075852C41008148 @default.
- W4386075852 hasConceptScore W4386075852C41895202 @default.
- W4386075852 hasFunder F4320321001 @default.
- W4386075852 hasFunder F4320335777 @default.
- W4386075852 hasLocation W43860758521 @default.
- W4386075852 hasOpenAccess W4386075852 @default.
- W4386075852 hasPrimaryLocation W43860758521 @default.
- W4386075852 hasRelatedWork W1534961803 @default.
- W4386075852 hasRelatedWork W3034360859 @default.
- W4386075852 hasRelatedWork W3037703370 @default.
- W4386075852 hasRelatedWork W3113145805 @default.
- W4386075852 hasRelatedWork W3157746466 @default.
- W4386075852 hasRelatedWork W4313564015 @default.
- W4386075852 hasRelatedWork W4321472132 @default.
- W4386075852 hasRelatedWork W4324107480 @default.
- W4386075852 hasRelatedWork W4376988852 @default.
- W4386075852 hasRelatedWork W2310403681 @default.
- W4386075852 isParatext "false" @default.
- W4386075852 isRetracted "false" @default.
- W4386075852 workType "article" @default.