FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3097432092> ?p ?o ?g. }

• W3097432092 abstract "Recently, the teacher-student knowledge distillation framework has demonstrated its potential in training Graph Neural Networks (GNNs). However, due to the difficulty of training over-parameterized GNN models, one may not easily obtain a satisfactory teacher model for distillation. Furthermore, the inefficient training process of teacher-student knowledge distillation also impedes its applications in GNN models. In this paper, we propose the first teacher-free knowledge distillation method for GNNs, termed GNN Self-Distillation (GNN-SD), that serves as a drop-in replacement of the standard training process. The method is built upon the proposed neighborhood discrepancy rate (NDR), which quantifies the non-smoothness of the embedded graph in an efficient way. Based on this metric, we propose the adaptive discrepancy retaining (ADR) regularizer to empower the transferability of knowledge that maintains high neighborhood discrepancy across GNN layers. We also summarize a generic GNN-SD framework that could be exploited to induce other distillation strategies. Experiments further prove the effectiveness and generalization of our approach, as it brings: 1) state-of-the-art GNN distillation performance with less training cost, 2) consistent and considerable performance enhancement for various popular backbones." @default.
• W3097432092 created "2020-11-09" @default.
• W3097432092 creator A5005345630 @default.
• W3097432092 creator A5029661830 @default.
• W3097432092 creator A5045777220 @default.
• W3097432092 creator A5052723092 @default.
• W3097432092 creator A5068865316 @default.
• W3097432092 creator A5082572337 @default.
• W3097432092 date "2020-11-04" @default.
• W3097432092 modified "2023-09-24" @default.
• W3097432092 title "On Self-Distilling Graph Neural Network" @default.
• W3097432092 cites W1522301498 @default.
• W3097432092 cites W1690739335 @default.
• W3097432092 cites W1821462560 @default.
• W3097432092 cites W2519887557 @default.
• W3097432092 cites W2624431344 @default.
• W3097432092 cites W2735272571 @default.
• W3097432092 cites W2768242641 @default.
• W3097432092 cites W2784814091 @default.
• W3097432092 cites W2890703109 @default.
• W3097432092 cites W2899771611 @default.
• W3097432092 cites W2918342466 @default.
• W3097432092 cites W2949829435 @default.
• W3097432092 cites W2951513317 @default.
• W3097432092 cites W2962711740 @default.
• W3097432092 cites W2963534679 @default.
• W3097432092 cites W2963695795 @default.
• W3097432092 cites W2963858333 @default.
• W3097432092 cites W2964114465 @default.
• W3097432092 cites W2964268168 @default.
• W3097432092 cites W2966475089 @default.
• W3097432092 cites W2971933740 @default.
• W3097432092 cites W2982157312 @default.
• W3097432092 cites W2985953135 @default.
• W3097432092 cites W2987861506 @default.
• W3097432092 cites W2995607862 @default.
• W3097432092 cites W2996268457 @default.
• W3097432092 cites W2998496395 @default.
• W3097432092 cites W3007332492 @default.
• W3097432092 cites W3013415548 @default.
• W3097432092 cites W3034756453 @default.
• W3097432092 cites W3035649237 @default.
• W3097432092 cites W3039474590 @default.
• W3097432092 doi "https://doi.org/10.48550/arxiv.2011.02255" @default.
• W3097432092 hasPublicationYear "2020" @default.
• W3097432092 type Work @default.
• W3097432092 sameAs 3097432092 @default.
• W3097432092 citedByCount "2" @default.
• W3097432092 countsByYear W30974320922021 @default.
• W3097432092 crossrefType "posted-content" @default.
• W3097432092 hasAuthorship W3097432092A5005345630 @default.
• W3097432092 hasAuthorship W3097432092A5029661830 @default.
• W3097432092 hasAuthorship W3097432092A5045777220 @default.
• W3097432092 hasAuthorship W3097432092A5052723092 @default.
• W3097432092 hasAuthorship W3097432092A5068865316 @default.
• W3097432092 hasAuthorship W3097432092A5082572337 @default.
• W3097432092 hasBestOaLocation W30974320921 @default.
• W3097432092 hasConcept C111919701 @default.
• W3097432092 hasConcept C11413529 @default.
• W3097432092 hasConcept C119857082 @default.
• W3097432092 hasConcept C127413603 @default.
• W3097432092 hasConcept C132525143 @default.
• W3097432092 hasConcept C134306372 @default.
• W3097432092 hasConcept C154945302 @default.
• W3097432092 hasConcept C165464430 @default.
• W3097432092 hasConcept C176217482 @default.
• W3097432092 hasConcept C177148314 @default.
• W3097432092 hasConcept C185592680 @default.
• W3097432092 hasConcept C204030448 @default.
• W3097432092 hasConcept C21547014 @default.
• W3097432092 hasConcept C33923547 @default.
• W3097432092 hasConcept C41008148 @default.
• W3097432092 hasConcept C43617362 @default.
• W3097432092 hasConcept C50644808 @default.
• W3097432092 hasConcept C80444323 @default.
• W3097432092 hasConcept C98045186 @default.
• W3097432092 hasConceptScore W3097432092C111919701 @default.
• W3097432092 hasConceptScore W3097432092C11413529 @default.
• W3097432092 hasConceptScore W3097432092C119857082 @default.
• W3097432092 hasConceptScore W3097432092C127413603 @default.
• W3097432092 hasConceptScore W3097432092C132525143 @default.
• W3097432092 hasConceptScore W3097432092C134306372 @default.
• W3097432092 hasConceptScore W3097432092C154945302 @default.
• W3097432092 hasConceptScore W3097432092C165464430 @default.
• W3097432092 hasConceptScore W3097432092C176217482 @default.
• W3097432092 hasConceptScore W3097432092C177148314 @default.
• W3097432092 hasConceptScore W3097432092C185592680 @default.
• W3097432092 hasConceptScore W3097432092C204030448 @default.
• W3097432092 hasConceptScore W3097432092C21547014 @default.
• W3097432092 hasConceptScore W3097432092C33923547 @default.
• W3097432092 hasConceptScore W3097432092C41008148 @default.
• W3097432092 hasConceptScore W3097432092C43617362 @default.
• W3097432092 hasConceptScore W3097432092C50644808 @default.
• W3097432092 hasConceptScore W3097432092C80444323 @default.
• W3097432092 hasConceptScore W3097432092C98045186 @default.
• W3097432092 hasLocation W30974320921 @default.
• W3097432092 hasOpenAccess W3097432092 @default.
• W3097432092 hasPrimaryLocation W30974320921 @default.
• W3097432092 hasRelatedWork W2357085366 @default.
• W3097432092 hasRelatedWork W2989932438 @default.

• next