Matches in SemOpenAlex for { <https://semopenalex.org/work/W4380135841> ?p ?o ?g. }
Showing items 1 to 80 of
80
with 100 items per page.
- W4380135841 abstract "Knowledge distillation (KD) has received much attention due to its success in compressing networks to allow for their deployment in resource-constrained systems. While the problem of adversarial robustness has been studied before in the KD setting, previous works overlook what we term the relative calibration of the student network with respect to its teacher in terms of soft confidences. In particular, we focus on two crucial questions with regard to a teacher-student pair: (i) do the teacher and student disagree at points close to correctly classified dataset examples, and (ii) is the distilled student as confident as the teacher around dataset examples? These are critical questions when considering the deployment of a smaller student network trained from a robust teacher within a safety-critical setting. To address these questions, we introduce a faithful imitation framework to discuss the relative calibration of confidences and provide empirical and certified methods to evaluate the relative calibration of a student w.r.t. its teacher. Further, to verifiably align the relative calibration incentives of the student to those of its teacher, we introduce faithful distillation. Our experiments on the MNIST, Fashion-MNIST and CIFAR-10 datasets demonstrate the need for such an analysis and the advantages of the increased verifiability of faithful distillation over alternative adversarial distillation methods." @default.
- W4380135841 created "2023-06-10" @default.
- W4380135841 creator A5000629699 @default.
- W4380135841 creator A5001534492 @default.
- W4380135841 creator A5019231708 @default.
- W4380135841 creator A5050954769 @default.
- W4380135841 creator A5064603755 @default.
- W4380135841 creator A5092130601 @default.
- W4380135841 date "2023-06-07" @default.
- W4380135841 modified "2023-09-25" @default.
- W4380135841 title "Faithful Knowledge Distillation" @default.
- W4380135841 doi "https://doi.org/10.48550/arxiv.2306.04431" @default.
- W4380135841 hasPublicationYear "2023" @default.
- W4380135841 type Work @default.
- W4380135841 citedByCount "0" @default.
- W4380135841 crossrefType "posted-content" @default.
- W4380135841 hasAuthorship W4380135841A5000629699 @default.
- W4380135841 hasAuthorship W4380135841A5001534492 @default.
- W4380135841 hasAuthorship W4380135841A5019231708 @default.
- W4380135841 hasAuthorship W4380135841A5050954769 @default.
- W4380135841 hasAuthorship W4380135841A5064603755 @default.
- W4380135841 hasAuthorship W4380135841A5092130601 @default.
- W4380135841 hasBestOaLocation W43801358411 @default.
- W4380135841 hasConcept C104317684 @default.
- W4380135841 hasConcept C105339364 @default.
- W4380135841 hasConcept C105795698 @default.
- W4380135841 hasConcept C108583219 @default.
- W4380135841 hasConcept C115903868 @default.
- W4380135841 hasConcept C119857082 @default.
- W4380135841 hasConcept C154945302 @default.
- W4380135841 hasConcept C165838908 @default.
- W4380135841 hasConcept C17744445 @default.
- W4380135841 hasConcept C178790620 @default.
- W4380135841 hasConcept C185592680 @default.
- W4380135841 hasConcept C190502265 @default.
- W4380135841 hasConcept C199539241 @default.
- W4380135841 hasConcept C204030448 @default.
- W4380135841 hasConcept C33923547 @default.
- W4380135841 hasConcept C37736160 @default.
- W4380135841 hasConcept C41008148 @default.
- W4380135841 hasConcept C46304622 @default.
- W4380135841 hasConcept C55493867 @default.
- W4380135841 hasConcept C63479239 @default.
- W4380135841 hasConceptScore W4380135841C104317684 @default.
- W4380135841 hasConceptScore W4380135841C105339364 @default.
- W4380135841 hasConceptScore W4380135841C105795698 @default.
- W4380135841 hasConceptScore W4380135841C108583219 @default.
- W4380135841 hasConceptScore W4380135841C115903868 @default.
- W4380135841 hasConceptScore W4380135841C119857082 @default.
- W4380135841 hasConceptScore W4380135841C154945302 @default.
- W4380135841 hasConceptScore W4380135841C165838908 @default.
- W4380135841 hasConceptScore W4380135841C17744445 @default.
- W4380135841 hasConceptScore W4380135841C178790620 @default.
- W4380135841 hasConceptScore W4380135841C185592680 @default.
- W4380135841 hasConceptScore W4380135841C190502265 @default.
- W4380135841 hasConceptScore W4380135841C199539241 @default.
- W4380135841 hasConceptScore W4380135841C204030448 @default.
- W4380135841 hasConceptScore W4380135841C33923547 @default.
- W4380135841 hasConceptScore W4380135841C37736160 @default.
- W4380135841 hasConceptScore W4380135841C41008148 @default.
- W4380135841 hasConceptScore W4380135841C46304622 @default.
- W4380135841 hasConceptScore W4380135841C55493867 @default.
- W4380135841 hasConceptScore W4380135841C63479239 @default.
- W4380135841 hasLocation W43801358411 @default.
- W4380135841 hasLocation W43801358412 @default.
- W4380135841 hasOpenAccess W4380135841 @default.
- W4380135841 hasPrimaryLocation W43801358411 @default.
- W4380135841 hasRelatedWork W2989784533 @default.
- W4380135841 hasRelatedWork W3035794605 @default.
- W4380135841 hasRelatedWork W3127679336 @default.
- W4380135841 hasRelatedWork W3138091863 @default.
- W4380135841 hasRelatedWork W3175493885 @default.
- W4380135841 hasRelatedWork W3178864044 @default.
- W4380135841 hasRelatedWork W3197436093 @default.
- W4380135841 hasRelatedWork W4286988501 @default.
- W4380135841 hasRelatedWork W4287269929 @default.
- W4380135841 hasRelatedWork W4288018014 @default.
- W4380135841 isParatext "false" @default.
- W4380135841 isRetracted "false" @default.
- W4380135841 workType "article" @default.