Matches in SemOpenAlex for { <https://semopenalex.org/work/W3155402362> ?p ?o ?g. }
- W3155402362 abstract "This paper theoretically investigates the following empirical phenomenon: given a high-complexity network with poor generalization bounds, one can distill it into a network with nearly identical predictions but low complexity and vastly smaller generalization bounds. The main contribution is an analysis showing that the original network inherits this good generalization bound from its distillation, assuming the use of well-behaved data augmentation. This bound is presented both in an abstract and in a concrete form, the latter complemented by a reduction technique to handle modern computation graphs featuring convolutional layers, fully-connected layers, and skip connections, to name a few. To round out the story, a (looser) classical uniform convergence analysis of compression is also presented, as well as a variety of experiments on cifar and mnist demonstrating similar generalization performance between the original network and its distillation." @default.
- W3155402362 created "2021-04-26" @default.
- W3155402362 creator A5010444468 @default.
- W3155402362 creator A5028859676 @default.
- W3155402362 creator A5061246300 @default.
- W3155402362 creator A5075366851 @default.
- W3155402362 date "2021-04-12" @default.
- W3155402362 modified "2023-09-27" @default.
- W3155402362 title "Generalization bounds via distillation" @default.
- W3155402362 cites W1542886316 @default.
- W3155402362 cites W1821462560 @default.
- W3155402362 cites W2045390367 @default.
- W3155402362 cites W2604117713 @default.
- W3155402362 cites W2709553318 @default.
- W3155402362 cites W2741081039 @default.
- W3155402362 cites W2785749378 @default.
- W3155402362 cites W2893562797 @default.
- W3155402362 cites W2944619585 @default.
- W3155402362 cites W2950220847 @default.
- W3155402362 cites W2952127252 @default.
- W3155402362 cites W2963813662 @default.
- W3155402362 cites W2970290137 @default.
- W3155402362 cites W2976958311 @default.
- W3155402362 cites W2989105640 @default.
- W3155402362 cites W2992043355 @default.
- W3155402362 cites W2995631573 @default.
- W3155402362 cites W3004459530 @default.
- W3155402362 cites W3103089845 @default.
- W3155402362 cites W3105979280 @default.
- W3155402362 cites W3119586787 @default.
- W3155402362 cites W607505555 @default.
- W3155402362 hasPublicationYear "2021" @default.
- W3155402362 type Work @default.
- W3155402362 sameAs 3155402362 @default.
- W3155402362 citedByCount "0" @default.
- W3155402362 crossrefType "posted-content" @default.
- W3155402362 hasAuthorship W3155402362A5010444468 @default.
- W3155402362 hasAuthorship W3155402362A5028859676 @default.
- W3155402362 hasAuthorship W3155402362A5061246300 @default.
- W3155402362 hasAuthorship W3155402362A5075366851 @default.
- W3155402362 hasConcept C108583219 @default.
- W3155402362 hasConcept C111335779 @default.
- W3155402362 hasConcept C11413529 @default.
- W3155402362 hasConcept C134306372 @default.
- W3155402362 hasConcept C136197465 @default.
- W3155402362 hasConcept C154945302 @default.
- W3155402362 hasConcept C159985019 @default.
- W3155402362 hasConcept C162324750 @default.
- W3155402362 hasConcept C177148314 @default.
- W3155402362 hasConcept C180016635 @default.
- W3155402362 hasConcept C185592680 @default.
- W3155402362 hasConcept C190502265 @default.
- W3155402362 hasConcept C192562407 @default.
- W3155402362 hasConcept C204030448 @default.
- W3155402362 hasConcept C2524010 @default.
- W3155402362 hasConcept C2777303404 @default.
- W3155402362 hasConcept C33923547 @default.
- W3155402362 hasConcept C41008148 @default.
- W3155402362 hasConcept C43617362 @default.
- W3155402362 hasConcept C45374587 @default.
- W3155402362 hasConcept C50522688 @default.
- W3155402362 hasConcept C77553402 @default.
- W3155402362 hasConcept C80444323 @default.
- W3155402362 hasConceptScore W3155402362C108583219 @default.
- W3155402362 hasConceptScore W3155402362C111335779 @default.
- W3155402362 hasConceptScore W3155402362C11413529 @default.
- W3155402362 hasConceptScore W3155402362C134306372 @default.
- W3155402362 hasConceptScore W3155402362C136197465 @default.
- W3155402362 hasConceptScore W3155402362C154945302 @default.
- W3155402362 hasConceptScore W3155402362C159985019 @default.
- W3155402362 hasConceptScore W3155402362C162324750 @default.
- W3155402362 hasConceptScore W3155402362C177148314 @default.
- W3155402362 hasConceptScore W3155402362C180016635 @default.
- W3155402362 hasConceptScore W3155402362C185592680 @default.
- W3155402362 hasConceptScore W3155402362C190502265 @default.
- W3155402362 hasConceptScore W3155402362C192562407 @default.
- W3155402362 hasConceptScore W3155402362C204030448 @default.
- W3155402362 hasConceptScore W3155402362C2524010 @default.
- W3155402362 hasConceptScore W3155402362C2777303404 @default.
- W3155402362 hasConceptScore W3155402362C33923547 @default.
- W3155402362 hasConceptScore W3155402362C41008148 @default.
- W3155402362 hasConceptScore W3155402362C43617362 @default.
- W3155402362 hasConceptScore W3155402362C45374587 @default.
- W3155402362 hasConceptScore W3155402362C50522688 @default.
- W3155402362 hasConceptScore W3155402362C77553402 @default.
- W3155402362 hasConceptScore W3155402362C80444323 @default.
- W3155402362 hasLocation W31554023621 @default.
- W3155402362 hasOpenAccess W3155402362 @default.
- W3155402362 hasPrimaryLocation W31554023621 @default.
- W3155402362 hasRelatedWork W111827256 @default.
- W3155402362 hasRelatedWork W1500866162 @default.
- W3155402362 hasRelatedWork W2014394412 @default.
- W3155402362 hasRelatedWork W2071570468 @default.
- W3155402362 hasRelatedWork W2141832027 @default.
- W3155402362 hasRelatedWork W2167737333 @default.
- W3155402362 hasRelatedWork W2198278046 @default.
- W3155402362 hasRelatedWork W2223051473 @default.
- W3155402362 hasRelatedWork W2253910737 @default.
- W3155402362 hasRelatedWork W2400225133 @default.
- W3155402362 hasRelatedWork W2401536655 @default.