Matches in SemOpenAlex for { <https://semopenalex.org/work/W3008549770> ?p ?o ?g. }
- W3008549770 abstract "Overfitting is one of the most common problems when training deep neural networks on comparatively small datasets. Here, we demonstrate that neural network activation sparsity is a reliable indicator for overfitting which we utilize to propose novel targeted sparsity visualization and regularization strategies. Based on these strategies we are able to understand and counteract overfitting caused by activation sparsity and filter correlation in a targeted layer-by-layer manner. Our results demonstrate that targeted sparsity regularization can efficiently be used to regularize well-known datasets and architectures with a significant increase in image classification performance while outperforming both dropout and batch normalization. Ultimately, our study reveals novel insights into the contradicting concepts of activation sparsity and network capacity by demonstrating that targeted sparsity regularization enables salient and discriminative feature learning while exploiting the full capacity of deep models without suffering from overfitting, even when trained excessively." @default.
- W3008549770 created "2020-03-06" @default.
- W3008549770 creator A5003115770 @default.
- W3008549770 creator A5027355770 @default.
- W3008549770 creator A5027852213 @default.
- W3008549770 creator A5064478411 @default.
- W3008549770 date "2020-02-21" @default.
- W3008549770 modified "2023-09-27" @default.
- W3008549770 title "Exploiting the Full Capacity of Deep Neural Networks while Avoiding Overfitting by Targeted Sparsity Regularization" @default.
- W3008549770 cites W1901129140 @default.
- W3008549770 cites W2012672587 @default.
- W3008549770 cites W2016084804 @default.
- W3008549770 cites W2095705004 @default.
- W3008549770 cites W2145889472 @default.
- W3008549770 cites W2156297475 @default.
- W3008549770 cites W2168345951 @default.
- W3008549770 cites W2581377246 @default.
- W3008549770 cites W2707890836 @default.
- W3008549770 cites W2735766064 @default.
- W3008549770 cites W2745461083 @default.
- W3008549770 cites W2751298778 @default.
- W3008549770 cites W2758695710 @default.
- W3008549770 cites W2783741806 @default.
- W3008549770 cites W2785523195 @default.
- W3008549770 cites W2810470036 @default.
- W3008549770 cites W2891021639 @default.
- W3008549770 cites W2903956504 @default.
- W3008549770 cites W2909680570 @default.
- W3008549770 cites W2949117887 @default.
- W3008549770 cites W2949736877 @default.
- W3008549770 cites W2952610664 @default.
- W3008549770 cites W2962684187 @default.
- W3008549770 cites W2962734576 @default.
- W3008549770 cites W2962851801 @default.
- W3008549770 cites W2963136565 @default.
- W3008549770 cites W2963150697 @default.
- W3008549770 cites W2963341956 @default.
- W3008549770 cites W2963454111 @default.
- W3008549770 cites W2970706158 @default.
- W3008549770 cites W2977655572 @default.
- W3008549770 cites W3000984812 @default.
- W3008549770 cites W3137695714 @default.
- W3008549770 hasPublicationYear "2020" @default.
- W3008549770 type Work @default.
- W3008549770 sameAs 3008549770 @default.
- W3008549770 citedByCount "0" @default.
- W3008549770 crossrefType "posted-content" @default.
- W3008549770 hasAuthorship W3008549770A5003115770 @default.
- W3008549770 hasAuthorship W3008549770A5027355770 @default.
- W3008549770 hasAuthorship W3008549770A5027852213 @default.
- W3008549770 hasAuthorship W3008549770A5064478411 @default.
- W3008549770 hasConcept C108583219 @default.
- W3008549770 hasConcept C119857082 @default.
- W3008549770 hasConcept C136886441 @default.
- W3008549770 hasConcept C138885662 @default.
- W3008549770 hasConcept C144024400 @default.
- W3008549770 hasConcept C153180895 @default.
- W3008549770 hasConcept C154945302 @default.
- W3008549770 hasConcept C19165224 @default.
- W3008549770 hasConcept C22019652 @default.
- W3008549770 hasConcept C2776135515 @default.
- W3008549770 hasConcept C2776145597 @default.
- W3008549770 hasConcept C2776401178 @default.
- W3008549770 hasConcept C2984842247 @default.
- W3008549770 hasConcept C41008148 @default.
- W3008549770 hasConcept C41895202 @default.
- W3008549770 hasConcept C50644808 @default.
- W3008549770 hasConcept C97931131 @default.
- W3008549770 hasConceptScore W3008549770C108583219 @default.
- W3008549770 hasConceptScore W3008549770C119857082 @default.
- W3008549770 hasConceptScore W3008549770C136886441 @default.
- W3008549770 hasConceptScore W3008549770C138885662 @default.
- W3008549770 hasConceptScore W3008549770C144024400 @default.
- W3008549770 hasConceptScore W3008549770C153180895 @default.
- W3008549770 hasConceptScore W3008549770C154945302 @default.
- W3008549770 hasConceptScore W3008549770C19165224 @default.
- W3008549770 hasConceptScore W3008549770C22019652 @default.
- W3008549770 hasConceptScore W3008549770C2776135515 @default.
- W3008549770 hasConceptScore W3008549770C2776145597 @default.
- W3008549770 hasConceptScore W3008549770C2776401178 @default.
- W3008549770 hasConceptScore W3008549770C2984842247 @default.
- W3008549770 hasConceptScore W3008549770C41008148 @default.
- W3008549770 hasConceptScore W3008549770C41895202 @default.
- W3008549770 hasConceptScore W3008549770C50644808 @default.
- W3008549770 hasConceptScore W3008549770C97931131 @default.
- W3008549770 hasLocation W30085497701 @default.
- W3008549770 hasOpenAccess W3008549770 @default.
- W3008549770 hasPrimaryLocation W30085497701 @default.
- W3008549770 hasRelatedWork W1148494366 @default.
- W3008549770 hasRelatedWork W2350490345 @default.
- W3008549770 hasRelatedWork W2544817929 @default.
- W3008549770 hasRelatedWork W2896059768 @default.
- W3008549770 hasRelatedWork W2897621223 @default.
- W3008549770 hasRelatedWork W2946138787 @default.
- W3008549770 hasRelatedWork W2952801580 @default.
- W3008549770 hasRelatedWork W2960122749 @default.
- W3008549770 hasRelatedWork W2964344598 @default.
- W3008549770 hasRelatedWork W2979492453 @default.
- W3008549770 hasRelatedWork W2990342489 @default.
- W3008549770 hasRelatedWork W3014088538 @default.