FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2976713865> ?p ?o ?g. }

• W2976713865 abstract "A leading hypothesis for the surprising generalization of neural networks is that the dynamics of gradient descent bias the model towards simple solutions, by searching through the solution space in an incremental order of complexity. We formally define the notion of incremental learning dynamics and derive the conditions on depth and initialization for which this phenomenon arises in deep linear models. Our main theoretical contribution is a dynamical depth separation result, proving that while shallow models can exhibit incremental learning dynamics, they require the initialization to be exponentially small for these dynamics to present themselves. However, once the model becomes deeper, the dependence becomes polynomial and incremental learning can arise in more natural settings. We complement our theoretical findings by experimenting with deep matrix sensing, quadratic neural networks and with binary classification using diagonal and convolutional linear networks, showing all of these models exhibit incremental learning." @default.
• W2976713865 created "2019-10-03" @default.
• W2976713865 creator A5049826794 @default.
• W2976713865 creator A5069498812 @default.
• W2976713865 creator A5078263052 @default.
• W2976713865 date "2019-09-26" @default.
• W2976713865 modified "2023-09-27" @default.
• W2976713865 title "The Implicit Bias of Depth: How Incremental Learning Drives Generalization" @default.
• W2976713865 cites W2125930537 @default.
• W2976713865 cites W2128659236 @default.
• W2976713865 cites W2591973785 @default.
• W2976713865 cites W2788800397 @default.
• W2976713865 cites W2792285703 @default.
• W2976713865 cites W2890647280 @default.
• W2976713865 cites W2899476926 @default.
• W2976713865 cites W2911742574 @default.
• W2976713865 cites W2947785987 @default.
• W2976713865 cites W2947859416 @default.
• W2976713865 cites W2951520791 @default.
• W2976713865 cites W2963417959 @default.
• W2976713865 cites W2963826371 @default.
• W2976713865 cites W2964031251 @default.
• W2976713865 cites W2965772785 @default.
• W2976713865 cites W2970166047 @default.
• W2976713865 cites W2970259623 @default.
• W2976713865 cites W2971095480 @default.
• W2976713865 cites W2971127900 @default.
• W2976713865 hasPublicationYear "2019" @default.
• W2976713865 type Work @default.
• W2976713865 sameAs 2976713865 @default.
• W2976713865 citedByCount "6" @default.
• W2976713865 countsByYear W29767138652020 @default.
• W2976713865 countsByYear W29767138652021 @default.
• W2976713865 crossrefType "posted-content" @default.
• W2976713865 hasAuthorship W2976713865A5049826794 @default.
• W2976713865 hasAuthorship W2976713865A5069498812 @default.
• W2976713865 hasAuthorship W2976713865A5078263052 @default.
• W2976713865 hasConcept C104317684 @default.
• W2976713865 hasConcept C111472728 @default.
• W2976713865 hasConcept C112313634 @default.
• W2976713865 hasConcept C11413529 @default.
• W2976713865 hasConcept C114466953 @default.
• W2976713865 hasConcept C127716648 @default.
• W2976713865 hasConcept C129844170 @default.
• W2976713865 hasConcept C130367717 @default.
• W2976713865 hasConcept C134306372 @default.
• W2976713865 hasConcept C138885662 @default.
• W2976713865 hasConcept C154945302 @default.
• W2976713865 hasConcept C177148314 @default.
• W2976713865 hasConcept C185592680 @default.
• W2976713865 hasConcept C188082640 @default.
• W2976713865 hasConcept C199360897 @default.
• W2976713865 hasConcept C2524010 @default.
• W2976713865 hasConcept C2780586882 @default.
• W2976713865 hasConcept C28826006 @default.
• W2976713865 hasConcept C33923547 @default.
• W2976713865 hasConcept C41008148 @default.
• W2976713865 hasConcept C55493867 @default.
• W2976713865 hasConceptScore W2976713865C104317684 @default.
• W2976713865 hasConceptScore W2976713865C111472728 @default.
• W2976713865 hasConceptScore W2976713865C112313634 @default.
• W2976713865 hasConceptScore W2976713865C11413529 @default.
• W2976713865 hasConceptScore W2976713865C114466953 @default.
• W2976713865 hasConceptScore W2976713865C127716648 @default.
• W2976713865 hasConceptScore W2976713865C129844170 @default.
• W2976713865 hasConceptScore W2976713865C130367717 @default.
• W2976713865 hasConceptScore W2976713865C134306372 @default.
• W2976713865 hasConceptScore W2976713865C138885662 @default.
• W2976713865 hasConceptScore W2976713865C154945302 @default.
• W2976713865 hasConceptScore W2976713865C177148314 @default.
• W2976713865 hasConceptScore W2976713865C185592680 @default.
• W2976713865 hasConceptScore W2976713865C188082640 @default.
• W2976713865 hasConceptScore W2976713865C199360897 @default.
• W2976713865 hasConceptScore W2976713865C2524010 @default.
• W2976713865 hasConceptScore W2976713865C2780586882 @default.
• W2976713865 hasConceptScore W2976713865C28826006 @default.
• W2976713865 hasConceptScore W2976713865C33923547 @default.
• W2976713865 hasConceptScore W2976713865C41008148 @default.
• W2976713865 hasConceptScore W2976713865C55493867 @default.
• W2976713865 hasLocation W29767138651 @default.
• W2976713865 hasOpenAccess W2976713865 @default.
• W2976713865 hasPrimaryLocation W29767138651 @default.
• W2976713865 hasRelatedWork W2563245990 @default.
• W2976713865 hasRelatedWork W2587741277 @default.
• W2976713865 hasRelatedWork W2899253307 @default.
• W2976713865 hasRelatedWork W2913473169 @default.
• W2976713865 hasRelatedWork W2952204734 @default.
• W2976713865 hasRelatedWork W2963504252 @default.
• W2976713865 hasRelatedWork W2970217468 @default.
• W2976713865 hasRelatedWork W2996210821 @default.
• W2976713865 hasRelatedWork W3046996896 @default.
• W2976713865 hasRelatedWork W3092830796 @default.
• W2976713865 hasRelatedWork W3105260243 @default.
• W2976713865 hasRelatedWork W3113190353 @default.
• W2976713865 hasRelatedWork W3115855231 @default.
• W2976713865 hasRelatedWork W3162003518 @default.
• W2976713865 hasRelatedWork W3164547988 @default.
• W2976713865 hasRelatedWork W3168121459 @default.
• W2976713865 hasRelatedWork W3176723190 @default.
• W2976713865 hasRelatedWork W3200346102 @default.

• next