Matches in SemOpenAlex for { <https://semopenalex.org/work/W2899686093> ?p ?o ?g. }
- W2899686093 abstract "Though Deep Neural Networks (DNNs) are widely celebrated for their practical performance, they demonstrate many intriguing phenomena related to depth that are difficult to explain both theoretically and intuitively. Understanding how weights in deep networks coordinate together across layers to form useful learners has proven somewhat intractable, in part because of the repeated composition of nonlinearities induced by depth. We present a reparameterization of DNNs as a linear function of a particular feature map that is locally independent of the weights. This feature map transforms depth-dependencies into simple {em tensor} products and maps each input to a discrete subset of the feature space. Then, in analogy with logistic regression, we propose a max-margin assumption that enables us to present a so-called {em sample compression} representation of the neural network in terms of the discrete activation state of neurons induced by s vectors. We show how the number of support vectors relate to learning guarantees for neural networks through sample compression bounds, yielding a sample complexity O(ns/e) for networks with n neurons. Additionally, this number of support vectors has monotonic dependence on width, depth, and label noise for simple networks trained on the MNIST dataset." @default.
- W2899686093 created "2018-11-16" @default.
- W2899686093 creator A5000266658 @default.
- W2899686093 creator A5088120102 @default.
- W2899686093 date "2018-11-05" @default.
- W2899686093 modified "2023-09-24" @default.
- W2899686093 title "Generalization Bounds for Neural Networks: Kernels, Symmetry, and Sample Compression." @default.
- W2899686093 hasPublicationYear "2018" @default.
- W2899686093 type Work @default.
- W2899686093 sameAs 2899686093 @default.
- W2899686093 citedByCount "0" @default.
- W2899686093 crossrefType "posted-content" @default.
- W2899686093 hasAuthorship W2899686093A5000266658 @default.
- W2899686093 hasAuthorship W2899686093A5088120102 @default.
- W2899686093 hasConcept C111472728 @default.
- W2899686093 hasConcept C11413529 @default.
- W2899686093 hasConcept C119857082 @default.
- W2899686093 hasConcept C134306372 @default.
- W2899686093 hasConcept C138885662 @default.
- W2899686093 hasConcept C14036430 @default.
- W2899686093 hasConcept C153180895 @default.
- W2899686093 hasConcept C154945302 @default.
- W2899686093 hasConcept C177148314 @default.
- W2899686093 hasConcept C17744445 @default.
- W2899686093 hasConcept C185592680 @default.
- W2899686093 hasConcept C190502265 @default.
- W2899686093 hasConcept C198531522 @default.
- W2899686093 hasConcept C199539241 @default.
- W2899686093 hasConcept C2524010 @default.
- W2899686093 hasConcept C2776359362 @default.
- W2899686093 hasConcept C2776401178 @default.
- W2899686093 hasConcept C2779886137 @default.
- W2899686093 hasConcept C2780586882 @default.
- W2899686093 hasConcept C33923547 @default.
- W2899686093 hasConcept C41008148 @default.
- W2899686093 hasConcept C41895202 @default.
- W2899686093 hasConcept C43617362 @default.
- W2899686093 hasConcept C50644808 @default.
- W2899686093 hasConcept C72169020 @default.
- W2899686093 hasConcept C774472 @default.
- W2899686093 hasConcept C78458016 @default.
- W2899686093 hasConcept C83665646 @default.
- W2899686093 hasConcept C86803240 @default.
- W2899686093 hasConcept C94625758 @default.
- W2899686093 hasConceptScore W2899686093C111472728 @default.
- W2899686093 hasConceptScore W2899686093C11413529 @default.
- W2899686093 hasConceptScore W2899686093C119857082 @default.
- W2899686093 hasConceptScore W2899686093C134306372 @default.
- W2899686093 hasConceptScore W2899686093C138885662 @default.
- W2899686093 hasConceptScore W2899686093C14036430 @default.
- W2899686093 hasConceptScore W2899686093C153180895 @default.
- W2899686093 hasConceptScore W2899686093C154945302 @default.
- W2899686093 hasConceptScore W2899686093C177148314 @default.
- W2899686093 hasConceptScore W2899686093C17744445 @default.
- W2899686093 hasConceptScore W2899686093C185592680 @default.
- W2899686093 hasConceptScore W2899686093C190502265 @default.
- W2899686093 hasConceptScore W2899686093C198531522 @default.
- W2899686093 hasConceptScore W2899686093C199539241 @default.
- W2899686093 hasConceptScore W2899686093C2524010 @default.
- W2899686093 hasConceptScore W2899686093C2776359362 @default.
- W2899686093 hasConceptScore W2899686093C2776401178 @default.
- W2899686093 hasConceptScore W2899686093C2779886137 @default.
- W2899686093 hasConceptScore W2899686093C2780586882 @default.
- W2899686093 hasConceptScore W2899686093C33923547 @default.
- W2899686093 hasConceptScore W2899686093C41008148 @default.
- W2899686093 hasConceptScore W2899686093C41895202 @default.
- W2899686093 hasConceptScore W2899686093C43617362 @default.
- W2899686093 hasConceptScore W2899686093C50644808 @default.
- W2899686093 hasConceptScore W2899686093C72169020 @default.
- W2899686093 hasConceptScore W2899686093C774472 @default.
- W2899686093 hasConceptScore W2899686093C78458016 @default.
- W2899686093 hasConceptScore W2899686093C83665646 @default.
- W2899686093 hasConceptScore W2899686093C86803240 @default.
- W2899686093 hasConceptScore W2899686093C94625758 @default.
- W2899686093 hasLocation W28996860931 @default.
- W2899686093 hasOpenAccess W2899686093 @default.
- W2899686093 hasPrimaryLocation W28996860931 @default.
- W2899686093 hasRelatedWork W2611375647 @default.
- W2899686093 hasRelatedWork W2749030024 @default.
- W2899686093 hasRelatedWork W2787442904 @default.
- W2899686093 hasRelatedWork W2899748887 @default.
- W2899686093 hasRelatedWork W2913473169 @default.
- W2899686093 hasRelatedWork W2963144505 @default.
- W2899686093 hasRelatedWork W2977118166 @default.
- W2899686093 hasRelatedWork W2981995215 @default.
- W2899686093 hasRelatedWork W2995658364 @default.
- W2899686093 hasRelatedWork W3014013215 @default.
- W2899686093 hasRelatedWork W3042991734 @default.
- W2899686093 hasRelatedWork W3094161272 @default.
- W2899686093 hasRelatedWork W3095034705 @default.
- W2899686093 hasRelatedWork W3126595976 @default.
- W2899686093 hasRelatedWork W3162003518 @default.
- W2899686093 hasRelatedWork W3174622107 @default.
- W2899686093 hasRelatedWork W3192896295 @default.
- W2899686093 hasRelatedWork W3208268610 @default.
- W2899686093 hasRelatedWork W2187753657 @default.
- W2899686093 hasRelatedWork W3090270091 @default.
- W2899686093 isParatext "false" @default.
- W2899686093 isRetracted "false" @default.
- W2899686093 magId "2899686093" @default.