Matches in SemOpenAlex for { <https://semopenalex.org/work/W3186134156> ?p ?o ?g. }
- W3186134156 abstract "Recent theoretical results show that gradient descent on deep neural networks under exponential loss functions locally maximizes classification margin, which is equivalent to minimizing the norm of the weight matrices under margin constraints. This property of the solution however does not fully characterize the generalization performance. We motivate theoretically and show empirically that the area under the curve of the margin distribution on the training set is in fact a good measure of generalization. We then show that, after data separation is achieved, it is possible to dynamically reduce the training set by more than 99% without significant loss of performance. Interestingly, the resulting subset of high capacity features is not consistent across different training runs, which is consistent with the theoretical claim that all training points should converge to the same asymptotic margin under SGD and in the presence of both batch normalization and weight decay." @default.
- W3186134156 created "2021-08-02" @default.
- W3186134156 creator A5001833084 @default.
- W3186134156 creator A5029350772 @default.
- W3186134156 creator A5033229997 @default.
- W3186134156 creator A5034635450 @default.
- W3186134156 creator A5046659487 @default.
- W3186134156 date "2021-07-21" @default.
- W3186134156 modified "2023-09-27" @default.
- W3186134156 title "Distribution of Classification Margins: Are All Data Equal?" @default.
- W3186134156 cites W2111296615 @default.
- W3186134156 cites W2115065944 @default.
- W3186134156 cites W2162341153 @default.
- W3186134156 cites W2552194003 @default.
- W3186134156 cites W2785648721 @default.
- W3186134156 cites W2883570905 @default.
- W3186134156 cites W2899748887 @default.
- W3186134156 cites W2911867426 @default.
- W3186134156 cites W2945175884 @default.
- W3186134156 cites W2962698540 @default.
- W3186134156 cites W2963236897 @default.
- W3186134156 cites W2963959597 @default.
- W3186134156 cites W2964020133 @default.
- W3186134156 cites W2964161337 @default.
- W3186134156 cites W3007253500 @default.
- W3186134156 cites W3065974826 @default.
- W3186134156 cites W3081112950 @default.
- W3186134156 cites W3081575329 @default.
- W3186134156 hasPublicationYear "2021" @default.
- W3186134156 type Work @default.
- W3186134156 sameAs 3186134156 @default.
- W3186134156 citedByCount "1" @default.
- W3186134156 countsByYear W31861341562021 @default.
- W3186134156 crossrefType "posted-content" @default.
- W3186134156 hasAuthorship W3186134156A5001833084 @default.
- W3186134156 hasAuthorship W3186134156A5029350772 @default.
- W3186134156 hasAuthorship W3186134156A5033229997 @default.
- W3186134156 hasAuthorship W3186134156A5034635450 @default.
- W3186134156 hasAuthorship W3186134156A5046659487 @default.
- W3186134156 hasConcept C111472728 @default.
- W3186134156 hasConcept C119857082 @default.
- W3186134156 hasConcept C126255220 @default.
- W3186134156 hasConcept C134306372 @default.
- W3186134156 hasConcept C136886441 @default.
- W3186134156 hasConcept C138885662 @default.
- W3186134156 hasConcept C144024400 @default.
- W3186134156 hasConcept C151376022 @default.
- W3186134156 hasConcept C153258448 @default.
- W3186134156 hasConcept C154945302 @default.
- W3186134156 hasConcept C177148314 @default.
- W3186134156 hasConcept C177264268 @default.
- W3186134156 hasConcept C17744445 @default.
- W3186134156 hasConcept C189950617 @default.
- W3186134156 hasConcept C19165224 @default.
- W3186134156 hasConcept C191795146 @default.
- W3186134156 hasConcept C199360897 @default.
- W3186134156 hasConcept C199539241 @default.
- W3186134156 hasConcept C28826006 @default.
- W3186134156 hasConcept C33923547 @default.
- W3186134156 hasConcept C41008148 @default.
- W3186134156 hasConcept C50644808 @default.
- W3186134156 hasConcept C51632099 @default.
- W3186134156 hasConcept C774472 @default.
- W3186134156 hasConceptScore W3186134156C111472728 @default.
- W3186134156 hasConceptScore W3186134156C119857082 @default.
- W3186134156 hasConceptScore W3186134156C126255220 @default.
- W3186134156 hasConceptScore W3186134156C134306372 @default.
- W3186134156 hasConceptScore W3186134156C136886441 @default.
- W3186134156 hasConceptScore W3186134156C138885662 @default.
- W3186134156 hasConceptScore W3186134156C144024400 @default.
- W3186134156 hasConceptScore W3186134156C151376022 @default.
- W3186134156 hasConceptScore W3186134156C153258448 @default.
- W3186134156 hasConceptScore W3186134156C154945302 @default.
- W3186134156 hasConceptScore W3186134156C177148314 @default.
- W3186134156 hasConceptScore W3186134156C177264268 @default.
- W3186134156 hasConceptScore W3186134156C17744445 @default.
- W3186134156 hasConceptScore W3186134156C189950617 @default.
- W3186134156 hasConceptScore W3186134156C19165224 @default.
- W3186134156 hasConceptScore W3186134156C191795146 @default.
- W3186134156 hasConceptScore W3186134156C199360897 @default.
- W3186134156 hasConceptScore W3186134156C199539241 @default.
- W3186134156 hasConceptScore W3186134156C28826006 @default.
- W3186134156 hasConceptScore W3186134156C33923547 @default.
- W3186134156 hasConceptScore W3186134156C41008148 @default.
- W3186134156 hasConceptScore W3186134156C50644808 @default.
- W3186134156 hasConceptScore W3186134156C51632099 @default.
- W3186134156 hasConceptScore W3186134156C774472 @default.
- W3186134156 hasLocation W31861341561 @default.
- W3186134156 hasOpenAccess W3186134156 @default.
- W3186134156 hasPrimaryLocation W31861341561 @default.
- W3186134156 hasRelatedWork W1552704443 @default.
- W3186134156 hasRelatedWork W1597529531 @default.
- W3186134156 hasRelatedWork W1973856371 @default.
- W3186134156 hasRelatedWork W2028011900 @default.
- W3186134156 hasRelatedWork W2128384737 @default.
- W3186134156 hasRelatedWork W2153743018 @default.
- W3186134156 hasRelatedWork W2172852868 @default.
- W3186134156 hasRelatedWork W2340870721 @default.
- W3186134156 hasRelatedWork W2786653492 @default.
- W3186134156 hasRelatedWork W2788819856 @default.