Matches in SemOpenAlex for { <https://semopenalex.org/work/W2894927917> ?p ?o ?g. }
Showing items 1 to 90 of
90
with 100 items per page.
- W2894927917 endingPage "258" @default.
- W2894927917 startingPage "221" @default.
- W2894927917 abstract "Margin enlargement over training data has been an important strategy since perceptrons in machine learning for the purpose of boosting the robustness of classifiers toward a good generalization ability. Yet Breiman shows a dilemma (Breiman, 1999) that a uniform improvement on margin distribution emph{does not} necessarily reduces generalization errors. In this paper, we revisit Breiman's dilemma in deep neural networks with recently proposed spectrally normalized margins. A novel perspective is provided to explain Breiman's dilemma based on phase transitions in dynamics of normalized margin distributions, that reflects the trade-off between expressive power of models and complexity of data. When data complexity is comparable to the model expressiveness in the sense that both training and test data share similar phase transitions in normalized margin dynamics, two efficient ways are derived to predict the trend of generalization or test error via classic margin-based generalization bounds with restricted Rademacher complexities. On the other hand, over-expressive models that exhibit uniform improvements on training margins, as a distinct phase transition to test margin dynamics, may lose such a prediction power and fail to prevent the overfitting. Experiments are conducted to show the validity of the proposed method with some basic convolutional networks, AlexNet, VGG-16, and ResNet-18, on several datasets including Cifar10/100 and mini-ImageNet." @default.
- W2894927917 created "2018-10-12" @default.
- W2894927917 creator A5000314582 @default.
- W2894927917 creator A5018560644 @default.
- W2894927917 creator A5051299066 @default.
- W2894927917 date "2022-01-01" @default.
- W2894927917 modified "2023-10-03" @default.
- W2894927917 title "On Breiman’s dilemma in neural networks: phase transitions of margin dynamics" @default.
- W2894927917 cites W1608733719 @default.
- W2894927917 cites W1686810756 @default.
- W2894927917 cites W1944672 @default.
- W2894927917 cites W1988790447 @default.
- W2894927917 cites W2034978228 @default.
- W2894927917 cites W2099579348 @default.
- W2894927917 cites W2103972570 @default.
- W2894927917 cites W2119821739 @default.
- W2894927917 cites W2128882956 @default.
- W2894927917 cites W2148603752 @default.
- W2894927917 cites W2172195373 @default.
- W2894927917 cites W2194775991 @default.
- W2894927917 cites W2775288145 @default.
- W2894927917 cites W2883570905 @default.
- W2894927917 cites W2911742574 @default.
- W2894927917 cites W2949559870 @default.
- W2894927917 cites W2963285844 @default.
- W2894927917 cites W2963341924 @default.
- W2894927917 cites W2963664410 @default.
- W2894927917 cites W2963836885 @default.
- W2894927917 cites W3098897816 @default.
- W2894927917 cites W3118608800 @default.
- W2894927917 cites W3137695714 @default.
- W2894927917 doi "https://doi.org/10.4310/amsa.2022.v7.n2.a4" @default.
- W2894927917 hasPublicationYear "2022" @default.
- W2894927917 type Work @default.
- W2894927917 sameAs 2894927917 @default.
- W2894927917 citedByCount "1" @default.
- W2894927917 countsByYear W28949279172020 @default.
- W2894927917 crossrefType "journal-article" @default.
- W2894927917 hasAuthorship W2894927917A5000314582 @default.
- W2894927917 hasAuthorship W2894927917A5018560644 @default.
- W2894927917 hasAuthorship W2894927917A5051299066 @default.
- W2894927917 hasConcept C119857082 @default.
- W2894927917 hasConcept C121332964 @default.
- W2894927917 hasConcept C121864883 @default.
- W2894927917 hasConcept C145912823 @default.
- W2894927917 hasConcept C154945302 @default.
- W2894927917 hasConcept C24890656 @default.
- W2894927917 hasConcept C2524010 @default.
- W2894927917 hasConcept C2778496695 @default.
- W2894927917 hasConcept C33923547 @default.
- W2894927917 hasConcept C41008148 @default.
- W2894927917 hasConcept C44280652 @default.
- W2894927917 hasConcept C50644808 @default.
- W2894927917 hasConcept C62520636 @default.
- W2894927917 hasConcept C774472 @default.
- W2894927917 hasConceptScore W2894927917C119857082 @default.
- W2894927917 hasConceptScore W2894927917C121332964 @default.
- W2894927917 hasConceptScore W2894927917C121864883 @default.
- W2894927917 hasConceptScore W2894927917C145912823 @default.
- W2894927917 hasConceptScore W2894927917C154945302 @default.
- W2894927917 hasConceptScore W2894927917C24890656 @default.
- W2894927917 hasConceptScore W2894927917C2524010 @default.
- W2894927917 hasConceptScore W2894927917C2778496695 @default.
- W2894927917 hasConceptScore W2894927917C33923547 @default.
- W2894927917 hasConceptScore W2894927917C41008148 @default.
- W2894927917 hasConceptScore W2894927917C44280652 @default.
- W2894927917 hasConceptScore W2894927917C50644808 @default.
- W2894927917 hasConceptScore W2894927917C62520636 @default.
- W2894927917 hasConceptScore W2894927917C774472 @default.
- W2894927917 hasIssue "2" @default.
- W2894927917 hasLocation W28949279171 @default.
- W2894927917 hasOpenAccess W2894927917 @default.
- W2894927917 hasPrimaryLocation W28949279171 @default.
- W2894927917 hasRelatedWork W1510154836 @default.
- W2894927917 hasRelatedWork W2274227655 @default.
- W2894927917 hasRelatedWork W2309719799 @default.
- W2894927917 hasRelatedWork W2386387936 @default.
- W2894927917 hasRelatedWork W2796547653 @default.
- W2894927917 hasRelatedWork W2996386983 @default.
- W2894927917 hasRelatedWork W3001020386 @default.
- W2894927917 hasRelatedWork W3107474891 @default.
- W2894927917 hasRelatedWork W4324144456 @default.
- W2894927917 hasRelatedWork W1629725936 @default.
- W2894927917 hasVolume "7" @default.
- W2894927917 isParatext "false" @default.
- W2894927917 isRetracted "false" @default.
- W2894927917 magId "2894927917" @default.
- W2894927917 workType "article" @default.