Matches in SemOpenAlex for { <https://semopenalex.org/work/W3146640504> ?p ?o ?g. }
- W3146640504 abstract "Recent studies revealed complex convergence dynamics in gradient-based methods, which has been little understood so far. Changing the step size to balance between high convergence rate and small generalization error may not be sufficient: maximizing the test accuracy usually requires a larger learning rate than minimizing the training loss. To explore the dynamic bounds of convergence rate, this study introduces textit{differential capability} into an optimization process, which measures whether the test accuracy increases as fast as a model approaches the decision boundary in a classification problem. The convergence analysis showed that: 1) a higher convergence rate leads to slower capability growth; 2) a lower convergence rate results in faster capability growth and decay; 3) regulating a convergence rate in either direction reduces differential capability." @default.
- W3146640504 created "2021-04-13" @default.
- W3146640504 creator A5090465649 @default.
- W3146640504 date "2021-04-02" @default.
- W3146640504 modified "2023-09-26" @default.
- W3146640504 title "Neurons learn slower than they think." @default.
- W3146640504 cites W1535520578 @default.
- W3146640504 cites W2751568301 @default.
- W3146640504 cites W2805627889 @default.
- W3146640504 cites W2886067286 @default.
- W3146640504 cites W2891340257 @default.
- W3146640504 cites W2905800572 @default.
- W3146640504 cites W2907225497 @default.
- W3146640504 cites W2911742574 @default.
- W3146640504 cites W2912981918 @default.
- W3146640504 cites W2921238576 @default.
- W3146640504 cites W2962726660 @default.
- W3146640504 cites W2963376662 @default.
- W3146640504 cites W2963482148 @default.
- W3146640504 cites W2963794891 @default.
- W3146640504 cites W2964072686 @default.
- W3146640504 cites W2964098911 @default.
- W3146640504 cites W2970028551 @default.
- W3146640504 cites W2994635124 @default.
- W3146640504 cites W2995896027 @default.
- W3146640504 cites W2998412226 @default.
- W3146640504 cites W3021189130 @default.
- W3146640504 cites W3034547948 @default.
- W3146640504 cites W3037945049 @default.
- W3146640504 cites W3046385591 @default.
- W3146640504 cites W3079955638 @default.
- W3146640504 cites W3081610431 @default.
- W3146640504 cites W3100084971 @default.
- W3146640504 cites W3100743822 @default.
- W3146640504 cites W3104429559 @default.
- W3146640504 cites W3122060391 @default.
- W3146640504 cites W3122402965 @default.
- W3146640504 cites W3132026801 @default.
- W3146640504 cites W3132471231 @default.
- W3146640504 cites W3137695714 @default.
- W3146640504 hasPublicationYear "2021" @default.
- W3146640504 type Work @default.
- W3146640504 sameAs 3146640504 @default.
- W3146640504 citedByCount "0" @default.
- W3146640504 crossrefType "posted-content" @default.
- W3146640504 hasAuthorship W3146640504A5090465649 @default.
- W3146640504 hasConcept C111919701 @default.
- W3146640504 hasConcept C121332964 @default.
- W3146640504 hasConcept C126255220 @default.
- W3146640504 hasConcept C134306372 @default.
- W3146640504 hasConcept C15744967 @default.
- W3146640504 hasConcept C162324750 @default.
- W3146640504 hasConcept C168031717 @default.
- W3146640504 hasConcept C169760540 @default.
- W3146640504 hasConcept C177148314 @default.
- W3146640504 hasConcept C26517878 @default.
- W3146640504 hasConcept C2777303404 @default.
- W3146640504 hasConcept C28826006 @default.
- W3146640504 hasConcept C33923547 @default.
- W3146640504 hasConcept C38652104 @default.
- W3146640504 hasConcept C41008148 @default.
- W3146640504 hasConcept C50522688 @default.
- W3146640504 hasConcept C538505008 @default.
- W3146640504 hasConcept C57869625 @default.
- W3146640504 hasConcept C93226319 @default.
- W3146640504 hasConcept C97355855 @default.
- W3146640504 hasConcept C98045186 @default.
- W3146640504 hasConceptScore W3146640504C111919701 @default.
- W3146640504 hasConceptScore W3146640504C121332964 @default.
- W3146640504 hasConceptScore W3146640504C126255220 @default.
- W3146640504 hasConceptScore W3146640504C134306372 @default.
- W3146640504 hasConceptScore W3146640504C15744967 @default.
- W3146640504 hasConceptScore W3146640504C162324750 @default.
- W3146640504 hasConceptScore W3146640504C168031717 @default.
- W3146640504 hasConceptScore W3146640504C169760540 @default.
- W3146640504 hasConceptScore W3146640504C177148314 @default.
- W3146640504 hasConceptScore W3146640504C26517878 @default.
- W3146640504 hasConceptScore W3146640504C2777303404 @default.
- W3146640504 hasConceptScore W3146640504C28826006 @default.
- W3146640504 hasConceptScore W3146640504C33923547 @default.
- W3146640504 hasConceptScore W3146640504C38652104 @default.
- W3146640504 hasConceptScore W3146640504C41008148 @default.
- W3146640504 hasConceptScore W3146640504C50522688 @default.
- W3146640504 hasConceptScore W3146640504C538505008 @default.
- W3146640504 hasConceptScore W3146640504C57869625 @default.
- W3146640504 hasConceptScore W3146640504C93226319 @default.
- W3146640504 hasConceptScore W3146640504C97355855 @default.
- W3146640504 hasConceptScore W3146640504C98045186 @default.
- W3146640504 hasLocation W31466405041 @default.
- W3146640504 hasOpenAccess W3146640504 @default.
- W3146640504 hasPrimaryLocation W31466405041 @default.
- W3146640504 hasRelatedWork W139408237 @default.
- W3146640504 hasRelatedWork W1653217956 @default.
- W3146640504 hasRelatedWork W1700473002 @default.
- W3146640504 hasRelatedWork W1978793268 @default.
- W3146640504 hasRelatedWork W1985435410 @default.
- W3146640504 hasRelatedWork W2000364167 @default.
- W3146640504 hasRelatedWork W209183012 @default.
- W3146640504 hasRelatedWork W2119469028 @default.
- W3146640504 hasRelatedWork W2133924951 @default.