Matches in SemOpenAlex for { <https://semopenalex.org/work/W3101952907> ?p ?o ?g. }
Showing items 1 to 84 of
84
with 100 items per page.
- W3101952907 endingPage "7753" @default.
- W3101952907 startingPage "7743" @default.
- W3101952907 abstract "The notion of implicit bias, or implicit regularization, has been suggested as a means to explain the surprising generalization ability of modern-days overparameterized learning algorithms. This notion refers to the tendency of the optimization algorithm towards a certain structured solution that often generalizes well. Recently, several papers have studied implicit regularization and were able to identify this phenomenon in various scenarios. We revisit this paradigm in arguably the simplest non-trivial setup, and study the implicit bias of Stochastic Gradient Descent (SGD) in the context of Stochastic Convex Optimization. As a first step, we provide a simple construction that rules out the existence of a emph{distribution-independent} implicit regularizer that governs the generalization ability of SGD. We then demonstrate a learning problem that rules out a very general class of emph{distribution-dependent} implicit regularizers from explaining generalization, which includes strongly convex regularizers as well as non-degenerate norm-based regularizations. Certain aspects of our constructions point out to significant difficulties in providing a comprehensive explanation of an algorithm's generalization performance by solely arguing about its implicit regularization properties." @default.
- W3101952907 created "2020-11-23" @default.
- W3101952907 creator A5053775980 @default.
- W3101952907 creator A5064250021 @default.
- W3101952907 creator A5066905280 @default.
- W3101952907 creator A5089862531 @default.
- W3101952907 date "2020-01-01" @default.
- W3101952907 modified "2023-09-24" @default.
- W3101952907 title "Can Implicit Bias Explain Generalization? Stochastic Convex Optimization as a Case Study" @default.
- W3101952907 hasPublicationYear "2020" @default.
- W3101952907 type Work @default.
- W3101952907 sameAs 3101952907 @default.
- W3101952907 citedByCount "5" @default.
- W3101952907 countsByYear W31019529072020 @default.
- W3101952907 countsByYear W31019529072021 @default.
- W3101952907 crossrefType "proceedings-article" @default.
- W3101952907 hasAuthorship W3101952907A5053775980 @default.
- W3101952907 hasAuthorship W3101952907A5064250021 @default.
- W3101952907 hasAuthorship W3101952907A5066905280 @default.
- W3101952907 hasAuthorship W3101952907A5089862531 @default.
- W3101952907 hasConcept C111472728 @default.
- W3101952907 hasConcept C112680207 @default.
- W3101952907 hasConcept C11413529 @default.
- W3101952907 hasConcept C126255220 @default.
- W3101952907 hasConcept C134306372 @default.
- W3101952907 hasConcept C138885662 @default.
- W3101952907 hasConcept C154945302 @default.
- W3101952907 hasConcept C157972887 @default.
- W3101952907 hasConcept C177148314 @default.
- W3101952907 hasConcept C191795146 @default.
- W3101952907 hasConcept C206688291 @default.
- W3101952907 hasConcept C2524010 @default.
- W3101952907 hasConcept C2776135515 @default.
- W3101952907 hasConcept C28826006 @default.
- W3101952907 hasConcept C33923547 @default.
- W3101952907 hasConcept C41008148 @default.
- W3101952907 hasConcept C50644808 @default.
- W3101952907 hasConceptScore W3101952907C111472728 @default.
- W3101952907 hasConceptScore W3101952907C112680207 @default.
- W3101952907 hasConceptScore W3101952907C11413529 @default.
- W3101952907 hasConceptScore W3101952907C126255220 @default.
- W3101952907 hasConceptScore W3101952907C134306372 @default.
- W3101952907 hasConceptScore W3101952907C138885662 @default.
- W3101952907 hasConceptScore W3101952907C154945302 @default.
- W3101952907 hasConceptScore W3101952907C157972887 @default.
- W3101952907 hasConceptScore W3101952907C177148314 @default.
- W3101952907 hasConceptScore W3101952907C191795146 @default.
- W3101952907 hasConceptScore W3101952907C206688291 @default.
- W3101952907 hasConceptScore W3101952907C2524010 @default.
- W3101952907 hasConceptScore W3101952907C2776135515 @default.
- W3101952907 hasConceptScore W3101952907C28826006 @default.
- W3101952907 hasConceptScore W3101952907C33923547 @default.
- W3101952907 hasConceptScore W3101952907C41008148 @default.
- W3101952907 hasConceptScore W3101952907C50644808 @default.
- W3101952907 hasLocation W31019529071 @default.
- W3101952907 hasOpenAccess W3101952907 @default.
- W3101952907 hasPrimaryLocation W31019529071 @default.
- W3101952907 hasRelatedWork W1786935204 @default.
- W3101952907 hasRelatedWork W2103336901 @default.
- W3101952907 hasRelatedWork W2105180921 @default.
- W3101952907 hasRelatedWork W2181730996 @default.
- W3101952907 hasRelatedWork W2239951326 @default.
- W3101952907 hasRelatedWork W2429903989 @default.
- W3101952907 hasRelatedWork W2474694648 @default.
- W3101952907 hasRelatedWork W2949647647 @default.
- W3101952907 hasRelatedWork W2952500758 @default.
- W3101952907 hasRelatedWork W2953045501 @default.
- W3101952907 hasRelatedWork W2960191176 @default.
- W3101952907 hasRelatedWork W2962916883 @default.
- W3101952907 hasRelatedWork W2963826371 @default.
- W3101952907 hasRelatedWork W3011435611 @default.
- W3101952907 hasRelatedWork W3025644566 @default.
- W3101952907 hasRelatedWork W3035572253 @default.
- W3101952907 hasRelatedWork W3040340324 @default.
- W3101952907 hasRelatedWork W3088481514 @default.
- W3101952907 hasRelatedWork W3170959106 @default.
- W3101952907 hasRelatedWork W3212221512 @default.
- W3101952907 hasVolume "33" @default.
- W3101952907 isParatext "false" @default.
- W3101952907 isRetracted "false" @default.
- W3101952907 magId "3101952907" @default.
- W3101952907 workType "article" @default.