Matches in SemOpenAlex for { <https://semopenalex.org/work/W3034214529> ?p ?o ?g. }
- W3034214529 abstract "We analyze in a closed form the learning dynamics of stochastic gradient descent (SGD) for a single layer neural network classifying a high-dimensional Gaussian mixture where each cluster is assigned one of two labels. This problem provides a prototype of a non-convex loss landscape with interpolating regimes and a large generalization gap. We define a particular stochastic process for which SGD can be extended to a continuous-time limit that we call stochastic gradient flow. In the full-batch limit we recover the standard gradient flow. We apply dynamical mean-field theory from statistical physics to track the dynamics of the algorithm in the high-dimensional limit via a self-consistent stochastic process. We explore the performance of the algorithm as a function of control parameters shedding light on how it navigates the loss landscape." @default.
- W3034214529 created "2020-06-19" @default.
- W3034214529 creator A5017614803 @default.
- W3034214529 creator A5054525547 @default.
- W3034214529 creator A5068236230 @default.
- W3034214529 creator A5089268172 @default.
- W3034214529 date "2020-12-07" @default.
- W3034214529 modified "2023-10-17" @default.
- W3034214529 title "Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification" @default.
- W3034214529 cites W1971565000 @default.
- W3034214529 cites W1977011475 @default.
- W3034214529 cites W1995842804 @default.
- W3034214529 cites W2026896061 @default.
- W3034214529 cites W2039263963 @default.
- W3034214529 cites W2042318263 @default.
- W3034214529 cites W2074238984 @default.
- W3034214529 cites W2080021732 @default.
- W3034214529 cites W2125930537 @default.
- W3034214529 cites W2166193626 @default.
- W3034214529 cites W2166693943 @default.
- W3034214529 cites W2168885649 @default.
- W3034214529 cites W2612837156 @default.
- W3034214529 cites W2766016303 @default.
- W3034214529 cites W2777256551 @default.
- W3034214529 cites W2798986185 @default.
- W3034214529 cites W2893759728 @default.
- W3034214529 cites W2910655610 @default.
- W3034214529 cites W2911742574 @default.
- W3034214529 cites W2913010492 @default.
- W3034214529 cites W2913728378 @default.
- W3034214529 cites W2948488743 @default.
- W3034214529 cites W2955330387 @default.
- W3034214529 cites W2963095610 @default.
- W3034214529 cites W2963148870 @default.
- W3034214529 cites W2963982189 @default.
- W3034214529 cites W2964088238 @default.
- W3034214529 cites W2966530573 @default.
- W3034214529 cites W2970540478 @default.
- W3034214529 cites W2976768568 @default.
- W3034214529 cites W2995689697 @default.
- W3034214529 cites W3007724531 @default.
- W3034214529 cites W3035703482 @default.
- W3034214529 cites W3099499532 @default.
- W3034214529 cites W3105463807 @default.
- W3034214529 cites W3107728769 @default.
- W3034214529 cites W3151137625 @default.
- W3034214529 hasPublicationYear "2020" @default.
- W3034214529 type Work @default.
- W3034214529 sameAs 3034214529 @default.
- W3034214529 citedByCount "0" @default.
- W3034214529 crossrefType "proceedings-article" @default.
- W3034214529 hasAuthorship W3034214529A5017614803 @default.
- W3034214529 hasAuthorship W3034214529A5054525547 @default.
- W3034214529 hasAuthorship W3034214529A5068236230 @default.
- W3034214529 hasAuthorship W3034214529A5089268172 @default.
- W3034214529 hasBestOaLocation W30342145292 @default.
- W3034214529 hasConcept C121332964 @default.
- W3034214529 hasConcept C121864883 @default.
- W3034214529 hasConcept C153258448 @default.
- W3034214529 hasConcept C154945302 @default.
- W3034214529 hasConcept C163716315 @default.
- W3034214529 hasConcept C202444582 @default.
- W3034214529 hasConcept C206688291 @default.
- W3034214529 hasConcept C28826006 @default.
- W3034214529 hasConcept C33923547 @default.
- W3034214529 hasConcept C41008148 @default.
- W3034214529 hasConcept C50644808 @default.
- W3034214529 hasConcept C51267290 @default.
- W3034214529 hasConcept C61326573 @default.
- W3034214529 hasConcept C62520636 @default.
- W3034214529 hasConcept C9652623 @default.
- W3034214529 hasConceptScore W3034214529C121332964 @default.
- W3034214529 hasConceptScore W3034214529C121864883 @default.
- W3034214529 hasConceptScore W3034214529C153258448 @default.
- W3034214529 hasConceptScore W3034214529C154945302 @default.
- W3034214529 hasConceptScore W3034214529C163716315 @default.
- W3034214529 hasConceptScore W3034214529C202444582 @default.
- W3034214529 hasConceptScore W3034214529C206688291 @default.
- W3034214529 hasConceptScore W3034214529C28826006 @default.
- W3034214529 hasConceptScore W3034214529C33923547 @default.
- W3034214529 hasConceptScore W3034214529C41008148 @default.
- W3034214529 hasConceptScore W3034214529C50644808 @default.
- W3034214529 hasConceptScore W3034214529C51267290 @default.
- W3034214529 hasConceptScore W3034214529C61326573 @default.
- W3034214529 hasConceptScore W3034214529C62520636 @default.
- W3034214529 hasConceptScore W3034214529C9652623 @default.
- W3034214529 hasLocation W30342145291 @default.
- W3034214529 hasLocation W30342145292 @default.
- W3034214529 hasLocation W30342145293 @default.
- W3034214529 hasLocation W30342145294 @default.
- W3034214529 hasLocation W30342145295 @default.
- W3034214529 hasOpenAccess W3034214529 @default.
- W3034214529 hasPrimaryLocation W30342145291 @default.
- W3034214529 hasRelatedWork W1966851638 @default.
- W3034214529 hasRelatedWork W1974481980 @default.
- W3034214529 hasRelatedWork W2054503408 @default.
- W3034214529 hasRelatedWork W2092366338 @default.
- W3034214529 hasRelatedWork W2158680431 @default.
- W3034214529 hasRelatedWork W2247482484 @default.
- W3034214529 hasRelatedWork W2337187786 @default.