Matches in SemOpenAlex for { <https://semopenalex.org/work/W4288601277> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4288601277 abstract "Neural networks with a large number of parameters admit a mean-field description, which has recently served as a theoretical explanation for the favorable training properties of overparameterized models. In this regime, gradient descent obeys a deterministic partial differential equation (PDE) that converges to a globally optimal solution for networks with a single hidden layer under appropriate assumptions. In this work, we propose a non-local mass transport dynamics that leads to a modified PDE with the same minimizer. We implement this non-local dynamics as a stochastic neuronal birth-death process and we prove that it accelerates the rate of convergence in the mean-field limit. We subsequently realize this PDE with two classes of numerical schemes that converge to the mean-field equation, each of which can easily be implemented for neural networks with finite numbers of parameters. We illustrate our algorithms with two models to provide intuition for the mechanism through which convergence is accelerated." @default.
- W4288601277 created "2022-07-29" @default.
- W4288601277 creator A5044193587 @default.
- W4288601277 creator A5048166612 @default.
- W4288601277 creator A5071403558 @default.
- W4288601277 creator A5086430646 @default.
- W4288601277 date "2019-02-05" @default.
- W4288601277 modified "2023-10-14" @default.
- W4288601277 title "Global convergence of neuron birth-death dynamics" @default.
- W4288601277 doi "https://doi.org/10.48550/arxiv.1902.01843" @default.
- W4288601277 hasPublicationYear "2019" @default.
- W4288601277 type Work @default.
- W4288601277 citedByCount "0" @default.
- W4288601277 crossrefType "posted-content" @default.
- W4288601277 hasAuthorship W4288601277A5044193587 @default.
- W4288601277 hasAuthorship W4288601277A5048166612 @default.
- W4288601277 hasAuthorship W4288601277A5071403558 @default.
- W4288601277 hasAuthorship W4288601277A5086430646 @default.
- W4288601277 hasBestOaLocation W42886012771 @default.
- W4288601277 hasConcept C111472728 @default.
- W4288601277 hasConcept C121332964 @default.
- W4288601277 hasConcept C126255220 @default.
- W4288601277 hasConcept C132010649 @default.
- W4288601277 hasConcept C134306372 @default.
- W4288601277 hasConcept C138885662 @default.
- W4288601277 hasConcept C151201525 @default.
- W4288601277 hasConcept C153258448 @default.
- W4288601277 hasConcept C154945302 @default.
- W4288601277 hasConcept C162324750 @default.
- W4288601277 hasConcept C202213908 @default.
- W4288601277 hasConcept C26517878 @default.
- W4288601277 hasConcept C2777303404 @default.
- W4288601277 hasConcept C28826006 @default.
- W4288601277 hasConcept C33923547 @default.
- W4288601277 hasConcept C38652104 @default.
- W4288601277 hasConcept C41008148 @default.
- W4288601277 hasConcept C50522688 @default.
- W4288601277 hasConcept C50644808 @default.
- W4288601277 hasConcept C51955184 @default.
- W4288601277 hasConcept C57869625 @default.
- W4288601277 hasConcept C62520636 @default.
- W4288601277 hasConcept C93779851 @default.
- W4288601277 hasConceptScore W4288601277C111472728 @default.
- W4288601277 hasConceptScore W4288601277C121332964 @default.
- W4288601277 hasConceptScore W4288601277C126255220 @default.
- W4288601277 hasConceptScore W4288601277C132010649 @default.
- W4288601277 hasConceptScore W4288601277C134306372 @default.
- W4288601277 hasConceptScore W4288601277C138885662 @default.
- W4288601277 hasConceptScore W4288601277C151201525 @default.
- W4288601277 hasConceptScore W4288601277C153258448 @default.
- W4288601277 hasConceptScore W4288601277C154945302 @default.
- W4288601277 hasConceptScore W4288601277C162324750 @default.
- W4288601277 hasConceptScore W4288601277C202213908 @default.
- W4288601277 hasConceptScore W4288601277C26517878 @default.
- W4288601277 hasConceptScore W4288601277C2777303404 @default.
- W4288601277 hasConceptScore W4288601277C28826006 @default.
- W4288601277 hasConceptScore W4288601277C33923547 @default.
- W4288601277 hasConceptScore W4288601277C38652104 @default.
- W4288601277 hasConceptScore W4288601277C41008148 @default.
- W4288601277 hasConceptScore W4288601277C50522688 @default.
- W4288601277 hasConceptScore W4288601277C50644808 @default.
- W4288601277 hasConceptScore W4288601277C51955184 @default.
- W4288601277 hasConceptScore W4288601277C57869625 @default.
- W4288601277 hasConceptScore W4288601277C62520636 @default.
- W4288601277 hasConceptScore W4288601277C93779851 @default.
- W4288601277 hasLocation W42886012771 @default.
- W4288601277 hasOpenAccess W4288601277 @default.
- W4288601277 hasPrimaryLocation W42886012771 @default.
- W4288601277 hasRelatedWork W1988519391 @default.
- W4288601277 hasRelatedWork W2082482750 @default.
- W4288601277 hasRelatedWork W2544122622 @default.
- W4288601277 hasRelatedWork W2914902801 @default.
- W4288601277 hasRelatedWork W3009193529 @default.
- W4288601277 hasRelatedWork W3018192452 @default.
- W4288601277 hasRelatedWork W3035228781 @default.
- W4288601277 hasRelatedWork W4285428732 @default.
- W4288601277 hasRelatedWork W4298250428 @default.
- W4288601277 hasRelatedWork W4307101729 @default.
- W4288601277 isParatext "false" @default.
- W4288601277 isRetracted "false" @default.
- W4288601277 workType "article" @default.