Matches in SemOpenAlex for { <https://semopenalex.org/work/W3004514911> ?p ?o ?g. }
Showing items 1 to 88 of
88
with 100 items per page.
- W3004514911 abstract "A recent line of work in deep learning theory has utilized the mean-field analysis to demonstrate the global convergence of noisy (stochastic) gradient descent for training over-parameterized two-layer neural networks. However, existing results in the mean-field setting do not provide the convergence rate of neural network training, and the generalization error bound is largely missing. In this paper, we provide a mean-field analysis in a generalized neural tangent kernel regime, and show that noisy gradient descent with weight decay can still exhibit a kernel-like behavior. This implies that the training loss converges linearly up to a certain accuracy in such regime. We also establish a generalization error bound for two-layer neural networks trained by noisy gradient descent with weight decay. Our results shed light on the connection between mean field analysis and the neural tangent kernel based analysis." @default.
- W3004514911 created "2020-02-14" @default.
- W3004514911 creator A5037709424 @default.
- W3004514911 creator A5051448391 @default.
- W3004514911 creator A5082974417 @default.
- W3004514911 creator A5086329948 @default.
- W3004514911 date "2020-02-10" @default.
- W3004514911 modified "2023-09-24" @default.
- W3004514911 title "Mean-Field Analysis of Two-Layer Neural Networks: Non-Asymptotic Rates and Generalization Bounds." @default.
- W3004514911 cites W2809090039 @default.
- W3004514911 hasPublicationYear "2020" @default.
- W3004514911 type Work @default.
- W3004514911 sameAs 3004514911 @default.
- W3004514911 citedByCount "2" @default.
- W3004514911 countsByYear W30045149112019 @default.
- W3004514911 countsByYear W30045149112020 @default.
- W3004514911 crossrefType "posted-content" @default.
- W3004514911 hasAuthorship W3004514911A5037709424 @default.
- W3004514911 hasAuthorship W3004514911A5051448391 @default.
- W3004514911 hasAuthorship W3004514911A5082974417 @default.
- W3004514911 hasAuthorship W3004514911A5086329948 @default.
- W3004514911 hasConcept C11413529 @default.
- W3004514911 hasConcept C118615104 @default.
- W3004514911 hasConcept C134306372 @default.
- W3004514911 hasConcept C138187205 @default.
- W3004514911 hasConcept C153258448 @default.
- W3004514911 hasConcept C154945302 @default.
- W3004514911 hasConcept C162324750 @default.
- W3004514911 hasConcept C165464430 @default.
- W3004514911 hasConcept C177148314 @default.
- W3004514911 hasConcept C202444582 @default.
- W3004514911 hasConcept C206688291 @default.
- W3004514911 hasConcept C2524010 @default.
- W3004514911 hasConcept C2777303404 @default.
- W3004514911 hasConcept C28826006 @default.
- W3004514911 hasConcept C33923547 @default.
- W3004514911 hasConcept C41008148 @default.
- W3004514911 hasConcept C50522688 @default.
- W3004514911 hasConcept C50644808 @default.
- W3004514911 hasConcept C74193536 @default.
- W3004514911 hasConcept C9652623 @default.
- W3004514911 hasConceptScore W3004514911C11413529 @default.
- W3004514911 hasConceptScore W3004514911C118615104 @default.
- W3004514911 hasConceptScore W3004514911C134306372 @default.
- W3004514911 hasConceptScore W3004514911C138187205 @default.
- W3004514911 hasConceptScore W3004514911C153258448 @default.
- W3004514911 hasConceptScore W3004514911C154945302 @default.
- W3004514911 hasConceptScore W3004514911C162324750 @default.
- W3004514911 hasConceptScore W3004514911C165464430 @default.
- W3004514911 hasConceptScore W3004514911C177148314 @default.
- W3004514911 hasConceptScore W3004514911C202444582 @default.
- W3004514911 hasConceptScore W3004514911C206688291 @default.
- W3004514911 hasConceptScore W3004514911C2524010 @default.
- W3004514911 hasConceptScore W3004514911C2777303404 @default.
- W3004514911 hasConceptScore W3004514911C28826006 @default.
- W3004514911 hasConceptScore W3004514911C33923547 @default.
- W3004514911 hasConceptScore W3004514911C41008148 @default.
- W3004514911 hasConceptScore W3004514911C50522688 @default.
- W3004514911 hasConceptScore W3004514911C50644808 @default.
- W3004514911 hasConceptScore W3004514911C74193536 @default.
- W3004514911 hasConceptScore W3004514911C9652623 @default.
- W3004514911 hasLocation W30045149111 @default.
- W3004514911 hasOpenAccess W3004514911 @default.
- W3004514911 hasPrimaryLocation W30045149111 @default.
- W3004514911 hasRelatedWork W2013362271 @default.
- W3004514911 hasRelatedWork W2037985840 @default.
- W3004514911 hasRelatedWork W2141996170 @default.
- W3004514911 hasRelatedWork W2766965791 @default.
- W3004514911 hasRelatedWork W2810862998 @default.
- W3004514911 hasRelatedWork W2894972989 @default.
- W3004514911 hasRelatedWork W2901741727 @default.
- W3004514911 hasRelatedWork W2907047316 @default.
- W3004514911 hasRelatedWork W2922277331 @default.
- W3004514911 hasRelatedWork W2946840143 @default.
- W3004514911 hasRelatedWork W2947989684 @default.
- W3004514911 hasRelatedWork W2959176742 @default.
- W3004514911 hasRelatedWork W2964915616 @default.
- W3004514911 hasRelatedWork W3035990832 @default.
- W3004514911 hasRelatedWork W3037508544 @default.
- W3004514911 hasRelatedWork W3121312397 @default.
- W3004514911 hasRelatedWork W3126161456 @default.
- W3004514911 hasRelatedWork W3135120748 @default.
- W3004514911 hasRelatedWork W3172612647 @default.
- W3004514911 hasRelatedWork W3213914290 @default.
- W3004514911 isParatext "false" @default.
- W3004514911 isRetracted "false" @default.
- W3004514911 magId "3004514911" @default.
- W3004514911 workType "article" @default.