Matches in SemOpenAlex for { <https://semopenalex.org/work/W3199714525> ?p ?o ?g. }
- W3199714525 abstract "An interesting observation in artificial neural networks is their favorable generalization error despite typically being extremely overparameterized. It is well known that classical statistical learning methods often result in vacuous generalization errors in the case of overparameterized neural networks. Adopting the recently developed Neural Tangent (NT) kernel theory, we prove uniform generalization bounds for overparameterized neural networks in kernel regimes, when the true data generating model belongs to the reproducing kernel Hilbert space (RKHS) corresponding to the NT kernel. Importantly, our bounds capture the exact error rates depending on the differentiability of the activation functions. In order to establish these bounds, we propose the information gain of the NT kernel as a measure of complexity of the learning problem. Our analysis uses a Mercer decomposition of the NT kernel in the basis of spherical harmonics and the decay rate of the corresponding eigenvalues. As a byproduct of our results, we show the equivalence between the RKHS corresponding to the NT kernel and its counterpart corresponding to the Matern family of kernels, that induces a very general class of models. We further discuss the implications of our analysis for some recent results on the regret bounds for reinforcement learning algorithms, which use overparameterized neural networks." @default.
- W3199714525 created "2021-09-27" @default.
- W3199714525 creator A5002832781 @default.
- W3199714525 creator A5009337709 @default.
- W3199714525 creator A5049569462 @default.
- W3199714525 creator A5079155200 @default.
- W3199714525 date "2021-09-13" @default.
- W3199714525 modified "2023-09-27" @default.
- W3199714525 title "Uniform Generalization Bounds for Overparameterized Neural Networks." @default.
- W3199714525 cites W120600689 @default.
- W3199714525 cites W1542886316 @default.
- W3199714525 cites W1579652926 @default.
- W3199714525 cites W1698155719 @default.
- W3199714525 cites W2014158063 @default.
- W3199714525 cites W2044514896 @default.
- W3199714525 cites W2099111195 @default.
- W3199714525 cites W2099471712 @default.
- W3199714525 cites W2099579348 @default.
- W3199714525 cites W2144902422 @default.
- W3199714525 cites W2163605009 @default.
- W3199714525 cites W2167608136 @default.
- W3199714525 cites W2550524953 @default.
- W3199714525 cites W2579923771 @default.
- W3199714525 cites W2604117713 @default.
- W3199714525 cites W2809090039 @default.
- W3199714525 cites W2880842812 @default.
- W3199714525 cites W2919115771 @default.
- W3199714525 cites W2947859416 @default.
- W3199714525 cites W2951665052 @default.
- W3199714525 cites W2952204734 @default.
- W3199714525 cites W2962685794 @default.
- W3199714525 cites W2962857907 @default.
- W3199714525 cites W2962939986 @default.
- W3199714525 cites W2964052793 @default.
- W3199714525 cites W2966650348 @default.
- W3199714525 cites W2971095480 @default.
- W3199714525 cites W2994747787 @default.
- W3199714525 cites W3030163527 @default.
- W3199714525 cites W3034511923 @default.
- W3199714525 cites W3034708079 @default.
- W3199714525 cites W3035407558 @default.
- W3199714525 cites W3036411057 @default.
- W3199714525 cites W3039141380 @default.
- W3199714525 cites W3089458484 @default.
- W3199714525 cites W3099842580 @default.
- W3199714525 cites W3101995310 @default.
- W3199714525 cites W3102361191 @default.
- W3199714525 cites W3102429474 @default.
- W3199714525 cites W3103313582 @default.
- W3199714525 cites W3109585842 @default.
- W3199714525 cites W3123002359 @default.
- W3199714525 cites W3124229194 @default.
- W3199714525 cites W3130725718 @default.
- W3199714525 cites W3130906801 @default.
- W3199714525 cites W3131697044 @default.
- W3199714525 cites W3181545753 @default.
- W3199714525 cites W3188343884 @default.
- W3199714525 cites W3194021689 @default.
- W3199714525 cites W3194505245 @default.
- W3199714525 cites W3159597788 @default.
- W3199714525 hasPublicationYear "2021" @default.
- W3199714525 type Work @default.
- W3199714525 sameAs 3199714525 @default.
- W3199714525 citedByCount "0" @default.
- W3199714525 crossrefType "posted-content" @default.
- W3199714525 hasAuthorship W3199714525A5002832781 @default.
- W3199714525 hasAuthorship W3199714525A5009337709 @default.
- W3199714525 hasAuthorship W3199714525A5049569462 @default.
- W3199714525 hasAuthorship W3199714525A5079155200 @default.
- W3199714525 hasConcept C11413529 @default.
- W3199714525 hasConcept C118615104 @default.
- W3199714525 hasConcept C122280245 @default.
- W3199714525 hasConcept C12267149 @default.
- W3199714525 hasConcept C134306372 @default.
- W3199714525 hasConcept C134517425 @default.
- W3199714525 hasConcept C154945302 @default.
- W3199714525 hasConcept C177148314 @default.
- W3199714525 hasConcept C202444582 @default.
- W3199714525 hasConcept C33923547 @default.
- W3199714525 hasConcept C41008148 @default.
- W3199714525 hasConcept C50644808 @default.
- W3199714525 hasConcept C62799726 @default.
- W3199714525 hasConcept C74193536 @default.
- W3199714525 hasConcept C80884492 @default.
- W3199714525 hasConceptScore W3199714525C11413529 @default.
- W3199714525 hasConceptScore W3199714525C118615104 @default.
- W3199714525 hasConceptScore W3199714525C122280245 @default.
- W3199714525 hasConceptScore W3199714525C12267149 @default.
- W3199714525 hasConceptScore W3199714525C134306372 @default.
- W3199714525 hasConceptScore W3199714525C134517425 @default.
- W3199714525 hasConceptScore W3199714525C154945302 @default.
- W3199714525 hasConceptScore W3199714525C177148314 @default.
- W3199714525 hasConceptScore W3199714525C202444582 @default.
- W3199714525 hasConceptScore W3199714525C33923547 @default.
- W3199714525 hasConceptScore W3199714525C41008148 @default.
- W3199714525 hasConceptScore W3199714525C50644808 @default.
- W3199714525 hasConceptScore W3199714525C62799726 @default.
- W3199714525 hasConceptScore W3199714525C74193536 @default.
- W3199714525 hasConceptScore W3199714525C80884492 @default.
- W3199714525 hasLocation W31997145251 @default.