Matches in SemOpenAlex for { <https://semopenalex.org/work/W3169353662> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W3169353662 endingPage "8129" @default.
- W3169353662 startingPage "8119" @default.
- W3169353662 abstract "A recent line of work has analyzed the theoretical properties of deep neural networks via the Neural Tangent Kernel (NTK). In particular, the smallest eigenvalue of the NTK has been related to the memorization capacity, the global convergence of gradient descent algorithms and the generalization of deep nets. However, existing results either provide bounds in the two-layer setting or assume that the spectrum of the NTK matrices is bounded away from 0 for multi-layer networks. In this paper, we provide tight bounds on the smallest eigenvalue of NTK matrices for deep ReLU nets, both in the limiting case of infinite widths and for finite widths. In the finite-width setting, the network architectures we consider are fairly general: we require the existence of a wide layer with roughly order of $N$ neurons, $N$ being the number of data samples; and the scaling of the remaining layer widths is arbitrary (up to logarithmic factors). To obtain our results, we analyze various quantities of independent interest: we give lower bounds on the smallest singular value of hidden feature matrices, and upper bounds on the Lipschitz constant of input-output feature maps." @default.
- W3169353662 created "2021-06-22" @default.
- W3169353662 creator A5061114394 @default.
- W3169353662 creator A5072280192 @default.
- W3169353662 creator A5074288744 @default.
- W3169353662 date "2021-07-18" @default.
- W3169353662 modified "2023-10-16" @default.
- W3169353662 title "Tight Bounds on the Smallest Eigenvalue of the Neural Tangent Kernel for Deep ReLU Networks" @default.
- W3169353662 hasPublicationYear "2021" @default.
- W3169353662 type Work @default.
- W3169353662 sameAs 3169353662 @default.
- W3169353662 citedByCount "5" @default.
- W3169353662 countsByYear W31693536622021 @default.
- W3169353662 countsByYear W31693536622022 @default.
- W3169353662 crossrefType "proceedings-article" @default.
- W3169353662 hasAuthorship W3169353662A5061114394 @default.
- W3169353662 hasAuthorship W3169353662A5072280192 @default.
- W3169353662 hasAuthorship W3169353662A5074288744 @default.
- W3169353662 hasConcept C11413529 @default.
- W3169353662 hasConcept C114614502 @default.
- W3169353662 hasConcept C118615104 @default.
- W3169353662 hasConcept C121332964 @default.
- W3169353662 hasConcept C134306372 @default.
- W3169353662 hasConcept C138187205 @default.
- W3169353662 hasConcept C153258448 @default.
- W3169353662 hasConcept C154945302 @default.
- W3169353662 hasConcept C158693339 @default.
- W3169353662 hasConcept C177148314 @default.
- W3169353662 hasConcept C22324862 @default.
- W3169353662 hasConcept C2524010 @default.
- W3169353662 hasConcept C33923547 @default.
- W3169353662 hasConcept C34388435 @default.
- W3169353662 hasConcept C39927690 @default.
- W3169353662 hasConcept C41008148 @default.
- W3169353662 hasConcept C50644808 @default.
- W3169353662 hasConcept C62520636 @default.
- W3169353662 hasConcept C74193536 @default.
- W3169353662 hasConceptScore W3169353662C11413529 @default.
- W3169353662 hasConceptScore W3169353662C114614502 @default.
- W3169353662 hasConceptScore W3169353662C118615104 @default.
- W3169353662 hasConceptScore W3169353662C121332964 @default.
- W3169353662 hasConceptScore W3169353662C134306372 @default.
- W3169353662 hasConceptScore W3169353662C138187205 @default.
- W3169353662 hasConceptScore W3169353662C153258448 @default.
- W3169353662 hasConceptScore W3169353662C154945302 @default.
- W3169353662 hasConceptScore W3169353662C158693339 @default.
- W3169353662 hasConceptScore W3169353662C177148314 @default.
- W3169353662 hasConceptScore W3169353662C22324862 @default.
- W3169353662 hasConceptScore W3169353662C2524010 @default.
- W3169353662 hasConceptScore W3169353662C33923547 @default.
- W3169353662 hasConceptScore W3169353662C34388435 @default.
- W3169353662 hasConceptScore W3169353662C39927690 @default.
- W3169353662 hasConceptScore W3169353662C41008148 @default.
- W3169353662 hasConceptScore W3169353662C50644808 @default.
- W3169353662 hasConceptScore W3169353662C62520636 @default.
- W3169353662 hasConceptScore W3169353662C74193536 @default.
- W3169353662 hasOpenAccess W3169353662 @default.
- W3169353662 hasRelatedWork W2099163034 @default.
- W3169353662 hasRelatedWork W2109004851 @default.
- W3169353662 hasRelatedWork W2152593035 @default.
- W3169353662 hasRelatedWork W2803710049 @default.
- W3169353662 hasRelatedWork W2806891045 @default.
- W3169353662 hasRelatedWork W2910155483 @default.
- W3169353662 hasRelatedWork W2946840143 @default.
- W3169353662 hasRelatedWork W2947989684 @default.
- W3169353662 hasRelatedWork W2963220074 @default.
- W3169353662 hasRelatedWork W2963950090 @default.
- W3169353662 hasRelatedWork W2964915616 @default.
- W3169353662 hasRelatedWork W2966363981 @default.
- W3169353662 hasRelatedWork W2995443162 @default.
- W3169353662 hasRelatedWork W2998329861 @default.
- W3169353662 hasRelatedWork W3023160755 @default.
- W3169353662 hasRelatedWork W3088153346 @default.
- W3169353662 hasRelatedWork W3102262919 @default.
- W3169353662 hasRelatedWork W3116397704 @default.
- W3169353662 hasRelatedWork W3182153751 @default.
- W3169353662 hasRelatedWork W3212971542 @default.
- W3169353662 isParatext "false" @default.
- W3169353662 isRetracted "false" @default.
- W3169353662 magId "3169353662" @default.
- W3169353662 workType "article" @default.