Matches in SemOpenAlex for { <https://semopenalex.org/work/W3026815147> ?p ?o ?g. }
- W3026815147 abstract "We study the eigenvalue distributions of the Conjugate Kernel and Neural Tangent Kernel associated to multi-layer feedforward neural networks. In an asymptotic regime where network width is increasing linearly in sample size, under random initialization of the weights, and for input samples satisfying a notion of approximate pairwise orthogonality, we show that the eigenvalue distributions of the CK and NTK converge to deterministic limits. The limit for the CK is described by iterating the Marcenko-Pastur map across the hidden layers. The limit for the NTK is equivalent to that of a linear combination of the CK matrices across layers, and may be described by recursive fixed-point equations that extend this Marcenko-Pastur map. We demonstrate the agreement of these asymptotic predictions with the observed spectra for both synthetic and CIFAR-10 training data, and we perform a small simulation to investigate the evolutions of these spectra over training." @default.
- W3026815147 created "2020-05-29" @default.
- W3026815147 creator A5047187143 @default.
- W3026815147 creator A5050219087 @default.
- W3026815147 date "2020-05-25" @default.
- W3026815147 modified "2023-09-26" @default.
- W3026815147 title "Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networks" @default.
- W3026815147 cites W1567512734 @default.
- W3026815147 cites W1836465849 @default.
- W3026815147 cites W1903051497 @default.
- W3026815147 cites W1969749556 @default.
- W3026815147 cites W2032291279 @default.
- W3026815147 cites W2043065155 @default.
- W3026815147 cites W2060581589 @default.
- W3026815147 cites W2100487820 @default.
- W3026815147 cites W2144902422 @default.
- W3026815147 cites W2154087390 @default.
- W3026815147 cites W2167608136 @default.
- W3026815147 cites W2618381130 @default.
- W3026815147 cites W2752851182 @default.
- W3026815147 cites W2763894180 @default.
- W3026815147 cites W2787248994 @default.
- W3026815147 cites W2803731016 @default.
- W3026815147 cites W2809090039 @default.
- W3026815147 cites W2894604724 @default.
- W3026815147 cites W2899748887 @default.
- W3026815147 cites W2913473169 @default.
- W3026815147 cites W2923764619 @default.
- W3026815147 cites W2940302217 @default.
- W3026815147 cites W2952204734 @default.
- W3026815147 cites W2952568974 @default.
- W3026815147 cites W2959995783 @default.
- W3026815147 cites W2962685794 @default.
- W3026815147 cites W2962698540 @default.
- W3026815147 cites W2962804662 @default.
- W3026815147 cites W2962939986 @default.
- W3026815147 cites W2963008903 @default.
- W3026815147 cites W2963094815 @default.
- W3026815147 cites W2963144092 @default.
- W3026815147 cites W2963470399 @default.
- W3026815147 cites W2963473864 @default.
- W3026815147 cites W2963650649 @default.
- W3026815147 cites W2963790895 @default.
- W3026815147 cites W2964052793 @default.
- W3026815147 cites W2964088238 @default.
- W3026815147 cites W2965497096 @default.
- W3026815147 cites W2967536008 @default.
- W3026815147 cites W2970618525 @default.
- W3026815147 cites W2970723196 @default.
- W3026815147 cites W2970731147 @default.
- W3026815147 cites W2971043187 @default.
- W3026815147 cites W2973294784 @default.
- W3026815147 cites W2976157562 @default.
- W3026815147 cites W2978773287 @default.
- W3026815147 cites W2988104282 @default.
- W3026815147 cites W2991641838 @default.
- W3026815147 cites W2998314487 @default.
- W3026815147 cites W3011231621 @default.
- W3026815147 cites W3034612893 @default.
- W3026815147 cites W3034704745 @default.
- W3026815147 cites W3041016014 @default.
- W3026815147 cites W3105622673 @default.
- W3026815147 cites W3118608800 @default.
- W3026815147 cites W3152114226 @default.
- W3026815147 cites W568673721 @default.
- W3026815147 cites W581677283 @default.
- W3026815147 hasPublicationYear "2020" @default.
- W3026815147 type Work @default.
- W3026815147 sameAs 3026815147 @default.
- W3026815147 citedByCount "2" @default.
- W3026815147 countsByYear W30268151472020 @default.
- W3026815147 countsByYear W30268151472021 @default.
- W3026815147 crossrefType "posted-content" @default.
- W3026815147 hasAuthorship W3026815147A5047187143 @default.
- W3026815147 hasAuthorship W3026815147A5050219087 @default.
- W3026815147 hasConcept C114466953 @default.
- W3026815147 hasConcept C114614502 @default.
- W3026815147 hasConcept C121332964 @default.
- W3026815147 hasConcept C134306372 @default.
- W3026815147 hasConcept C138187205 @default.
- W3026815147 hasConcept C151201525 @default.
- W3026815147 hasConcept C154945302 @default.
- W3026815147 hasConcept C158693339 @default.
- W3026815147 hasConcept C17137986 @default.
- W3026815147 hasConcept C199360897 @default.
- W3026815147 hasConcept C2524010 @default.
- W3026815147 hasConcept C28826006 @default.
- W3026815147 hasConcept C33923547 @default.
- W3026815147 hasConcept C41008148 @default.
- W3026815147 hasConcept C50644808 @default.
- W3026815147 hasConcept C62520636 @default.
- W3026815147 hasConcept C74193536 @default.
- W3026815147 hasConceptScore W3026815147C114466953 @default.
- W3026815147 hasConceptScore W3026815147C114614502 @default.
- W3026815147 hasConceptScore W3026815147C121332964 @default.
- W3026815147 hasConceptScore W3026815147C134306372 @default.
- W3026815147 hasConceptScore W3026815147C138187205 @default.
- W3026815147 hasConceptScore W3026815147C151201525 @default.
- W3026815147 hasConceptScore W3026815147C154945302 @default.
- W3026815147 hasConceptScore W3026815147C158693339 @default.