Matches in SemOpenAlex for { <https://semopenalex.org/work/W3165466435> ?p ?o ?g. }
- W3165466435 abstract "The Neural Tangent Kernel (NTK) is the wide-network limit of a kernel defined using neural networks at initialization, whose embedding is the gradient of the output of the network with respect to its parameters. We study the which is defined using the same embedding, except after training, for neural networks with standard architectures, on binary classification problems extracted from MNIST and CIFAR-10, trained using SGD in a standard way. For some dataset-architecture pairs, after a few epochs of neural network training, a hard-margin SVM using the network's after kernel is much more accurate than when the network's initial kernel is used. For networks with an architecture similar to VGG, the after kernel is more global, in the sense that it is less invariant to transformations of input images that disrupt the global structure of the image while leaving the local statistics largely intact. For fully connected networks, the after kernel is less global in this sense. The after kernel tends to be more invariant to small shifts, rotations and zooms; data augmentation does not improve these invariances. The (finite approximation to the) conjugate kernel, obtained using the last layer of hidden nodes, sometimes, but not always, provides a good approximation to the NTK and the after kernel." @default.
- W3165466435 created "2021-06-07" @default.
- W3165466435 creator A5084487318 @default.
- W3165466435 date "2021-05-21" @default.
- W3165466435 modified "2023-09-27" @default.
- W3165466435 title "Properties of the After Kernel." @default.
- W3165466435 cites W2101234009 @default.
- W3165466435 cites W2142387771 @default.
- W3165466435 cites W2593634001 @default.
- W3165466435 cites W2767204723 @default.
- W3165466435 cites W2809090039 @default.
- W3165466435 cites W2886067286 @default.
- W3165466435 cites W2913190747 @default.
- W3165466435 cites W2913473169 @default.
- W3165466435 cites W2942810103 @default.
- W3165466435 cites W2952204734 @default.
- W3165466435 cites W2955590385 @default.
- W3165466435 cites W2962698540 @default.
- W3165466435 cites W2962835968 @default.
- W3165466435 cites W2962939986 @default.
- W3165466435 cites W2963239103 @default.
- W3165466435 cites W2963837241 @default.
- W3165466435 cites W2964084001 @default.
- W3165466435 cites W2964098911 @default.
- W3165466435 cites W2964161337 @default.
- W3165466435 cites W2965772785 @default.
- W3165466435 cites W2970176397 @default.
- W3165466435 cites W2970176896 @default.
- W3165466435 cites W2970332347 @default.
- W3165466435 cites W2970618525 @default.
- W3165466435 cites W2971043187 @default.
- W3165466435 cites W2971169274 @default.
- W3165466435 cites W2994747787 @default.
- W3165466435 cites W2995625976 @default.
- W3165466435 cites W2996168800 @default.
- W3165466435 cites W2996320484 @default.
- W3165466435 cites W3000127803 @default.
- W3165466435 cites W3009686669 @default.
- W3165466435 cites W3046680711 @default.
- W3165466435 cites W3046749015 @default.
- W3165466435 cites W3065974826 @default.
- W3165466435 cites W3098033339 @default.
- W3165466435 cites W3101069636 @default.
- W3165466435 cites W3101581426 @default.
- W3165466435 cites W3101787089 @default.
- W3165466435 cites W3108365919 @default.
- W3165466435 cites W3122402965 @default.
- W3165466435 cites W3127775241 @default.
- W3165466435 cites W3128012611 @default.
- W3165466435 cites W3181384422 @default.
- W3165466435 hasPublicationYear "2021" @default.
- W3165466435 type Work @default.
- W3165466435 sameAs 3165466435 @default.
- W3165466435 citedByCount "2" @default.
- W3165466435 countsByYear W31654664352021 @default.
- W3165466435 crossrefType "posted-content" @default.
- W3165466435 hasAuthorship W3165466435A5084487318 @default.
- W3165466435 hasConcept C11413529 @default.
- W3165466435 hasConcept C114466953 @default.
- W3165466435 hasConcept C118615104 @default.
- W3165466435 hasConcept C122280245 @default.
- W3165466435 hasConcept C12267149 @default.
- W3165466435 hasConcept C134517425 @default.
- W3165466435 hasConcept C140417398 @default.
- W3165466435 hasConcept C153180895 @default.
- W3165466435 hasConcept C154945302 @default.
- W3165466435 hasConcept C182335926 @default.
- W3165466435 hasConcept C190470478 @default.
- W3165466435 hasConcept C190502265 @default.
- W3165466435 hasConcept C195699287 @default.
- W3165466435 hasConcept C199360897 @default.
- W3165466435 hasConcept C33923547 @default.
- W3165466435 hasConcept C37914503 @default.
- W3165466435 hasConcept C41008148 @default.
- W3165466435 hasConcept C41608201 @default.
- W3165466435 hasConcept C50644808 @default.
- W3165466435 hasConcept C55851704 @default.
- W3165466435 hasConcept C74193536 @default.
- W3165466435 hasConcept C75866337 @default.
- W3165466435 hasConceptScore W3165466435C11413529 @default.
- W3165466435 hasConceptScore W3165466435C114466953 @default.
- W3165466435 hasConceptScore W3165466435C118615104 @default.
- W3165466435 hasConceptScore W3165466435C122280245 @default.
- W3165466435 hasConceptScore W3165466435C12267149 @default.
- W3165466435 hasConceptScore W3165466435C134517425 @default.
- W3165466435 hasConceptScore W3165466435C140417398 @default.
- W3165466435 hasConceptScore W3165466435C153180895 @default.
- W3165466435 hasConceptScore W3165466435C154945302 @default.
- W3165466435 hasConceptScore W3165466435C182335926 @default.
- W3165466435 hasConceptScore W3165466435C190470478 @default.
- W3165466435 hasConceptScore W3165466435C190502265 @default.
- W3165466435 hasConceptScore W3165466435C195699287 @default.
- W3165466435 hasConceptScore W3165466435C199360897 @default.
- W3165466435 hasConceptScore W3165466435C33923547 @default.
- W3165466435 hasConceptScore W3165466435C37914503 @default.
- W3165466435 hasConceptScore W3165466435C41008148 @default.
- W3165466435 hasConceptScore W3165466435C41608201 @default.
- W3165466435 hasConceptScore W3165466435C50644808 @default.
- W3165466435 hasConceptScore W3165466435C55851704 @default.
- W3165466435 hasConceptScore W3165466435C74193536 @default.