Matches in SemOpenAlex for { <https://semopenalex.org/work/W3036333857> ?p ?o ?g. }
- W3036333857 abstract "The study of deep neural networks (DNNs) in the infinite-width limit, via the so-called neural tangent kernel (NTK) approach, has provided new insights into the dynamics of learning, generalization, and the impact of initialization. One key DNN architecture remains to be kernelized, namely, the recurrent neural network (RNN). In this paper we introduce and study the Recurrent Neural Tangent Kernel (RNTK), which provides new insights into the behavior of overparametrized RNNs. A key property of the RNTK should greatly benefit practitioners is its ability to compare inputs of different length. To this end, we characterize how the RNTK weights different time steps to form its output under different initialization parameters and nonlinearity choices. A synthetic and 56 real-world data experiments demonstrate that the RNTK offers significant performance gains over other kernels, including standard NTKs, across a wide array of data sets." @default.
- W3036333857 created "2020-06-25" @default.
- W3036333857 creator A5016499384 @default.
- W3036333857 creator A5018162534 @default.
- W3036333857 creator A5047293370 @default.
- W3036333857 creator A5072713767 @default.
- W3036333857 date "2020-06-18" @default.
- W3036333857 modified "2023-09-27" @default.
- W3036333857 title "The Recurrent Neural Tangent Kernel" @default.
- W3036333857 cites W1567512734 @default.
- W3036333857 cites W1589901016 @default.
- W3036333857 cites W1800356822 @default.
- W3036333857 cites W2064675550 @default.
- W3036333857 cites W2107878631 @default.
- W3036333857 cites W2110485445 @default.
- W3036333857 cites W2153635508 @default.
- W3036333857 cites W2157331557 @default.
- W3036333857 cites W2167608136 @default.
- W3036333857 cites W2278108219 @default.
- W3036333857 cites W2581719241 @default.
- W3036333857 cites W2809090039 @default.
- W3036333857 cites W2900959181 @default.
- W3036333857 cites W2906432502 @default.
- W3036333857 cites W2910655610 @default.
- W3036333857 cites W2910905005 @default.
- W3036333857 cites W2911867426 @default.
- W3036333857 cites W2912260645 @default.
- W3036333857 cites W2913473169 @default.
- W3036333857 cites W2962698540 @default.
- W3036333857 cites W2963042606 @default.
- W3036333857 cites W2963323437 @default.
- W3036333857 cites W2963518130 @default.
- W3036333857 cites W2963886912 @default.
- W3036333857 cites W2964052793 @default.
- W3036333857 cites W2964313743 @default.
- W3036333857 cites W2970330753 @default.
- W3036333857 cites W2970474218 @default.
- W3036333857 cites W2971043187 @default.
- W3036333857 cites W2981549002 @default.
- W3036333857 cites W2988244882 @default.
- W3036333857 cites W2991290085 @default.
- W3036333857 cites W2994872659 @default.
- W3036333857 cites W2995097486 @default.
- W3036333857 cites W3005679856 @default.
- W3036333857 cites W3038074040 @default.
- W3036333857 cites W3088274487 @default.
- W3036333857 cites W3101069636 @default.
- W3036333857 hasPublicationYear "2020" @default.
- W3036333857 type Work @default.
- W3036333857 sameAs 3036333857 @default.
- W3036333857 citedByCount "6" @default.
- W3036333857 countsByYear W30363338572020 @default.
- W3036333857 countsByYear W30363338572021 @default.
- W3036333857 crossrefType "posted-content" @default.
- W3036333857 hasAuthorship W3036333857A5016499384 @default.
- W3036333857 hasAuthorship W3036333857A5018162534 @default.
- W3036333857 hasAuthorship W3036333857A5047293370 @default.
- W3036333857 hasAuthorship W3036333857A5072713767 @default.
- W3036333857 hasConcept C11413529 @default.
- W3036333857 hasConcept C114466953 @default.
- W3036333857 hasConcept C118615104 @default.
- W3036333857 hasConcept C119857082 @default.
- W3036333857 hasConcept C121332964 @default.
- W3036333857 hasConcept C122280245 @default.
- W3036333857 hasConcept C12267149 @default.
- W3036333857 hasConcept C134306372 @default.
- W3036333857 hasConcept C138187205 @default.
- W3036333857 hasConcept C147168706 @default.
- W3036333857 hasConcept C151201525 @default.
- W3036333857 hasConcept C153180895 @default.
- W3036333857 hasConcept C154945302 @default.
- W3036333857 hasConcept C158622935 @default.
- W3036333857 hasConcept C177148314 @default.
- W3036333857 hasConcept C199360897 @default.
- W3036333857 hasConcept C2524010 @default.
- W3036333857 hasConcept C26517878 @default.
- W3036333857 hasConcept C33923547 @default.
- W3036333857 hasConcept C38652104 @default.
- W3036333857 hasConcept C41008148 @default.
- W3036333857 hasConcept C50644808 @default.
- W3036333857 hasConcept C62520636 @default.
- W3036333857 hasConcept C74193536 @default.
- W3036333857 hasConceptScore W3036333857C11413529 @default.
- W3036333857 hasConceptScore W3036333857C114466953 @default.
- W3036333857 hasConceptScore W3036333857C118615104 @default.
- W3036333857 hasConceptScore W3036333857C119857082 @default.
- W3036333857 hasConceptScore W3036333857C121332964 @default.
- W3036333857 hasConceptScore W3036333857C122280245 @default.
- W3036333857 hasConceptScore W3036333857C12267149 @default.
- W3036333857 hasConceptScore W3036333857C134306372 @default.
- W3036333857 hasConceptScore W3036333857C138187205 @default.
- W3036333857 hasConceptScore W3036333857C147168706 @default.
- W3036333857 hasConceptScore W3036333857C151201525 @default.
- W3036333857 hasConceptScore W3036333857C153180895 @default.
- W3036333857 hasConceptScore W3036333857C154945302 @default.
- W3036333857 hasConceptScore W3036333857C158622935 @default.
- W3036333857 hasConceptScore W3036333857C177148314 @default.
- W3036333857 hasConceptScore W3036333857C199360897 @default.
- W3036333857 hasConceptScore W3036333857C2524010 @default.
- W3036333857 hasConceptScore W3036333857C26517878 @default.