Matches in SemOpenAlex for { <https://semopenalex.org/work/W4283743695> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4283743695 abstract "Kernel ridge regression (KRR) has recently attracted renewed interest due to its potential for explaining the transient effects, such as double descent, that emerge during neural network training. In this work, we study how the alignment between the target function and the kernel affects the performance of the KRR. We focus on the truncated KRR (TKRR) which utilizes an additional parameter that controls the spectral truncation of the kernel matrix. We show that for polynomial alignment, there is an emph{over-aligned} regime, in which TKRR can achieve a faster rate than what is achievable by full KRR. The rate of TKRR can improve all the way to the parametric rate, while that of full KRR is capped at a sub-optimal value. This shows that target alignemnt can be better leveraged by utilizing spectral truncation in kernel methods. We also consider the bandlimited alignment setting and show that the regularization surface of TKRR can exhibit transient effects including multiple descent and non-monotonic behavior. Our results show that there is a strong and quantifable relation between the shape of the emph{alignment spectrum} and the generalization performance of kernel methods, both in terms of rates and in finite samples." @default.
- W4283743695 created "2022-07-02" @default.
- W4283743695 creator A5018725689 @default.
- W4283743695 creator A5020881664 @default.
- W4283743695 creator A5022421173 @default.
- W4283743695 date "2022-06-28" @default.
- W4283743695 modified "2023-09-27" @default.
- W4283743695 title "Target alignment in truncated kernel ridge regression" @default.
- W4283743695 doi "https://doi.org/10.48550/arxiv.2206.14255" @default.
- W4283743695 hasPublicationYear "2022" @default.
- W4283743695 type Work @default.
- W4283743695 citedByCount "0" @default.
- W4283743695 crossrefType "posted-content" @default.
- W4283743695 hasAuthorship W4283743695A5018725689 @default.
- W4283743695 hasAuthorship W4283743695A5020881664 @default.
- W4283743695 hasAuthorship W4283743695A5022421173 @default.
- W4283743695 hasBestOaLocation W42837436951 @default.
- W4283743695 hasConcept C105795698 @default.
- W4283743695 hasConcept C106195933 @default.
- W4283743695 hasConcept C11413529 @default.
- W4283743695 hasConcept C117251300 @default.
- W4283743695 hasConcept C118615104 @default.
- W4283743695 hasConcept C122280245 @default.
- W4283743695 hasConcept C12267149 @default.
- W4283743695 hasConcept C134306372 @default.
- W4283743695 hasConcept C153258448 @default.
- W4283743695 hasConcept C154945302 @default.
- W4283743695 hasConcept C200695384 @default.
- W4283743695 hasConcept C2776135515 @default.
- W4283743695 hasConcept C28826006 @default.
- W4283743695 hasConcept C33923547 @default.
- W4283743695 hasConcept C41008148 @default.
- W4283743695 hasConcept C50644808 @default.
- W4283743695 hasConcept C72169020 @default.
- W4283743695 hasConcept C74193536 @default.
- W4283743695 hasConcept C83546350 @default.
- W4283743695 hasConceptScore W4283743695C105795698 @default.
- W4283743695 hasConceptScore W4283743695C106195933 @default.
- W4283743695 hasConceptScore W4283743695C11413529 @default.
- W4283743695 hasConceptScore W4283743695C117251300 @default.
- W4283743695 hasConceptScore W4283743695C118615104 @default.
- W4283743695 hasConceptScore W4283743695C122280245 @default.
- W4283743695 hasConceptScore W4283743695C12267149 @default.
- W4283743695 hasConceptScore W4283743695C134306372 @default.
- W4283743695 hasConceptScore W4283743695C153258448 @default.
- W4283743695 hasConceptScore W4283743695C154945302 @default.
- W4283743695 hasConceptScore W4283743695C200695384 @default.
- W4283743695 hasConceptScore W4283743695C2776135515 @default.
- W4283743695 hasConceptScore W4283743695C28826006 @default.
- W4283743695 hasConceptScore W4283743695C33923547 @default.
- W4283743695 hasConceptScore W4283743695C41008148 @default.
- W4283743695 hasConceptScore W4283743695C50644808 @default.
- W4283743695 hasConceptScore W4283743695C72169020 @default.
- W4283743695 hasConceptScore W4283743695C74193536 @default.
- W4283743695 hasConceptScore W4283743695C83546350 @default.
- W4283743695 hasLocation W42837436951 @default.
- W4283743695 hasOpenAccess W4283743695 @default.
- W4283743695 hasPrimaryLocation W42837436951 @default.
- W4283743695 hasRelatedWork W184886946 @default.
- W4283743695 hasRelatedWork W2060290203 @default.
- W4283743695 hasRelatedWork W2112851454 @default.
- W4283743695 hasRelatedWork W2158168589 @default.
- W4283743695 hasRelatedWork W2159436900 @default.
- W4283743695 hasRelatedWork W2245628116 @default.
- W4283743695 hasRelatedWork W2393859811 @default.
- W4283743695 hasRelatedWork W2944714786 @default.
- W4283743695 hasRelatedWork W3049153348 @default.
- W4283743695 hasRelatedWork W4283743695 @default.
- W4283743695 isParatext "false" @default.
- W4283743695 isRetracted "false" @default.
- W4283743695 workType "article" @default.