Matches in SemOpenAlex for { <https://semopenalex.org/work/W3173114656> ?p ?o ?g. }
- W3173114656 abstract "In real word applications, data generating process for training a machine learning model often differs from what the model encounters in the test stage. Understanding how and whether machine learning models generalize under such distributional shifts have been a theoretical challenge. Here, we study generalization in kernel regression when the training and test distributions are different using methods from statistical physics. Using the replica method, we derive an analytical formula for the out-of-distribution generalization error applicable to any kernel and real datasets. We identify an overlap matrix that quantifies the mismatch between distributions for a given kernel as a key determinant of generalization performance under distribution shift. Using our analytical expressions we elucidate various generalization phenomena including possible improvement in generalization when there is a mismatch. We develop procedures for optimizing training and test distributions for a given data budget to find best and worst case generalizations under the shift. We present applications of our theory to real and synthetic datasets and for many kernels. We compare results of our theory applied to Neural Tangent Kernel with simulations of wide networks and show agreement. We analyze linear regression in further depth." @default.
- W3173114656 created "2021-06-22" @default.
- W3173114656 creator A5023195984 @default.
- W3173114656 creator A5039282308 @default.
- W3173114656 creator A5040593057 @default.
- W3173114656 date "2021-06-04" @default.
- W3173114656 modified "2023-09-23" @default.
- W3173114656 title "Out-of-Distribution Generalization in Kernel Regression" @default.
- W3173114656 cites W121410702 @default.
- W3173114656 cites W1510073064 @default.
- W3173114656 cites W1560724230 @default.
- W3173114656 cites W164706946 @default.
- W3173114656 cites W1944672 @default.
- W3173114656 cites W1964862779 @default.
- W3173114656 cites W1971249498 @default.
- W3173114656 cites W1987060751 @default.
- W3173114656 cites W2068558570 @default.
- W3173114656 cites W2089880431 @default.
- W3173114656 cites W2090614046 @default.
- W3173114656 cites W2104094955 @default.
- W3173114656 cites W2110652811 @default.
- W3173114656 cites W2126442689 @default.
- W3173114656 cites W2146766088 @default.
- W3173114656 cites W2162651021 @default.
- W3173114656 cites W2319356411 @default.
- W3173114656 cites W2462906003 @default.
- W3173114656 cites W2809090039 @default.
- W3173114656 cites W2897355816 @default.
- W3173114656 cites W2923764619 @default.
- W3173114656 cites W2942630857 @default.
- W3173114656 cites W2945033152 @default.
- W3173114656 cites W2947561056 @default.
- W3173114656 cites W2952853356 @default.
- W3173114656 cites W2962900737 @default.
- W3173114656 cites W2963060032 @default.
- W3173114656 cites W2963518130 @default.
- W3173114656 cites W2964034630 @default.
- W3173114656 cites W2964052793 @default.
- W3173114656 cites W2973152224 @default.
- W3173114656 cites W2979509742 @default.
- W3173114656 cites W2991497298 @default.
- W3173114656 cites W2994747787 @default.
- W3173114656 cites W2996360471 @default.
- W3173114656 cites W2996603747 @default.
- W3173114656 cites W3007592798 @default.
- W3173114656 cites W3009460743 @default.
- W3173114656 cites W3033802587 @default.
- W3173114656 cites W3034704745 @default.
- W3173114656 cites W3034708079 @default.
- W3173114656 cites W3046705928 @default.
- W3173114656 cites W3046835365 @default.
- W3173114656 cites W3102632574 @default.
- W3173114656 cites W3103557498 @default.
- W3173114656 cites W3114796327 @default.
- W3173114656 cites W3119755129 @default.
- W3173114656 cites W3130674728 @default.
- W3173114656 cites W3135893734 @default.
- W3173114656 cites W3162003518 @default.
- W3173114656 cites W3171395320 @default.
- W3173114656 cites W567568486 @default.
- W3173114656 cites W3141350557 @default.
- W3173114656 hasPublicationYear "2021" @default.
- W3173114656 type Work @default.
- W3173114656 sameAs 3173114656 @default.
- W3173114656 citedByCount "0" @default.
- W3173114656 crossrefType "posted-content" @default.
- W3173114656 hasAuthorship W3173114656A5023195984 @default.
- W3173114656 hasAuthorship W3173114656A5039282308 @default.
- W3173114656 hasAuthorship W3173114656A5040593057 @default.
- W3173114656 hasConcept C105795698 @default.
- W3173114656 hasConcept C11413529 @default.
- W3173114656 hasConcept C118615104 @default.
- W3173114656 hasConcept C119857082 @default.
- W3173114656 hasConcept C122280245 @default.
- W3173114656 hasConcept C12267149 @default.
- W3173114656 hasConcept C134306372 @default.
- W3173114656 hasConcept C154945302 @default.
- W3173114656 hasConcept C177148314 @default.
- W3173114656 hasConcept C200695384 @default.
- W3173114656 hasConcept C28826006 @default.
- W3173114656 hasConcept C33923547 @default.
- W3173114656 hasConcept C41008148 @default.
- W3173114656 hasConcept C50644808 @default.
- W3173114656 hasConcept C74193536 @default.
- W3173114656 hasConcept C83546350 @default.
- W3173114656 hasConceptScore W3173114656C105795698 @default.
- W3173114656 hasConceptScore W3173114656C11413529 @default.
- W3173114656 hasConceptScore W3173114656C118615104 @default.
- W3173114656 hasConceptScore W3173114656C119857082 @default.
- W3173114656 hasConceptScore W3173114656C122280245 @default.
- W3173114656 hasConceptScore W3173114656C12267149 @default.
- W3173114656 hasConceptScore W3173114656C134306372 @default.
- W3173114656 hasConceptScore W3173114656C154945302 @default.
- W3173114656 hasConceptScore W3173114656C177148314 @default.
- W3173114656 hasConceptScore W3173114656C200695384 @default.
- W3173114656 hasConceptScore W3173114656C28826006 @default.
- W3173114656 hasConceptScore W3173114656C33923547 @default.
- W3173114656 hasConceptScore W3173114656C41008148 @default.
- W3173114656 hasConceptScore W3173114656C50644808 @default.
- W3173114656 hasConceptScore W3173114656C74193536 @default.