Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287167969> ?p ?o ?g. }
Showing items 1 to 75 of
75
with 100 items per page.
- W4287167969 abstract "Classically, data interpolation with a parametrized model class is possible as long as the number of parameters is larger than the number of equations to be satisfied. A puzzling phenomenon in deep learning is that models are trained with many more parameters than what this classical theory would suggest. We propose a partial theoretical explanation for this phenomenon. We prove that for a broad class of data distributions and model classes, overparametrization is necessary if one wants to interpolate the data smoothly. Namely we show that smooth interpolation requires $d$ times more parameters than mere interpolation, where $d$ is the ambient data dimension. We prove this universal law of robustness for any smoothly parametrized function class with polynomial size weights, and any covariate distribution verifying isoperimetry. In the case of two-layers neural networks and Gaussian covariates, this law was conjectured in prior work by Bubeck, Li and Nagaraj. We also give an interpretation of our result as an improved generalization bound for model classes consisting of smooth functions." @default.
- W4287167969 created "2022-07-25" @default.
- W4287167969 creator A5012362703 @default.
- W4287167969 creator A5021842384 @default.
- W4287167969 date "2021-05-26" @default.
- W4287167969 modified "2023-09-27" @default.
- W4287167969 title "A Universal Law of Robustness via Isoperimetry" @default.
- W4287167969 doi "https://doi.org/10.48550/arxiv.2105.12806" @default.
- W4287167969 hasPublicationYear "2021" @default.
- W4287167969 type Work @default.
- W4287167969 citedByCount "0" @default.
- W4287167969 crossrefType "posted-content" @default.
- W4287167969 hasAuthorship W4287167969A5012362703 @default.
- W4287167969 hasAuthorship W4287167969A5021842384 @default.
- W4287167969 hasBestOaLocation W42871679691 @default.
- W4287167969 hasConcept C104114177 @default.
- W4287167969 hasConcept C104317684 @default.
- W4287167969 hasConcept C121332964 @default.
- W4287167969 hasConcept C134306372 @default.
- W4287167969 hasConcept C137800194 @default.
- W4287167969 hasConcept C154945302 @default.
- W4287167969 hasConcept C163716315 @default.
- W4287167969 hasConcept C177148314 @default.
- W4287167969 hasConcept C185592680 @default.
- W4287167969 hasConcept C199360897 @default.
- W4287167969 hasConcept C202444582 @default.
- W4287167969 hasConcept C2777212361 @default.
- W4287167969 hasConcept C28826006 @default.
- W4287167969 hasConcept C33676613 @default.
- W4287167969 hasConcept C33923547 @default.
- W4287167969 hasConcept C41008148 @default.
- W4287167969 hasConcept C50335755 @default.
- W4287167969 hasConcept C527412718 @default.
- W4287167969 hasConcept C55493867 @default.
- W4287167969 hasConcept C62520636 @default.
- W4287167969 hasConcept C63479239 @default.
- W4287167969 hasConcept C90119067 @default.
- W4287167969 hasConceptScore W4287167969C104114177 @default.
- W4287167969 hasConceptScore W4287167969C104317684 @default.
- W4287167969 hasConceptScore W4287167969C121332964 @default.
- W4287167969 hasConceptScore W4287167969C134306372 @default.
- W4287167969 hasConceptScore W4287167969C137800194 @default.
- W4287167969 hasConceptScore W4287167969C154945302 @default.
- W4287167969 hasConceptScore W4287167969C163716315 @default.
- W4287167969 hasConceptScore W4287167969C177148314 @default.
- W4287167969 hasConceptScore W4287167969C185592680 @default.
- W4287167969 hasConceptScore W4287167969C199360897 @default.
- W4287167969 hasConceptScore W4287167969C202444582 @default.
- W4287167969 hasConceptScore W4287167969C2777212361 @default.
- W4287167969 hasConceptScore W4287167969C28826006 @default.
- W4287167969 hasConceptScore W4287167969C33676613 @default.
- W4287167969 hasConceptScore W4287167969C33923547 @default.
- W4287167969 hasConceptScore W4287167969C41008148 @default.
- W4287167969 hasConceptScore W4287167969C50335755 @default.
- W4287167969 hasConceptScore W4287167969C527412718 @default.
- W4287167969 hasConceptScore W4287167969C55493867 @default.
- W4287167969 hasConceptScore W4287167969C62520636 @default.
- W4287167969 hasConceptScore W4287167969C63479239 @default.
- W4287167969 hasConceptScore W4287167969C90119067 @default.
- W4287167969 hasLocation W42871679691 @default.
- W4287167969 hasOpenAccess W4287167969 @default.
- W4287167969 hasPrimaryLocation W42871679691 @default.
- W4287167969 hasRelatedWork W1944449767 @default.
- W4287167969 hasRelatedWork W2007390580 @default.
- W4287167969 hasRelatedWork W2007556383 @default.
- W4287167969 hasRelatedWork W2058786500 @default.
- W4287167969 hasRelatedWork W2058922891 @default.
- W4287167969 hasRelatedWork W2076063560 @default.
- W4287167969 hasRelatedWork W2078116297 @default.
- W4287167969 hasRelatedWork W2100975629 @default.
- W4287167969 hasRelatedWork W2133822759 @default.
- W4287167969 hasRelatedWork W2963602586 @default.
- W4287167969 isParatext "false" @default.
- W4287167969 isRetracted "false" @default.
- W4287167969 workType "article" @default.