FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3164935232> ?p ?o ?g. }

• W3164935232 abstract "Classically, data interpolation with a parametrized model class is possible as long as the number of parameters is larger than the number of equations to be satisfied. A puzzling phenomenon in deep learning is that models are trained with many more parameters than what this classical theory would suggest. We propose a theoretical explanation for this phenomenon. We prove that for a broad class of data distributions and model classes, overparametrization is necessary if one wants to interpolate the data smoothly. Namely we show that smooth interpolation requires $d$ times more parameters than mere interpolation, where $d$ is the ambient data dimension. We prove this universal law of robustness for any smoothly parametrized function class with polynomial size weights, and any covariate distribution verifying isoperimetry. In the case of two-layers neural networks and Gaussian covariates, this law was conjectured in prior work by Bubeck, Li and Nagaraj. We also give an interpretation of our result as an improved generalization bound for model classes consisting of smooth functions." @default.
• W3164935232 created "2021-06-07" @default.
• W3164935232 creator A5012362703 @default.
• W3164935232 creator A5021842384 @default.
• W3164935232 date "2021-05-26" @default.
• W3164935232 modified "2023-09-27" @default.
• W3164935232 title "A Universal Law of Robustness via Isoperimetry" @default.
• W3164935232 cites W1573820523 @default.
• W3164935232 cites W2001141328 @default.
• W3164935232 cites W2053186076 @default.
• W3164935232 cites W2067708435 @default.
• W3164935232 cites W2099052275 @default.
• W3164935232 cites W2110005684 @default.
• W3164935232 cites W2140793251 @default.
• W3164935232 cites W2257317309 @default.
• W3164935232 cites W2618017917 @default.
• W3164935232 cites W2774564255 @default.
• W3164935232 cites W2786622092 @default.
• W3164935232 cites W2787248994 @default.
• W3164935232 cites W2907107840 @default.
• W3164935232 cites W2963042606 @default.
• W3164935232 cites W2963289726 @default.
• W3164935232 cites W2963518130 @default.
• W3164935232 cites W2963664410 @default.
• W3164935232 cites W2963693826 @default.
• W3164935232 cites W2963836885 @default.
• W3164935232 cites W2963992014 @default.
• W3164935232 cites W2964253222 @default.
• W3164935232 cites W2964294232 @default.
• W3164935232 cites W2967536008 @default.
• W3164935232 cites W2970457724 @default.
• W3164935232 cites W2971120029 @default.
• W3164935232 cites W2996568780 @default.
• W3164935232 cites W2996603747 @default.
• W3164935232 cites W3018252856 @default.
• W3164935232 cites W3035032188 @default.
• W3164935232 cites W3092171228 @default.
• W3164935232 cites W3106038371 @default.
• W3164935232 cites W3172995164 @default.
• W3164935232 cites W3173923927 @default.
• W3164935232 cites W3200847599 @default.
• W3164935232 cites W607505555 @default.
• W3164935232 cites W88155604 @default.
• W3164935232 hasPublicationYear "2021" @default.
• W3164935232 type Work @default.
• W3164935232 sameAs 3164935232 @default.
• W3164935232 citedByCount "3" @default.
• W3164935232 countsByYear W31649352322021 @default.
• W3164935232 crossrefType "posted-content" @default.
• W3164935232 hasAuthorship W3164935232A5012362703 @default.
• W3164935232 hasAuthorship W3164935232A5021842384 @default.
• W3164935232 hasConcept C104114177 @default.
• W3164935232 hasConcept C104317684 @default.
• W3164935232 hasConcept C121332964 @default.
• W3164935232 hasConcept C134306372 @default.
• W3164935232 hasConcept C137800194 @default.
• W3164935232 hasConcept C154945302 @default.
• W3164935232 hasConcept C163716315 @default.
• W3164935232 hasConcept C177148314 @default.
• W3164935232 hasConcept C185592680 @default.
• W3164935232 hasConcept C2777212361 @default.
• W3164935232 hasConcept C28826006 @default.
• W3164935232 hasConcept C33923547 @default.
• W3164935232 hasConcept C41008148 @default.
• W3164935232 hasConcept C50335755 @default.
• W3164935232 hasConcept C55493867 @default.
• W3164935232 hasConcept C62520636 @default.
• W3164935232 hasConcept C63479239 @default.
• W3164935232 hasConcept C90119067 @default.
• W3164935232 hasConceptScore W3164935232C104114177 @default.
• W3164935232 hasConceptScore W3164935232C104317684 @default.
• W3164935232 hasConceptScore W3164935232C121332964 @default.
• W3164935232 hasConceptScore W3164935232C134306372 @default.
• W3164935232 hasConceptScore W3164935232C137800194 @default.
• W3164935232 hasConceptScore W3164935232C154945302 @default.
• W3164935232 hasConceptScore W3164935232C163716315 @default.
• W3164935232 hasConceptScore W3164935232C177148314 @default.
• W3164935232 hasConceptScore W3164935232C185592680 @default.
• W3164935232 hasConceptScore W3164935232C2777212361 @default.
• W3164935232 hasConceptScore W3164935232C28826006 @default.
• W3164935232 hasConceptScore W3164935232C33923547 @default.
• W3164935232 hasConceptScore W3164935232C41008148 @default.
• W3164935232 hasConceptScore W3164935232C50335755 @default.
• W3164935232 hasConceptScore W3164935232C55493867 @default.
• W3164935232 hasConceptScore W3164935232C62520636 @default.
• W3164935232 hasConceptScore W3164935232C63479239 @default.
• W3164935232 hasConceptScore W3164935232C90119067 @default.
• W3164935232 hasLocation W31649352321 @default.
• W3164935232 hasOpenAccess W3164935232 @default.
• W3164935232 hasPrimaryLocation W31649352321 @default.
• W3164935232 hasRelatedWork W1895639643 @default.
• W3164935232 hasRelatedWork W1959142945 @default.
• W3164935232 hasRelatedWork W2172030265 @default.
• W3164935232 hasRelatedWork W2294296233 @default.
• W3164935232 hasRelatedWork W2299814524 @default.
• W3164935232 hasRelatedWork W2950298468 @default.
• W3164935232 hasRelatedWork W2964313593 @default.
• W3164935232 hasRelatedWork W2966039532 @default.
• W3164935232 hasRelatedWork W2976474300 @default.
• W3164935232 hasRelatedWork W2991285061 @default.

• next