Matches in SemOpenAlex for { <https://semopenalex.org/work/W4366605514> ?p ?o ?g. }
Showing items 1 to 93 of
93
with 100 items per page.
- W4366605514 endingPage "1460" @default.
- W4366605514 startingPage "1437" @default.
- W4366605514 abstract "Abstract In deep learning, it is common to overparameterize neural networks, that is, to use more parameters than training samples. Quite surprisingly training the neural network via (stochastic) gradient descent leads to models that generalize very well, while classical statistics would suggest overfitting. In order to gain understanding of this implicit bias phenomenon, we study the special case of sparse recovery (compressed sensing) which is of interest on its own. More precisely, in order to reconstruct a vector from underdetermined linear measurements, we introduce a corresponding overparameterized square loss functional, where the vector to be reconstructed is deeply factorized into several vectors. We show that, if there exists an exact solution, vanilla gradient flow for the overparameterized loss functional converges to a good approximation of the solution of minimal $ell _1$-norm. The latter is well-known to promote sparse solutions. As a by-product, our results significantly improve the sample complexity for compressed sensing via gradient flow/descent on overparameterized models derived in previous works. The theory accurately predicts the recovery rate in numerical experiments. Our proof relies on analyzing a certain Bregman divergence of the flow. This bypasses the obstacles caused by non-convexity and should be of independent interest." @default.
- W4366605514 created "2023-04-23" @default.
- W4366605514 creator A5005201576 @default.
- W4366605514 creator A5054532502 @default.
- W4366605514 creator A5063241706 @default.
- W4366605514 date "2023-04-21" @default.
- W4366605514 modified "2023-09-30" @default.
- W4366605514 title "More is less: inducing sparsity via overparameterization" @default.
- W4366605514 cites W143004564 @default.
- W4366605514 cites W2033468335 @default.
- W4366605514 cites W2145096794 @default.
- W4366605514 cites W2164452299 @default.
- W4366605514 cites W2546982352 @default.
- W4366605514 cites W2963306714 @default.
- W4366605514 cites W3128734291 @default.
- W4366605514 cites W4250955649 @default.
- W4366605514 doi "https://doi.org/10.1093/imaiai/iaad012" @default.
- W4366605514 hasPublicationYear "2023" @default.
- W4366605514 type Work @default.
- W4366605514 citedByCount "0" @default.
- W4366605514 crossrefType "journal-article" @default.
- W4366605514 hasAuthorship W4366605514A5005201576 @default.
- W4366605514 hasAuthorship W4366605514A5054532502 @default.
- W4366605514 hasAuthorship W4366605514A5063241706 @default.
- W4366605514 hasBestOaLocation W43666055142 @default.
- W4366605514 hasConcept C106159729 @default.
- W4366605514 hasConcept C11413529 @default.
- W4366605514 hasConcept C117160843 @default.
- W4366605514 hasConcept C124851039 @default.
- W4366605514 hasConcept C126255220 @default.
- W4366605514 hasConcept C134306372 @default.
- W4366605514 hasConcept C138885662 @default.
- W4366605514 hasConcept C153258448 @default.
- W4366605514 hasConcept C154945302 @default.
- W4366605514 hasConcept C162324750 @default.
- W4366605514 hasConcept C167879884 @default.
- W4366605514 hasConcept C179690561 @default.
- W4366605514 hasConcept C206688291 @default.
- W4366605514 hasConcept C207390915 @default.
- W4366605514 hasConcept C22019652 @default.
- W4366605514 hasConcept C2524010 @default.
- W4366605514 hasConcept C28826006 @default.
- W4366605514 hasConcept C33923547 @default.
- W4366605514 hasConcept C38349280 @default.
- W4366605514 hasConcept C41008148 @default.
- W4366605514 hasConcept C41895202 @default.
- W4366605514 hasConcept C50644808 @default.
- W4366605514 hasConcept C72134830 @default.
- W4366605514 hasConceptScore W4366605514C106159729 @default.
- W4366605514 hasConceptScore W4366605514C11413529 @default.
- W4366605514 hasConceptScore W4366605514C117160843 @default.
- W4366605514 hasConceptScore W4366605514C124851039 @default.
- W4366605514 hasConceptScore W4366605514C126255220 @default.
- W4366605514 hasConceptScore W4366605514C134306372 @default.
- W4366605514 hasConceptScore W4366605514C138885662 @default.
- W4366605514 hasConceptScore W4366605514C153258448 @default.
- W4366605514 hasConceptScore W4366605514C154945302 @default.
- W4366605514 hasConceptScore W4366605514C162324750 @default.
- W4366605514 hasConceptScore W4366605514C167879884 @default.
- W4366605514 hasConceptScore W4366605514C179690561 @default.
- W4366605514 hasConceptScore W4366605514C206688291 @default.
- W4366605514 hasConceptScore W4366605514C207390915 @default.
- W4366605514 hasConceptScore W4366605514C22019652 @default.
- W4366605514 hasConceptScore W4366605514C2524010 @default.
- W4366605514 hasConceptScore W4366605514C28826006 @default.
- W4366605514 hasConceptScore W4366605514C33923547 @default.
- W4366605514 hasConceptScore W4366605514C38349280 @default.
- W4366605514 hasConceptScore W4366605514C41008148 @default.
- W4366605514 hasConceptScore W4366605514C41895202 @default.
- W4366605514 hasConceptScore W4366605514C50644808 @default.
- W4366605514 hasConceptScore W4366605514C72134830 @default.
- W4366605514 hasFunder F4320328470 @default.
- W4366605514 hasIssue "3" @default.
- W4366605514 hasLocation W43666055141 @default.
- W4366605514 hasLocation W43666055142 @default.
- W4366605514 hasOpenAccess W4366605514 @default.
- W4366605514 hasPrimaryLocation W43666055141 @default.
- W4366605514 hasRelatedWork W2082153276 @default.
- W4366605514 hasRelatedWork W2989932438 @default.
- W4366605514 hasRelatedWork W2995185977 @default.
- W4366605514 hasRelatedWork W3006799728 @default.
- W4366605514 hasRelatedWork W3038581899 @default.
- W4366605514 hasRelatedWork W3155726402 @default.
- W4366605514 hasRelatedWork W4224998919 @default.
- W4366605514 hasRelatedWork W4226517573 @default.
- W4366605514 hasRelatedWork W4287748599 @default.
- W4366605514 hasRelatedWork W4366605514 @default.
- W4366605514 hasVolume "12" @default.
- W4366605514 isParatext "false" @default.
- W4366605514 isRetracted "false" @default.
- W4366605514 workType "article" @default.