Matches in SemOpenAlex for { <https://semopenalex.org/work/W4384263427> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W4384263427 abstract "We carry out an information-theoretical analysis of a two-layer neural network trained from input-output pairs generated by a teacher network with matching architecture, in overparametrized regimes. Our results come in the form of bounds relating i) the mutual information between training data and network weights, or ii) the Bayes-optimal generalization error, to the same quantities but for a simpler (generalized) linear model for which explicit expressions are rigorously known. Our bounds, which are expressed in terms of the number of training samples, input dimension and number of hidden units, thus yield fundamental performance limits for any neural network (and actually any learning procedure) trained from limited data generated according to our two-layer teacher neural network model. The proof relies on rigorous tools from spin glasses and is guided by ``Gaussian equivalence principles'' lying at the core of numerous recent analyses of neural networks. With respect to the existing literature, which is either non-rigorous or restricted to the case of the learning of the readout weights only, our results are information-theoretic (i.e. are not specific to any learning algorithm) and, importantly, cover a setting where all the network parameters are trained." @default.
- W4384263427 created "2023-07-14" @default.
- W4384263427 creator A5046625465 @default.
- W4384263427 creator A5057057294 @default.
- W4384263427 creator A5091565239 @default.
- W4384263427 date "2023-07-11" @default.
- W4384263427 modified "2023-10-17" @default.
- W4384263427 title "Fundamental limits of overparametrized shallow neural networks for supervised learning" @default.
- W4384263427 doi "https://doi.org/10.48550/arxiv.2307.05635" @default.
- W4384263427 hasPublicationYear "2023" @default.
- W4384263427 type Work @default.
- W4384263427 citedByCount "0" @default.
- W4384263427 crossrefType "posted-content" @default.
- W4384263427 hasAuthorship W4384263427A5046625465 @default.
- W4384263427 hasAuthorship W4384263427A5057057294 @default.
- W4384263427 hasAuthorship W4384263427A5091565239 @default.
- W4384263427 hasBestOaLocation W43842634271 @default.
- W4384263427 hasConcept C105795698 @default.
- W4384263427 hasConcept C11413529 @default.
- W4384263427 hasConcept C117765406 @default.
- W4384263427 hasConcept C118615104 @default.
- W4384263427 hasConcept C119322782 @default.
- W4384263427 hasConcept C119857082 @default.
- W4384263427 hasConcept C121332964 @default.
- W4384263427 hasConcept C127413603 @default.
- W4384263427 hasConcept C134306372 @default.
- W4384263427 hasConcept C152139883 @default.
- W4384263427 hasConcept C153083717 @default.
- W4384263427 hasConcept C154945302 @default.
- W4384263427 hasConcept C163716315 @default.
- W4384263427 hasConcept C165064840 @default.
- W4384263427 hasConcept C175202392 @default.
- W4384263427 hasConcept C176248197 @default.
- W4384263427 hasConcept C177148314 @default.
- W4384263427 hasConcept C193415008 @default.
- W4384263427 hasConcept C202444582 @default.
- W4384263427 hasConcept C2780069185 @default.
- W4384263427 hasConcept C2780428219 @default.
- W4384263427 hasConcept C33676613 @default.
- W4384263427 hasConcept C33923547 @default.
- W4384263427 hasConcept C38652104 @default.
- W4384263427 hasConcept C41008148 @default.
- W4384263427 hasConcept C50644808 @default.
- W4384263427 hasConcept C62520636 @default.
- W4384263427 hasConcept C78519656 @default.
- W4384263427 hasConcept C86582703 @default.
- W4384263427 hasConceptScore W4384263427C105795698 @default.
- W4384263427 hasConceptScore W4384263427C11413529 @default.
- W4384263427 hasConceptScore W4384263427C117765406 @default.
- W4384263427 hasConceptScore W4384263427C118615104 @default.
- W4384263427 hasConceptScore W4384263427C119322782 @default.
- W4384263427 hasConceptScore W4384263427C119857082 @default.
- W4384263427 hasConceptScore W4384263427C121332964 @default.
- W4384263427 hasConceptScore W4384263427C127413603 @default.
- W4384263427 hasConceptScore W4384263427C134306372 @default.
- W4384263427 hasConceptScore W4384263427C152139883 @default.
- W4384263427 hasConceptScore W4384263427C153083717 @default.
- W4384263427 hasConceptScore W4384263427C154945302 @default.
- W4384263427 hasConceptScore W4384263427C163716315 @default.
- W4384263427 hasConceptScore W4384263427C165064840 @default.
- W4384263427 hasConceptScore W4384263427C175202392 @default.
- W4384263427 hasConceptScore W4384263427C176248197 @default.
- W4384263427 hasConceptScore W4384263427C177148314 @default.
- W4384263427 hasConceptScore W4384263427C193415008 @default.
- W4384263427 hasConceptScore W4384263427C202444582 @default.
- W4384263427 hasConceptScore W4384263427C2780069185 @default.
- W4384263427 hasConceptScore W4384263427C2780428219 @default.
- W4384263427 hasConceptScore W4384263427C33676613 @default.
- W4384263427 hasConceptScore W4384263427C33923547 @default.
- W4384263427 hasConceptScore W4384263427C38652104 @default.
- W4384263427 hasConceptScore W4384263427C41008148 @default.
- W4384263427 hasConceptScore W4384263427C50644808 @default.
- W4384263427 hasConceptScore W4384263427C62520636 @default.
- W4384263427 hasConceptScore W4384263427C78519656 @default.
- W4384263427 hasConceptScore W4384263427C86582703 @default.
- W4384263427 hasLocation W43842634271 @default.
- W4384263427 hasOpenAccess W4384263427 @default.
- W4384263427 hasPrimaryLocation W43842634271 @default.
- W4384263427 hasRelatedWork W1494863055 @default.
- W4384263427 hasRelatedWork W1560379207 @default.
- W4384263427 hasRelatedWork W2020771639 @default.
- W4384263427 hasRelatedWork W2089093251 @default.
- W4384263427 hasRelatedWork W2150509975 @default.
- W4384263427 hasRelatedWork W2367207292 @default.
- W4384263427 hasRelatedWork W2386387936 @default.
- W4384263427 hasRelatedWork W2461336877 @default.
- W4384263427 hasRelatedWork W2545902598 @default.
- W4384263427 hasRelatedWork W1629725936 @default.
- W4384263427 isParatext "false" @default.
- W4384263427 isRetracted "false" @default.
- W4384263427 workType "article" @default.