FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2946171505> ?p ?o ?g. }

• W2946171505 abstract "It remains a puzzle that why deep neural networks (DNNs), with more parameters than samples, often generalize well. An attempt of understanding this puzzle is to discover implicit biases underlying the training process of DNNs, such as the Frequency Principle (F-Principle), i.e., DNNs often fit target functions from low to high frequencies. Inspired by the F-Principle, we propose an effective model of linear F-Principle (LFP) dynamics which accurately predicts the learning results of two-layer ReLU neural networks (NNs) of large widths. This LFP dynamics is rationalized by a linearized mean field residual dynamics of NNs. Importantly, the long-time limit solution of this LFP dynamics is equivalent to the solution of a constrained optimization problem explicitly minimizing an FP-norm, in which higher frequencies of feasible solutions are more heavily penalized. Using this optimization formulation, an a priori estimate of the generalization error bound is provided, revealing that a higher FP-norm of the target function increases the generalization error. Overall, by explicitizing the implicit bias of the F-Principle as an explicit penalty for two-layer NNs, our work makes a step towards a quantitative understanding of the learning and generalization of general DNNs." @default.
• W2946171505 created "2019-05-29" @default.
• W2946171505 creator A5002236438 @default.
• W2946171505 creator A5014714161 @default.
• W2946171505 creator A5028268055 @default.
• W2946171505 creator A5039481707 @default.
• W2946171505 date "2019-05-24" @default.
• W2946171505 modified "2023-09-25" @default.
• W2946171505 title "Explicitizing an Implicit Bias of the Frequency Principle in Two-layer Neural Networks." @default.
• W2946171505 cites W1522301498 @default.
• W2946171505 cites W1811750039 @default.
• W2946171505 cites W1892947258 @default.
• W2946171505 cites W2103496339 @default.
• W2946171505 cites W2115881141 @default.
• W2946171505 cites W2139338362 @default.
• W2946171505 cites W2579923771 @default.
• W2946171505 cites W2604117713 @default.
• W2946171505 cites W2623127191 @default.
• W2946171505 cites W2682189153 @default.
• W2946171505 cites W2709553318 @default.
• W2946171505 cites W2731468224 @default.
• W2946171505 cites W2777138330 @default.
• W2946171505 cites W2800415562 @default.
• W2946171505 cites W2803921058 @default.
• W2946171505 cites W2807299122 @default.
• W2946171505 cites W2809468328 @default.
• W2946171505 cites W2810699377 @default.
• W2946171505 cites W2887630004 @default.
• W2946171505 cites W2889237180 @default.
• W2946171505 cites W2895906462 @default.
• W2946171505 cites W2901766411 @default.
• W2946171505 cites W2911742574 @default.
• W2946171505 cites W2911867426 @default.
• W2946171505 cites W2913010492 @default.
• W2946171505 cites W2914483840 @default.
• W2946171505 cites W2914811257 @default.
• W2946171505 cites W2919115771 @default.
• W2946171505 cites W2927724204 @default.
• W2946171505 cites W2935998557 @default.
• W2946171505 cites W2938647293 @default.
• W2946171505 cites W2946216287 @default.
• W2946171505 cites W2949582403 @default.
• W2946171505 cites W2950220847 @default.
• W2946171505 cites W2950928354 @default.
• W2946171505 cites W2963095610 @default.
• W2946171505 cites W2963695615 @default.
• W2946171505 cites W2963739978 @default.
• W2946171505 cites W2963959597 @default.
• W2946171505 cites W607505555 @default.
• W2946171505 hasPublicationYear "2019" @default.
• W2946171505 type Work @default.
• W2946171505 sameAs 2946171505 @default.
• W2946171505 citedByCount "14" @default.
• W2946171505 countsByYear W29461715052018 @default.
• W2946171505 countsByYear W29461715052019 @default.
• W2946171505 countsByYear W29461715052020 @default.
• W2946171505 countsByYear W29461715052021 @default.
• W2946171505 crossrefType "posted-content" @default.
• W2946171505 hasAuthorship W2946171505A5002236438 @default.
• W2946171505 hasAuthorship W2946171505A5014714161 @default.
• W2946171505 hasAuthorship W2946171505A5028268055 @default.
• W2946171505 hasAuthorship W2946171505A5039481707 @default.
• W2946171505 hasConcept C111472728 @default.
• W2946171505 hasConcept C11413529 @default.
• W2946171505 hasConcept C134306372 @default.
• W2946171505 hasConcept C138885662 @default.
• W2946171505 hasConcept C151201525 @default.
• W2946171505 hasConcept C154945302 @default.
• W2946171505 hasConcept C155512373 @default.
• W2946171505 hasConcept C177148314 @default.
• W2946171505 hasConcept C17744445 @default.
• W2946171505 hasConcept C191795146 @default.
• W2946171505 hasConcept C199539241 @default.
• W2946171505 hasConcept C28826006 @default.
• W2946171505 hasConcept C33923547 @default.
• W2946171505 hasConcept C41008148 @default.
• W2946171505 hasConcept C50644808 @default.
• W2946171505 hasConcept C75553542 @default.
• W2946171505 hasConceptScore W2946171505C111472728 @default.
• W2946171505 hasConceptScore W2946171505C11413529 @default.
• W2946171505 hasConceptScore W2946171505C134306372 @default.
• W2946171505 hasConceptScore W2946171505C138885662 @default.
• W2946171505 hasConceptScore W2946171505C151201525 @default.
• W2946171505 hasConceptScore W2946171505C154945302 @default.
• W2946171505 hasConceptScore W2946171505C155512373 @default.
• W2946171505 hasConceptScore W2946171505C177148314 @default.
• W2946171505 hasConceptScore W2946171505C17744445 @default.
• W2946171505 hasConceptScore W2946171505C191795146 @default.
• W2946171505 hasConceptScore W2946171505C199539241 @default.
• W2946171505 hasConceptScore W2946171505C28826006 @default.
• W2946171505 hasConceptScore W2946171505C33923547 @default.
• W2946171505 hasConceptScore W2946171505C41008148 @default.
• W2946171505 hasConceptScore W2946171505C50644808 @default.
• W2946171505 hasConceptScore W2946171505C75553542 @default.
• W2946171505 hasLocation W29461715051 @default.
• W2946171505 hasOpenAccess W2946171505 @default.
• W2946171505 hasPrimaryLocation W29461715051 @default.
• W2946171505 hasRelatedWork W1522301498 @default.
• W2946171505 hasRelatedWork W2809090039 @default.
• W2946171505 hasRelatedWork W2809468328 @default.

• next