Matches in SemOpenAlex for { <https://semopenalex.org/work/W2789756211> ?p ?o ?g. }
Showing items 1 to 87 of
87
with 100 items per page.
- W2789756211 abstract "We provide new theoretical insights on why over-parametrization is effective in learning neural networks. For a $k$ hidden node shallow network with quadratic activation and $n$ training data points, we show as long as $ k ge sqrt{2n}$, over-parametrization enables local search algorithms to find a emph{globally} optimal solution for general smooth and convex loss functions. Further, despite that the number of parameters may exceed the sample size, using theory of Rademacher complexity, we show with weight decay, the solution also generalizes well if the data is sampled from a regular distribution such as Gaussian. To prove when $kge sqrt{2n}$, the loss function has benign landscape properties, we adopt an idea from smoothed analysis, which may have other applications in studying loss surfaces of neural networks." @default.
- W2789756211 created "2018-03-29" @default.
- W2789756211 creator A5033061754 @default.
- W2789756211 creator A5059740024 @default.
- W2789756211 date "2018-03-03" @default.
- W2789756211 modified "2023-09-27" @default.
- W2789756211 title "On the Power of Over-parametrization in Neural Networks with Quadratic Activation" @default.
- W2789756211 hasPublicationYear "2018" @default.
- W2789756211 type Work @default.
- W2789756211 sameAs 2789756211 @default.
- W2789756211 citedByCount "0" @default.
- W2789756211 crossrefType "posted-content" @default.
- W2789756211 hasAuthorship W2789756211A5033061754 @default.
- W2789756211 hasAuthorship W2789756211A5059740024 @default.
- W2789756211 hasConcept C110121322 @default.
- W2789756211 hasConcept C112680207 @default.
- W2789756211 hasConcept C11413529 @default.
- W2789756211 hasConcept C114614502 @default.
- W2789756211 hasConcept C118615104 @default.
- W2789756211 hasConcept C121332964 @default.
- W2789756211 hasConcept C129844170 @default.
- W2789756211 hasConcept C134306372 @default.
- W2789756211 hasConcept C14036430 @default.
- W2789756211 hasConcept C154945302 @default.
- W2789756211 hasConcept C163716315 @default.
- W2789756211 hasConcept C202444582 @default.
- W2789756211 hasConcept C202887219 @default.
- W2789756211 hasConcept C2524010 @default.
- W2789756211 hasConcept C28826006 @default.
- W2789756211 hasConcept C33923547 @default.
- W2789756211 hasConcept C41008148 @default.
- W2789756211 hasConcept C50644808 @default.
- W2789756211 hasConcept C62520636 @default.
- W2789756211 hasConcept C62611344 @default.
- W2789756211 hasConcept C74902906 @default.
- W2789756211 hasConcept C78458016 @default.
- W2789756211 hasConcept C86803240 @default.
- W2789756211 hasConceptScore W2789756211C110121322 @default.
- W2789756211 hasConceptScore W2789756211C112680207 @default.
- W2789756211 hasConceptScore W2789756211C11413529 @default.
- W2789756211 hasConceptScore W2789756211C114614502 @default.
- W2789756211 hasConceptScore W2789756211C118615104 @default.
- W2789756211 hasConceptScore W2789756211C121332964 @default.
- W2789756211 hasConceptScore W2789756211C129844170 @default.
- W2789756211 hasConceptScore W2789756211C134306372 @default.
- W2789756211 hasConceptScore W2789756211C14036430 @default.
- W2789756211 hasConceptScore W2789756211C154945302 @default.
- W2789756211 hasConceptScore W2789756211C163716315 @default.
- W2789756211 hasConceptScore W2789756211C202444582 @default.
- W2789756211 hasConceptScore W2789756211C202887219 @default.
- W2789756211 hasConceptScore W2789756211C2524010 @default.
- W2789756211 hasConceptScore W2789756211C28826006 @default.
- W2789756211 hasConceptScore W2789756211C33923547 @default.
- W2789756211 hasConceptScore W2789756211C41008148 @default.
- W2789756211 hasConceptScore W2789756211C50644808 @default.
- W2789756211 hasConceptScore W2789756211C62520636 @default.
- W2789756211 hasConceptScore W2789756211C62611344 @default.
- W2789756211 hasConceptScore W2789756211C74902906 @default.
- W2789756211 hasConceptScore W2789756211C78458016 @default.
- W2789756211 hasConceptScore W2789756211C86803240 @default.
- W2789756211 hasLocation W27897562111 @default.
- W2789756211 hasOpenAccess W2789756211 @default.
- W2789756211 hasPrimaryLocation W27897562111 @default.
- W2789756211 hasRelatedWork W1988019790 @default.
- W2789756211 hasRelatedWork W2107822587 @default.
- W2789756211 hasRelatedWork W2625063094 @default.
- W2789756211 hasRelatedWork W2748447781 @default.
- W2789756211 hasRelatedWork W2750924312 @default.
- W2789756211 hasRelatedWork W2751060898 @default.
- W2789756211 hasRelatedWork W2755888403 @default.
- W2789756211 hasRelatedWork W2907047316 @default.
- W2789756211 hasRelatedWork W2910155483 @default.
- W2789756211 hasRelatedWork W2913010492 @default.
- W2789756211 hasRelatedWork W2966363981 @default.
- W2789756211 hasRelatedWork W2970332347 @default.
- W2789756211 hasRelatedWork W2970890756 @default.
- W2789756211 hasRelatedWork W3003477032 @default.
- W2789756211 hasRelatedWork W3037508544 @default.
- W2789756211 hasRelatedWork W3078407515 @default.
- W2789756211 hasRelatedWork W3088153346 @default.
- W2789756211 hasRelatedWork W3121312397 @default.
- W2789756211 hasRelatedWork W3129277020 @default.
- W2789756211 hasRelatedWork W3182153751 @default.
- W2789756211 isParatext "false" @default.
- W2789756211 isRetracted "false" @default.
- W2789756211 magId "2789756211" @default.
- W2789756211 workType "article" @default.