Matches in SemOpenAlex for { <https://semopenalex.org/work/W2898077722> ?p ?o ?g. }
- W2898077722 abstract "Significant advances have been made recently on training neural networks, where the main challenge is in solving an optimization problem with abundant critical points. However, existing approaches to address this issue crucially rely on a restrictive assumption: the training data is drawn from a Gaussian distribution. In this paper, we provide a novel unified framework to design loss functions with desirable landscape properties for a wide range of general input distributions. On these loss functions, remarkably, stochastic gradient descent theoretically recovers the true parameters with global initializations and empirically outperforms the existing approaches. Our loss function design bridges the notion of score functions with the topic of neural network optimization. Central to our approach is the task of estimating the score function from samples, which is of basic and independent interest to theoretical statistics. Traditional estimation methods (example: kernel based) fail right at the outset; we bring statistical methods of local likelihood to design a novel estimator of score functions, that provably adapts to the local geometry of the unknown density." @default.
- W2898077722 created "2018-10-26" @default.
- W2898077722 creator A5028243041 @default.
- W2898077722 creator A5050142356 @default.
- W2898077722 creator A5053980484 @default.
- W2898077722 creator A5079380666 @default.
- W2898077722 date "2018-10-09" @default.
- W2898077722 modified "2023-09-22" @default.
- W2898077722 title "Learning One-hidden-layer Neural Networks under General Input Distributions" @default.
- W2898077722 cites W1873595945 @default.
- W2898077722 cites W2004945083 @default.
- W2898077722 cites W2143915663 @default.
- W2898077722 cites W2798418464 @default.
- W2898077722 cites W2949798199 @default.
- W2898077722 cites W2952318479 @default.
- W2898077722 doi "https://doi.org/10.48550/arxiv.1810.04133" @default.
- W2898077722 hasPublicationYear "2018" @default.
- W2898077722 type Work @default.
- W2898077722 sameAs 2898077722 @default.
- W2898077722 citedByCount "10" @default.
- W2898077722 countsByYear W28980777222018 @default.
- W2898077722 countsByYear W28980777222019 @default.
- W2898077722 countsByYear W28980777222020 @default.
- W2898077722 countsByYear W28980777222021 @default.
- W2898077722 crossrefType "posted-content" @default.
- W2898077722 hasAuthorship W2898077722A5028243041 @default.
- W2898077722 hasAuthorship W2898077722A5050142356 @default.
- W2898077722 hasAuthorship W2898077722A5053980484 @default.
- W2898077722 hasAuthorship W2898077722A5079380666 @default.
- W2898077722 hasBestOaLocation W28980777221 @default.
- W2898077722 hasConcept C105795698 @default.
- W2898077722 hasConcept C114614502 @default.
- W2898077722 hasConcept C119857082 @default.
- W2898077722 hasConcept C121332964 @default.
- W2898077722 hasConcept C126255220 @default.
- W2898077722 hasConcept C14036430 @default.
- W2898077722 hasConcept C153258448 @default.
- W2898077722 hasConcept C154945302 @default.
- W2898077722 hasConcept C159985019 @default.
- W2898077722 hasConcept C162324750 @default.
- W2898077722 hasConcept C163716315 @default.
- W2898077722 hasConcept C185429906 @default.
- W2898077722 hasConcept C187736073 @default.
- W2898077722 hasConcept C192562407 @default.
- W2898077722 hasConcept C204323151 @default.
- W2898077722 hasConcept C206688291 @default.
- W2898077722 hasConcept C2780451532 @default.
- W2898077722 hasConcept C33923547 @default.
- W2898077722 hasConcept C41008148 @default.
- W2898077722 hasConcept C50644808 @default.
- W2898077722 hasConcept C62520636 @default.
- W2898077722 hasConcept C65660741 @default.
- W2898077722 hasConcept C71134354 @default.
- W2898077722 hasConcept C74193536 @default.
- W2898077722 hasConcept C78458016 @default.
- W2898077722 hasConcept C86803240 @default.
- W2898077722 hasConceptScore W2898077722C105795698 @default.
- W2898077722 hasConceptScore W2898077722C114614502 @default.
- W2898077722 hasConceptScore W2898077722C119857082 @default.
- W2898077722 hasConceptScore W2898077722C121332964 @default.
- W2898077722 hasConceptScore W2898077722C126255220 @default.
- W2898077722 hasConceptScore W2898077722C14036430 @default.
- W2898077722 hasConceptScore W2898077722C153258448 @default.
- W2898077722 hasConceptScore W2898077722C154945302 @default.
- W2898077722 hasConceptScore W2898077722C159985019 @default.
- W2898077722 hasConceptScore W2898077722C162324750 @default.
- W2898077722 hasConceptScore W2898077722C163716315 @default.
- W2898077722 hasConceptScore W2898077722C185429906 @default.
- W2898077722 hasConceptScore W2898077722C187736073 @default.
- W2898077722 hasConceptScore W2898077722C192562407 @default.
- W2898077722 hasConceptScore W2898077722C204323151 @default.
- W2898077722 hasConceptScore W2898077722C206688291 @default.
- W2898077722 hasConceptScore W2898077722C2780451532 @default.
- W2898077722 hasConceptScore W2898077722C33923547 @default.
- W2898077722 hasConceptScore W2898077722C41008148 @default.
- W2898077722 hasConceptScore W2898077722C50644808 @default.
- W2898077722 hasConceptScore W2898077722C62520636 @default.
- W2898077722 hasConceptScore W2898077722C65660741 @default.
- W2898077722 hasConceptScore W2898077722C71134354 @default.
- W2898077722 hasConceptScore W2898077722C74193536 @default.
- W2898077722 hasConceptScore W2898077722C78458016 @default.
- W2898077722 hasConceptScore W2898077722C86803240 @default.
- W2898077722 hasLocation W28980777221 @default.
- W2898077722 hasOpenAccess W2898077722 @default.
- W2898077722 hasPrimaryLocation W28980777221 @default.
- W2898077722 hasRelatedWork W2549189808 @default.
- W2898077722 hasRelatedWork W2593380010 @default.
- W2898077722 hasRelatedWork W2618003483 @default.
- W2898077722 hasRelatedWork W2763374915 @default.
- W2898077722 hasRelatedWork W2765428107 @default.
- W2898077722 hasRelatedWork W2766371994 @default.
- W2898077722 hasRelatedWork W2793333878 @default.
- W2898077722 hasRelatedWork W2892675615 @default.
- W2898077722 hasRelatedWork W2894201461 @default.
- W2898077722 hasRelatedWork W2908206262 @default.
- W2898077722 hasRelatedWork W2912330043 @default.
- W2898077722 hasRelatedWork W2962698540 @default.
- W2898077722 hasRelatedWork W2962930448 @default.
- W2898077722 hasRelatedWork W2962933129 @default.
- W2898077722 hasRelatedWork W2963417959 @default.