Matches in SemOpenAlex for { <https://semopenalex.org/work/W2766844050> ?p ?o ?g. }
- W2766844050 abstract "The past decade has witnessed a successful application of deep learning to solving many challenging problems in machine learning and artificial intelligence. However, the loss functions of deep neural networks (especially nonlinear networks) are still far from being well understood from a theoretical aspect. In this paper, we enrich the current understanding of the landscape of the square loss functions for three types of neural networks. Specifically, when the parameter matrices are square, we provide an explicit characterization of the global minimizers for linear networks, linear residual networks, and nonlinear networks with one hidden layer. Then, we establish two quadratic types of landscape properties for the square loss of these neural networks, i.e., the gradient dominance condition within the neighborhood of their full rank global minimizers, and the regularity condition along certain directions and within the neighborhood of their global minimizers. These two landscape properties are desirable for the optimization around the global minimizers of the loss function for these neural networks." @default.
- W2766844050 created "2017-11-10" @default.
- W2766844050 creator A5042048777 @default.
- W2766844050 creator A5044769501 @default.
- W2766844050 date "2017-10-18" @default.
- W2766844050 modified "2023-10-18" @default.
- W2766844050 title "Characterization of Gradient Dominance and Regularity Conditions for Neural Networks." @default.
- W2766844050 cites W1488435683 @default.
- W2766844050 cites W1899249567 @default.
- W2766844050 cites W2022740958 @default.
- W2766844050 cites W2042264548 @default.
- W2766844050 cites W2078626246 @default.
- W2766844050 cites W2116680824 @default.
- W2766844050 cites W2157665330 @default.
- W2766844050 cites W2171902495 @default.
- W2766844050 cites W2193937378 @default.
- W2766844050 cites W2194775991 @default.
- W2766844050 cites W221278985 @default.
- W2766844050 cites W2304667012 @default.
- W2766844050 cites W2399360881 @default.
- W2766844050 cites W2399402693 @default.
- W2766844050 cites W2514742857 @default.
- W2766844050 cites W2557283755 @default.
- W2766844050 cites W2573849764 @default.
- W2766844050 cites W2589065377 @default.
- W2766844050 cites W2601424732 @default.
- W2766844050 cites W2608609325 @default.
- W2766844050 cites W2618003483 @default.
- W2766844050 cites W2736030546 @default.
- W2766844050 cites W2739160792 @default.
- W2766844050 cites W2952574409 @default.
- W2766844050 cites W2963248893 @default.
- W2766844050 cites W2963446085 @default.
- W2766844050 cites W2963449128 @default.
- W2766844050 cites W2963731874 @default.
- W2766844050 cites W3141595720 @default.
- W2766844050 hasPublicationYear "2017" @default.
- W2766844050 type Work @default.
- W2766844050 sameAs 2766844050 @default.
- W2766844050 citedByCount "20" @default.
- W2766844050 countsByYear W27668440502016 @default.
- W2766844050 countsByYear W27668440502018 @default.
- W2766844050 countsByYear W27668440502019 @default.
- W2766844050 countsByYear W27668440502020 @default.
- W2766844050 countsByYear W27668440502021 @default.
- W2766844050 crossrefType "posted-content" @default.
- W2766844050 hasAuthorship W2766844050A5042048777 @default.
- W2766844050 hasAuthorship W2766844050A5044769501 @default.
- W2766844050 hasConcept C104317684 @default.
- W2766844050 hasConcept C108583219 @default.
- W2766844050 hasConcept C11413529 @default.
- W2766844050 hasConcept C114614502 @default.
- W2766844050 hasConcept C120665830 @default.
- W2766844050 hasConcept C121332964 @default.
- W2766844050 hasConcept C126255220 @default.
- W2766844050 hasConcept C129844170 @default.
- W2766844050 hasConcept C135692309 @default.
- W2766844050 hasConcept C14036430 @default.
- W2766844050 hasConcept C151913843 @default.
- W2766844050 hasConcept C154945302 @default.
- W2766844050 hasConcept C155512373 @default.
- W2766844050 hasConcept C158622935 @default.
- W2766844050 hasConcept C164226766 @default.
- W2766844050 hasConcept C185592680 @default.
- W2766844050 hasConcept C2524010 @default.
- W2766844050 hasConcept C2780841128 @default.
- W2766844050 hasConcept C33923547 @default.
- W2766844050 hasConcept C41008148 @default.
- W2766844050 hasConcept C50644808 @default.
- W2766844050 hasConcept C55493867 @default.
- W2766844050 hasConcept C62520636 @default.
- W2766844050 hasConcept C78458016 @default.
- W2766844050 hasConcept C86803240 @default.
- W2766844050 hasConceptScore W2766844050C104317684 @default.
- W2766844050 hasConceptScore W2766844050C108583219 @default.
- W2766844050 hasConceptScore W2766844050C11413529 @default.
- W2766844050 hasConceptScore W2766844050C114614502 @default.
- W2766844050 hasConceptScore W2766844050C120665830 @default.
- W2766844050 hasConceptScore W2766844050C121332964 @default.
- W2766844050 hasConceptScore W2766844050C126255220 @default.
- W2766844050 hasConceptScore W2766844050C129844170 @default.
- W2766844050 hasConceptScore W2766844050C135692309 @default.
- W2766844050 hasConceptScore W2766844050C14036430 @default.
- W2766844050 hasConceptScore W2766844050C151913843 @default.
- W2766844050 hasConceptScore W2766844050C154945302 @default.
- W2766844050 hasConceptScore W2766844050C155512373 @default.
- W2766844050 hasConceptScore W2766844050C158622935 @default.
- W2766844050 hasConceptScore W2766844050C164226766 @default.
- W2766844050 hasConceptScore W2766844050C185592680 @default.
- W2766844050 hasConceptScore W2766844050C2524010 @default.
- W2766844050 hasConceptScore W2766844050C2780841128 @default.
- W2766844050 hasConceptScore W2766844050C33923547 @default.
- W2766844050 hasConceptScore W2766844050C41008148 @default.
- W2766844050 hasConceptScore W2766844050C50644808 @default.
- W2766844050 hasConceptScore W2766844050C55493867 @default.
- W2766844050 hasConceptScore W2766844050C62520636 @default.
- W2766844050 hasConceptScore W2766844050C78458016 @default.
- W2766844050 hasConceptScore W2766844050C86803240 @default.
- W2766844050 hasLocation W27668440501 @default.
- W2766844050 hasOpenAccess W2766844050 @default.