Matches in SemOpenAlex for { <https://semopenalex.org/work/W3186352445> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W3186352445 abstract "In non-convex settings, it is established that the behavior of gradient-based algorithms is different in the vicinity of local structures of the objective function such as strict and non-strict saddle points, local and global minima and maxima. It is therefore crucial to describe the landscape of non-convex problems. That is, to describe as well as possible the set of points of each of the above categories. In this work, we study the landscape of the empirical risk associated with deep linear neural networks and the square loss. It is known that, under weak assumptions, this objective function has no spurious local minima and no local maxima. We go a step further and characterize, among all critical points, which are global minimizers, strict saddle points, and non-strict saddle points. We enumerate all the associated critical values. The characterization is simple, involves conditions on the ranks of partial matrix products, and sheds some light on global convergence or implicit regularization that have been proved or observed when optimizing a linear neural network. In passing, we also provide an explicit parameterization of the set of all global minimizers and exhibit large sets of strict and non-strict saddle points." @default.
- W3186352445 created "2021-08-02" @default.
- W3186352445 creator A5016303776 @default.
- W3186352445 creator A5047104219 @default.
- W3186352445 creator A5083749816 @default.
- W3186352445 date "2021-07-28" @default.
- W3186352445 modified "2023-10-17" @default.
- W3186352445 title "Global minimizers, strict and non-strict saddle points, and implicit regularization for deep linear neural networks" @default.
- W3186352445 cites W1582774210 @default.
- W3186352445 cites W1899249567 @default.
- W3186352445 cites W2078626246 @default.
- W3186352445 cites W2079135578 @default.
- W3186352445 cites W2088883866 @default.
- W3186352445 cites W2474090883 @default.
- W3186352445 cites W2565538933 @default.
- W3186352445 cites W2593380010 @default.
- W3186352445 cites W2601846890 @default.
- W3186352445 cites W2746420172 @default.
- W3186352445 cites W2804589149 @default.
- W3186352445 cites W2898365215 @default.
- W3186352445 cites W2899536062 @default.
- W3186352445 cites W2923764619 @default.
- W3186352445 cites W2943463079 @default.
- W3186352445 cites W2962726660 @default.
- W3186352445 cites W2962754331 @default.
- W3186352445 cites W2962781506 @default.
- W3186352445 cites W2962810483 @default.
- W3186352445 cites W2963076198 @default.
- W3186352445 cites W2963086136 @default.
- W3186352445 cites W2963095610 @default.
- W3186352445 cites W2963427613 @default.
- W3186352445 cites W2963446085 @default.
- W3186352445 cites W2963487351 @default.
- W3186352445 cites W2963504252 @default.
- W3186352445 cites W2963518130 @default.
- W3186352445 cites W2963622172 @default.
- W3186352445 cites W2963651774 @default.
- W3186352445 cites W2964072429 @default.
- W3186352445 cites W2964106499 @default.
- W3186352445 cites W2966228138 @default.
- W3186352445 cites W2970259623 @default.
- W3186352445 cites W2994927236 @default.
- W3186352445 cites W2996210821 @default.
- W3186352445 cites W2996284974 @default.
- W3186352445 cites W2996609754 @default.
- W3186352445 cites W3034634013 @default.
- W3186352445 cites W3042661192 @default.
- W3186352445 cites W3086769137 @default.
- W3186352445 cites W3098897816 @default.
- W3186352445 cites W3106042364 @default.
- W3186352445 cites W3113425034 @default.
- W3186352445 cites W3149313975 @default.
- W3186352445 hasPublicationYear "2021" @default.
- W3186352445 type Work @default.
- W3186352445 sameAs 3186352445 @default.
- W3186352445 citedByCount "0" @default.
- W3186352445 crossrefType "posted-content" @default.
- W3186352445 hasAuthorship W3186352445A5016303776 @default.
- W3186352445 hasAuthorship W3186352445A5047104219 @default.
- W3186352445 hasAuthorship W3186352445A5083749816 @default.
- W3186352445 hasBestOaLocation W31863524451 @default.
- W3186352445 hasConcept C126255220 @default.
- W3186352445 hasConcept C154945302 @default.
- W3186352445 hasConcept C2524010 @default.
- W3186352445 hasConcept C2681867 @default.
- W3186352445 hasConcept C2776135515 @default.
- W3186352445 hasConcept C28826006 @default.
- W3186352445 hasConcept C2984842247 @default.
- W3186352445 hasConcept C33923547 @default.
- W3186352445 hasConcept C41008148 @default.
- W3186352445 hasConcept C50644808 @default.
- W3186352445 hasConceptScore W3186352445C126255220 @default.
- W3186352445 hasConceptScore W3186352445C154945302 @default.
- W3186352445 hasConceptScore W3186352445C2524010 @default.
- W3186352445 hasConceptScore W3186352445C2681867 @default.
- W3186352445 hasConceptScore W3186352445C2776135515 @default.
- W3186352445 hasConceptScore W3186352445C28826006 @default.
- W3186352445 hasConceptScore W3186352445C2984842247 @default.
- W3186352445 hasConceptScore W3186352445C33923547 @default.
- W3186352445 hasConceptScore W3186352445C41008148 @default.
- W3186352445 hasConceptScore W3186352445C50644808 @default.
- W3186352445 hasLocation W31863524451 @default.
- W3186352445 hasLocation W31863524452 @default.
- W3186352445 hasLocation W31863524453 @default.
- W3186352445 hasOpenAccess W3186352445 @default.
- W3186352445 hasPrimaryLocation W31863524451 @default.
- W3186352445 hasRelatedWork W1970706285 @default.
- W3186352445 hasRelatedWork W2294590153 @default.
- W3186352445 hasRelatedWork W2381322109 @default.
- W3186352445 hasRelatedWork W2401310550 @default.
- W3186352445 hasRelatedWork W2767153625 @default.
- W3186352445 hasRelatedWork W3094031457 @default.
- W3186352445 hasRelatedWork W3131924448 @default.
- W3186352445 hasRelatedWork W3173102712 @default.
- W3186352445 hasRelatedWork W4220659530 @default.
- W3186352445 hasRelatedWork W4285050980 @default.
- W3186352445 isParatext "false" @default.
- W3186352445 isRetracted "false" @default.
- W3186352445 magId "3186352445" @default.
- W3186352445 workType "article" @default.