Matches in SemOpenAlex for { <https://semopenalex.org/work/W3127701625> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W3127701625 abstract "Most non-linear neural networks are known to have poor local minima (Yun et al. (2019)) and it is shown that training a neural network is NP-hard (Blum & Rivest (1988)). A line of work has studied the global optimality of neural networks in various settings but unfortunately all previous networks without spurious local minima are linear networks or networks with unrealistic assumptions. In this work we demonstrate for the first time that a non-linear neural network can have no poor local minima under no assumptions. Recently, a number of papers considered complex-valued neural networks (CVNNs) in various settings and suggest that CVNNs have competitive or even preferable behaviour compared to real-valued networks. Unfortunately, there is currently no theoretical analysis on the optimization of complex-valued networks, given that complex functions usually have a disparate optimization landscape. This is the first work towards analysing the optimization landscape of CVNNs. We prove a surprising result that no spurious local minima exist for one hidden layer complex-valued neural networks with quadratic activation. Since CVNNs can have real-valued datasets and there are no assumptions, our results are applicable to practical networks. Along the way, we develop a novel set of tools and techniques for analyzing the optimization of CVNNs, which may be useful in other contexts. Lastly, we prove spurious local minima exist for CVNNs with non-analytic CReLU activation." @default.
- W3127701625 created "2021-02-15" @default.
- W3127701625 creator A5064113562 @default.
- W3127701625 date "2021-05-04" @default.
- W3127701625 modified "2023-09-27" @default.
- W3127701625 title "Complex neural networks have no spurious local minima" @default.
- W3127701625 hasPublicationYear "2021" @default.
- W3127701625 type Work @default.
- W3127701625 sameAs 3127701625 @default.
- W3127701625 citedByCount "0" @default.
- W3127701625 crossrefType "journal-article" @default.
- W3127701625 hasAuthorship W3127701625A5064113562 @default.
- W3127701625 hasConcept C119857082 @default.
- W3127701625 hasConcept C126255220 @default.
- W3127701625 hasConcept C129844170 @default.
- W3127701625 hasConcept C134306372 @default.
- W3127701625 hasConcept C147168706 @default.
- W3127701625 hasConcept C154945302 @default.
- W3127701625 hasConcept C177264268 @default.
- W3127701625 hasConcept C186633575 @default.
- W3127701625 hasConcept C199360897 @default.
- W3127701625 hasConcept C2524010 @default.
- W3127701625 hasConcept C33923547 @default.
- W3127701625 hasConcept C41008148 @default.
- W3127701625 hasConcept C50644808 @default.
- W3127701625 hasConcept C86582703 @default.
- W3127701625 hasConcept C97256817 @default.
- W3127701625 hasConceptScore W3127701625C119857082 @default.
- W3127701625 hasConceptScore W3127701625C126255220 @default.
- W3127701625 hasConceptScore W3127701625C129844170 @default.
- W3127701625 hasConceptScore W3127701625C134306372 @default.
- W3127701625 hasConceptScore W3127701625C147168706 @default.
- W3127701625 hasConceptScore W3127701625C154945302 @default.
- W3127701625 hasConceptScore W3127701625C177264268 @default.
- W3127701625 hasConceptScore W3127701625C186633575 @default.
- W3127701625 hasConceptScore W3127701625C199360897 @default.
- W3127701625 hasConceptScore W3127701625C2524010 @default.
- W3127701625 hasConceptScore W3127701625C33923547 @default.
- W3127701625 hasConceptScore W3127701625C41008148 @default.
- W3127701625 hasConceptScore W3127701625C50644808 @default.
- W3127701625 hasConceptScore W3127701625C86582703 @default.
- W3127701625 hasConceptScore W3127701625C97256817 @default.
- W3127701625 hasLocation W31277016251 @default.
- W3127701625 hasOpenAccess W3127701625 @default.
- W3127701625 hasPrimaryLocation W31277016251 @default.
- W3127701625 hasRelatedWork W2335571733 @default.
- W3127701625 hasRelatedWork W2614119628 @default.
- W3127701625 hasRelatedWork W2766844050 @default.
- W3127701625 hasRelatedWork W2787442904 @default.
- W3127701625 hasRelatedWork W2788991260 @default.
- W3127701625 hasRelatedWork W2796744096 @default.
- W3127701625 hasRelatedWork W2798826368 @default.
- W3127701625 hasRelatedWork W2895966359 @default.
- W3127701625 hasRelatedWork W2954072389 @default.
- W3127701625 hasRelatedWork W2963095610 @default.
- W3127701625 hasRelatedWork W2977882304 @default.
- W3127701625 hasRelatedWork W2985558461 @default.
- W3127701625 hasRelatedWork W2991290085 @default.
- W3127701625 hasRelatedWork W3035267860 @default.
- W3127701625 hasRelatedWork W3037189286 @default.
- W3127701625 hasRelatedWork W3164547988 @default.
- W3127701625 hasRelatedWork W3199400829 @default.
- W3127701625 hasRelatedWork W3207766955 @default.
- W3127701625 hasRelatedWork W3208268610 @default.
- W3127701625 hasRelatedWork W2187753657 @default.
- W3127701625 isParatext "false" @default.
- W3127701625 isRetracted "false" @default.
- W3127701625 magId "3127701625" @default.
- W3127701625 workType "article" @default.