Matches in SemOpenAlex for { <https://semopenalex.org/work/W2896616461> ?p ?o ?g. }
- W2896616461 endingPage "1202" @default.
- W2896616461 startingPage "1193" @default.
- W2896616461 abstract "Despite significant recent advances in deep neural networks, training them remains a challenge due to the highly non-convex nature of the objective function. State-of-the-art methods rely on error backpropagation, which suffers from several well-known issues, such as vanishing and exploding gradients, inability to handle non-differentiable nonlinearities and to parallelize weight-updates across layers, and biological implausibility. These limitations continue to motivate exploration of alternative training algorithms, including several recently proposed auxiliary-variable methods which break the complex nested objective function into local subproblems. However, those techniques are mainly offline (batch), which limits their applicability to extremely large datasets, as well as to online, continual or reinforcement learning. The main contribution of our work is a novel online (stochastic/mini-batch) alternating minimization (AM) approach for training deep neural networks, together with the first theoretical convergence guarantees for AM in stochastic settings and promising empirical results on a variety of architectures and datasets." @default.
- W2896616461 created "2018-10-26" @default.
- W2896616461 creator A5003725957 @default.
- W2896616461 creator A5006452373 @default.
- W2896616461 creator A5037253351 @default.
- W2896616461 creator A5050054734 @default.
- W2896616461 creator A5055394860 @default.
- W2896616461 creator A5055430458 @default.
- W2896616461 creator A5057758042 @default.
- W2896616461 creator A5060857025 @default.
- W2896616461 creator A5079000501 @default.
- W2896616461 creator A5081069627 @default.
- W2896616461 creator A5087512862 @default.
- W2896616461 date "2019-05-24" @default.
- W2896616461 modified "2023-10-04" @default.
- W2896616461 title "Beyond backprop: Online alternating minimization with auxiliary variables" @default.
- W2896616461 hasPublicationYear "2019" @default.
- W2896616461 type Work @default.
- W2896616461 sameAs 2896616461 @default.
- W2896616461 citedByCount "20" @default.
- W2896616461 countsByYear W28966164612018 @default.
- W2896616461 countsByYear W28966164612019 @default.
- W2896616461 countsByYear W28966164612020 @default.
- W2896616461 countsByYear W28966164612021 @default.
- W2896616461 crossrefType "proceedings-article" @default.
- W2896616461 hasAuthorship W2896616461A5003725957 @default.
- W2896616461 hasAuthorship W2896616461A5006452373 @default.
- W2896616461 hasAuthorship W2896616461A5037253351 @default.
- W2896616461 hasAuthorship W2896616461A5050054734 @default.
- W2896616461 hasAuthorship W2896616461A5055394860 @default.
- W2896616461 hasAuthorship W2896616461A5055430458 @default.
- W2896616461 hasAuthorship W2896616461A5057758042 @default.
- W2896616461 hasAuthorship W2896616461A5060857025 @default.
- W2896616461 hasAuthorship W2896616461A5079000501 @default.
- W2896616461 hasAuthorship W2896616461A5081069627 @default.
- W2896616461 hasAuthorship W2896616461A5087512862 @default.
- W2896616461 hasConcept C108583219 @default.
- W2896616461 hasConcept C11413529 @default.
- W2896616461 hasConcept C119857082 @default.
- W2896616461 hasConcept C126255220 @default.
- W2896616461 hasConcept C134306372 @default.
- W2896616461 hasConcept C136197465 @default.
- W2896616461 hasConcept C14036430 @default.
- W2896616461 hasConcept C147764199 @default.
- W2896616461 hasConcept C154945302 @default.
- W2896616461 hasConcept C155032097 @default.
- W2896616461 hasConcept C162324750 @default.
- W2896616461 hasConcept C199360897 @default.
- W2896616461 hasConcept C202615002 @default.
- W2896616461 hasConcept C206688291 @default.
- W2896616461 hasConcept C2777303404 @default.
- W2896616461 hasConcept C2984842247 @default.
- W2896616461 hasConcept C33923547 @default.
- W2896616461 hasConcept C41008148 @default.
- W2896616461 hasConcept C50522688 @default.
- W2896616461 hasConcept C50644808 @default.
- W2896616461 hasConcept C78458016 @default.
- W2896616461 hasConcept C86803240 @default.
- W2896616461 hasConcept C97541855 @default.
- W2896616461 hasConceptScore W2896616461C108583219 @default.
- W2896616461 hasConceptScore W2896616461C11413529 @default.
- W2896616461 hasConceptScore W2896616461C119857082 @default.
- W2896616461 hasConceptScore W2896616461C126255220 @default.
- W2896616461 hasConceptScore W2896616461C134306372 @default.
- W2896616461 hasConceptScore W2896616461C136197465 @default.
- W2896616461 hasConceptScore W2896616461C14036430 @default.
- W2896616461 hasConceptScore W2896616461C147764199 @default.
- W2896616461 hasConceptScore W2896616461C154945302 @default.
- W2896616461 hasConceptScore W2896616461C155032097 @default.
- W2896616461 hasConceptScore W2896616461C162324750 @default.
- W2896616461 hasConceptScore W2896616461C199360897 @default.
- W2896616461 hasConceptScore W2896616461C202615002 @default.
- W2896616461 hasConceptScore W2896616461C206688291 @default.
- W2896616461 hasConceptScore W2896616461C2777303404 @default.
- W2896616461 hasConceptScore W2896616461C2984842247 @default.
- W2896616461 hasConceptScore W2896616461C33923547 @default.
- W2896616461 hasConceptScore W2896616461C41008148 @default.
- W2896616461 hasConceptScore W2896616461C50522688 @default.
- W2896616461 hasConceptScore W2896616461C50644808 @default.
- W2896616461 hasConceptScore W2896616461C78458016 @default.
- W2896616461 hasConceptScore W2896616461C86803240 @default.
- W2896616461 hasConceptScore W2896616461C97541855 @default.
- W2896616461 hasOpenAccess W2896616461 @default.
- W2896616461 hasRelatedWork W116854235 @default.
- W2896616461 hasRelatedWork W1520121841 @default.
- W2896616461 hasRelatedWork W1598846723 @default.
- W2896616461 hasRelatedWork W1793186821 @default.
- W2896616461 hasRelatedWork W1994616650 @default.
- W2896616461 hasRelatedWork W2009551863 @default.
- W2896616461 hasRelatedWork W2112952404 @default.
- W2896616461 hasRelatedWork W2346438296 @default.
- W2896616461 hasRelatedWork W2552737632 @default.
- W2896616461 hasRelatedWork W2911586496 @default.
- W2896616461 hasRelatedWork W2913289884 @default.
- W2896616461 hasRelatedWork W2962723887 @default.
- W2896616461 hasRelatedWork W2963140169 @default.
- W2896616461 hasRelatedWork W2963177864 @default.
- W2896616461 hasRelatedWork W2963432546 @default.