Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320859095> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4320859095 abstract "Supervised learning in deep neural networks is commonly performed using error backpropagation. However, the sequential propagation of errors during the backward pass limits its scalability and applicability to low-powered neuromorphic hardware. Therefore, there is growing interest in finding local alternatives to backpropagation. Recently proposed methods based on forward-mode automatic differentiation suffer from high variance in large deep neural networks, which affects convergence. In this paper, we propose the Forward Direct Feedback Alignment algorithm that combines Activity-Perturbed Forward Gradients with Direct Feedback Alignment and momentum. We provide both theoretical proofs and empirical evidence that our proposed method achieves lower variance than forward gradient techniques. In this way, our approach enables faster convergence and better performance when compared to other local alternatives to backpropagation and opens a new perspective for the development of online learning algorithms compatible with neuromorphic systems." @default.
- W4320859095 created "2023-02-16" @default.
- W4320859095 creator A5018144455 @default.
- W4320859095 creator A5072779904 @default.
- W4320859095 date "2022-12-14" @default.
- W4320859095 modified "2023-10-16" @default.
- W4320859095 title "Low-Variance Forward Gradients using Direct Feedback Alignment and Momentum" @default.
- W4320859095 doi "https://doi.org/10.48550/arxiv.2212.07282" @default.
- W4320859095 hasPublicationYear "2022" @default.
- W4320859095 type Work @default.
- W4320859095 citedByCount "0" @default.
- W4320859095 crossrefType "posted-content" @default.
- W4320859095 hasAuthorship W4320859095A5018144455 @default.
- W4320859095 hasAuthorship W4320859095A5072779904 @default.
- W4320859095 hasBestOaLocation W43208590951 @default.
- W4320859095 hasConcept C11413529 @default.
- W4320859095 hasConcept C119857082 @default.
- W4320859095 hasConcept C121955636 @default.
- W4320859095 hasConcept C12713177 @default.
- W4320859095 hasConcept C127413603 @default.
- W4320859095 hasConcept C133731056 @default.
- W4320859095 hasConcept C144133560 @default.
- W4320859095 hasConcept C151927369 @default.
- W4320859095 hasConcept C154945302 @default.
- W4320859095 hasConcept C155032097 @default.
- W4320859095 hasConcept C162324750 @default.
- W4320859095 hasConcept C196083921 @default.
- W4320859095 hasConcept C2777303404 @default.
- W4320859095 hasConcept C38858127 @default.
- W4320859095 hasConcept C41008148 @default.
- W4320859095 hasConcept C48044578 @default.
- W4320859095 hasConcept C50522688 @default.
- W4320859095 hasConcept C50644808 @default.
- W4320859095 hasConcept C77088390 @default.
- W4320859095 hasConceptScore W4320859095C11413529 @default.
- W4320859095 hasConceptScore W4320859095C119857082 @default.
- W4320859095 hasConceptScore W4320859095C121955636 @default.
- W4320859095 hasConceptScore W4320859095C12713177 @default.
- W4320859095 hasConceptScore W4320859095C127413603 @default.
- W4320859095 hasConceptScore W4320859095C133731056 @default.
- W4320859095 hasConceptScore W4320859095C144133560 @default.
- W4320859095 hasConceptScore W4320859095C151927369 @default.
- W4320859095 hasConceptScore W4320859095C154945302 @default.
- W4320859095 hasConceptScore W4320859095C155032097 @default.
- W4320859095 hasConceptScore W4320859095C162324750 @default.
- W4320859095 hasConceptScore W4320859095C196083921 @default.
- W4320859095 hasConceptScore W4320859095C2777303404 @default.
- W4320859095 hasConceptScore W4320859095C38858127 @default.
- W4320859095 hasConceptScore W4320859095C41008148 @default.
- W4320859095 hasConceptScore W4320859095C48044578 @default.
- W4320859095 hasConceptScore W4320859095C50522688 @default.
- W4320859095 hasConceptScore W4320859095C50644808 @default.
- W4320859095 hasConceptScore W4320859095C77088390 @default.
- W4320859095 hasLocation W43208590951 @default.
- W4320859095 hasOpenAccess W4320859095 @default.
- W4320859095 hasPrimaryLocation W43208590951 @default.
- W4320859095 hasRelatedWork W1604847762 @default.
- W4320859095 hasRelatedWork W1824158299 @default.
- W4320859095 hasRelatedWork W2002183807 @default.
- W4320859095 hasRelatedWork W2082482750 @default.
- W4320859095 hasRelatedWork W2086999410 @default.
- W4320859095 hasRelatedWork W2102331258 @default.
- W4320859095 hasRelatedWork W2111678839 @default.
- W4320859095 hasRelatedWork W2349436282 @default.
- W4320859095 hasRelatedWork W2388528423 @default.
- W4320859095 hasRelatedWork W2391384657 @default.
- W4320859095 isParatext "false" @default.
- W4320859095 isRetracted "false" @default.
- W4320859095 workType "article" @default.