Matches in SemOpenAlex for { <https://semopenalex.org/work/W1520121841> ?p ?o ?g. }
- W1520121841 abstract "Neuroscientists have long criticised deep learning algorithms as incompatible with current knowledge of neurobiology. We explore more biologically plausible versions of deep representation learning, focusing here mostly on unsupervised learning but developing a learning mechanism that could account for supervised, unsupervised and reinforcement learning. The starting point is that the basic learning rule believed to govern synaptic weight updates (Spike-TimingDependent Plasticity) can be interpreted as gradient descent on some objective function so long as the neuronal dynamics push firing rates towards better values of the objective function (be it supervised, unsupervised, or reward-driven). The second main idea is that this corresponds to a form of the variational EM algorithm, i.e., with approximate rather than exact posteriors, implemented by neural dynamics. Another contribution of this paper is that the gradients required for updating the hidden states in the above variational interpretation can be estimated using an approximation that only requires propagating activations forward and backward, with pairs of layers learning to form a denoising auto-encoder. Finally, we extend the theory about the probabilistic interpretation of auto-encoders to justify improved sampling schemes based on the generative interpretation of denoising auto-encoders, and we validate all these ideas on generative learning tasks." @default.
- W1520121841 created "2016-06-24" @default.
- W1520121841 creator A5024900991 @default.
- W1520121841 creator A5041213674 @default.
- W1520121841 creator A5069119629 @default.
- W1520121841 creator A5086198262 @default.
- W1520121841 date "2015-02-14" @default.
- W1520121841 modified "2023-10-01" @default.
- W1520121841 title "Towards Biologically Plausible Deep Learning" @default.
- W1520121841 cites W1547224907 @default.
- W1520121841 cites W1606458877 @default.
- W1520121841 cites W1654947107 @default.
- W1520121841 cites W1710476689 @default.
- W1520121841 cites W1813659000 @default.
- W1520121841 cites W1855112655 @default.
- W1520121841 cites W189596042 @default.
- W1520121841 cites W1931823119 @default.
- W1520121841 cites W1959608418 @default.
- W1520121841 cites W1993845689 @default.
- W1520121841 cites W2025768430 @default.
- W1520121841 cites W2037993055 @default.
- W1520121841 cites W2064971633 @default.
- W1520121841 cites W2069845225 @default.
- W1520121841 cites W2098241945 @default.
- W1520121841 cites W2098580305 @default.
- W1520121841 cites W2105728138 @default.
- W1520121841 cites W2108501770 @default.
- W1520121841 cites W2121392865 @default.
- W1520121841 cites W2126398289 @default.
- W1520121841 cites W2134664762 @default.
- W1520121841 cites W2134842679 @default.
- W1520121841 cites W2136922672 @default.
- W1520121841 cites W2147101007 @default.
- W1520121841 cites W2153564253 @default.
- W1520121841 cites W2156387975 @default.
- W1520121841 cites W2163179684 @default.
- W1520121841 cites W2167433878 @default.
- W1520121841 cites W2171490498 @default.
- W1520121841 cites W2172172255 @default.
- W1520121841 cites W2218318129 @default.
- W1520121841 cites W2567948266 @default.
- W1520121841 cites W2914470628 @default.
- W1520121841 cites W2949416428 @default.
- W1520121841 cites W2951446714 @default.
- W1520121841 cites W2952069045 @default.
- W1520121841 cites W2964300310 @default.
- W1520121841 hasPublicationYear "2015" @default.
- W1520121841 type Work @default.
- W1520121841 sameAs 1520121841 @default.
- W1520121841 citedByCount "103" @default.
- W1520121841 countsByYear W15201218412015 @default.
- W1520121841 countsByYear W15201218412016 @default.
- W1520121841 countsByYear W15201218412017 @default.
- W1520121841 countsByYear W15201218412018 @default.
- W1520121841 countsByYear W15201218412019 @default.
- W1520121841 countsByYear W15201218412020 @default.
- W1520121841 countsByYear W15201218412021 @default.
- W1520121841 crossrefType "posted-content" @default.
- W1520121841 hasAuthorship W1520121841A5024900991 @default.
- W1520121841 hasAuthorship W1520121841A5041213674 @default.
- W1520121841 hasAuthorship W1520121841A5069119629 @default.
- W1520121841 hasAuthorship W1520121841A5086198262 @default.
- W1520121841 hasConcept C119857082 @default.
- W1520121841 hasConcept C136389625 @default.
- W1520121841 hasConcept C14036430 @default.
- W1520121841 hasConcept C153258448 @default.
- W1520121841 hasConcept C154945302 @default.
- W1520121841 hasConcept C167966045 @default.
- W1520121841 hasConcept C17744445 @default.
- W1520121841 hasConcept C199360897 @default.
- W1520121841 hasConcept C199539241 @default.
- W1520121841 hasConcept C2776359362 @default.
- W1520121841 hasConcept C39890363 @default.
- W1520121841 hasConcept C41008148 @default.
- W1520121841 hasConcept C49937458 @default.
- W1520121841 hasConcept C50644808 @default.
- W1520121841 hasConcept C527412718 @default.
- W1520121841 hasConcept C78458016 @default.
- W1520121841 hasConcept C8038995 @default.
- W1520121841 hasConcept C86803240 @default.
- W1520121841 hasConcept C94625758 @default.
- W1520121841 hasConcept C97541855 @default.
- W1520121841 hasConceptScore W1520121841C119857082 @default.
- W1520121841 hasConceptScore W1520121841C136389625 @default.
- W1520121841 hasConceptScore W1520121841C14036430 @default.
- W1520121841 hasConceptScore W1520121841C153258448 @default.
- W1520121841 hasConceptScore W1520121841C154945302 @default.
- W1520121841 hasConceptScore W1520121841C167966045 @default.
- W1520121841 hasConceptScore W1520121841C17744445 @default.
- W1520121841 hasConceptScore W1520121841C199360897 @default.
- W1520121841 hasConceptScore W1520121841C199539241 @default.
- W1520121841 hasConceptScore W1520121841C2776359362 @default.
- W1520121841 hasConceptScore W1520121841C39890363 @default.
- W1520121841 hasConceptScore W1520121841C41008148 @default.
- W1520121841 hasConceptScore W1520121841C49937458 @default.
- W1520121841 hasConceptScore W1520121841C50644808 @default.
- W1520121841 hasConceptScore W1520121841C527412718 @default.
- W1520121841 hasConceptScore W1520121841C78458016 @default.
- W1520121841 hasConceptScore W1520121841C8038995 @default.
- W1520121841 hasConceptScore W1520121841C86803240 @default.