Matches in SemOpenAlex for { <https://semopenalex.org/work/W3199022968> ?p ?o ?g. }
- W3199022968 abstract "Spiking neural networks are a promising approach towards next-generation models of the brain in computational neuroscience. Moreover, compared to classic artificial neural networks, they could serve as an energy-efficient deployment of AI by enabling fast computation in specialized neuromorphic hardware. However, training deep spiking neural networks, especially in an unsupervised manner, is challenging and the performance of a spiking model is significantly hindered by dead or bursting neurons. Here, we apply end-to-end learning with membrane potential-based backpropagation to a spiking convolutional auto-encoder with multiple trainable layers of leaky integrate-and-fire neurons. We propose bio-inspired regularization methods to control the spike density in latent representations. In the experiments, we show that applying regularization on membrane potential and spiking output successfully avoids both dead and bursting neurons and significantly decreases the reconstruction error of the spiking auto-encoder. Training regularized networks on the MNIST dataset yields image reconstruction quality comparable to non-spiking baseline models (deterministic and variational auto-encoder) and indicates improvement upon earlier approaches. Importantly, we show that, unlike the variational auto-encoder, the spiking latent representations display structure associated with the image class." @default.
- W3199022968 created "2021-09-27" @default.
- W3199022968 creator A5004385039 @default.
- W3199022968 creator A5031674443 @default.
- W3199022968 creator A5057436325 @default.
- W3199022968 date "2021-09-22" @default.
- W3199022968 modified "2023-09-26" @default.
- W3199022968 title "Training Deep Spiking Auto-encoders without Bursting or Dying Neurons through Regularization" @default.
- W3199022968 cites W1512240840 @default.
- W3199022968 cites W1959608418 @default.
- W3199022968 cites W2042422091 @default.
- W3199022968 cites W2061021698 @default.
- W3199022968 cites W2112796928 @default.
- W3199022968 cites W2125138707 @default.
- W3199022968 cites W2190490644 @default.
- W3199022968 cites W2242818861 @default.
- W3199022968 cites W2260550436 @default.
- W3199022968 cites W2283854151 @default.
- W3199022968 cites W2357843841 @default.
- W3199022968 cites W2513853720 @default.
- W3199022968 cites W2562486519 @default.
- W3199022968 cites W2604933500 @default.
- W3199022968 cites W2620342231 @default.
- W3199022968 cites W2898323475 @default.
- W3199022968 cites W2908861709 @default.
- W3199022968 cites W2915589364 @default.
- W3199022968 cites W2922783569 @default.
- W3199022968 cites W2944546415 @default.
- W3199022968 cites W2950921734 @default.
- W3199022968 cites W2962804204 @default.
- W3199022968 cites W2962966540 @default.
- W3199022968 cites W2963504544 @default.
- W3199022968 cites W2963527334 @default.
- W3199022968 cites W2963887857 @default.
- W3199022968 cites W2964121744 @default.
- W3199022968 cites W2971074500 @default.
- W3199022968 cites W2984844508 @default.
- W3199022968 cites W3007283957 @default.
- W3199022968 cites W3035640865 @default.
- W3199022968 cites W3038041907 @default.
- W3199022968 cites W3043133474 @default.
- W3199022968 cites W3102087395 @default.
- W3199022968 cites W3122690883 @default.
- W3199022968 cites W3135669240 @default.
- W3199022968 cites W3139657805 @default.
- W3199022968 hasPublicationYear "2021" @default.
- W3199022968 type Work @default.
- W3199022968 sameAs 3199022968 @default.
- W3199022968 citedByCount "0" @default.
- W3199022968 crossrefType "posted-content" @default.
- W3199022968 hasAuthorship W3199022968A5004385039 @default.
- W3199022968 hasAuthorship W3199022968A5031674443 @default.
- W3199022968 hasAuthorship W3199022968A5057436325 @default.
- W3199022968 hasConcept C101738243 @default.
- W3199022968 hasConcept C108583219 @default.
- W3199022968 hasConcept C111919701 @default.
- W3199022968 hasConcept C11731999 @default.
- W3199022968 hasConcept C118505674 @default.
- W3199022968 hasConcept C151927369 @default.
- W3199022968 hasConcept C153180895 @default.
- W3199022968 hasConcept C154945302 @default.
- W3199022968 hasConcept C169760540 @default.
- W3199022968 hasConcept C190502265 @default.
- W3199022968 hasConcept C195221683 @default.
- W3199022968 hasConcept C2776135515 @default.
- W3199022968 hasConcept C41008148 @default.
- W3199022968 hasConcept C50644808 @default.
- W3199022968 hasConcept C86803240 @default.
- W3199022968 hasConceptScore W3199022968C101738243 @default.
- W3199022968 hasConceptScore W3199022968C108583219 @default.
- W3199022968 hasConceptScore W3199022968C111919701 @default.
- W3199022968 hasConceptScore W3199022968C11731999 @default.
- W3199022968 hasConceptScore W3199022968C118505674 @default.
- W3199022968 hasConceptScore W3199022968C151927369 @default.
- W3199022968 hasConceptScore W3199022968C153180895 @default.
- W3199022968 hasConceptScore W3199022968C154945302 @default.
- W3199022968 hasConceptScore W3199022968C169760540 @default.
- W3199022968 hasConceptScore W3199022968C190502265 @default.
- W3199022968 hasConceptScore W3199022968C195221683 @default.
- W3199022968 hasConceptScore W3199022968C2776135515 @default.
- W3199022968 hasConceptScore W3199022968C41008148 @default.
- W3199022968 hasConceptScore W3199022968C50644808 @default.
- W3199022968 hasConceptScore W3199022968C86803240 @default.
- W3199022968 hasLocation W31990229681 @default.
- W3199022968 hasOpenAccess W3199022968 @default.
- W3199022968 hasPrimaryLocation W31990229681 @default.
- W3199022968 hasRelatedWork W2004168727 @default.
- W3199022968 hasRelatedWork W2129653773 @default.
- W3199022968 hasRelatedWork W2521023735 @default.
- W3199022968 hasRelatedWork W2569813014 @default.
- W3199022968 hasRelatedWork W2626540870 @default.
- W3199022968 hasRelatedWork W2758121337 @default.
- W3199022968 hasRelatedWork W2787186454 @default.
- W3199022968 hasRelatedWork W2894081242 @default.
- W3199022968 hasRelatedWork W2908861709 @default.
- W3199022968 hasRelatedWork W2968605021 @default.
- W3199022968 hasRelatedWork W2977464668 @default.
- W3199022968 hasRelatedWork W3015205410 @default.
- W3199022968 hasRelatedWork W3046208328 @default.
- W3199022968 hasRelatedWork W3084655686 @default.