Matches in SemOpenAlex for { <https://semopenalex.org/work/W3088915095> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W3088915095 abstract "Dropout is a technique that silences the activity of units stochastically while training deep networks to reduce overfitting. Here we introduce Quantal Synaptic Dilution (QSD), a biologically plausible model of dropout regularisation based on the quantal properties of neuronal synapses, that incorporates heterogeneities in response magnitudes and release probabilities for vesicular quanta. QSD outperforms standard dropout in ReLU multilayer perceptrons, with enhanced sparse encoding at test time when dropout masks are replaced with identity functions, without shifts in trainable weight or bias distributions. For convolutional networks, the method also improves generalisation in computer vision tasks with and without inclusion of additional forms of regularisation. QSD also outperforms standard dropout in recurrent networks for language modelling and sentiment analysis. An advantage of QSD over many variations of dropout is that it can be implemented generally in all conventional deep networks where standard dropout is applicable." @default.
- W3088915095 created "2020-10-01" @default.
- W3088915095 creator A5015107357 @default.
- W3088915095 date "2020-09-28" @default.
- W3088915095 modified "2023-09-27" @default.
- W3088915095 title "Quantal synaptic dilution enhances sparse encoding and dropout regularisation in deep networks." @default.
- W3088915095 cites W1591801644 @default.
- W3088915095 cites W1677182931 @default.
- W3088915095 cites W1826234144 @default.
- W3088915095 cites W1836465849 @default.
- W3088915095 cites W1904365287 @default.
- W3088915095 cites W1936750108 @default.
- W3088915095 cites W1969675252 @default.
- W3088915095 cites W1991549674 @default.
- W3088915095 cites W2029212436 @default.
- W3088915095 cites W2031543773 @default.
- W3088915095 cites W2041624665 @default.
- W3088915095 cites W2047730591 @default.
- W3088915095 cites W2069536209 @default.
- W3088915095 cites W2095705004 @default.
- W3088915095 cites W2101544804 @default.
- W3088915095 cites W2112796928 @default.
- W3088915095 cites W2133671888 @default.
- W3088915095 cites W2139621297 @default.
- W3088915095 cites W2156387975 @default.
- W3088915095 cites W2163455955 @default.
- W3088915095 cites W2194775991 @default.
- W3088915095 cites W2294059674 @default.
- W3088915095 cites W2340078209 @default.
- W3088915095 cites W2401231614 @default.
- W3088915095 cites W2605055943 @default.
- W3088915095 cites W2752013927 @default.
- W3088915095 cites W2934810769 @default.
- W3088915095 cites W2942228371 @default.
- W3088915095 cites W2943008967 @default.
- W3088915095 cites W2952165242 @default.
- W3088915095 cites W2962734576 @default.
- W3088915095 cites W2963266340 @default.
- W3088915095 cites W2963883365 @default.
- W3088915095 cites W2964059111 @default.
- W3088915095 cites W2964073649 @default.
- W3088915095 cites W35527955 @default.
- W3088915095 cites W4919037 @default.
- W3088915095 cites W2992523816 @default.
- W3088915095 hasPublicationYear "2020" @default.
- W3088915095 type Work @default.
- W3088915095 sameAs 3088915095 @default.
- W3088915095 citedByCount "0" @default.
- W3088915095 crossrefType "posted-content" @default.
- W3088915095 hasAuthorship W3088915095A5015107357 @default.
- W3088915095 hasConcept C108583219 @default.
- W3088915095 hasConcept C11413529 @default.
- W3088915095 hasConcept C119857082 @default.
- W3088915095 hasConcept C125411270 @default.
- W3088915095 hasConcept C153180895 @default.
- W3088915095 hasConcept C154945302 @default.
- W3088915095 hasConcept C22019652 @default.
- W3088915095 hasConcept C2776145597 @default.
- W3088915095 hasConcept C41008148 @default.
- W3088915095 hasConcept C50644808 @default.
- W3088915095 hasConcept C60908668 @default.
- W3088915095 hasConceptScore W3088915095C108583219 @default.
- W3088915095 hasConceptScore W3088915095C11413529 @default.
- W3088915095 hasConceptScore W3088915095C119857082 @default.
- W3088915095 hasConceptScore W3088915095C125411270 @default.
- W3088915095 hasConceptScore W3088915095C153180895 @default.
- W3088915095 hasConceptScore W3088915095C154945302 @default.
- W3088915095 hasConceptScore W3088915095C22019652 @default.
- W3088915095 hasConceptScore W3088915095C2776145597 @default.
- W3088915095 hasConceptScore W3088915095C41008148 @default.
- W3088915095 hasConceptScore W3088915095C50644808 @default.
- W3088915095 hasConceptScore W3088915095C60908668 @default.
- W3088915095 hasLocation W30889150951 @default.
- W3088915095 hasOpenAccess W3088915095 @default.
- W3088915095 hasPrimaryLocation W30889150951 @default.
- W3088915095 hasRelatedWork W2030463701 @default.
- W3088915095 hasRelatedWork W2065119031 @default.
- W3088915095 hasRelatedWork W2097733365 @default.
- W3088915095 hasRelatedWork W2143859653 @default.
- W3088915095 hasRelatedWork W2485075754 @default.
- W3088915095 hasRelatedWork W2556594148 @default.
- W3088915095 hasRelatedWork W2732498630 @default.
- W3088915095 hasRelatedWork W2765930287 @default.
- W3088915095 hasRelatedWork W2883759998 @default.
- W3088915095 hasRelatedWork W2969184347 @default.
- W3088915095 hasRelatedWork W2987387366 @default.
- W3088915095 hasRelatedWork W3010293065 @default.
- W3088915095 hasRelatedWork W3035675397 @default.
- W3088915095 hasRelatedWork W3035720456 @default.
- W3088915095 hasRelatedWork W3047688913 @default.
- W3088915095 hasRelatedWork W3103066660 @default.
- W3088915095 hasRelatedWork W3105121123 @default.
- W3088915095 hasRelatedWork W3121515295 @default.
- W3088915095 hasRelatedWork W3208399933 @default.
- W3088915095 hasRelatedWork W3213833720 @default.
- W3088915095 isParatext "false" @default.
- W3088915095 isRetracted "false" @default.
- W3088915095 magId "3088915095" @default.
- W3088915095 workType "article" @default.