Matches in SemOpenAlex for { <https://semopenalex.org/work/W3213267979> ?p ?o ?g. }
Showing items 1 to 90 of
90
with 100 items per page.
- W3213267979 abstract "We provide a general framework for studying recurrent neural networks (RNNs) trained by injecting noise into hidden states. Specifically, we consider RNNs that can be viewed as discretizations of stochastic differential equations driven by input data. This framework allows us to study the implicit regularization effect of general noise injection schemes by deriving an approximate explicit regularizer in the small noise regime. We find that, under reasonable assumptions, this implicit regularization promotes flatter minima; it biases towards models with more stable dynamics; and, in classification tasks, it favors models with larger classification margin. Sufficient conditions for global stability are obtained, highlighting the phenomenon of stochastic stabilization, where noise injection can improve stability during training. Our theory is supported by empirical results which demonstrate improved robustness with respect to various input perturbations, while maintaining state-of-the-art performance." @default.
- W3213267979 created "2021-11-22" @default.
- W3213267979 creator A5007032334 @default.
- W3213267979 creator A5030249020 @default.
- W3213267979 creator A5033006662 @default.
- W3213267979 creator A5055366983 @default.
- W3213267979 date "2021-12-06" @default.
- W3213267979 modified "2023-09-24" @default.
- W3213267979 title "Noisy Recurrent Neural Networks" @default.
- W3213267979 hasPublicationYear "2021" @default.
- W3213267979 type Work @default.
- W3213267979 sameAs 3213267979 @default.
- W3213267979 citedByCount "0" @default.
- W3213267979 crossrefType "proceedings-article" @default.
- W3213267979 hasAuthorship W3213267979A5007032334 @default.
- W3213267979 hasAuthorship W3213267979A5030249020 @default.
- W3213267979 hasAuthorship W3213267979A5033006662 @default.
- W3213267979 hasAuthorship W3213267979A5055366983 @default.
- W3213267979 hasConcept C104317684 @default.
- W3213267979 hasConcept C112972136 @default.
- W3213267979 hasConcept C115961682 @default.
- W3213267979 hasConcept C119857082 @default.
- W3213267979 hasConcept C134306372 @default.
- W3213267979 hasConcept C147168706 @default.
- W3213267979 hasConcept C154945302 @default.
- W3213267979 hasConcept C185592680 @default.
- W3213267979 hasConcept C186633575 @default.
- W3213267979 hasConcept C2775924081 @default.
- W3213267979 hasConcept C2776135515 @default.
- W3213267979 hasConcept C2781170535 @default.
- W3213267979 hasConcept C28826006 @default.
- W3213267979 hasConcept C33923547 @default.
- W3213267979 hasConcept C41008148 @default.
- W3213267979 hasConcept C47446073 @default.
- W3213267979 hasConcept C50644808 @default.
- W3213267979 hasConcept C51955184 @default.
- W3213267979 hasConcept C55493867 @default.
- W3213267979 hasConcept C63479239 @default.
- W3213267979 hasConcept C774472 @default.
- W3213267979 hasConcept C99498987 @default.
- W3213267979 hasConceptScore W3213267979C104317684 @default.
- W3213267979 hasConceptScore W3213267979C112972136 @default.
- W3213267979 hasConceptScore W3213267979C115961682 @default.
- W3213267979 hasConceptScore W3213267979C119857082 @default.
- W3213267979 hasConceptScore W3213267979C134306372 @default.
- W3213267979 hasConceptScore W3213267979C147168706 @default.
- W3213267979 hasConceptScore W3213267979C154945302 @default.
- W3213267979 hasConceptScore W3213267979C185592680 @default.
- W3213267979 hasConceptScore W3213267979C186633575 @default.
- W3213267979 hasConceptScore W3213267979C2775924081 @default.
- W3213267979 hasConceptScore W3213267979C2776135515 @default.
- W3213267979 hasConceptScore W3213267979C2781170535 @default.
- W3213267979 hasConceptScore W3213267979C28826006 @default.
- W3213267979 hasConceptScore W3213267979C33923547 @default.
- W3213267979 hasConceptScore W3213267979C41008148 @default.
- W3213267979 hasConceptScore W3213267979C47446073 @default.
- W3213267979 hasConceptScore W3213267979C50644808 @default.
- W3213267979 hasConceptScore W3213267979C51955184 @default.
- W3213267979 hasConceptScore W3213267979C55493867 @default.
- W3213267979 hasConceptScore W3213267979C63479239 @default.
- W3213267979 hasConceptScore W3213267979C774472 @default.
- W3213267979 hasConceptScore W3213267979C99498987 @default.
- W3213267979 hasLocation W32132679791 @default.
- W3213267979 hasOpenAccess W3213267979 @default.
- W3213267979 hasPrimaryLocation W32132679791 @default.
- W3213267979 hasRelatedWork W2895616758 @default.
- W3213267979 hasRelatedWork W2899253307 @default.
- W3213267979 hasRelatedWork W2900751540 @default.
- W3213267979 hasRelatedWork W2919767206 @default.
- W3213267979 hasRelatedWork W2923794453 @default.
- W3213267979 hasRelatedWork W2949203910 @default.
- W3213267979 hasRelatedWork W2963602979 @default.
- W3213267979 hasRelatedWork W2979563282 @default.
- W3213267979 hasRelatedWork W2990189480 @default.
- W3213267979 hasRelatedWork W3006064982 @default.
- W3213267979 hasRelatedWork W3035618986 @default.
- W3213267979 hasRelatedWork W3035751893 @default.
- W3213267979 hasRelatedWork W3036844898 @default.
- W3213267979 hasRelatedWork W3046739385 @default.
- W3213267979 hasRelatedWork W3111663897 @default.
- W3213267979 hasRelatedWork W3124313856 @default.
- W3213267979 hasRelatedWork W3127713124 @default.
- W3213267979 hasRelatedWork W3188261512 @default.
- W3213267979 hasRelatedWork W3207208954 @default.
- W3213267979 hasRelatedWork W3101080188 @default.
- W3213267979 hasVolume "34" @default.
- W3213267979 isParatext "false" @default.
- W3213267979 isRetracted "false" @default.
- W3213267979 magId "3213267979" @default.
- W3213267979 workType "article" @default.