Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287330102> ?p ?o ?g. }
Showing items 1 to 75 of
75
with 100 items per page.
- W4287330102 abstract "We provide a general framework for studying recurrent neural networks (RNNs) trained by injecting noise into hidden states. Specifically, we consider RNNs that can be viewed as discretizations of stochastic differential equations driven by input data. This framework allows us to study the implicit regularization effect of general noise injection schemes by deriving an approximate explicit regularizer in the small noise regime. We find that, under reasonable assumptions, this implicit regularization promotes flatter minima; it biases towards models with more stable dynamics; and, in classification tasks, it favors models with larger classification margin. Sufficient conditions for global stability are obtained, highlighting the phenomenon of stochastic stabilization, where noise injection can improve stability during training. Our theory is supported by empirical results which demonstrate that the RNNs have improved robustness with respect to various input perturbations." @default.
- W4287330102 created "2022-07-25" @default.
- W4287330102 creator A5007032334 @default.
- W4287330102 creator A5030249020 @default.
- W4287330102 creator A5033006662 @default.
- W4287330102 creator A5055366983 @default.
- W4287330102 date "2021-02-09" @default.
- W4287330102 modified "2023-09-29" @default.
- W4287330102 title "Noisy Recurrent Neural Networks" @default.
- W4287330102 doi "https://doi.org/10.48550/arxiv.2102.04877" @default.
- W4287330102 hasPublicationYear "2021" @default.
- W4287330102 type Work @default.
- W4287330102 citedByCount "0" @default.
- W4287330102 crossrefType "posted-content" @default.
- W4287330102 hasAuthorship W4287330102A5007032334 @default.
- W4287330102 hasAuthorship W4287330102A5030249020 @default.
- W4287330102 hasAuthorship W4287330102A5033006662 @default.
- W4287330102 hasAuthorship W4287330102A5055366983 @default.
- W4287330102 hasBestOaLocation W42873301021 @default.
- W4287330102 hasConcept C104317684 @default.
- W4287330102 hasConcept C112972136 @default.
- W4287330102 hasConcept C11413529 @default.
- W4287330102 hasConcept C115961682 @default.
- W4287330102 hasConcept C119857082 @default.
- W4287330102 hasConcept C134306372 @default.
- W4287330102 hasConcept C147168706 @default.
- W4287330102 hasConcept C154945302 @default.
- W4287330102 hasConcept C185592680 @default.
- W4287330102 hasConcept C186633575 @default.
- W4287330102 hasConcept C2776135515 @default.
- W4287330102 hasConcept C28826006 @default.
- W4287330102 hasConcept C33923547 @default.
- W4287330102 hasConcept C41008148 @default.
- W4287330102 hasConcept C50644808 @default.
- W4287330102 hasConcept C51955184 @default.
- W4287330102 hasConcept C55493867 @default.
- W4287330102 hasConcept C63479239 @default.
- W4287330102 hasConcept C774472 @default.
- W4287330102 hasConcept C99498987 @default.
- W4287330102 hasConceptScore W4287330102C104317684 @default.
- W4287330102 hasConceptScore W4287330102C112972136 @default.
- W4287330102 hasConceptScore W4287330102C11413529 @default.
- W4287330102 hasConceptScore W4287330102C115961682 @default.
- W4287330102 hasConceptScore W4287330102C119857082 @default.
- W4287330102 hasConceptScore W4287330102C134306372 @default.
- W4287330102 hasConceptScore W4287330102C147168706 @default.
- W4287330102 hasConceptScore W4287330102C154945302 @default.
- W4287330102 hasConceptScore W4287330102C185592680 @default.
- W4287330102 hasConceptScore W4287330102C186633575 @default.
- W4287330102 hasConceptScore W4287330102C2776135515 @default.
- W4287330102 hasConceptScore W4287330102C28826006 @default.
- W4287330102 hasConceptScore W4287330102C33923547 @default.
- W4287330102 hasConceptScore W4287330102C41008148 @default.
- W4287330102 hasConceptScore W4287330102C50644808 @default.
- W4287330102 hasConceptScore W4287330102C51955184 @default.
- W4287330102 hasConceptScore W4287330102C55493867 @default.
- W4287330102 hasConceptScore W4287330102C63479239 @default.
- W4287330102 hasConceptScore W4287330102C774472 @default.
- W4287330102 hasConceptScore W4287330102C99498987 @default.
- W4287330102 hasLocation W42873301021 @default.
- W4287330102 hasOpenAccess W4287330102 @default.
- W4287330102 hasPrimaryLocation W42873301021 @default.
- W4287330102 hasRelatedWork W2004989359 @default.
- W4287330102 hasRelatedWork W2024452492 @default.
- W4287330102 hasRelatedWork W2039617089 @default.
- W4287330102 hasRelatedWork W2126831439 @default.
- W4287330102 hasRelatedWork W2147107577 @default.
- W4287330102 hasRelatedWork W2166578533 @default.
- W4287330102 hasRelatedWork W2364230301 @default.
- W4287330102 hasRelatedWork W2376464645 @default.
- W4287330102 hasRelatedWork W2379047625 @default.
- W4287330102 hasRelatedWork W4287330102 @default.
- W4287330102 isParatext "false" @default.
- W4287330102 isRetracted "false" @default.
- W4287330102 workType "article" @default.