Matches in SemOpenAlex for { <https://semopenalex.org/work/W2962785940> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W2962785940 abstract "Recursive neural networks (RNN) and their recently proposed extension recursive long short term memory networks (RLSTM) are models that compute representations for sentences, by recursively combining word embeddings according to an externally provided parse tree. Both models thus, unlike recurrent networks, explicitly make use of the hierarchical structure of a sentence. In this paper, we demonstrate that RNNs nevertheless suffer from the vanishing gradient and long distance dependency problem, and that RLSTMs greatly improve over RNN's on these problems. We present an artificial learning task that allows us to quantify the severity of these problems for both models. We further show that a ratio of gradients (at the root node and a focal leaf node) is highly indicative of the success of backpropagation at optimizing the relevant weights low in the tree. This paper thus provides an explanation for existing, superior results of RLSTMs on tasks such as sentiment analysis, and suggests that the benefits of including hierarchical structure and of including LSTM-style gating are complementary." @default.
- W2962785940 created "2019-07-30" @default.
- W2962785940 creator A5007928903 @default.
- W2962785940 creator A5061504918 @default.
- W2962785940 date "2016-01-01" @default.
- W2962785940 modified "2023-10-02" @default.
- W2962785940 title "Quantifying the Vanishing Gradient and Long Distance Dependency Problem in Recursive Neural Networks and Recursive LSTMs" @default.
- W2962785940 cites W1879966306 @default.
- W2962785940 cites W2064675550 @default.
- W2962785940 cites W2107878631 @default.
- W2962785940 cites W2121029939 @default.
- W2962785940 cites W2133280805 @default.
- W2962785940 cites W2146502635 @default.
- W2962785940 cites W2250644439 @default.
- W2962785940 cites W2251012068 @default.
- W2962785940 cites W2251939518 @default.
- W2962785940 cites W2960930698 @default.
- W2962785940 cites W2963355447 @default.
- W2962785940 doi "https://doi.org/10.18653/v1/w16-1610" @default.
- W2962785940 hasPublicationYear "2016" @default.
- W2962785940 type Work @default.
- W2962785940 sameAs 2962785940 @default.
- W2962785940 citedByCount "17" @default.
- W2962785940 countsByYear W29627859402017 @default.
- W2962785940 countsByYear W29627859402018 @default.
- W2962785940 countsByYear W29627859402019 @default.
- W2962785940 countsByYear W29627859402020 @default.
- W2962785940 countsByYear W29627859402021 @default.
- W2962785940 countsByYear W29627859402022 @default.
- W2962785940 countsByYear W29627859402023 @default.
- W2962785940 crossrefType "proceedings-article" @default.
- W2962785940 hasAuthorship W2962785940A5007928903 @default.
- W2962785940 hasAuthorship W2962785940A5061504918 @default.
- W2962785940 hasBestOaLocation W29627859401 @default.
- W2962785940 hasConcept C11413529 @default.
- W2962785940 hasConcept C147168706 @default.
- W2962785940 hasConcept C154945302 @default.
- W2962785940 hasConcept C19768560 @default.
- W2962785940 hasConcept C41008148 @default.
- W2962785940 hasConcept C50644808 @default.
- W2962785940 hasConceptScore W2962785940C11413529 @default.
- W2962785940 hasConceptScore W2962785940C147168706 @default.
- W2962785940 hasConceptScore W2962785940C154945302 @default.
- W2962785940 hasConceptScore W2962785940C19768560 @default.
- W2962785940 hasConceptScore W2962785940C41008148 @default.
- W2962785940 hasConceptScore W2962785940C50644808 @default.
- W2962785940 hasLocation W29627859401 @default.
- W2962785940 hasLocation W29627859402 @default.
- W2962785940 hasLocation W29627859403 @default.
- W2962785940 hasOpenAccess W2962785940 @default.
- W2962785940 hasPrimaryLocation W29627859401 @default.
- W2962785940 hasRelatedWork W1529400504 @default.
- W2962785940 hasRelatedWork W2386387936 @default.
- W2962785940 hasRelatedWork W2392110728 @default.
- W2962785940 hasRelatedWork W2888625260 @default.
- W2962785940 hasRelatedWork W2902723393 @default.
- W2962785940 hasRelatedWork W2916088583 @default.
- W2962785940 hasRelatedWork W63071447 @default.
- W2962785940 hasRelatedWork W65617392 @default.
- W2962785940 hasRelatedWork W83176488 @default.
- W2962785940 hasRelatedWork W2169928498 @default.
- W2962785940 isParatext "false" @default.
- W2962785940 isRetracted "false" @default.
- W2962785940 magId "2962785940" @default.
- W2962785940 workType "article" @default.