Matches in SemOpenAlex for { <https://semopenalex.org/work/W2103452139> ?p ?o ?g. }
- W2103452139 endingPage "1338" @default.
- W2103452139 startingPage "1329" @default.
- W2103452139 abstract "It has previously been shown that gradient-descent learning algorithms for recurrent neural networks can perform poorly on tasks that involve long-term dependencies, i.e. those problems for which the desired output depends on inputs presented at times far in the past. We show that the long-term dependencies problem is lessened for a class of architectures called nonlinear autoregressive models with exogenous (NARX) recurrent neural networks, which have powerful representational capabilities. We have previously reported that gradient descent learning can be more effective in NARX networks than in recurrent neural network architectures that have hidden states on problems including grammatical inference and nonlinear system identification. Typically, the network converges much faster and generalizes better than other networks. The results in this paper are consistent with this phenomenon. We present some experimental results which show that NARX networks can often retain information for two to three times as long as conventional recurrent neural networks. We show that although NARX networks do not circumvent the problem of long-term dependencies, they can greatly improve performance on long-term dependency problems. We also describe in detail some of the assumptions regarding what it means to latch information robustly and suggest possible ways to loosen these assumptions." @default.
- W2103452139 created "2016-06-24" @default.
- W2103452139 creator A5001294898 @default.
- W2103452139 creator A5039482466 @default.
- W2103452139 creator A5051182859 @default.
- W2103452139 creator A5059588772 @default.
- W2103452139 date "1996-11-01" @default.
- W2103452139 modified "2023-10-18" @default.
- W2103452139 title "Learning long-term dependencies in NARX recurrent neural networks" @default.
- W2103452139 cites W1484641991 @default.
- W2103452139 cites W1502856245 @default.
- W2103452139 cites W1602414358 @default.
- W2103452139 cites W1967914652 @default.
- W2103452139 cites W1996010635 @default.
- W2103452139 cites W1996741810 @default.
- W2103452139 cites W2025410943 @default.
- W2103452139 cites W2036317923 @default.
- W2103452139 cites W2064675550 @default.
- W2103452139 cites W2067619114 @default.
- W2103452139 cites W2097924526 @default.
- W2103452139 cites W2098398123 @default.
- W2103452139 cites W2105727046 @default.
- W2103452139 cites W2107878631 @default.
- W2103452139 cites W2115072676 @default.
- W2103452139 cites W2123716044 @default.
- W2103452139 cites W2126434873 @default.
- W2103452139 cites W2138484437 @default.
- W2103452139 cites W2139273175 @default.
- W2103452139 cites W2159097614 @default.
- W2103452139 cites W2171800554 @default.
- W2103452139 cites W4240172095 @default.
- W2103452139 cites W4254816979 @default.
- W2103452139 doi "https://doi.org/10.1109/72.548162" @default.
- W2103452139 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/18263528" @default.
- W2103452139 hasPublicationYear "1996" @default.
- W2103452139 type Work @default.
- W2103452139 sameAs 2103452139 @default.
- W2103452139 citedByCount "596" @default.
- W2103452139 countsByYear W21034521392012 @default.
- W2103452139 countsByYear W21034521392013 @default.
- W2103452139 countsByYear W21034521392014 @default.
- W2103452139 countsByYear W21034521392015 @default.
- W2103452139 countsByYear W21034521392016 @default.
- W2103452139 countsByYear W21034521392017 @default.
- W2103452139 countsByYear W21034521392018 @default.
- W2103452139 countsByYear W21034521392019 @default.
- W2103452139 countsByYear W21034521392020 @default.
- W2103452139 countsByYear W21034521392021 @default.
- W2103452139 countsByYear W21034521392022 @default.
- W2103452139 countsByYear W21034521392023 @default.
- W2103452139 crossrefType "journal-article" @default.
- W2103452139 hasAuthorship W2103452139A5001294898 @default.
- W2103452139 hasAuthorship W2103452139A5039482466 @default.
- W2103452139 hasAuthorship W2103452139A5051182859 @default.
- W2103452139 hasAuthorship W2103452139A5059588772 @default.
- W2103452139 hasConcept C108583219 @default.
- W2103452139 hasConcept C119857082 @default.
- W2103452139 hasConcept C121332964 @default.
- W2103452139 hasConcept C147168706 @default.
- W2103452139 hasConcept C149782125 @default.
- W2103452139 hasConcept C153258448 @default.
- W2103452139 hasConcept C154945302 @default.
- W2103452139 hasConcept C158622935 @default.
- W2103452139 hasConcept C159877910 @default.
- W2103452139 hasConcept C2776214188 @default.
- W2103452139 hasConcept C33923547 @default.
- W2103452139 hasConcept C41008148 @default.
- W2103452139 hasConcept C42536954 @default.
- W2103452139 hasConcept C50644808 @default.
- W2103452139 hasConcept C61797465 @default.
- W2103452139 hasConcept C62520636 @default.
- W2103452139 hasConceptScore W2103452139C108583219 @default.
- W2103452139 hasConceptScore W2103452139C119857082 @default.
- W2103452139 hasConceptScore W2103452139C121332964 @default.
- W2103452139 hasConceptScore W2103452139C147168706 @default.
- W2103452139 hasConceptScore W2103452139C149782125 @default.
- W2103452139 hasConceptScore W2103452139C153258448 @default.
- W2103452139 hasConceptScore W2103452139C154945302 @default.
- W2103452139 hasConceptScore W2103452139C158622935 @default.
- W2103452139 hasConceptScore W2103452139C159877910 @default.
- W2103452139 hasConceptScore W2103452139C2776214188 @default.
- W2103452139 hasConceptScore W2103452139C33923547 @default.
- W2103452139 hasConceptScore W2103452139C41008148 @default.
- W2103452139 hasConceptScore W2103452139C42536954 @default.
- W2103452139 hasConceptScore W2103452139C50644808 @default.
- W2103452139 hasConceptScore W2103452139C61797465 @default.
- W2103452139 hasConceptScore W2103452139C62520636 @default.
- W2103452139 hasIssue "6" @default.
- W2103452139 hasLocation W21034521391 @default.
- W2103452139 hasLocation W21034521392 @default.
- W2103452139 hasOpenAccess W2103452139 @default.
- W2103452139 hasPrimaryLocation W21034521391 @default.
- W2103452139 hasRelatedWork W2036704594 @default.
- W2103452139 hasRelatedWork W2275178414 @default.
- W2103452139 hasRelatedWork W2606910468 @default.
- W2103452139 hasRelatedWork W2984112945 @default.
- W2103452139 hasRelatedWork W2995801509 @default.
- W2103452139 hasRelatedWork W3083782034 @default.