FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3100454002> ?p ?o ?g. }

• W3100454002 abstract "While recurrent models have been effective in NLP tasks, their performance on context-free languages (CFLs) has been found to be quite weak. Given that CFLs are believed to capture important phenomena such as hierarchical structure in natural languages, this discrepancy in performance calls for an explanation. We study the performance of recurrent models on Dyck-n languages, a particularly important and well-studied class of CFLs. We find that while recurrent models generalize nearly perfectly if the lengths of the training and test strings are from the same range, they perform poorly if the test strings are longer. At the same time, we observe that recurrent models are expressive enough to recognize Dyck words of arbitrary lengths in finite precision if their depths are bounded. Hence, we evaluate our models on samples generated from Dyck languages with bounded depth and find that they are indeed able to generalize to much higher lengths. Since natural language datasets have nested dependencies of bounded depth, this may help explain why they perform well in modeling hierarchical dependencies in natural language data despite prior works indicating poor generalization performance on Dyck languages. We perform probing studies to support our results and provide comparisons with Transformers." @default.
• W3100454002 created "2020-11-23" @default.
• W3100454002 creator A5029531416 @default.
• W3100454002 creator A5067127146 @default.
• W3100454002 creator A5088355901 @default.
• W3100454002 date "2020-11-08" @default.
• W3100454002 modified "2023-09-27" @default.
• W3100454002 title "On the Practical Ability of Recurrent Neural Networks to Recognize Hierarchical Languages" @default.
• W3100454002 cites W1522301498 @default.
• W3100454002 cites W1732222442 @default.
• W3100454002 cites W1890888469 @default.
• W3100454002 cites W2003250112 @default.
• W3100454002 cites W2064675550 @default.
• W3100454002 cites W2072160811 @default.
• W3100454002 cites W2094528305 @default.
• W3100454002 cites W2115912164 @default.
• W3100454002 cites W2121029939 @default.
• W3100454002 cites W2130942839 @default.
• W3100454002 cites W2563157576 @default.
• W3100454002 cites W2739255396 @default.
• W3100454002 cites W2789868 @default.
• W3100454002 cites W2914557243 @default.
• W3100454002 cites W2949292434 @default.
• W3100454002 cites W2951815760 @default.
• W3100454002 cites W2962749806 @default.
• W3100454002 cites W2962911926 @default.
• W3100454002 cites W2963059228 @default.
• W3100454002 cites W2963341956 @default.
• W3100454002 cites W2963403868 @default.
• W3100454002 cites W2963525616 @default.
• W3100454002 cites W2963723151 @default.
• W3100454002 cites W2963751529 @default.
• W3100454002 cites W2963753324 @default.
• W3100454002 cites W2970060558 @default.
• W3100454002 cites W2972889706 @default.
• W3100454002 cites W2973122905 @default.
• W3100454002 cites W2983086530 @default.
• W3100454002 cites W3032974082 @default.
• W3100454002 cites W3091917188 @default.
• W3100454002 hasPublicationYear "2020" @default.
• W3100454002 type Work @default.
• W3100454002 sameAs 3100454002 @default.
• W3100454002 citedByCount "0" @default.
• W3100454002 crossrefType "posted-content" @default.
• W3100454002 hasAuthorship W3100454002A5029531416 @default.
• W3100454002 hasAuthorship W3100454002A5067127146 @default.
• W3100454002 hasAuthorship W3100454002A5088355901 @default.
• W3100454002 hasConcept C112505250 @default.
• W3100454002 hasConcept C119857082 @default.
• W3100454002 hasConcept C121332964 @default.
• W3100454002 hasConcept C134306372 @default.
• W3100454002 hasConcept C137293760 @default.
• W3100454002 hasConcept C147168706 @default.
• W3100454002 hasConcept C151730666 @default.
• W3100454002 hasConcept C154945302 @default.
• W3100454002 hasConcept C159985019 @default.
• W3100454002 hasConcept C165801399 @default.
• W3100454002 hasConcept C177148314 @default.
• W3100454002 hasConcept C192562407 @default.
• W3100454002 hasConcept C195324797 @default.
• W3100454002 hasConcept C204321447 @default.
• W3100454002 hasConcept C204323151 @default.
• W3100454002 hasConcept C2779343474 @default.
• W3100454002 hasConcept C33923547 @default.
• W3100454002 hasConcept C34388435 @default.
• W3100454002 hasConcept C41008148 @default.
• W3100454002 hasConcept C50644808 @default.
• W3100454002 hasConcept C52370388 @default.
• W3100454002 hasConcept C62520636 @default.
• W3100454002 hasConcept C66322947 @default.
• W3100454002 hasConcept C80444323 @default.
• W3100454002 hasConcept C86803240 @default.
• W3100454002 hasConceptScore W3100454002C112505250 @default.
• W3100454002 hasConceptScore W3100454002C119857082 @default.
• W3100454002 hasConceptScore W3100454002C121332964 @default.
• W3100454002 hasConceptScore W3100454002C134306372 @default.
• W3100454002 hasConceptScore W3100454002C137293760 @default.
• W3100454002 hasConceptScore W3100454002C147168706 @default.
• W3100454002 hasConceptScore W3100454002C151730666 @default.
• W3100454002 hasConceptScore W3100454002C154945302 @default.
• W3100454002 hasConceptScore W3100454002C159985019 @default.
• W3100454002 hasConceptScore W3100454002C165801399 @default.
• W3100454002 hasConceptScore W3100454002C177148314 @default.
• W3100454002 hasConceptScore W3100454002C192562407 @default.
• W3100454002 hasConceptScore W3100454002C195324797 @default.
• W3100454002 hasConceptScore W3100454002C204321447 @default.
• W3100454002 hasConceptScore W3100454002C204323151 @default.
• W3100454002 hasConceptScore W3100454002C2779343474 @default.
• W3100454002 hasConceptScore W3100454002C33923547 @default.
• W3100454002 hasConceptScore W3100454002C34388435 @default.
• W3100454002 hasConceptScore W3100454002C41008148 @default.
• W3100454002 hasConceptScore W3100454002C50644808 @default.
• W3100454002 hasConceptScore W3100454002C52370388 @default.
• W3100454002 hasConceptScore W3100454002C62520636 @default.
• W3100454002 hasConceptScore W3100454002C66322947 @default.
• W3100454002 hasConceptScore W3100454002C80444323 @default.
• W3100454002 hasConceptScore W3100454002C86803240 @default.
• W3100454002 hasLocation W31004540021 @default.
• W3100454002 hasOpenAccess W3100454002 @default.
• W3100454002 hasPrimaryLocation W31004540021 @default.

• next