Matches in SemOpenAlex for { <https://semopenalex.org/work/W3105033018> ?p ?o ?g. }
- W3105033018 abstract "Attention mechanisms have improved the performance of NLP tasks while allowing models to remain explainable. Self-attention is currently widely used, however interpretability is difficult due to the numerous attention distributions. Recent work has shown that model representations can benefit from label-specific information, while facilitating interpretation of predictions. We introduce the Label Attention Layer: a new form of self-attention where attention heads represent labels. We test our novel layer by running constituency and dependency parsing experiments and show our new model obtains new state-of-the-art results for both tasks on both the Penn Treebank (PTB) and Chinese Treebank. Additionally, our model requires fewer self-attention layers compared to existing work. Finally, we find that the Label Attention heads learn relations between syntactic categories and show pathways to analyze errors." @default.
- W3105033018 created "2020-11-23" @default.
- W3105033018 creator A5009286723 @default.
- W3105033018 creator A5010708309 @default.
- W3105033018 creator A5020042558 @default.
- W3105033018 creator A5022894020 @default.
- W3105033018 creator A5028863551 @default.
- W3105033018 creator A5041381130 @default.
- W3105033018 date "2020-01-01" @default.
- W3105033018 modified "2023-09-26" @default.
- W3105033018 title "Rethinking Self-Attention: Towards Interpretability in Neural Parsing" @default.
- W3105033018 cites W1502293651 @default.
- W3105033018 cites W1632114991 @default.
- W3105033018 cites W1902237438 @default.
- W3105033018 cites W1970961429 @default.
- W3105033018 cites W2038248725 @default.
- W3105033018 cites W2096204319 @default.
- W3105033018 cites W2152907450 @default.
- W3105033018 cites W2470673105 @default.
- W3105033018 cites W2523467643 @default.
- W3105033018 cites W2554915555 @default.
- W3105033018 cites W2559842427 @default.
- W3105033018 cites W2564486991 @default.
- W3105033018 cites W2597655663 @default.
- W3105033018 cites W2775624460 @default.
- W3105033018 cites W2798569372 @default.
- W3105033018 cites W2798921788 @default.
- W3105033018 cites W2805910418 @default.
- W3105033018 cites W2859207840 @default.
- W3105033018 cites W2888799392 @default.
- W3105033018 cites W2891339190 @default.
- W3105033018 cites W2891602716 @default.
- W3105033018 cites W2924690340 @default.
- W3105033018 cites W2934842096 @default.
- W3105033018 cites W2953359159 @default.
- W3105033018 cites W2962788148 @default.
- W3105033018 cites W2963021447 @default.
- W3105033018 cites W2963033685 @default.
- W3105033018 cites W2963073938 @default.
- W3105033018 cites W2963084773 @default.
- W3105033018 cites W2963106122 @default.
- W3105033018 cites W2963213121 @default.
- W3105033018 cites W2963227939 @default.
- W3105033018 cites W2963330800 @default.
- W3105033018 cites W2963341956 @default.
- W3105033018 cites W2963372751 @default.
- W3105033018 cites W2963403868 @default.
- W3105033018 cites W2963462075 @default.
- W3105033018 cites W2963571341 @default.
- W3105033018 cites W2963621383 @default.
- W3105033018 cites W2963643701 @default.
- W3105033018 cites W2964030814 @default.
- W3105033018 cites W2964308564 @default.
- W3105033018 cites W2970597249 @default.
- W3105033018 cites W2970726176 @default.
- W3105033018 cites W2971092323 @default.
- W3105033018 doi "https://doi.org/10.18653/v1/2020.findings-emnlp.65" @default.
- W3105033018 hasPublicationYear "2020" @default.
- W3105033018 type Work @default.
- W3105033018 sameAs 3105033018 @default.
- W3105033018 citedByCount "41" @default.
- W3105033018 countsByYear W31050330182020 @default.
- W3105033018 countsByYear W31050330182021 @default.
- W3105033018 countsByYear W31050330182022 @default.
- W3105033018 countsByYear W31050330182023 @default.
- W3105033018 crossrefType "proceedings-article" @default.
- W3105033018 hasAuthorship W3105033018A5009286723 @default.
- W3105033018 hasAuthorship W3105033018A5010708309 @default.
- W3105033018 hasAuthorship W3105033018A5020042558 @default.
- W3105033018 hasAuthorship W3105033018A5022894020 @default.
- W3105033018 hasAuthorship W3105033018A5028863551 @default.
- W3105033018 hasAuthorship W3105033018A5041381130 @default.
- W3105033018 hasBestOaLocation W31050330181 @default.
- W3105033018 hasConcept C119857082 @default.
- W3105033018 hasConcept C154945302 @default.
- W3105033018 hasConcept C164883195 @default.
- W3105033018 hasConcept C178790620 @default.
- W3105033018 hasConcept C185592680 @default.
- W3105033018 hasConcept C186644900 @default.
- W3105033018 hasConcept C19768560 @default.
- W3105033018 hasConcept C199360897 @default.
- W3105033018 hasConcept C204321447 @default.
- W3105033018 hasConcept C206134035 @default.
- W3105033018 hasConcept C2779227376 @default.
- W3105033018 hasConcept C2781067378 @default.
- W3105033018 hasConcept C41008148 @default.
- W3105033018 hasConcept C527412718 @default.
- W3105033018 hasConceptScore W3105033018C119857082 @default.
- W3105033018 hasConceptScore W3105033018C154945302 @default.
- W3105033018 hasConceptScore W3105033018C164883195 @default.
- W3105033018 hasConceptScore W3105033018C178790620 @default.
- W3105033018 hasConceptScore W3105033018C185592680 @default.
- W3105033018 hasConceptScore W3105033018C186644900 @default.
- W3105033018 hasConceptScore W3105033018C19768560 @default.
- W3105033018 hasConceptScore W3105033018C199360897 @default.
- W3105033018 hasConceptScore W3105033018C204321447 @default.
- W3105033018 hasConceptScore W3105033018C206134035 @default.
- W3105033018 hasConceptScore W3105033018C2779227376 @default.
- W3105033018 hasConceptScore W3105033018C2781067378 @default.
- W3105033018 hasConceptScore W3105033018C41008148 @default.