Matches in SemOpenAlex for { <https://semopenalex.org/work/W3142802968> ?p ?o ?g. }
Showing items 1 to 95 of
95
with 100 items per page.
- W3142802968 abstract "Why do large pre-trained transformer-based models perform so well across a wide variety of NLP tasks? Recent research suggests the key may lie in multi-headed attention mechanism's ability to learn and represent linguistic information. Understanding how these models represent both syntactic and semantic knowledge is vital to investigate why they succeed and fail, what they have learned, and how they can improve. We present Dodrio, an open-source interactive visualization tool to help NLP researchers and practitioners analyze attention mechanisms in transformer-based models with linguistic knowledge. Dodrio tightly integrates an overview that summarizes the roles of different attention heads, and detailed views that help users compare attention weights with the syntactic structure and semantic information in the input text. To facilitate the visual comparison of attention weights and linguistic knowledge, Dodrio applies different graph visualization techniques to represent attention weights scalable to longer input text. Case studies highlight how Dodrio provides insights into understanding the attention mechanism in transformer-based models. Dodrio is available at this https URL." @default.
- W3142802968 created "2021-04-13" @default.
- W3142802968 creator A5009373644 @default.
- W3142802968 creator A5019311613 @default.
- W3142802968 creator A5020153026 @default.
- W3142802968 date "2021-03-26" @default.
- W3142802968 modified "2023-09-27" @default.
- W3142802968 title "Dodrio: Exploring Transformer Models with Interactive Visualization" @default.
- W3142802968 cites W1514535095 @default.
- W3142802968 cites W1632114991 @default.
- W3142802968 cites W1755776945 @default.
- W3142802968 cites W2013989095 @default.
- W3142802968 cites W2123442489 @default.
- W3142802968 cites W2251939518 @default.
- W3142802968 cites W2889326414 @default.
- W3142802968 cites W2934842096 @default.
- W3142802968 cites W2946794439 @default.
- W3142802968 cites W2950784811 @default.
- W3142802968 cites W2962958286 @default.
- W3142802968 cites W2963214037 @default.
- W3142802968 cites W2963310665 @default.
- W3142802968 cites W2963341956 @default.
- W3142802968 cites W2970726176 @default.
- W3142802968 cites W2970862333 @default.
- W3142802968 cites W2972324944 @default.
- W3142802968 cites W2977162702 @default.
- W3142802968 cites W2978017171 @default.
- W3142802968 cites W2995446988 @default.
- W3142802968 cites W3021941048 @default.
- W3142802968 cites W3035367371 @default.
- W3142802968 cites W3038035611 @default.
- W3142802968 cites W3093452197 @default.
- W3142802968 cites W3099143320 @default.
- W3142802968 cites W3101155149 @default.
- W3142802968 cites W3118485687 @default.
- W3142802968 cites W3154565472 @default.
- W3142802968 hasPublicationYear "2021" @default.
- W3142802968 type Work @default.
- W3142802968 sameAs 3142802968 @default.
- W3142802968 citedByCount "0" @default.
- W3142802968 crossrefType "posted-content" @default.
- W3142802968 hasAuthorship W3142802968A5009373644 @default.
- W3142802968 hasAuthorship W3142802968A5019311613 @default.
- W3142802968 hasAuthorship W3142802968A5020153026 @default.
- W3142802968 hasConcept C121332964 @default.
- W3142802968 hasConcept C136197465 @default.
- W3142802968 hasConcept C154945302 @default.
- W3142802968 hasConcept C165801399 @default.
- W3142802968 hasConcept C204321447 @default.
- W3142802968 hasConcept C2983448237 @default.
- W3142802968 hasConcept C36464697 @default.
- W3142802968 hasConcept C41008148 @default.
- W3142802968 hasConcept C48044578 @default.
- W3142802968 hasConcept C62520636 @default.
- W3142802968 hasConcept C66322947 @default.
- W3142802968 hasConcept C77088390 @default.
- W3142802968 hasConceptScore W3142802968C121332964 @default.
- W3142802968 hasConceptScore W3142802968C136197465 @default.
- W3142802968 hasConceptScore W3142802968C154945302 @default.
- W3142802968 hasConceptScore W3142802968C165801399 @default.
- W3142802968 hasConceptScore W3142802968C204321447 @default.
- W3142802968 hasConceptScore W3142802968C2983448237 @default.
- W3142802968 hasConceptScore W3142802968C36464697 @default.
- W3142802968 hasConceptScore W3142802968C41008148 @default.
- W3142802968 hasConceptScore W3142802968C48044578 @default.
- W3142802968 hasConceptScore W3142802968C62520636 @default.
- W3142802968 hasConceptScore W3142802968C66322947 @default.
- W3142802968 hasConceptScore W3142802968C77088390 @default.
- W3142802968 hasLocation W31428029681 @default.
- W3142802968 hasOpenAccess W3142802968 @default.
- W3142802968 hasPrimaryLocation W31428029681 @default.
- W3142802968 hasRelatedWork W2125973684 @default.
- W3142802968 hasRelatedWork W2258702405 @default.
- W3142802968 hasRelatedWork W2268590461 @default.
- W3142802968 hasRelatedWork W2741363662 @default.
- W3142802968 hasRelatedWork W2741775782 @default.
- W3142802968 hasRelatedWork W2891505635 @default.
- W3142802968 hasRelatedWork W2897142347 @default.
- W3142802968 hasRelatedWork W2979949198 @default.
- W3142802968 hasRelatedWork W3021934057 @default.
- W3142802968 hasRelatedWork W3025341884 @default.
- W3142802968 hasRelatedWork W3030501723 @default.
- W3142802968 hasRelatedWork W3038035611 @default.
- W3142802968 hasRelatedWork W3087570533 @default.
- W3142802968 hasRelatedWork W3114612190 @default.
- W3142802968 hasRelatedWork W3138794547 @default.
- W3142802968 hasRelatedWork W3153758184 @default.
- W3142802968 hasRelatedWork W3154594410 @default.
- W3142802968 hasRelatedWork W3175479236 @default.
- W3142802968 hasRelatedWork W3192899774 @default.
- W3142802968 hasRelatedWork W647008666 @default.
- W3142802968 isParatext "false" @default.
- W3142802968 isRetracted "false" @default.
- W3142802968 magId "3142802968" @default.
- W3142802968 workType "article" @default.