Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287181718> ?p ?o ?g. }
Showing items 1 to 58 of
58
with 100 items per page.
- W4287181718 abstract "Black-box probing models can reliably extract linguistic features like tense, number, and syntactic role from pretrained word representations. However, the manner in which these features are encoded in representations remains poorly understood. We present a systematic study of the linear geometry of contextualized word representations in ELMO and BERT. We show that a variety of linguistic features (including structured dependency relationships) are encoded in low-dimensional subspaces. We then refine this geometric picture, showing that there are hierarchical relations between the subspaces encoding general linguistic categories and more specific ones, and that low-dimensional feature encodings are distributed rather than aligned to individual neurons. Finally, we demonstrate that these linear subspaces are causally related to model behavior, and can be used to perform fine-grained manipulation of BERT's output distribution." @default.
- W4287181718 created "2022-07-25" @default.
- W4287181718 creator A5070829652 @default.
- W4287181718 creator A5083003591 @default.
- W4287181718 date "2021-05-14" @default.
- W4287181718 modified "2023-09-30" @default.
- W4287181718 title "The Low-Dimensional Linear Geometry of Contextualized Word Representations" @default.
- W4287181718 doi "https://doi.org/10.48550/arxiv.2105.07109" @default.
- W4287181718 hasPublicationYear "2021" @default.
- W4287181718 type Work @default.
- W4287181718 citedByCount "0" @default.
- W4287181718 crossrefType "posted-content" @default.
- W4287181718 hasAuthorship W4287181718A5070829652 @default.
- W4287181718 hasAuthorship W4287181718A5083003591 @default.
- W4287181718 hasBestOaLocation W42871817181 @default.
- W4287181718 hasConcept C12362212 @default.
- W4287181718 hasConcept C125411270 @default.
- W4287181718 hasConcept C136197465 @default.
- W4287181718 hasConcept C138885662 @default.
- W4287181718 hasConcept C154945302 @default.
- W4287181718 hasConcept C19768560 @default.
- W4287181718 hasConcept C204321447 @default.
- W4287181718 hasConcept C2524010 @default.
- W4287181718 hasConcept C2776401178 @default.
- W4287181718 hasConcept C33923547 @default.
- W4287181718 hasConcept C41008148 @default.
- W4287181718 hasConcept C41895202 @default.
- W4287181718 hasConcept C90805587 @default.
- W4287181718 hasConceptScore W4287181718C12362212 @default.
- W4287181718 hasConceptScore W4287181718C125411270 @default.
- W4287181718 hasConceptScore W4287181718C136197465 @default.
- W4287181718 hasConceptScore W4287181718C138885662 @default.
- W4287181718 hasConceptScore W4287181718C154945302 @default.
- W4287181718 hasConceptScore W4287181718C19768560 @default.
- W4287181718 hasConceptScore W4287181718C204321447 @default.
- W4287181718 hasConceptScore W4287181718C2524010 @default.
- W4287181718 hasConceptScore W4287181718C2776401178 @default.
- W4287181718 hasConceptScore W4287181718C33923547 @default.
- W4287181718 hasConceptScore W4287181718C41008148 @default.
- W4287181718 hasConceptScore W4287181718C41895202 @default.
- W4287181718 hasConceptScore W4287181718C90805587 @default.
- W4287181718 hasLocation W42871817181 @default.
- W4287181718 hasLocation W42871817182 @default.
- W4287181718 hasOpenAccess W4287181718 @default.
- W4287181718 hasPrimaryLocation W42871817181 @default.
- W4287181718 hasRelatedWork W1483367581 @default.
- W4287181718 hasRelatedWork W1592893681 @default.
- W4287181718 hasRelatedWork W2200456380 @default.
- W4287181718 hasRelatedWork W2335876948 @default.
- W4287181718 hasRelatedWork W2511797247 @default.
- W4287181718 hasRelatedWork W2891339190 @default.
- W4287181718 hasRelatedWork W2901590103 @default.
- W4287181718 hasRelatedWork W3091324991 @default.
- W4287181718 hasRelatedWork W3205370023 @default.
- W4287181718 hasRelatedWork W4287181718 @default.
- W4287181718 isParatext "false" @default.
- W4287181718 isRetracted "false" @default.
- W4287181718 workType "article" @default.