Matches in SemOpenAlex for { <https://semopenalex.org/work/W3159657177> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W3159657177 abstract "NLP has a rich history of representing our prior understanding of language in the form of graphs. Recent work on analyzing contextualized text representations has focused on hand-designed probe models to understand how and to what extent do these representations encode a particular linguistic phenomenon. However, due to the inter-dependence of various phenomena and randomness of training probe models, detecting how these representations encode the rich information in these linguistic graphs remains a challenging problem. In this paper, we propose a new information-theoretic probe, Bird's Eye, which is a fairly simple probe method for detecting if and how these representations encode the information in these linguistic graphs. Instead of using classifier performance, our probe takes an information-theoretic view of probing and estimates the mutual information between the linguistic graph embedded in a continuous space and the contextualized word representations. Furthermore, we also propose an approach to use our probe to investigate localized linguistic information in the linguistic graphs using perturbation analysis. We call this probing setup Worm's Eye. Using these probes, we analyze BERT models on their ability to encode a syntactic and a semantic graph structure, and find that these models encode to some degree both syntactic as well as semantic information; albeit syntactic information to a greater extent." @default.
- W3159657177 created "2021-05-10" @default.
- W3159657177 creator A5002316432 @default.
- W3159657177 creator A5059522548 @default.
- W3159657177 date "2021-05-06" @default.
- W3159657177 modified "2023-09-27" @default.
- W3159657177 title "Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach" @default.
- W3159657177 cites W1508977358 @default.
- W3159657177 cites W1600587676 @default.
- W3159657177 cites W1632114991 @default.
- W3159657177 cites W2013196554 @default.
- W3159657177 cites W2013606862 @default.
- W3159657177 cites W2060092029 @default.
- W3159657177 cites W2080722576 @default.
- W3159657177 cites W2082290707 @default.
- W3159657177 cites W2092939357 @default.
- W3159657177 cites W2102471334 @default.
- W3159657177 cites W2114771311 @default.
- W3159657177 cites W2128652000 @default.
- W3159657177 cites W2129977294 @default.
- W3159657177 cites W2153579005 @default.
- W3159657177 cites W2154053567 @default.
- W3159657177 cites W2158698691 @default.
- W3159657177 cites W2159636675 @default.
- W3159657177 cites W2250537251 @default.
- W3159657177 cites W2250539671 @default.
- W3159657177 cites W2251071803 @default.
- W3159657177 cites W2252123671 @default.
- W3159657177 cites W2624431344 @default.
- W3159657177 cites W2625800120 @default.
- W3159657177 cites W2787560479 @default.
- W3159657177 cites W2803832867 @default.
- W3159657177 cites W2946359678 @default.
- W3159657177 cites W2946417913 @default.
- W3159657177 cites W2948947170 @default.
- W3159657177 cites W2953369973 @default.
- W3159657177 cites W2962679290 @default.
- W3159657177 cites W2962767366 @default.
- W3159657177 cites W2962777840 @default.
- W3159657177 cites W2963224980 @default.
- W3159657177 cites W2963341956 @default.
- W3159657177 cites W2964204621 @default.
- W3159657177 cites W2964303116 @default.
- W3159657177 cites W2966753611 @default.
- W3159657177 cites W2970727289 @default.
- W3159657177 cites W2970862333 @default.
- W3159657177 cites W3035305735 @default.
- W3159657177 cites W3097484825 @default.
- W3159657177 cites W3103054319 @default.
- W3159657177 cites W3104097132 @default.
- W3159657177 cites W3105705953 @default.
- W3159657177 cites W3118485687 @default.
- W3159657177 cites W3138301265 @default.
- W3159657177 doi "https://doi.org/10.48550/arxiv.2105.02629" @default.
- W3159657177 hasPublicationYear "2021" @default.
- W3159657177 type Work @default.
- W3159657177 sameAs 3159657177 @default.
- W3159657177 citedByCount "0" @default.
- W3159657177 crossrefType "posted-content" @default.
- W3159657177 hasAuthorship W3159657177A5002316432 @default.
- W3159657177 hasAuthorship W3159657177A5059522548 @default.
- W3159657177 hasBestOaLocation W31596571771 @default.
- W3159657177 hasConcept C104317684 @default.
- W3159657177 hasConcept C138885662 @default.
- W3159657177 hasConcept C154945302 @default.
- W3159657177 hasConcept C185592680 @default.
- W3159657177 hasConcept C204321447 @default.
- W3159657177 hasConcept C41008148 @default.
- W3159657177 hasConcept C41895202 @default.
- W3159657177 hasConcept C53893814 @default.
- W3159657177 hasConcept C55493867 @default.
- W3159657177 hasConcept C66746571 @default.
- W3159657177 hasConceptScore W3159657177C104317684 @default.
- W3159657177 hasConceptScore W3159657177C138885662 @default.
- W3159657177 hasConceptScore W3159657177C154945302 @default.
- W3159657177 hasConceptScore W3159657177C185592680 @default.
- W3159657177 hasConceptScore W3159657177C204321447 @default.
- W3159657177 hasConceptScore W3159657177C41008148 @default.
- W3159657177 hasConceptScore W3159657177C41895202 @default.
- W3159657177 hasConceptScore W3159657177C53893814 @default.
- W3159657177 hasConceptScore W3159657177C55493867 @default.
- W3159657177 hasConceptScore W3159657177C66746571 @default.
- W3159657177 hasLocation W31596571771 @default.
- W3159657177 hasLocation W31596571772 @default.
- W3159657177 hasOpenAccess W3159657177 @default.
- W3159657177 hasPrimaryLocation W31596571771 @default.
- W3159657177 hasRelatedWork W1512634710 @default.
- W3159657177 hasRelatedWork W1512718085 @default.
- W3159657177 hasRelatedWork W1569841287 @default.
- W3159657177 hasRelatedWork W1585034923 @default.
- W3159657177 hasRelatedWork W2167662847 @default.
- W3159657177 hasRelatedWork W2789919619 @default.
- W3159657177 hasRelatedWork W3107474891 @default.
- W3159657177 hasRelatedWork W38394648 @default.
- W3159657177 hasRelatedWork W2594281132 @default.
- W3159657177 hasRelatedWork W2610387714 @default.
- W3159657177 isParatext "false" @default.
- W3159657177 isRetracted "false" @default.
- W3159657177 magId "3159657177" @default.
- W3159657177 workType "article" @default.