Matches in SemOpenAlex for { <https://semopenalex.org/work/W3200726972> ?p ?o ?g. }
- W3200726972 abstract "Language agnostic and semantic-language information isolation is an emerging research direction for multilingual representations models. We explore this problem from a novel angle of geometric algebra and semantic space. A simple but highly effective method “Language Information Removal (LIR)” factors out language identity information from semantic related components in multilingual representations pre-trained on multi-monolingual data. A post-training and model-agnostic method, LIR only uses simple linear operations, e.g. matrix factorization and orthogonal projection. LIR reveals that for weak-alignment multilingual systems, the principal components of semantic spaces primarily encodes language identity information. We first evaluate the LIR on a cross-lingual question answer retrieval task (LAReQA), which requires the strong alignment for the multilingual embedding space. Experiment shows that LIR is highly effectively on this task, yielding almost 100% relative improvement in MAP for weak-alignment models. We then evaluate the LIR on Amazon Reviews and XEVAL dataset, with the observation that removing language information is able to improve the cross-lingual transfer performance." @default.
- W3200726972 created "2021-09-27" @default.
- W3200726972 creator A5061822097 @default.
- W3200726972 creator A5073726152 @default.
- W3200726972 creator A5075033007 @default.
- W3200726972 creator A5075394091 @default.
- W3200726972 date "2021-01-01" @default.
- W3200726972 modified "2023-09-27" @default.
- W3200726972 title "A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations" @default.
- W3200726972 cites W2014902591 @default.
- W3200726972 cites W2028175314 @default.
- W3200726972 cites W2114524997 @default.
- W3200726972 cites W2160660844 @default.
- W3200726972 cites W2163455955 @default.
- W3200726972 cites W2171068337 @default.
- W3200726972 cites W2250790822 @default.
- W3200726972 cites W2251939518 @default.
- W3200726972 cites W2620558438 @default.
- W3200726972 cites W2752172973 @default.
- W3200726972 cites W2963341956 @default.
- W3200726972 cites W2964073004 @default.
- W3200726972 cites W2964165804 @default.
- W3200726972 cites W2970618241 @default.
- W3200726972 cites W2970719206 @default.
- W3200726972 cites W2987270981 @default.
- W3200726972 cites W3012990076 @default.
- W3200726972 cites W3013840636 @default.
- W3200726972 cites W3034469191 @default.
- W3200726972 cites W3035390927 @default.
- W3200726972 cites W3035497479 @default.
- W3200726972 cites W3038033387 @default.
- W3200726972 cites W3039695075 @default.
- W3200726972 cites W3092973241 @default.
- W3200726972 cites W3094152627 @default.
- W3200726972 cites W3100198908 @default.
- W3200726972 cites W3102455836 @default.
- W3200726972 cites W3105698638 @default.
- W3200726972 cites W3114537677 @default.
- W3200726972 cites W3186903869 @default.
- W3200726972 cites W342285082 @default.
- W3200726972 doi "https://doi.org/10.18653/v1/2021.emnlp-main.470" @default.
- W3200726972 hasPublicationYear "2021" @default.
- W3200726972 type Work @default.
- W3200726972 sameAs 3200726972 @default.
- W3200726972 citedByCount "1" @default.
- W3200726972 countsByYear W32007269722023 @default.
- W3200726972 crossrefType "proceedings-article" @default.
- W3200726972 hasAuthorship W3200726972A5061822097 @default.
- W3200726972 hasAuthorship W3200726972A5073726152 @default.
- W3200726972 hasAuthorship W3200726972A5075033007 @default.
- W3200726972 hasAuthorship W3200726972A5075394091 @default.
- W3200726972 hasBestOaLocation W32007269721 @default.
- W3200726972 hasConcept C111472728 @default.
- W3200726972 hasConcept C111919701 @default.
- W3200726972 hasConcept C11413529 @default.
- W3200726972 hasConcept C12362212 @default.
- W3200726972 hasConcept C137293760 @default.
- W3200726972 hasConcept C138885662 @default.
- W3200726972 hasConcept C154945302 @default.
- W3200726972 hasConcept C162324750 @default.
- W3200726972 hasConcept C187736073 @default.
- W3200726972 hasConcept C204321447 @default.
- W3200726972 hasConcept C2524010 @default.
- W3200726972 hasConcept C2778572836 @default.
- W3200726972 hasConcept C2780451532 @default.
- W3200726972 hasConcept C2780586882 @default.
- W3200726972 hasConcept C33923547 @default.
- W3200726972 hasConcept C41008148 @default.
- W3200726972 hasConcept C41608201 @default.
- W3200726972 hasConcept C57493831 @default.
- W3200726972 hasConceptScore W3200726972C111472728 @default.
- W3200726972 hasConceptScore W3200726972C111919701 @default.
- W3200726972 hasConceptScore W3200726972C11413529 @default.
- W3200726972 hasConceptScore W3200726972C12362212 @default.
- W3200726972 hasConceptScore W3200726972C137293760 @default.
- W3200726972 hasConceptScore W3200726972C138885662 @default.
- W3200726972 hasConceptScore W3200726972C154945302 @default.
- W3200726972 hasConceptScore W3200726972C162324750 @default.
- W3200726972 hasConceptScore W3200726972C187736073 @default.
- W3200726972 hasConceptScore W3200726972C204321447 @default.
- W3200726972 hasConceptScore W3200726972C2524010 @default.
- W3200726972 hasConceptScore W3200726972C2778572836 @default.
- W3200726972 hasConceptScore W3200726972C2780451532 @default.
- W3200726972 hasConceptScore W3200726972C2780586882 @default.
- W3200726972 hasConceptScore W3200726972C33923547 @default.
- W3200726972 hasConceptScore W3200726972C41008148 @default.
- W3200726972 hasConceptScore W3200726972C41608201 @default.
- W3200726972 hasConceptScore W3200726972C57493831 @default.
- W3200726972 hasLocation W32007269721 @default.
- W3200726972 hasLocation W32007269722 @default.
- W3200726972 hasOpenAccess W3200726972 @default.
- W3200726972 hasPrimaryLocation W32007269721 @default.
- W3200726972 hasRelatedWork W1989705153 @default.
- W3200726972 hasRelatedWork W1995844989 @default.
- W3200726972 hasRelatedWork W2037681520 @default.
- W3200726972 hasRelatedWork W2081647779 @default.
- W3200726972 hasRelatedWork W2359001871 @default.
- W3200726972 hasRelatedWork W2789919619 @default.
- W3200726972 hasRelatedWork W2794358477 @default.
- W3200726972 hasRelatedWork W3038046972 @default.