Matches in SemOpenAlex for { <https://semopenalex.org/work/W3180299705> ?p ?o ?g. }
- W3180299705 abstract "Multilingual Language Models (MLLMs) such as mBERT, XLM, XLM-R, textit{etc.} have emerged as a viable option for bringing the power of pretraining to a large number of languages. Given their success in zero shot transfer learning, there has emerged a large body of work in (i) building bigger MLLMs covering a large number of languages (ii) creating exhaustive benchmarks covering a wider variety of tasks and languages for evaluating MLLMs (iii) analysing the performance of MLLMs on monolingual, zero shot crosslingual and bilingual tasks (iv) understanding the universal language patterns (if any) learnt by MLLMs and (v) augmenting the (often) limited capacity of MLLMs to improve their performance on seen or even unseen languages. In this survey, we review the existing literature covering the above broad areas of research pertaining to MLLMs. Based on our survey, we recommend some promising directions of future research." @default.
- W3180299705 created "2021-07-19" @default.
- W3180299705 creator A5030945392 @default.
- W3180299705 creator A5031718651 @default.
- W3180299705 creator A5050036814 @default.
- W3180299705 creator A5052909911 @default.
- W3180299705 creator A5078774993 @default.
- W3180299705 date "2021-07-01" @default.
- W3180299705 modified "2023-09-24" @default.
- W3180299705 title "A Primer on Pretrained Multilingual Language Models" @default.
- W3180299705 cites W131533222 @default.
- W3180299705 cites W2006969979 @default.
- W3180299705 cites W2121879602 @default.
- W3180299705 cites W2126725946 @default.
- W3180299705 cites W2144578941 @default.
- W3180299705 cites W2148708890 @default.
- W3180299705 cites W2251939518 @default.
- W3180299705 cites W2525778437 @default.
- W3180299705 cites W2538358357 @default.
- W3180299705 cites W2742155240 @default.
- W3180299705 cites W2842511635 @default.
- W3180299705 cites W2915429162 @default.
- W3180299705 cites W2946794439 @default.
- W3180299705 cites W2962784628 @default.
- W3180299705 cites W2962869940 @default.
- W3180299705 cites W2963211188 @default.
- W3180299705 cites W2963216553 @default.
- W3180299705 cites W2963223306 @default.
- W3180299705 cites W2963250244 @default.
- W3180299705 cites W2963310665 @default.
- W3180299705 cites W2963341956 @default.
- W3180299705 cites W2963403868 @default.
- W3180299705 cites W2963633299 @default.
- W3180299705 cites W2963721344 @default.
- W3180299705 cites W2963846996 @default.
- W3180299705 cites W2964303773 @default.
- W3180299705 cites W2964308564 @default.
- W3180299705 cites W2965373594 @default.
- W3180299705 cites W2970193165 @default.
- W3180299705 cites W2970752815 @default.
- W3180299705 cites W2970850076 @default.
- W3180299705 cites W2970854433 @default.
- W3180299705 cites W2971863715 @default.
- W3180299705 cites W2983836503 @default.
- W3180299705 cites W2985620815 @default.
- W3180299705 cites W2987270981 @default.
- W3180299705 cites W2989276524 @default.
- W3180299705 cites W2994885767 @default.
- W3180299705 cites W2994928925 @default.
- W3180299705 cites W2995015695 @default.
- W3180299705 cites W2995118574 @default.
- W3180299705 cites W2995647371 @default.
- W3180299705 cites W2996822578 @default.
- W3180299705 cites W3016562905 @default.
- W3180299705 cites W3022583179 @default.
- W3180299705 cites W3023133114 @default.
- W3180299705 cites W3030175377 @default.
- W3180299705 cites W3030394039 @default.
- W3180299705 cites W3032388710 @default.
- W3180299705 cites W3032532958 @default.
- W3180299705 cites W3034469191 @default.
- W3180299705 cites W3034949522 @default.
- W3180299705 cites W3035032094 @default.
- W3180299705 cites W3035137491 @default.
- W3180299705 cites W3035390927 @default.
- W3180299705 cites W3035463087 @default.
- W3180299705 cites W3035497479 @default.
- W3180299705 cites W3035524453 @default.
- W3180299705 cites W3035547806 @default.
- W3180299705 cites W3042381743 @default.
- W3180299705 cites W3042711927 @default.
- W3180299705 cites W3045462440 @default.
- W3180299705 cites W3051275803 @default.
- W3180299705 cites W3085139254 @default.
- W3180299705 cites W3087873698 @default.
- W3180299705 cites W3088382025 @default.
- W3180299705 cites W3095349973 @default.
- W3180299705 cites W3097879195 @default.
- W3180299705 cites W3098466758 @default.
- W3180299705 cites W3098604850 @default.
- W3180299705 cites W3099004917 @default.
- W3180299705 cites W3099771192 @default.
- W3180299705 cites W3099793224 @default.
- W3180299705 cites W3099919888 @default.
- W3180299705 cites W3100198908 @default.
- W3180299705 cites W3100308117 @default.
- W3180299705 cites W3101498587 @default.
- W3180299705 cites W3102455836 @default.
- W3180299705 cites W3102483398 @default.
- W3180299705 cites W3103490574 @default.
- W3180299705 cites W3104033643 @default.
- W3180299705 cites W3104329353 @default.
- W3180299705 cites W3104881680 @default.
- W3180299705 cites W3105190698 @default.
- W3180299705 cites W3105220303 @default.
- W3180299705 cites W3105421296 @default.
- W3180299705 cites W3105813095 @default.
- W3180299705 cites W3107826490 @default.
- W3180299705 cites W3112302586 @default.
- W3180299705 cites W3115224631 @default.