Matches in SemOpenAlex for { <https://semopenalex.org/work/W3199227577> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W3199227577 abstract "Transformer-based language models such as BERT have outperformed previous models on a large number of English benchmarks, but their evaluation is often limited to English or a small number of well-resourced languages. In this work, we evaluate monolingual, multilingual, and randomly initialized language models from the BERT family on a variety of Uralic languages including Estonian, Finnish, Hungarian, Erzya, Moksha, Karelian, Livvi, Komi Permyak, Komi Zyrian, Northern Sami, and Skolt Sami. When monolingual models are available (currently only et, fi, hu), these perform better on their native language, but in general they transfer worse than multilingual models or models of genetically unrelated languages that share the same character set. Remarkably, straightforward transfer of high-resource models, even without special efforts toward hyperparameter optimization, yields what appear to be state of the art POS and NER tools for the minority Uralic languages where there is sufficient data for finetuning." @default.
- W3199227577 created "2021-09-27" @default.
- W3199227577 creator A5014685952 @default.
- W3199227577 creator A5018650131 @default.
- W3199227577 creator A5065413313 @default.
- W3199227577 date "2021-09-13" @default.
- W3199227577 modified "2023-09-27" @default.
- W3199227577 title "Evaluating Transferability of BERT Models on Uralic Languages" @default.
- W3199227577 cites W1965299982 @default.
- W3199227577 cites W2021887163 @default.
- W3199227577 cites W2121879602 @default.
- W3199227577 cites W2147838663 @default.
- W3199227577 cites W2405246503 @default.
- W3199227577 cites W2740145017 @default.
- W3199227577 cites W2784566685 @default.
- W3199227577 cites W2908510526 @default.
- W3199227577 cites W2912569021 @default.
- W3199227577 cites W2946676565 @default.
- W3199227577 cites W2963250244 @default.
- W3199227577 cites W2963341956 @default.
- W3199227577 cites W2963403868 @default.
- W3199227577 cites W2963643701 @default.
- W3199227577 cites W2963846996 @default.
- W3199227577 cites W2965373594 @default.
- W3199227577 cites W2970529259 @default.
- W3199227577 cites W2970854433 @default.
- W3199227577 cites W2983040767 @default.
- W3199227577 cites W2995647371 @default.
- W3199227577 cites W2995983139 @default.
- W3199227577 cites W3018647120 @default.
- W3199227577 cites W3087944847 @default.
- W3199227577 cites W3095349973 @default.
- W3199227577 cites W3098824823 @default.
- W3199227577 cites W3136927871 @default.
- W3199227577 cites W3156886841 @default.
- W3199227577 cites W3215499059 @default.
- W3199227577 hasPublicationYear "2021" @default.
- W3199227577 type Work @default.
- W3199227577 sameAs 3199227577 @default.
- W3199227577 citedByCount "0" @default.
- W3199227577 crossrefType "posted-content" @default.
- W3199227577 hasAuthorship W3199227577A5014685952 @default.
- W3199227577 hasAuthorship W3199227577A5018650131 @default.
- W3199227577 hasAuthorship W3199227577A5065413313 @default.
- W3199227577 hasConcept C119857082 @default.
- W3199227577 hasConcept C137293760 @default.
- W3199227577 hasConcept C138885662 @default.
- W3199227577 hasConcept C140331021 @default.
- W3199227577 hasConcept C154945302 @default.
- W3199227577 hasConcept C177264268 @default.
- W3199227577 hasConcept C199360897 @default.
- W3199227577 hasConcept C204321447 @default.
- W3199227577 hasConcept C205649164 @default.
- W3199227577 hasConcept C2776092919 @default.
- W3199227577 hasConcept C41008148 @default.
- W3199227577 hasConcept C41895202 @default.
- W3199227577 hasConcept C61272859 @default.
- W3199227577 hasConcept C8642999 @default.
- W3199227577 hasConceptScore W3199227577C119857082 @default.
- W3199227577 hasConceptScore W3199227577C137293760 @default.
- W3199227577 hasConceptScore W3199227577C138885662 @default.
- W3199227577 hasConceptScore W3199227577C140331021 @default.
- W3199227577 hasConceptScore W3199227577C154945302 @default.
- W3199227577 hasConceptScore W3199227577C177264268 @default.
- W3199227577 hasConceptScore W3199227577C199360897 @default.
- W3199227577 hasConceptScore W3199227577C204321447 @default.
- W3199227577 hasConceptScore W3199227577C205649164 @default.
- W3199227577 hasConceptScore W3199227577C2776092919 @default.
- W3199227577 hasConceptScore W3199227577C41008148 @default.
- W3199227577 hasConceptScore W3199227577C41895202 @default.
- W3199227577 hasConceptScore W3199227577C61272859 @default.
- W3199227577 hasConceptScore W3199227577C8642999 @default.
- W3199227577 hasLocation W31992275771 @default.
- W3199227577 hasOpenAccess W3199227577 @default.
- W3199227577 hasPrimaryLocation W31992275771 @default.
- W3199227577 hasRelatedWork W1420976978 @default.
- W3199227577 hasRelatedWork W1550143991 @default.
- W3199227577 hasRelatedWork W2133152677 @default.
- W3199227577 hasRelatedWork W2199100596 @default.
- W3199227577 hasRelatedWork W2250449185 @default.
- W3199227577 hasRelatedWork W2251310571 @default.
- W3199227577 hasRelatedWork W2295481403 @default.
- W3199227577 hasRelatedWork W2537352332 @default.
- W3199227577 hasRelatedWork W2589235027 @default.
- W3199227577 hasRelatedWork W2591744087 @default.
- W3199227577 hasRelatedWork W2602848778 @default.
- W3199227577 hasRelatedWork W2805384729 @default.
- W3199227577 hasRelatedWork W2993818995 @default.
- W3199227577 hasRelatedWork W2999397914 @default.
- W3199227577 hasRelatedWork W3027825632 @default.
- W3199227577 hasRelatedWork W3036448453 @default.
- W3199227577 hasRelatedWork W3131063663 @default.
- W3199227577 hasRelatedWork W3136927871 @default.
- W3199227577 hasRelatedWork W3186011180 @default.
- W3199227577 hasRelatedWork W2623046484 @default.
- W3199227577 isParatext "false" @default.
- W3199227577 isRetracted "false" @default.
- W3199227577 magId "3199227577" @default.
- W3199227577 workType "article" @default.