Matches in SemOpenAlex for { <https://semopenalex.org/work/W3095224541> ?p ?o ?g. }
- W3095224541 abstract "In this paper, we introduce an advanced Russian general language understanding evaluation benchmark -- RussianGLUE. Recent advances in the field of universal language models and transformers require the development of a methodology for their broad diagnostics and testing for general intellectual skills - detection of natural language inference, commonsense reasoning, ability to perform simple logical operations regardless of text subject or lexicon. For the first time, a benchmark of nine tasks, collected and organized analogically to the SuperGLUE methodology, was developed from scratch for the Russian language. We provide baselines, human level evaluation, an open-source framework for evaluating models (this https URL), and an overall leaderboard of transformer models for the Russian language. Besides, we present the first results of comparing multilingual models in the adapted diagnostic test set and offer the first steps to further expanding or assessing state-of-the-art models independently of language." @default.
- W3095224541 created "2020-11-09" @default.
- W3095224541 creator A5001784131 @default.
- W3095224541 creator A5002782799 @default.
- W3095224541 creator A5006755109 @default.
- W3095224541 creator A5012399568 @default.
- W3095224541 creator A5037825255 @default.
- W3095224541 creator A5059438258 @default.
- W3095224541 creator A5062209350 @default.
- W3095224541 creator A5071539494 @default.
- W3095224541 creator A5079740967 @default.
- W3095224541 creator A5083490320 @default.
- W3095224541 date "2020-10-29" @default.
- W3095224541 modified "2023-09-26" @default.
- W3095224541 title "RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark" @default.
- W3095224541 cites W1599016936 @default.
- W3095224541 cites W2101234009 @default.
- W3095224541 cites W2772460218 @default.
- W3095224541 cites W2790235966 @default.
- W3095224541 cites W2804897457 @default.
- W3095224541 cites W2809324505 @default.
- W3095224541 cites W2898662126 @default.
- W3095224541 cites W2946659172 @default.
- W3095224541 cites W2946676565 @default.
- W3095224541 cites W2952638691 @default.
- W3095224541 cites W2963310665 @default.
- W3095224541 cites W2963341956 @default.
- W3095224541 cites W2970120757 @default.
- W3095224541 cites W2971019533 @default.
- W3095224541 cites W2971044268 @default.
- W3095224541 cites W2981852735 @default.
- W3095224541 cites W2990704537 @default.
- W3095224541 cites W3013840636 @default.
- W3095224541 cites W3032532958 @default.
- W3095224541 cites W3102483398 @default.
- W3095224541 hasPublicationYear "2020" @default.
- W3095224541 type Work @default.
- W3095224541 sameAs 3095224541 @default.
- W3095224541 citedByCount "4" @default.
- W3095224541 countsByYear W30952245412020 @default.
- W3095224541 countsByYear W30952245412021 @default.
- W3095224541 crossrefType "posted-content" @default.
- W3095224541 hasAuthorship W3095224541A5001784131 @default.
- W3095224541 hasAuthorship W3095224541A5002782799 @default.
- W3095224541 hasAuthorship W3095224541A5006755109 @default.
- W3095224541 hasAuthorship W3095224541A5012399568 @default.
- W3095224541 hasAuthorship W3095224541A5037825255 @default.
- W3095224541 hasAuthorship W3095224541A5059438258 @default.
- W3095224541 hasAuthorship W3095224541A5062209350 @default.
- W3095224541 hasAuthorship W3095224541A5071539494 @default.
- W3095224541 hasAuthorship W3095224541A5079740967 @default.
- W3095224541 hasAuthorship W3095224541A5083490320 @default.
- W3095224541 hasConcept C121332964 @default.
- W3095224541 hasConcept C129353971 @default.
- W3095224541 hasConcept C13280743 @default.
- W3095224541 hasConcept C137293760 @default.
- W3095224541 hasConcept C154945302 @default.
- W3095224541 hasConcept C165801399 @default.
- W3095224541 hasConcept C185798385 @default.
- W3095224541 hasConcept C195324797 @default.
- W3095224541 hasConcept C199360897 @default.
- W3095224541 hasConcept C204321447 @default.
- W3095224541 hasConcept C205649164 @default.
- W3095224541 hasConcept C2776214188 @default.
- W3095224541 hasConcept C2778121359 @default.
- W3095224541 hasConcept C2983448237 @default.
- W3095224541 hasConcept C41008148 @default.
- W3095224541 hasConcept C62520636 @default.
- W3095224541 hasConcept C66322947 @default.
- W3095224541 hasConcept C83479923 @default.
- W3095224541 hasConceptScore W3095224541C121332964 @default.
- W3095224541 hasConceptScore W3095224541C129353971 @default.
- W3095224541 hasConceptScore W3095224541C13280743 @default.
- W3095224541 hasConceptScore W3095224541C137293760 @default.
- W3095224541 hasConceptScore W3095224541C154945302 @default.
- W3095224541 hasConceptScore W3095224541C165801399 @default.
- W3095224541 hasConceptScore W3095224541C185798385 @default.
- W3095224541 hasConceptScore W3095224541C195324797 @default.
- W3095224541 hasConceptScore W3095224541C199360897 @default.
- W3095224541 hasConceptScore W3095224541C204321447 @default.
- W3095224541 hasConceptScore W3095224541C205649164 @default.
- W3095224541 hasConceptScore W3095224541C2776214188 @default.
- W3095224541 hasConceptScore W3095224541C2778121359 @default.
- W3095224541 hasConceptScore W3095224541C2983448237 @default.
- W3095224541 hasConceptScore W3095224541C41008148 @default.
- W3095224541 hasConceptScore W3095224541C62520636 @default.
- W3095224541 hasConceptScore W3095224541C66322947 @default.
- W3095224541 hasConceptScore W3095224541C83479923 @default.
- W3095224541 hasLocation W30952245411 @default.
- W3095224541 hasOpenAccess W3095224541 @default.
- W3095224541 hasPrimaryLocation W30952245411 @default.
- W3095224541 hasRelatedWork W125816299 @default.
- W3095224541 hasRelatedWork W136634297 @default.
- W3095224541 hasRelatedWork W1519739771 @default.
- W3095224541 hasRelatedWork W1904228841 @default.
- W3095224541 hasRelatedWork W1928971333 @default.
- W3095224541 hasRelatedWork W1989661187 @default.
- W3095224541 hasRelatedWork W2022325029 @default.
- W3095224541 hasRelatedWork W2130031070 @default.
- W3095224541 hasRelatedWork W2136202293 @default.