Matches in SemOpenAlex for { <https://semopenalex.org/work/W4200259318> ?p ?o ?g. }
Showing items 1 to 93 of
93
with 100 items per page.
- W4200259318 abstract "Text generation is one of the most important and challenging tasks in NLP, where models have shown a significant performance increase in recent years. However, most generative models are available only for English, whereas low-resource languages like Romanian have no available alternatives. As such, we introduce RoGPT2, a Romanian version of the GPT2 model, trained on the largest corpus available for the Romanian language. Three versions of the model were trained, namely base (124M parameters), medium (354M parameters), and large (774M parameters). Six tasks from the LiRo benchmark were selected to test the performance and limitations of our encoder versus BERT-Base models for Romanian (RoBERT, BERT-ro-base, and RoDiBERT). RoGPT2 manages to achieve similar or even better performance, except for the task of zero-shot learning cross-lingual question answering. RoGPT2 also obtains state-of-the-art results for grammar error correction (RoGEC) using the RONACC corpus, thus arguing for the model’s capability to generate grammatically correct text (F <inf xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>0.5</inf> = 69.01). In addition, we introduce two use cases in which we showcase the different versions and explore the extent to which RoGPT2 is able to continue Romanian news articles. After fine-tuning, the model generated rather long text which accounts for the context of the news." @default.
- W4200259318 created "2021-12-31" @default.
- W4200259318 creator A5072192995 @default.
- W4200259318 creator A5073856277 @default.
- W4200259318 creator A5081056915 @default.
- W4200259318 date "2021-11-01" @default.
- W4200259318 modified "2023-10-18" @default.
- W4200259318 title "RoGPT2: Romanian GPT2 for Text Generation" @default.
- W4200259318 cites W2022647735 @default.
- W4200259318 cites W2157331557 @default.
- W4200259318 cites W2508316494 @default.
- W4200259318 cites W2741494657 @default.
- W4200259318 cites W2963586344 @default.
- W4200259318 cites W2963748441 @default.
- W4200259318 cites W3001434439 @default.
- W4200259318 cites W3102046836 @default.
- W4200259318 cites W3104033643 @default.
- W4200259318 cites W3113952093 @default.
- W4200259318 cites W3114757058 @default.
- W4200259318 cites W3156205246 @default.
- W4200259318 doi "https://doi.org/10.1109/ictai52525.2021.00183" @default.
- W4200259318 hasPublicationYear "2021" @default.
- W4200259318 type Work @default.
- W4200259318 citedByCount "3" @default.
- W4200259318 countsByYear W42002593182022 @default.
- W4200259318 countsByYear W42002593182023 @default.
- W4200259318 crossrefType "proceedings-article" @default.
- W4200259318 hasAuthorship W4200259318A5072192995 @default.
- W4200259318 hasAuthorship W4200259318A5073856277 @default.
- W4200259318 hasAuthorship W4200259318A5081056915 @default.
- W4200259318 hasConcept C111919701 @default.
- W4200259318 hasConcept C118505674 @default.
- W4200259318 hasConcept C129400051 @default.
- W4200259318 hasConcept C13280743 @default.
- W4200259318 hasConcept C134306372 @default.
- W4200259318 hasConcept C137293760 @default.
- W4200259318 hasConcept C138885662 @default.
- W4200259318 hasConcept C151730666 @default.
- W4200259318 hasConcept C154945302 @default.
- W4200259318 hasConcept C162324750 @default.
- W4200259318 hasConcept C185798385 @default.
- W4200259318 hasConcept C187736073 @default.
- W4200259318 hasConcept C204321447 @default.
- W4200259318 hasConcept C205649164 @default.
- W4200259318 hasConcept C26022165 @default.
- W4200259318 hasConcept C2779343474 @default.
- W4200259318 hasConcept C2780451532 @default.
- W4200259318 hasConcept C33923547 @default.
- W4200259318 hasConcept C39890363 @default.
- W4200259318 hasConcept C41008148 @default.
- W4200259318 hasConcept C41895202 @default.
- W4200259318 hasConcept C42058472 @default.
- W4200259318 hasConcept C86803240 @default.
- W4200259318 hasConceptScore W4200259318C111919701 @default.
- W4200259318 hasConceptScore W4200259318C118505674 @default.
- W4200259318 hasConceptScore W4200259318C129400051 @default.
- W4200259318 hasConceptScore W4200259318C13280743 @default.
- W4200259318 hasConceptScore W4200259318C134306372 @default.
- W4200259318 hasConceptScore W4200259318C137293760 @default.
- W4200259318 hasConceptScore W4200259318C138885662 @default.
- W4200259318 hasConceptScore W4200259318C151730666 @default.
- W4200259318 hasConceptScore W4200259318C154945302 @default.
- W4200259318 hasConceptScore W4200259318C162324750 @default.
- W4200259318 hasConceptScore W4200259318C185798385 @default.
- W4200259318 hasConceptScore W4200259318C187736073 @default.
- W4200259318 hasConceptScore W4200259318C204321447 @default.
- W4200259318 hasConceptScore W4200259318C205649164 @default.
- W4200259318 hasConceptScore W4200259318C26022165 @default.
- W4200259318 hasConceptScore W4200259318C2779343474 @default.
- W4200259318 hasConceptScore W4200259318C2780451532 @default.
- W4200259318 hasConceptScore W4200259318C33923547 @default.
- W4200259318 hasConceptScore W4200259318C39890363 @default.
- W4200259318 hasConceptScore W4200259318C41008148 @default.
- W4200259318 hasConceptScore W4200259318C41895202 @default.
- W4200259318 hasConceptScore W4200259318C42058472 @default.
- W4200259318 hasConceptScore W4200259318C86803240 @default.
- W4200259318 hasFunder F4320315989 @default.
- W4200259318 hasLocation W42002593181 @default.
- W4200259318 hasOpenAccess W4200259318 @default.
- W4200259318 hasPrimaryLocation W42002593181 @default.
- W4200259318 hasRelatedWork W2068988742 @default.
- W4200259318 hasRelatedWork W2081647779 @default.
- W4200259318 hasRelatedWork W2351105107 @default.
- W4200259318 hasRelatedWork W2557791779 @default.
- W4200259318 hasRelatedWork W3107474891 @default.
- W4200259318 hasRelatedWork W3185852197 @default.
- W4200259318 hasRelatedWork W3198803088 @default.
- W4200259318 hasRelatedWork W335511412 @default.
- W4200259318 hasRelatedWork W4251332209 @default.
- W4200259318 hasRelatedWork W4323363096 @default.
- W4200259318 isParatext "false" @default.
- W4200259318 isRetracted "false" @default.
- W4200259318 workType "article" @default.