Matches in SemOpenAlex for { <https://semopenalex.org/work/W4288804510> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W4288804510 abstract "Large pretrained language models have recently conquered the area of natural language processing. As an alternative to predominant masked language modelling introduced in BERT, the T5 model has introduced a more general training objective, namely sequence to sequence transformation, which includes masked language model but more naturally fits text generation tasks such as machine translation, summarization, question answering, text simplification, dialogue systems, etc. The monolingual variants of T5 models have been limited to well-resourced languages, while the massively multilingual T5 model supports 101 languages. In contrast, we trained two different sized T5-type sequence to sequence models for morphologically rich Slovene language with much less resources and analyzed their behavior on 11 tasks. Concerning classification tasks, the SloT5 models mostly lag behind the monolingual Slovene SloBERTa model but are useful for the generative tasks." @default.
- W4288804510 created "2022-07-30" @default.
- W4288804510 creator A5020021079 @default.
- W4288804510 creator A5056310562 @default.
- W4288804510 date "2022-07-28" @default.
- W4288804510 modified "2023-09-29" @default.
- W4288804510 title "Sequence to sequence pretraining for a less-resourced Slovenian language" @default.
- W4288804510 doi "https://doi.org/10.48550/arxiv.2207.13988" @default.
- W4288804510 hasPublicationYear "2022" @default.
- W4288804510 type Work @default.
- W4288804510 citedByCount "0" @default.
- W4288804510 crossrefType "posted-content" @default.
- W4288804510 hasAuthorship W4288804510A5020021079 @default.
- W4288804510 hasAuthorship W4288804510A5056310562 @default.
- W4288804510 hasBestOaLocation W42888045101 @default.
- W4288804510 hasConcept C104317684 @default.
- W4288804510 hasConcept C137293760 @default.
- W4288804510 hasConcept C138885662 @default.
- W4288804510 hasConcept C154945302 @default.
- W4288804510 hasConcept C170858558 @default.
- W4288804510 hasConcept C185592680 @default.
- W4288804510 hasConcept C203005215 @default.
- W4288804510 hasConcept C204241405 @default.
- W4288804510 hasConcept C204321447 @default.
- W4288804510 hasConcept C2778112365 @default.
- W4288804510 hasConcept C39890363 @default.
- W4288804510 hasConcept C41008148 @default.
- W4288804510 hasConcept C41895202 @default.
- W4288804510 hasConcept C54355233 @default.
- W4288804510 hasConcept C55493867 @default.
- W4288804510 hasConcept C86803240 @default.
- W4288804510 hasConceptScore W4288804510C104317684 @default.
- W4288804510 hasConceptScore W4288804510C137293760 @default.
- W4288804510 hasConceptScore W4288804510C138885662 @default.
- W4288804510 hasConceptScore W4288804510C154945302 @default.
- W4288804510 hasConceptScore W4288804510C170858558 @default.
- W4288804510 hasConceptScore W4288804510C185592680 @default.
- W4288804510 hasConceptScore W4288804510C203005215 @default.
- W4288804510 hasConceptScore W4288804510C204241405 @default.
- W4288804510 hasConceptScore W4288804510C204321447 @default.
- W4288804510 hasConceptScore W4288804510C2778112365 @default.
- W4288804510 hasConceptScore W4288804510C39890363 @default.
- W4288804510 hasConceptScore W4288804510C41008148 @default.
- W4288804510 hasConceptScore W4288804510C41895202 @default.
- W4288804510 hasConceptScore W4288804510C54355233 @default.
- W4288804510 hasConceptScore W4288804510C55493867 @default.
- W4288804510 hasConceptScore W4288804510C86803240 @default.
- W4288804510 hasLocation W42888045101 @default.
- W4288804510 hasOpenAccess W4288804510 @default.
- W4288804510 hasPrimaryLocation W42888045101 @default.
- W4288804510 hasRelatedWork W2747680751 @default.
- W4288804510 hasRelatedWork W2964945503 @default.
- W4288804510 hasRelatedWork W2985347586 @default.
- W4288804510 hasRelatedWork W3088348751 @default.
- W4288804510 hasRelatedWork W3107474891 @default.
- W4288804510 hasRelatedWork W3128216712 @default.
- W4288804510 hasRelatedWork W4226126415 @default.
- W4288804510 hasRelatedWork W4288410200 @default.
- W4288804510 hasRelatedWork W4288804510 @default.
- W4288804510 hasRelatedWork W4313415421 @default.
- W4288804510 isParatext "false" @default.
- W4288804510 isRetracted "false" @default.
- W4288804510 workType "article" @default.