Matches in SemOpenAlex for { <https://semopenalex.org/work/W3129912700> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W3129912700 abstract "The monolingual Slovene RoBERTa (A Robustly Optimized Bidirectional Encoder Representations from Transformers) model is a state-of-the-art model representing words/tokens as contextually dependent word embeddings, used for various NLP tasks. Word embeddings can be extracted for every word occurrence and then used in training a model for an end task, but typically the whole RoBERTa model is fine-tuned end-to-end.SloBERTa model is closely related to French Camembert model https://camembert-model.fr/. The corpora used for training the model have 3.47 billion tokens in total. The subword vocabulary contains 32,000 tokens. The scripts and programs used for data preparation and training the model are available on https://github.com/clarinsi/Slovene-BERT-ToolCompared with the previous version (1.0), this version was trained for further 61 epochs (v1.0 37 epochs, v2.0 98 epochs), for a total of 200,000 iterations/updates.The released model here is a pytorch neural network model, intended for usage with the transformers library https://github.com/huggingface/transformers (sloberta.2.0.transformers.tar.gz) or fairseq library https://github.com/pytorch/fairseq (sloberta.2.0.fairseq.tar.gz)" @default.
- W3129912700 created "2021-03-01" @default.
- W3129912700 creator A5020021079 @default.
- W3129912700 creator A5056310562 @default.
- W3129912700 date "2021-01-17" @default.
- W3129912700 modified "2023-09-28" @default.
- W3129912700 title "Slovenian RoBERTa contextual embeddings model: SloBERTa 2.0" @default.
- W3129912700 hasPublicationYear "2021" @default.
- W3129912700 type Work @default.
- W3129912700 sameAs 3129912700 @default.
- W3129912700 citedByCount "0" @default.
- W3129912700 crossrefType "journal-article" @default.
- W3129912700 hasAuthorship W3129912700A5020021079 @default.
- W3129912700 hasAuthorship W3129912700A5056310562 @default.
- W3129912700 hasConcept C111919701 @default.
- W3129912700 hasConcept C118505674 @default.
- W3129912700 hasConcept C121332964 @default.
- W3129912700 hasConcept C137293760 @default.
- W3129912700 hasConcept C138885662 @default.
- W3129912700 hasConcept C154945302 @default.
- W3129912700 hasConcept C165801399 @default.
- W3129912700 hasConcept C199360897 @default.
- W3129912700 hasConcept C204321447 @default.
- W3129912700 hasConcept C2777601683 @default.
- W3129912700 hasConcept C28490314 @default.
- W3129912700 hasConcept C41008148 @default.
- W3129912700 hasConcept C41895202 @default.
- W3129912700 hasConcept C50644808 @default.
- W3129912700 hasConcept C61423126 @default.
- W3129912700 hasConcept C62520636 @default.
- W3129912700 hasConcept C66322947 @default.
- W3129912700 hasConcept C90805587 @default.
- W3129912700 hasConceptScore W3129912700C111919701 @default.
- W3129912700 hasConceptScore W3129912700C118505674 @default.
- W3129912700 hasConceptScore W3129912700C121332964 @default.
- W3129912700 hasConceptScore W3129912700C137293760 @default.
- W3129912700 hasConceptScore W3129912700C138885662 @default.
- W3129912700 hasConceptScore W3129912700C154945302 @default.
- W3129912700 hasConceptScore W3129912700C165801399 @default.
- W3129912700 hasConceptScore W3129912700C199360897 @default.
- W3129912700 hasConceptScore W3129912700C204321447 @default.
- W3129912700 hasConceptScore W3129912700C2777601683 @default.
- W3129912700 hasConceptScore W3129912700C28490314 @default.
- W3129912700 hasConceptScore W3129912700C41008148 @default.
- W3129912700 hasConceptScore W3129912700C41895202 @default.
- W3129912700 hasConceptScore W3129912700C50644808 @default.
- W3129912700 hasConceptScore W3129912700C61423126 @default.
- W3129912700 hasConceptScore W3129912700C62520636 @default.
- W3129912700 hasConceptScore W3129912700C66322947 @default.
- W3129912700 hasConceptScore W3129912700C90805587 @default.
- W3129912700 hasLocation W31299127001 @default.
- W3129912700 hasOpenAccess W3129912700 @default.
- W3129912700 hasPrimaryLocation W31299127001 @default.
- W3129912700 hasRelatedWork W2118090838 @default.
- W3129912700 hasRelatedWork W2466291125 @default.
- W3129912700 hasRelatedWork W2501758317 @default.
- W3129912700 hasRelatedWork W2503522607 @default.
- W3129912700 hasRelatedWork W2673116624 @default.
- W3129912700 hasRelatedWork W2912918913 @default.
- W3129912700 hasRelatedWork W2921972128 @default.
- W3129912700 hasRelatedWork W2946267400 @default.
- W3129912700 hasRelatedWork W2969688307 @default.
- W3129912700 hasRelatedWork W2973088264 @default.
- W3129912700 hasRelatedWork W2998278558 @default.
- W3129912700 hasRelatedWork W3031082191 @default.
- W3129912700 hasRelatedWork W3090900859 @default.
- W3129912700 hasRelatedWork W3107535086 @default.
- W3129912700 hasRelatedWork W3122459310 @default.
- W3129912700 hasRelatedWork W3153132431 @default.
- W3129912700 hasRelatedWork W3159183446 @default.
- W3129912700 hasRelatedWork W3184609040 @default.
- W3129912700 hasRelatedWork W3204309793 @default.
- W3129912700 hasRelatedWork W3089244126 @default.
- W3129912700 isParatext "false" @default.
- W3129912700 isRetracted "false" @default.
- W3129912700 magId "3129912700" @default.
- W3129912700 workType "article" @default.