FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3091798082> ?p ?o ?g. }

• W3091798082 abstract "Multilingual contextual embeddings have demonstrated state-of-the-art performance in zero-shot cross-lingual transfer learning, where multilingual BERT is fine-tuned on one source language and evaluated on a different target language. However, published results for mBERT zero-shot accuracy vary as much as 17 points on the MLDoc classification task across four papers. We show that the standard practice of using English dev accuracy for model selection in the zero-shot setting makes it difficult to obtain reproducible results on the MLDoc and XNLI tasks. English dev accuracy is often uncorrelated (or even anti-correlated) with target language accuracy, and zero-shot performance varies greatly at different points in the same fine-tuning run and between different fine-tuning runs. These reproducibility issues are also present for other tasks with different pre-trained embeddings (e.g., MLQA with XLM-R). We recommend providing oracle scores alongside zero-shot results: still fine-tune using English data, but choose a checkpoint with the target dev set. Reporting this upper bound makes results more consistent by avoiding arbitrarily bad checkpoints." @default.
• W3091798082 created "2020-10-15" @default.
• W3091798082 creator A5034797164 @default.
• W3091798082 creator A5037283647 @default.
• W3091798082 creator A5073224570 @default.
• W3091798082 creator A5089283502 @default.
• W3091798082 date "2020-04-30" @default.
• W3091798082 modified "2023-10-17" @default.
• W3091798082 title "Don't Use English Dev: On the Zero-Shot Cross-Lingual Evaluation of Contextual Embeddings" @default.
• W3091798082 cites W2560647685 @default.
• W3091798082 cites W2891555348 @default.
• W3091798082 cites W2952354317 @default.
• W3091798082 cites W2952638691 @default.
• W3091798082 cites W2953109491 @default.
• W3091798082 cites W2962824887 @default.
• W3091798082 cites W2963341956 @default.
• W3091798082 cites W2963602293 @default.
• W3091798082 cites W2963721344 @default.
• W3091798082 cites W2963748792 @default.
• W3091798082 cites W2970189355 @default.
• W3091798082 cites W2970193165 @default.
• W3091798082 cites W2970752815 @default.
• W3091798082 cites W2970854433 @default.
• W3091798082 cites W2971105085 @default.
• W3091798082 cites W3008618223 @default.
• W3091798082 cites W3009586901 @default.
• W3091798082 cites W3014635508 @default.
• W3091798082 cites W3023125906 @default.
• W3091798082 cites W3030045039 @default.
• W3091798082 cites W3034469191 @default.
• W3091798082 cites W3035390927 @default.
• W3091798082 cites W3035497479 @default.
• W3091798082 cites W3036272385 @default.
• W3091798082 cites W3102483398 @default.
• W3091798082 hasPublicationYear "2020" @default.
• W3091798082 type Work @default.
• W3091798082 sameAs 3091798082 @default.
• W3091798082 citedByCount "1" @default.
• W3091798082 countsByYear W30917980822020 @default.
• W3091798082 crossrefType "posted-content" @default.
• W3091798082 hasAuthorship W3091798082A5034797164 @default.
• W3091798082 hasAuthorship W3091798082A5037283647 @default.
• W3091798082 hasAuthorship W3091798082A5073224570 @default.
• W3091798082 hasAuthorship W3091798082A5089283502 @default.
• W3091798082 hasConcept C105795698 @default.
• W3091798082 hasConcept C11413529 @default.
• W3091798082 hasConcept C115903868 @default.
• W3091798082 hasConcept C120665830 @default.
• W3091798082 hasConcept C121332964 @default.
• W3091798082 hasConcept C127413603 @default.
• W3091798082 hasConcept C138885662 @default.
• W3091798082 hasConcept C154945302 @default.
• W3091798082 hasConcept C162324750 @default.
• W3091798082 hasConcept C169345407 @default.
• W3091798082 hasConcept C177264268 @default.
• W3091798082 hasConcept C178790620 @default.
• W3091798082 hasConcept C185592680 @default.
• W3091798082 hasConcept C187736073 @default.
• W3091798082 hasConcept C199360897 @default.
• W3091798082 hasConcept C204321447 @default.
• W3091798082 hasConcept C2778344882 @default.
• W3091798082 hasConcept C2780451532 @default.
• W3091798082 hasConcept C2780813799 @default.
• W3091798082 hasConcept C2992734406 @default.
• W3091798082 hasConcept C3019835501 @default.
• W3091798082 hasConcept C33923547 @default.
• W3091798082 hasConcept C41008148 @default.
• W3091798082 hasConcept C41895202 @default.
• W3091798082 hasConcept C55166926 @default.
• W3091798082 hasConcept C78519656 @default.
• W3091798082 hasConceptScore W3091798082C105795698 @default.
• W3091798082 hasConceptScore W3091798082C11413529 @default.
• W3091798082 hasConceptScore W3091798082C115903868 @default.
• W3091798082 hasConceptScore W3091798082C120665830 @default.
• W3091798082 hasConceptScore W3091798082C121332964 @default.
• W3091798082 hasConceptScore W3091798082C127413603 @default.
• W3091798082 hasConceptScore W3091798082C138885662 @default.
• W3091798082 hasConceptScore W3091798082C154945302 @default.
• W3091798082 hasConceptScore W3091798082C162324750 @default.
• W3091798082 hasConceptScore W3091798082C169345407 @default.
• W3091798082 hasConceptScore W3091798082C177264268 @default.
• W3091798082 hasConceptScore W3091798082C178790620 @default.
• W3091798082 hasConceptScore W3091798082C185592680 @default.
• W3091798082 hasConceptScore W3091798082C187736073 @default.
• W3091798082 hasConceptScore W3091798082C199360897 @default.
• W3091798082 hasConceptScore W3091798082C204321447 @default.
• W3091798082 hasConceptScore W3091798082C2778344882 @default.
• W3091798082 hasConceptScore W3091798082C2780451532 @default.
• W3091798082 hasConceptScore W3091798082C2780813799 @default.
• W3091798082 hasConceptScore W3091798082C2992734406 @default.
• W3091798082 hasConceptScore W3091798082C3019835501 @default.
• W3091798082 hasConceptScore W3091798082C33923547 @default.
• W3091798082 hasConceptScore W3091798082C41008148 @default.
• W3091798082 hasConceptScore W3091798082C41895202 @default.
• W3091798082 hasConceptScore W3091798082C55166926 @default.
• W3091798082 hasConceptScore W3091798082C78519656 @default.
• W3091798082 hasLocation W30917980821 @default.
• W3091798082 hasOpenAccess W3091798082 @default.
• W3091798082 hasPrimaryLocation W30917980821 @default.
• W3091798082 hasRelatedWork W2033268831 @default.

• next