FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3213569904> ?p ?o ?g. }

• W3213569904 endingPage "2412" @default.
• W3213569904 startingPage "2400" @default.
• W3213569904 abstract "Language use differs between domains and even within a domain, language use changes over time. For pre-trained language models like BERT, domain adaptation through continued pre-training has been shown to improve performance on in-domain downstream tasks. In this article, we investigate whether temporal adaptation can bring additional benefits. For this purpose, we introduce a corpus of social media comments sampled over three years. It contains unlabelled data for adaptation and evaluation on an upstream masked language modelling task as well as labelled data for fine-tuning and evaluation on a downstream document classification task. We find that temporality matters for both tasks: temporal adaptation improves upstream and temporal fine-tuning downstream task performance. Time-specific models generally perform better on past than on future test sets, which matches evidence on the bursty usage of topical words. However, adapting BERT to time and domain does not improve performance on the downstream task over only adapting to domain. Token-level analysis shows that temporal adaptation captures event-driven changes in language use in the downstream task, but not those changes that are actually relevant to task performance. Based on our findings, we discuss when temporal adaptation may be more effective." @default.
• W3213569904 created "2021-11-22" @default.
• W3213569904 creator A5049920688 @default.
• W3213569904 creator A5050023117 @default.
• W3213569904 date "2021-11-01" @default.
• W3213569904 modified "2023-09-26" @default.
• W3213569904 title "Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media" @default.
• W3213569904 cites W1880262756 @default.
• W3213569904 cites W194380233 @default.
• W3213569904 cites W1975690018 @default.
• W3213569904 cites W2086661708 @default.
• W3213569904 cites W2251617662 @default.
• W3213569904 cites W2251738400 @default.
• W3213569904 cites W2340954483 @default.
• W3213569904 cites W2538660910 @default.
• W3213569904 cites W2788802649 @default.
• W3213569904 cites W2798837230 @default.
• W3213569904 cites W2799068938 @default.
• W3213569904 cites W2900167100 @default.
• W3213569904 cites W2908510526 @default.
• W3213569904 cites W2911227954 @default.
• W3213569904 cites W2911489562 @default.
• W3213569904 cites W2936652946 @default.
• W3213569904 cites W2937845937 @default.
• W3213569904 cites W2945808907 @default.
• W3213569904 cites W2949573100 @default.
• W3213569904 cites W2955109214 @default.
• W3213569904 cites W2963099212 @default.
• W3213569904 cites W2963341956 @default.
• W3213569904 cites W2963562560 @default.
• W3213569904 cites W2963716420 @default.
• W3213569904 cites W2963780471 @default.
• W3213569904 cites W2963834345 @default.
• W3213569904 cites W2970771982 @default.
• W3213569904 cites W3034238904 @default.
• W3213569904 cites W3036074945 @default.
• W3213569904 cites W3037528277 @default.
• W3213569904 cites W3106061119 @default.
• W3213569904 cites W3117461888 @default.
• W3213569904 cites W3152669093 @default.
• W3213569904 cites W3175236579 @default.
• W3213569904 cites W3187758092 @default.
• W3213569904 hasPublicationYear "2021" @default.
• W3213569904 type Work @default.
• W3213569904 sameAs 3213569904 @default.
• W3213569904 citedByCount "0" @default.
• W3213569904 crossrefType "proceedings-article" @default.
• W3213569904 hasAuthorship W3213569904A5049920688 @default.
• W3213569904 hasAuthorship W3213569904A5050023117 @default.
• W3213569904 hasConcept C111472728 @default.
• W3213569904 hasConcept C134306372 @default.
• W3213569904 hasConcept C137293760 @default.
• W3213569904 hasConcept C138885662 @default.
• W3213569904 hasConcept C139807058 @default.
• W3213569904 hasConcept C141679102 @default.
• W3213569904 hasConcept C154945302 @default.
• W3213569904 hasConcept C15744967 @default.
• W3213569904 hasConcept C162324750 @default.
• W3213569904 hasConcept C169760540 @default.
• W3213569904 hasConcept C175154964 @default.
• W3213569904 hasConcept C187736073 @default.
• W3213569904 hasConcept C191172861 @default.
• W3213569904 hasConcept C204321447 @default.
• W3213569904 hasConcept C21547014 @default.
• W3213569904 hasConcept C2776207758 @default.
• W3213569904 hasConcept C2776434776 @default.
• W3213569904 hasConcept C2780451532 @default.
• W3213569904 hasConcept C31258907 @default.
• W3213569904 hasConcept C33923547 @default.
• W3213569904 hasConcept C36503486 @default.
• W3213569904 hasConcept C38652104 @default.
• W3213569904 hasConcept C41008148 @default.
• W3213569904 hasConcept C48145219 @default.
• W3213569904 hasConcept C95623464 @default.
• W3213569904 hasConceptScore W3213569904C111472728 @default.
• W3213569904 hasConceptScore W3213569904C134306372 @default.
• W3213569904 hasConceptScore W3213569904C137293760 @default.
• W3213569904 hasConceptScore W3213569904C138885662 @default.
• W3213569904 hasConceptScore W3213569904C139807058 @default.
• W3213569904 hasConceptScore W3213569904C141679102 @default.
• W3213569904 hasConceptScore W3213569904C154945302 @default.
• W3213569904 hasConceptScore W3213569904C15744967 @default.
• W3213569904 hasConceptScore W3213569904C162324750 @default.
• W3213569904 hasConceptScore W3213569904C169760540 @default.
• W3213569904 hasConceptScore W3213569904C175154964 @default.
• W3213569904 hasConceptScore W3213569904C187736073 @default.
• W3213569904 hasConceptScore W3213569904C191172861 @default.
• W3213569904 hasConceptScore W3213569904C204321447 @default.
• W3213569904 hasConceptScore W3213569904C21547014 @default.
• W3213569904 hasConceptScore W3213569904C2776207758 @default.
• W3213569904 hasConceptScore W3213569904C2776434776 @default.
• W3213569904 hasConceptScore W3213569904C2780451532 @default.
• W3213569904 hasConceptScore W3213569904C31258907 @default.
• W3213569904 hasConceptScore W3213569904C33923547 @default.
• W3213569904 hasConceptScore W3213569904C36503486 @default.
• W3213569904 hasConceptScore W3213569904C38652104 @default.
• W3213569904 hasConceptScore W3213569904C41008148 @default.
• W3213569904 hasConceptScore W3213569904C48145219 @default.

• next