FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3197296686> ?p ?o ?g. }

• W3197296686 abstract "The rise of pre-trained language models has yielded substantial progress in the vast majority of Natural Language Processing (NLP) tasks. However, a generic approach towards the pre-training procedure can naturally be sub-optimal in some cases. Particularly, fine-tuning a pre-trained language model on a source domain and then applying it to a different target domain, results in a sharp performance decline of the eventual classifier for many source-target domain pairs. Moreover, in some NLP tasks, the output categories substantially differ between domains, making adaptation even more challenging. This, for example, happens in the task of aspect extraction, where the aspects of interest of reviews of, e.g., restaurants or electronic devices may be very different. This paper presents a new fine-tuning scheme for BERT, which aims to address the above challenges. We name this scheme DILBERT: Domain Invariant Learning with BERT, and customize it for aspect extraction in the unsupervised domain adaptation setting. DILBERT harnesses the categorical information of both the source and the target domains to guide the pre-training process towards a more domain and category invariant representation, thus closing the gap between the domains. We show that DILBERT yields substantial improvements over state-of-the-art baselines while using a fraction of the unlabeled data, particularly in more challenging domain adaptation setups." @default.
• W3197296686 created "2021-09-13" @default.
• W3197296686 creator A5003744048 @default.
• W3197296686 creator A5054952724 @default.
• W3197296686 creator A5063658122 @default.
• W3197296686 date "2021-09-01" @default.
• W3197296686 modified "2023-09-27" @default.
• W3197296686 title "DILBERT: Customized Pre-Training for Domain Adaptation withCategory Shift, with an Application to Aspect Extraction" @default.
• W3197296686 cites W1517771839 @default.
• W3197296686 cites W1731081199 @default.
• W3197296686 cites W1859957297 @default.
• W3197296686 cites W2027731328 @default.
• W3197296686 cites W2096873754 @default.
• W3197296686 cites W2097606805 @default.
• W3197296686 cites W2100362224 @default.
• W3197296686 cites W2105523772 @default.
• W3197296686 cites W2120354757 @default.
• W3197296686 cites W2131953535 @default.
• W3197296686 cites W2148034183 @default.
• W3197296686 cites W2158108973 @default.
• W3197296686 cites W2159457224 @default.
• W3197296686 cites W2163302275 @default.
• W3197296686 cites W2215421138 @default.
• W3197296686 cites W2251294039 @default.
• W3197296686 cites W2251648804 @default.
• W3197296686 cites W2252024663 @default.
• W3197296686 cites W2604356472 @default.
• W3197296686 cites W2803777992 @default.
• W3197296686 cites W2889720764 @default.
• W3197296686 cites W2908510526 @default.
• W3197296686 cites W2925618549 @default.
• W3197296686 cites W2949821452 @default.
• W3197296686 cites W2953217208 @default.
• W3197296686 cites W2962750142 @default.
• W3197296686 cites W2962843214 @default.
• W3197296686 cites W2963341956 @default.
• W3197296686 cites W2963403868 @default.
• W3197296686 cites W2963463240 @default.
• W3197296686 cites W2963571341 @default.
• W3197296686 cites W2965373594 @default.
• W3197296686 cites W2971014768 @default.
• W3197296686 cites W2982455176 @default.
• W3197296686 cites W3031882196 @default.
• W3197296686 cites W3035419191 @default.
• W3197296686 cites W3083515246 @default.
• W3197296686 cites W3090047754 @default.
• W3197296686 cites W3102449459 @default.
• W3197296686 cites W3117560413 @default.
• W3197296686 hasPublicationYear "2021" @default.
• W3197296686 type Work @default.
• W3197296686 sameAs 3197296686 @default.
• W3197296686 citedByCount "0" @default.
• W3197296686 crossrefType "posted-content" @default.
• W3197296686 hasAuthorship W3197296686A5003744048 @default.
• W3197296686 hasAuthorship W3197296686A5054952724 @default.
• W3197296686 hasAuthorship W3197296686A5063658122 @default.
• W3197296686 hasConcept C119857082 @default.
• W3197296686 hasConcept C120665830 @default.
• W3197296686 hasConcept C121332964 @default.
• W3197296686 hasConcept C134306372 @default.
• W3197296686 hasConcept C137293760 @default.
• W3197296686 hasConcept C139807058 @default.
• W3197296686 hasConcept C154945302 @default.
• W3197296686 hasConcept C162324750 @default.
• W3197296686 hasConcept C187736073 @default.
• W3197296686 hasConcept C190470478 @default.
• W3197296686 hasConcept C199360897 @default.
• W3197296686 hasConcept C204321447 @default.
• W3197296686 hasConcept C2776434776 @default.
• W3197296686 hasConcept C2780451532 @default.
• W3197296686 hasConcept C33923547 @default.
• W3197296686 hasConcept C36503486 @default.
• W3197296686 hasConcept C37914503 @default.
• W3197296686 hasConcept C41008148 @default.
• W3197296686 hasConcept C5274069 @default.
• W3197296686 hasConcept C95623464 @default.
• W3197296686 hasConcept C98045186 @default.
• W3197296686 hasConceptScore W3197296686C119857082 @default.
• W3197296686 hasConceptScore W3197296686C120665830 @default.
• W3197296686 hasConceptScore W3197296686C121332964 @default.
• W3197296686 hasConceptScore W3197296686C134306372 @default.
• W3197296686 hasConceptScore W3197296686C137293760 @default.
• W3197296686 hasConceptScore W3197296686C139807058 @default.
• W3197296686 hasConceptScore W3197296686C154945302 @default.
• W3197296686 hasConceptScore W3197296686C162324750 @default.
• W3197296686 hasConceptScore W3197296686C187736073 @default.
• W3197296686 hasConceptScore W3197296686C190470478 @default.
• W3197296686 hasConceptScore W3197296686C199360897 @default.
• W3197296686 hasConceptScore W3197296686C204321447 @default.
• W3197296686 hasConceptScore W3197296686C2776434776 @default.
• W3197296686 hasConceptScore W3197296686C2780451532 @default.
• W3197296686 hasConceptScore W3197296686C33923547 @default.
• W3197296686 hasConceptScore W3197296686C36503486 @default.
• W3197296686 hasConceptScore W3197296686C37914503 @default.
• W3197296686 hasConceptScore W3197296686C41008148 @default.
• W3197296686 hasConceptScore W3197296686C5274069 @default.
• W3197296686 hasConceptScore W3197296686C95623464 @default.
• W3197296686 hasConceptScore W3197296686C98045186 @default.
• W3197296686 hasLocation W31972966861 @default.
• W3197296686 hasOpenAccess W3197296686 @default.

• next