Matches in SemOpenAlex for { <https://semopenalex.org/work/W3101478412> ?p ?o ?g. }
- W3101478412 abstract "Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from a small percentage of emph{randomly} masked-out tokens. In this paper, we show that careful masking strategies can bridge the knowledge gap of masked language models (MLMs) about the domains more effectively by allocating self-supervision where it is needed. Furthermore, we propose an effective training strategy by adversarially masking out those tokens which are harder to reconstruct by the underlying MLM. The adversarial objective leads to a challenging combinatorial optimisation problem over emph{subsets} of tokens, which we tackle efficiently through relaxation to a variational lowerbound and dynamic programming. On six unsupervised domain adaptation tasks involving named entity recognition, our method strongly outperforms the random masking strategy and achieves up to +1.64 F1 score improvements." @default.
- W3101478412 created "2020-11-23" @default.
- W3101478412 creator A5036447132 @default.
- W3101478412 creator A5062855474 @default.
- W3101478412 creator A5081525024 @default.
- W3101478412 date "2020-10-05" @default.
- W3101478412 modified "2023-09-26" @default.
- W3101478412 title "Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models" @default.
- W3101478412 cites W2047782770 @default.
- W3101478412 cites W2099471712 @default.
- W3101478412 cites W2117278770 @default.
- W3101478412 cites W2547875792 @default.
- W3101478412 cites W2787423662 @default.
- W3101478412 cites W2799054028 @default.
- W3101478412 cites W2898700502 @default.
- W3101478412 cites W2911489562 @default.
- W3101478412 cites W2925618549 @default.
- W3101478412 cites W2946232455 @default.
- W3101478412 cites W2950813464 @default.
- W3101478412 cites W2952826391 @default.
- W3101478412 cites W2963341956 @default.
- W3101478412 cites W2963777311 @default.
- W3101478412 cites W2963826681 @default.
- W3101478412 cites W2964125718 @default.
- W3101478412 cites W2965373594 @default.
- W3101478412 cites W2971277088 @default.
- W3101478412 cites W2972860176 @default.
- W3101478412 cites W2987154291 @default.
- W3101478412 cites W3017003177 @default.
- W3101478412 cites W3034238904 @default.
- W3101478412 cites W76749362 @default.
- W3101478412 hasPublicationYear "2020" @default.
- W3101478412 type Work @default.
- W3101478412 sameAs 3101478412 @default.
- W3101478412 citedByCount "0" @default.
- W3101478412 crossrefType "posted-content" @default.
- W3101478412 hasAuthorship W3101478412A5036447132 @default.
- W3101478412 hasAuthorship W3101478412A5062855474 @default.
- W3101478412 hasAuthorship W3101478412A5081525024 @default.
- W3101478412 hasConcept C119857082 @default.
- W3101478412 hasConcept C120665830 @default.
- W3101478412 hasConcept C121332964 @default.
- W3101478412 hasConcept C134306372 @default.
- W3101478412 hasConcept C137293760 @default.
- W3101478412 hasConcept C139807058 @default.
- W3101478412 hasConcept C142362112 @default.
- W3101478412 hasConcept C153349607 @default.
- W3101478412 hasConcept C154945302 @default.
- W3101478412 hasConcept C162324750 @default.
- W3101478412 hasConcept C187736073 @default.
- W3101478412 hasConcept C2776434776 @default.
- W3101478412 hasConcept C2777402240 @default.
- W3101478412 hasConcept C2780451532 @default.
- W3101478412 hasConcept C33923547 @default.
- W3101478412 hasConcept C36503486 @default.
- W3101478412 hasConcept C41008148 @default.
- W3101478412 hasConcept C41608201 @default.
- W3101478412 hasConcept C80444323 @default.
- W3101478412 hasConcept C95623464 @default.
- W3101478412 hasConceptScore W3101478412C119857082 @default.
- W3101478412 hasConceptScore W3101478412C120665830 @default.
- W3101478412 hasConceptScore W3101478412C121332964 @default.
- W3101478412 hasConceptScore W3101478412C134306372 @default.
- W3101478412 hasConceptScore W3101478412C137293760 @default.
- W3101478412 hasConceptScore W3101478412C139807058 @default.
- W3101478412 hasConceptScore W3101478412C142362112 @default.
- W3101478412 hasConceptScore W3101478412C153349607 @default.
- W3101478412 hasConceptScore W3101478412C154945302 @default.
- W3101478412 hasConceptScore W3101478412C162324750 @default.
- W3101478412 hasConceptScore W3101478412C187736073 @default.
- W3101478412 hasConceptScore W3101478412C2776434776 @default.
- W3101478412 hasConceptScore W3101478412C2777402240 @default.
- W3101478412 hasConceptScore W3101478412C2780451532 @default.
- W3101478412 hasConceptScore W3101478412C33923547 @default.
- W3101478412 hasConceptScore W3101478412C36503486 @default.
- W3101478412 hasConceptScore W3101478412C41008148 @default.
- W3101478412 hasConceptScore W3101478412C41608201 @default.
- W3101478412 hasConceptScore W3101478412C80444323 @default.
- W3101478412 hasConceptScore W3101478412C95623464 @default.
- W3101478412 hasLocation W31014784121 @default.
- W3101478412 hasOpenAccess W3101478412 @default.
- W3101478412 hasPrimaryLocation W31014784121 @default.
- W3101478412 hasRelatedWork W2593768305 @default.
- W3101478412 hasRelatedWork W2752889156 @default.
- W3101478412 hasRelatedWork W2758609995 @default.
- W3101478412 hasRelatedWork W2767699072 @default.
- W3101478412 hasRelatedWork W2771358947 @default.
- W3101478412 hasRelatedWork W2799497467 @default.
- W3101478412 hasRelatedWork W2810453092 @default.
- W3101478412 hasRelatedWork W2914282508 @default.
- W3101478412 hasRelatedWork W2970799610 @default.
- W3101478412 hasRelatedWork W2975758481 @default.
- W3101478412 hasRelatedWork W2994223730 @default.
- W3101478412 hasRelatedWork W2998666297 @default.
- W3101478412 hasRelatedWork W3034765384 @default.
- W3101478412 hasRelatedWork W3060185009 @default.
- W3101478412 hasRelatedWork W3100356292 @default.
- W3101478412 hasRelatedWork W3102297327 @default.
- W3101478412 hasRelatedWork W3152016334 @default.
- W3101478412 hasRelatedWork W3189569440 @default.