Matches in SemOpenAlex for { <https://semopenalex.org/work/W3191852631> ?p ?o ?g. }
- W3191852631 abstract "Document context-aware machine translation remains challenging due to the lack of large-scale document parallel corpora. To make full use of source-side monolingual documents for context-aware NMT, we propose a Pre-training approach with Global Context (PGC). In particular, we first propose a novel self-supervised pre-training task, which contains two training objectives: (1) reconstructing the original sentence from a corrupted version; (2) generating a gap sentence from its left and right neighbouring sentences. Then we design a universal model for PGC which consists of a global context encoder, a sentence encoder and a decoder, with similar architecture to typical context-aware NMT models. We evaluate the effectiveness and generality of our pre-trained PGC model by adapting it to various downstream context-aware NMT models. Detailed experimentation on four different translation tasks demonstrates that our PGC approach significantly improves the translation performance of context-aware NMT. For example, based on the state-of-the-art SAN model, we achieve an averaged improvement of 1.85 BLEU scores and 1.59 Meteor scores on the four translation tasks." @default.
- W3191852631 created "2021-08-16" @default.
- W3191852631 creator A5011874659 @default.
- W3191852631 creator A5012794465 @default.
- W3191852631 creator A5019715118 @default.
- W3191852631 creator A5032057273 @default.
- W3191852631 creator A5052585993 @default.
- W3191852631 creator A5053204257 @default.
- W3191852631 creator A5085736941 @default.
- W3191852631 creator A5089990864 @default.
- W3191852631 date "2021-08-01" @default.
- W3191852631 modified "2023-09-23" @default.
- W3191852631 title "Improving Context-Aware Neural Machine Translation with Source-side Monolingual Documents" @default.
- W3191852631 cites W2799051177 @default.
- W3191852631 cites W2808508619 @default.
- W3191852631 cites W2891534142 @default.
- W3191852631 cites W2962802109 @default.
- W3191852631 cites W2962943802 @default.
- W3191852631 cites W2963341956 @default.
- W3191852631 cites W2964093087 @default.
- W3191852631 cites W2964202354 @default.
- W3191852631 cites W2964291396 @default.
- W3191852631 cites W2970529093 @default.
- W3191852631 cites W2971347700 @default.
- W3191852631 cites W2980462515 @default.
- W3191852631 cites W2982399380 @default.
- W3191852631 cites W3034715004 @default.
- W3191852631 cites W3035520602 @default.
- W3191852631 cites W3042199843 @default.
- W3191852631 cites W3107826490 @default.
- W3191852631 doi "https://doi.org/10.24963/ijcai.2021/522" @default.
- W3191852631 hasPublicationYear "2021" @default.
- W3191852631 type Work @default.
- W3191852631 sameAs 3191852631 @default.
- W3191852631 citedByCount "1" @default.
- W3191852631 countsByYear W31918526312023 @default.
- W3191852631 crossrefType "proceedings-article" @default.
- W3191852631 hasAuthorship W3191852631A5011874659 @default.
- W3191852631 hasAuthorship W3191852631A5012794465 @default.
- W3191852631 hasAuthorship W3191852631A5019715118 @default.
- W3191852631 hasAuthorship W3191852631A5032057273 @default.
- W3191852631 hasAuthorship W3191852631A5052585993 @default.
- W3191852631 hasAuthorship W3191852631A5053204257 @default.
- W3191852631 hasAuthorship W3191852631A5085736941 @default.
- W3191852631 hasAuthorship W3191852631A5089990864 @default.
- W3191852631 hasBestOaLocation W31918526311 @default.
- W3191852631 hasConcept C104317684 @default.
- W3191852631 hasConcept C105580179 @default.
- W3191852631 hasConcept C111919701 @default.
- W3191852631 hasConcept C118505674 @default.
- W3191852631 hasConcept C149364088 @default.
- W3191852631 hasConcept C151730666 @default.
- W3191852631 hasConcept C154945302 @default.
- W3191852631 hasConcept C15744967 @default.
- W3191852631 hasConcept C162324750 @default.
- W3191852631 hasConcept C183322885 @default.
- W3191852631 hasConcept C185592680 @default.
- W3191852631 hasConcept C187736073 @default.
- W3191852631 hasConcept C203005215 @default.
- W3191852631 hasConcept C204321447 @default.
- W3191852631 hasConcept C2777530160 @default.
- W3191852631 hasConcept C2779343474 @default.
- W3191852631 hasConcept C2780451532 @default.
- W3191852631 hasConcept C2780767217 @default.
- W3191852631 hasConcept C2781238097 @default.
- W3191852631 hasConcept C28490314 @default.
- W3191852631 hasConcept C41008148 @default.
- W3191852631 hasConcept C542102704 @default.
- W3191852631 hasConcept C55493867 @default.
- W3191852631 hasConcept C86803240 @default.
- W3191852631 hasConceptScore W3191852631C104317684 @default.
- W3191852631 hasConceptScore W3191852631C105580179 @default.
- W3191852631 hasConceptScore W3191852631C111919701 @default.
- W3191852631 hasConceptScore W3191852631C118505674 @default.
- W3191852631 hasConceptScore W3191852631C149364088 @default.
- W3191852631 hasConceptScore W3191852631C151730666 @default.
- W3191852631 hasConceptScore W3191852631C154945302 @default.
- W3191852631 hasConceptScore W3191852631C15744967 @default.
- W3191852631 hasConceptScore W3191852631C162324750 @default.
- W3191852631 hasConceptScore W3191852631C183322885 @default.
- W3191852631 hasConceptScore W3191852631C185592680 @default.
- W3191852631 hasConceptScore W3191852631C187736073 @default.
- W3191852631 hasConceptScore W3191852631C203005215 @default.
- W3191852631 hasConceptScore W3191852631C204321447 @default.
- W3191852631 hasConceptScore W3191852631C2777530160 @default.
- W3191852631 hasConceptScore W3191852631C2779343474 @default.
- W3191852631 hasConceptScore W3191852631C2780451532 @default.
- W3191852631 hasConceptScore W3191852631C2780767217 @default.
- W3191852631 hasConceptScore W3191852631C2781238097 @default.
- W3191852631 hasConceptScore W3191852631C28490314 @default.
- W3191852631 hasConceptScore W3191852631C41008148 @default.
- W3191852631 hasConceptScore W3191852631C542102704 @default.
- W3191852631 hasConceptScore W3191852631C55493867 @default.
- W3191852631 hasConceptScore W3191852631C86803240 @default.
- W3191852631 hasLocation W31918526311 @default.
- W3191852631 hasOpenAccess W3191852631 @default.
- W3191852631 hasPrimaryLocation W31918526311 @default.
- W3191852631 hasRelatedWork W170118632 @default.
- W3191852631 hasRelatedWork W1947252915 @default.
- W3191852631 hasRelatedWork W1978971213 @default.