Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385574310> ?p ?o ?g. }
Showing items 1 to 79 of
79
with 100 items per page.
- W4385574310 abstract "Pre-trained Language Models (PLMs) have shown effectiveness in various Natural Language Processing (NLP) tasks. Denoising autoencoder is one of the most successful pre-training frameworks, learning to recompose the original text given a noise-corrupted one. The existing studies mainly focus on injecting noises into the input. This paper introduces a simple yet effective pre-training paradigm, equipped with a knowledge-enhanced decoder that predicts the next entity token with noises in the prefix, explicitly strengthening the representation learning of entities that span over multiple input tokens. Specifically, when predicting the next token within an entity, we feed masks into the prefix in place of some of the previous ground-truth tokens that constitute the entity. Our model achieves new state-of-the-art results on two knowledge-driven data-to-text generation tasks with up to 2% BLEU gains." @default.
- W4385574310 created "2023-08-05" @default.
- W4385574310 creator A5006794114 @default.
- W4385574310 creator A5011555779 @default.
- W4385574310 creator A5023573950 @default.
- W4385574310 creator A5024484357 @default.
- W4385574310 creator A5058514856 @default.
- W4385574310 date "2022-01-01" @default.
- W4385574310 modified "2023-09-23" @default.
- W4385574310 title "PRINCE: Prefix-Masked Decoding for Knowledge Enhanced Sequence-to-Sequence Pre-Training" @default.
- W4385574310 doi "https://doi.org/10.18653/v1/2022.emnlp-main.171" @default.
- W4385574310 hasPublicationYear "2022" @default.
- W4385574310 type Work @default.
- W4385574310 citedByCount "0" @default.
- W4385574310 crossrefType "proceedings-article" @default.
- W4385574310 hasAuthorship W4385574310A5006794114 @default.
- W4385574310 hasAuthorship W4385574310A5011555779 @default.
- W4385574310 hasAuthorship W4385574310A5023573950 @default.
- W4385574310 hasAuthorship W4385574310A5024484357 @default.
- W4385574310 hasAuthorship W4385574310A5058514856 @default.
- W4385574310 hasBestOaLocation W43855743101 @default.
- W4385574310 hasConcept C101738243 @default.
- W4385574310 hasConcept C108583219 @default.
- W4385574310 hasConcept C11413529 @default.
- W4385574310 hasConcept C120665830 @default.
- W4385574310 hasConcept C121332964 @default.
- W4385574310 hasConcept C125411270 @default.
- W4385574310 hasConcept C137293760 @default.
- W4385574310 hasConcept C138885662 @default.
- W4385574310 hasConcept C141603448 @default.
- W4385574310 hasConcept C154945302 @default.
- W4385574310 hasConcept C192209626 @default.
- W4385574310 hasConcept C204321447 @default.
- W4385574310 hasConcept C2778112365 @default.
- W4385574310 hasConcept C28490314 @default.
- W4385574310 hasConcept C38652104 @default.
- W4385574310 hasConcept C41008148 @default.
- W4385574310 hasConcept C41895202 @default.
- W4385574310 hasConcept C48145219 @default.
- W4385574310 hasConcept C54355233 @default.
- W4385574310 hasConcept C57273362 @default.
- W4385574310 hasConcept C86803240 @default.
- W4385574310 hasConceptScore W4385574310C101738243 @default.
- W4385574310 hasConceptScore W4385574310C108583219 @default.
- W4385574310 hasConceptScore W4385574310C11413529 @default.
- W4385574310 hasConceptScore W4385574310C120665830 @default.
- W4385574310 hasConceptScore W4385574310C121332964 @default.
- W4385574310 hasConceptScore W4385574310C125411270 @default.
- W4385574310 hasConceptScore W4385574310C137293760 @default.
- W4385574310 hasConceptScore W4385574310C138885662 @default.
- W4385574310 hasConceptScore W4385574310C141603448 @default.
- W4385574310 hasConceptScore W4385574310C154945302 @default.
- W4385574310 hasConceptScore W4385574310C192209626 @default.
- W4385574310 hasConceptScore W4385574310C204321447 @default.
- W4385574310 hasConceptScore W4385574310C2778112365 @default.
- W4385574310 hasConceptScore W4385574310C28490314 @default.
- W4385574310 hasConceptScore W4385574310C38652104 @default.
- W4385574310 hasConceptScore W4385574310C41008148 @default.
- W4385574310 hasConceptScore W4385574310C41895202 @default.
- W4385574310 hasConceptScore W4385574310C48145219 @default.
- W4385574310 hasConceptScore W4385574310C54355233 @default.
- W4385574310 hasConceptScore W4385574310C57273362 @default.
- W4385574310 hasConceptScore W4385574310C86803240 @default.
- W4385574310 hasLocation W43855743101 @default.
- W4385574310 hasOpenAccess W4385574310 @default.
- W4385574310 hasPrimaryLocation W43855743101 @default.
- W4385574310 hasRelatedWork W2669956259 @default.
- W4385574310 hasRelatedWork W2939353110 @default.
- W4385574310 hasRelatedWork W3165097609 @default.
- W4385574310 hasRelatedWork W3165463024 @default.
- W4385574310 hasRelatedWork W3214993561 @default.
- W4385574310 hasRelatedWork W4287178339 @default.
- W4385574310 hasRelatedWork W4292874285 @default.
- W4385574310 hasRelatedWork W4310034804 @default.
- W4385574310 hasRelatedWork W4311648049 @default.
- W4385574310 hasRelatedWork W4327774331 @default.
- W4385574310 isParatext "false" @default.
- W4385574310 isRetracted "false" @default.
- W4385574310 workType "article" @default.