Matches in SemOpenAlex for { <https://semopenalex.org/work/W4366999926> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W4366999926 abstract "Non-AutoRegressive (NAR) text generation models have drawn much attention because of their significantly faster decoding speed and good generation quality in machine translation. However, in a wider range of text generation tasks, existing NAR models lack proper pre-training, making them still far behind the pre-trained autoregressive models. In this paper, we propose Pre-trained Directed Acyclic Transformer (PreDAT) and a novel pre-training task to promote prediction consistency in NAR generation. Experiments on five text generation tasks show that our PreDAT remarkably outperforms existing pre-trained NAR models (+4.2 scores on average) and even achieves better results than pre-trained autoregressive baselines in n-gram-based metrics, along with 17 times speedup in throughput. Further analysis shows that PreDAT benefits from the unbiased prediction order that alleviates the error accumulation problem in autoregressive generation, which provides new insights into the advantages of NAR generation." @default.
- W4366999926 created "2023-04-27" @default.
- W4366999926 creator A5010446607 @default.
- W4366999926 creator A5044042138 @default.
- W4366999926 creator A5091491018 @default.
- W4366999926 date "2023-04-23" @default.
- W4366999926 modified "2023-09-30" @default.
- W4366999926 title "Directed Acyclic Transformer Pre-training for High-quality Non-autoregressive Text Generation" @default.
- W4366999926 doi "https://doi.org/10.48550/arxiv.2304.11791" @default.
- W4366999926 hasPublicationYear "2023" @default.
- W4366999926 type Work @default.
- W4366999926 citedByCount "0" @default.
- W4366999926 crossrefType "posted-content" @default.
- W4366999926 hasAuthorship W4366999926A5010446607 @default.
- W4366999926 hasAuthorship W4366999926A5044042138 @default.
- W4366999926 hasAuthorship W4366999926A5091491018 @default.
- W4366999926 hasBestOaLocation W43669999261 @default.
- W4366999926 hasConcept C105795698 @default.
- W4366999926 hasConcept C119599485 @default.
- W4366999926 hasConcept C119857082 @default.
- W4366999926 hasConcept C127413603 @default.
- W4366999926 hasConcept C154945302 @default.
- W4366999926 hasConcept C159877910 @default.
- W4366999926 hasConcept C165801399 @default.
- W4366999926 hasConcept C173608175 @default.
- W4366999926 hasConcept C203005215 @default.
- W4366999926 hasConcept C2776436953 @default.
- W4366999926 hasConcept C28490314 @default.
- W4366999926 hasConcept C33923547 @default.
- W4366999926 hasConcept C41008148 @default.
- W4366999926 hasConcept C66322947 @default.
- W4366999926 hasConcept C68339613 @default.
- W4366999926 hasConceptScore W4366999926C105795698 @default.
- W4366999926 hasConceptScore W4366999926C119599485 @default.
- W4366999926 hasConceptScore W4366999926C119857082 @default.
- W4366999926 hasConceptScore W4366999926C127413603 @default.
- W4366999926 hasConceptScore W4366999926C154945302 @default.
- W4366999926 hasConceptScore W4366999926C159877910 @default.
- W4366999926 hasConceptScore W4366999926C165801399 @default.
- W4366999926 hasConceptScore W4366999926C173608175 @default.
- W4366999926 hasConceptScore W4366999926C203005215 @default.
- W4366999926 hasConceptScore W4366999926C2776436953 @default.
- W4366999926 hasConceptScore W4366999926C28490314 @default.
- W4366999926 hasConceptScore W4366999926C33923547 @default.
- W4366999926 hasConceptScore W4366999926C41008148 @default.
- W4366999926 hasConceptScore W4366999926C66322947 @default.
- W4366999926 hasConceptScore W4366999926C68339613 @default.
- W4366999926 hasLocation W43669999261 @default.
- W4366999926 hasOpenAccess W4366999926 @default.
- W4366999926 hasPrimaryLocation W43669999261 @default.
- W4366999926 hasRelatedWork W2948381505 @default.
- W4366999926 hasRelatedWork W3054488230 @default.
- W4366999926 hasRelatedWork W3095358777 @default.
- W4366999926 hasRelatedWork W3107474891 @default.
- W4366999926 hasRelatedWork W3116857254 @default.
- W4366999926 hasRelatedWork W3141754740 @default.
- W4366999926 hasRelatedWork W3160622492 @default.
- W4366999926 hasRelatedWork W3185923046 @default.
- W4366999926 hasRelatedWork W3206689743 @default.
- W4366999926 hasRelatedWork W4303874710 @default.
- W4366999926 isParatext "false" @default.
- W4366999926 isRetracted "false" @default.
- W4366999926 workType "article" @default.