Matches in SemOpenAlex for { <https://semopenalex.org/work/W4377029243> ?p ?o ?g. }
Showing items 1 to 93 of
93
with 100 items per page.
- W4377029243 abstract "Diffusion models have gained significant attention in the realm of image generation due to their exceptional performance. Their success has been recently expanded to text generation via generating all tokens within a sequence concurrently. However, natural language exhibits a far more pronounced sequential dependency in comparison to images, and the majority of existing language models are trained with a left-to-right auto-regressive approach. To account for the inherent sequential characteristic of natural language, we introduce Auto-Regressive Diffusion (AR-Diffusion). AR-Diffusion ensures that the generation of tokens on the right depends on the generated ones on the left, a mechanism achieved through employing a dynamic number of denoising steps that vary based on token position. This results in tokens on the left undergoing fewer denoising steps than those on the right, thereby enabling them to generate earlier and subsequently influence the generation of tokens on the right. In a series of experiments on various text generation tasks, including text summarization, machine translation, and common sense generation, AR-Diffusion clearly demonstrated its superiority over existing diffusion language models and that it can be $100timessim600times$ faster when achieving comparable results. Our code is available at https://github.com/microsoft/ProphetNet/tree/master/AR-diffusion." @default.
- W4377029243 created "2023-05-19" @default.
- W4377029243 creator A5010250334 @default.
- W4377029243 creator A5011504177 @default.
- W4377029243 creator A5022672030 @default.
- W4377029243 creator A5028766349 @default.
- W4377029243 creator A5041448669 @default.
- W4377029243 creator A5042018181 @default.
- W4377029243 creator A5043356063 @default.
- W4377029243 creator A5047916298 @default.
- W4377029243 creator A5051745436 @default.
- W4377029243 creator A5067205077 @default.
- W4377029243 creator A5076409244 @default.
- W4377029243 creator A5078689432 @default.
- W4377029243 date "2023-05-16" @default.
- W4377029243 modified "2023-10-16" @default.
- W4377029243 title "AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation" @default.
- W4377029243 doi "https://doi.org/10.48550/arxiv.2305.09515" @default.
- W4377029243 hasPublicationYear "2023" @default.
- W4377029243 type Work @default.
- W4377029243 citedByCount "0" @default.
- W4377029243 crossrefType "posted-content" @default.
- W4377029243 hasAuthorship W4377029243A5010250334 @default.
- W4377029243 hasAuthorship W4377029243A5011504177 @default.
- W4377029243 hasAuthorship W4377029243A5022672030 @default.
- W4377029243 hasAuthorship W4377029243A5028766349 @default.
- W4377029243 hasAuthorship W4377029243A5041448669 @default.
- W4377029243 hasAuthorship W4377029243A5042018181 @default.
- W4377029243 hasAuthorship W4377029243A5043356063 @default.
- W4377029243 hasAuthorship W4377029243A5047916298 @default.
- W4377029243 hasAuthorship W4377029243A5051745436 @default.
- W4377029243 hasAuthorship W4377029243A5067205077 @default.
- W4377029243 hasAuthorship W4377029243A5076409244 @default.
- W4377029243 hasAuthorship W4377029243A5078689432 @default.
- W4377029243 hasBestOaLocation W43770292431 @default.
- W4377029243 hasConcept C11413529 @default.
- W4377029243 hasConcept C121332964 @default.
- W4377029243 hasConcept C137293760 @default.
- W4377029243 hasConcept C149782125 @default.
- W4377029243 hasConcept C154945302 @default.
- W4377029243 hasConcept C159877910 @default.
- W4377029243 hasConcept C170858558 @default.
- W4377029243 hasConcept C195324797 @default.
- W4377029243 hasConcept C203005215 @default.
- W4377029243 hasConcept C204321447 @default.
- W4377029243 hasConcept C2776187449 @default.
- W4377029243 hasConcept C2778112365 @default.
- W4377029243 hasConcept C28490314 @default.
- W4377029243 hasConcept C33923547 @default.
- W4377029243 hasConcept C38652104 @default.
- W4377029243 hasConcept C41008148 @default.
- W4377029243 hasConcept C48145219 @default.
- W4377029243 hasConcept C54355233 @default.
- W4377029243 hasConcept C69357855 @default.
- W4377029243 hasConcept C86803240 @default.
- W4377029243 hasConcept C97355855 @default.
- W4377029243 hasConceptScore W4377029243C11413529 @default.
- W4377029243 hasConceptScore W4377029243C121332964 @default.
- W4377029243 hasConceptScore W4377029243C137293760 @default.
- W4377029243 hasConceptScore W4377029243C149782125 @default.
- W4377029243 hasConceptScore W4377029243C154945302 @default.
- W4377029243 hasConceptScore W4377029243C159877910 @default.
- W4377029243 hasConceptScore W4377029243C170858558 @default.
- W4377029243 hasConceptScore W4377029243C195324797 @default.
- W4377029243 hasConceptScore W4377029243C203005215 @default.
- W4377029243 hasConceptScore W4377029243C204321447 @default.
- W4377029243 hasConceptScore W4377029243C2776187449 @default.
- W4377029243 hasConceptScore W4377029243C2778112365 @default.
- W4377029243 hasConceptScore W4377029243C28490314 @default.
- W4377029243 hasConceptScore W4377029243C33923547 @default.
- W4377029243 hasConceptScore W4377029243C38652104 @default.
- W4377029243 hasConceptScore W4377029243C41008148 @default.
- W4377029243 hasConceptScore W4377029243C48145219 @default.
- W4377029243 hasConceptScore W4377029243C54355233 @default.
- W4377029243 hasConceptScore W4377029243C69357855 @default.
- W4377029243 hasConceptScore W4377029243C86803240 @default.
- W4377029243 hasConceptScore W4377029243C97355855 @default.
- W4377029243 hasLocation W43770292431 @default.
- W4377029243 hasOpenAccess W4377029243 @default.
- W4377029243 hasPrimaryLocation W43770292431 @default.
- W4377029243 hasRelatedWork W2747680751 @default.
- W4377029243 hasRelatedWork W2888693386 @default.
- W4377029243 hasRelatedWork W2963837967 @default.
- W4377029243 hasRelatedWork W2964945503 @default.
- W4377029243 hasRelatedWork W3088348751 @default.
- W4377029243 hasRelatedWork W3107474891 @default.
- W4377029243 hasRelatedWork W3154504973 @default.
- W4377029243 hasRelatedWork W4285744218 @default.
- W4377029243 hasRelatedWork W4288804510 @default.
- W4377029243 hasRelatedWork W3045475294 @default.
- W4377029243 isParatext "false" @default.
- W4377029243 isRetracted "false" @default.
- W4377029243 workType "article" @default.