Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386075487> ?p ?o ?g. }
- W4386075487 abstract "Talking head synthesis is a promising approach for the video production industry. Recently, a lot of effort has been devoted in this research area to improve the generation quality or enhance the model generalization. However, there are few works able to address both issues simultaneously, which is essential for practical applications. To this end, in this paper, we turn attention to the emerging powerful Latent Diffusion Models, and model the Talking head generation as an audio-driven temporally coherent denoising process (DiffTalk). More specifically, instead of employing audio signals as the single driving factor, we investigate the control mechanism of the talking face, and incorporate reference face images and landmarks as conditions for personality-aware generalized synthesis. In this way, the proposed DiffTalk is capable of producing high-quality talking head videos in synchronization with the source audio, and more importantly, it can be naturally generalized across different identities without further finetuning. Additionally, our DiffTalk can be gracefully tailored for higher-resolution synthesis with negligible extra computational cost. Extensive experiments show that the proposed DiffTalk efficiently synthesizes high-fidelity audio-driven talking head videos for generalized novel identities. For more video results, please refer to https://sstzal.github.io/DiffTalk/." @default.
- W4386075487 created "2023-08-23" @default.
- W4386075487 creator A5010357390 @default.
- W4386075487 creator A5036569726 @default.
- W4386075487 creator A5044985818 @default.
- W4386075487 creator A5073022351 @default.
- W4386075487 creator A5082419115 @default.
- W4386075487 creator A5089266478 @default.
- W4386075487 creator A5090079801 @default.
- W4386075487 date "2023-06-01" @default.
- W4386075487 modified "2023-09-26" @default.
- W4386075487 title "DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation" @default.
- W4386075487 cites W2048971218 @default.
- W4386075487 cites W2146991130 @default.
- W4386075487 cites W2237250383 @default.
- W4386075487 cites W2486034530 @default.
- W4386075487 cites W2738406145 @default.
- W4386075487 cites W2806379360 @default.
- W4386075487 cites W2944294033 @default.
- W4386075487 cites W2962785568 @default.
- W4386075487 cites W2981263323 @default.
- W4386075487 cites W2990452356 @default.
- W4386075487 cites W2996833883 @default.
- W4386075487 cites W3019952993 @default.
- W4386075487 cites W3034257218 @default.
- W4386075487 cites W3081492798 @default.
- W4386075487 cites W3173531806 @default.
- W4386075487 cites W3174763799 @default.
- W4386075487 cites W3180355996 @default.
- W4386075487 cites W3180770160 @default.
- W4386075487 cites W3186090335 @default.
- W4386075487 cites W3197199219 @default.
- W4386075487 cites W3211147706 @default.
- W4386075487 cites W4312497550 @default.
- W4386075487 cites W4312910768 @default.
- W4386075487 cites W4312933868 @default.
- W4386075487 doi "https://doi.org/10.1109/cvpr52729.2023.00197" @default.
- W4386075487 hasPublicationYear "2023" @default.
- W4386075487 type Work @default.
- W4386075487 citedByCount "0" @default.
- W4386075487 crossrefType "proceedings-article" @default.
- W4386075487 hasAuthorship W4386075487A5010357390 @default.
- W4386075487 hasAuthorship W4386075487A5036569726 @default.
- W4386075487 hasAuthorship W4386075487A5044985818 @default.
- W4386075487 hasAuthorship W4386075487A5073022351 @default.
- W4386075487 hasAuthorship W4386075487A5082419115 @default.
- W4386075487 hasAuthorship W4386075487A5089266478 @default.
- W4386075487 hasAuthorship W4386075487A5090079801 @default.
- W4386075487 hasConcept C111919701 @default.
- W4386075487 hasConcept C121684516 @default.
- W4386075487 hasConcept C127162648 @default.
- W4386075487 hasConcept C134306372 @default.
- W4386075487 hasConcept C144024400 @default.
- W4386075487 hasConcept C154945302 @default.
- W4386075487 hasConcept C177148314 @default.
- W4386075487 hasConcept C2776459999 @default.
- W4386075487 hasConcept C2778562939 @default.
- W4386075487 hasConcept C2779304628 @default.
- W4386075487 hasConcept C28490314 @default.
- W4386075487 hasConcept C31258907 @default.
- W4386075487 hasConcept C33923547 @default.
- W4386075487 hasConcept C36289849 @default.
- W4386075487 hasConcept C41008148 @default.
- W4386075487 hasConcept C502989409 @default.
- W4386075487 hasConcept C76155785 @default.
- W4386075487 hasConcept C98045186 @default.
- W4386075487 hasConceptScore W4386075487C111919701 @default.
- W4386075487 hasConceptScore W4386075487C121684516 @default.
- W4386075487 hasConceptScore W4386075487C127162648 @default.
- W4386075487 hasConceptScore W4386075487C134306372 @default.
- W4386075487 hasConceptScore W4386075487C144024400 @default.
- W4386075487 hasConceptScore W4386075487C154945302 @default.
- W4386075487 hasConceptScore W4386075487C177148314 @default.
- W4386075487 hasConceptScore W4386075487C2776459999 @default.
- W4386075487 hasConceptScore W4386075487C2778562939 @default.
- W4386075487 hasConceptScore W4386075487C2779304628 @default.
- W4386075487 hasConceptScore W4386075487C28490314 @default.
- W4386075487 hasConceptScore W4386075487C31258907 @default.
- W4386075487 hasConceptScore W4386075487C33923547 @default.
- W4386075487 hasConceptScore W4386075487C36289849 @default.
- W4386075487 hasConceptScore W4386075487C41008148 @default.
- W4386075487 hasConceptScore W4386075487C502989409 @default.
- W4386075487 hasConceptScore W4386075487C76155785 @default.
- W4386075487 hasConceptScore W4386075487C98045186 @default.
- W4386075487 hasFunder F4320321001 @default.
- W4386075487 hasFunder F4320335777 @default.
- W4386075487 hasLocation W43860754871 @default.
- W4386075487 hasOpenAccess W4386075487 @default.
- W4386075487 hasPrimaryLocation W43860754871 @default.
- W4386075487 hasRelatedWork W1594853694 @default.
- W4386075487 hasRelatedWork W2008102628 @default.
- W4386075487 hasRelatedWork W2352331355 @default.
- W4386075487 hasRelatedWork W2367492307 @default.
- W4386075487 hasRelatedWork W2370579750 @default.
- W4386075487 hasRelatedWork W2386057428 @default.
- W4386075487 hasRelatedWork W2388891502 @default.
- W4386075487 hasRelatedWork W2615259895 @default.
- W4386075487 hasRelatedWork W2885094885 @default.
- W4386075487 hasRelatedWork W4231453522 @default.
- W4386075487 isParatext "false" @default.