Matches in SemOpenAlex for { <https://semopenalex.org/work/W4375868939> ?p ?o ?g. }
Showing items 1 to 84 of
84
with 100 items per page.
- W4375868939 abstract "Audio-driven talking face with portrait customization enhances the flexibility of avatar applications for different scenarios, such as on-line meetings, mixed reality, and data generation. Among the existing methods, audio-driven talking face and face swapping are typically viewed as separate tasks that are cascaded to achieve the objective. Using state-of-the-art methods Wav2Lip and SimSwap for this purpose, we meet some issues: affected mouth synchronization, lost texture information, and slow inference speed. To resolve these issues, we propose an end-to-end model that combines the advantages of both approaches. Our approach generates highly-synchronized mouth with the aid of a pre-trained lip-sync discriminator. And identity information is provided by ArcFace and the ID injection module in the model because of its strong correlation with facial texture. Experimental results demonstrate that our method achieves lip-sync accuracy comparable to real synced videos, preserves more texture details than cascade methods, and alleviates the blurring of Wav2Lip. Also, our approach improves the inference speed. <sup xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sup>" @default.
- W4375868939 created "2023-05-10" @default.
- W4375868939 creator A5011128591 @default.
- W4375868939 creator A5023949159 @default.
- W4375868939 creator A5036821828 @default.
- W4375868939 creator A5065865253 @default.
- W4375868939 creator A5089469089 @default.
- W4375868939 date "2023-06-04" @default.
- W4375868939 modified "2023-09-27" @default.
- W4375868939 title "Wavsyncswap: End-To-End Portrait-Customized Audio-Driven Talking Face Generation" @default.
- W4375868939 cites W2162220380 @default.
- W4375868939 cites W2237250383 @default.
- W4375868939 cites W2593414223 @default.
- W4375868939 cites W2603777577 @default.
- W4375868939 cites W2808631503 @default.
- W4375868939 cites W2944294033 @default.
- W4375868939 cites W2963800363 @default.
- W4375868939 cites W2963839617 @default.
- W4375868939 cites W2969985801 @default.
- W4375868939 cites W3019952993 @default.
- W4375868939 cites W3034301684 @default.
- W4375868939 cites W3081492798 @default.
- W4375868939 cites W3166055650 @default.
- W4375868939 cites W3191243633 @default.
- W4375868939 cites W3195529437 @default.
- W4375868939 cites W3197199219 @default.
- W4375868939 cites W3197199501 @default.
- W4375868939 cites W4200174933 @default.
- W4375868939 cites W4312911690 @default.
- W4375868939 doi "https://doi.org/10.1109/icassp49357.2023.10094807" @default.
- W4375868939 hasPublicationYear "2023" @default.
- W4375868939 type Work @default.
- W4375868939 citedByCount "0" @default.
- W4375868939 crossrefType "proceedings-article" @default.
- W4375868939 hasAuthorship W4375868939A5011128591 @default.
- W4375868939 hasAuthorship W4375868939A5023949159 @default.
- W4375868939 hasAuthorship W4375868939A5036821828 @default.
- W4375868939 hasAuthorship W4375868939A5065865253 @default.
- W4375868939 hasAuthorship W4375868939A5089469089 @default.
- W4375868939 hasBestOaLocation W43758689391 @default.
- W4375868939 hasConcept C126042441 @default.
- W4375868939 hasConcept C127162648 @default.
- W4375868939 hasConcept C144024400 @default.
- W4375868939 hasConcept C154945302 @default.
- W4375868939 hasConcept C2776214188 @default.
- W4375868939 hasConcept C2778562939 @default.
- W4375868939 hasConcept C2779304628 @default.
- W4375868939 hasConcept C28490314 @default.
- W4375868939 hasConcept C31258907 @default.
- W4375868939 hasConcept C31972630 @default.
- W4375868939 hasConcept C36289849 @default.
- W4375868939 hasConcept C3913047 @default.
- W4375868939 hasConcept C41008148 @default.
- W4375868939 hasConcept C76155785 @default.
- W4375868939 hasConceptScore W4375868939C126042441 @default.
- W4375868939 hasConceptScore W4375868939C127162648 @default.
- W4375868939 hasConceptScore W4375868939C144024400 @default.
- W4375868939 hasConceptScore W4375868939C154945302 @default.
- W4375868939 hasConceptScore W4375868939C2776214188 @default.
- W4375868939 hasConceptScore W4375868939C2778562939 @default.
- W4375868939 hasConceptScore W4375868939C2779304628 @default.
- W4375868939 hasConceptScore W4375868939C28490314 @default.
- W4375868939 hasConceptScore W4375868939C31258907 @default.
- W4375868939 hasConceptScore W4375868939C31972630 @default.
- W4375868939 hasConceptScore W4375868939C36289849 @default.
- W4375868939 hasConceptScore W4375868939C3913047 @default.
- W4375868939 hasConceptScore W4375868939C41008148 @default.
- W4375868939 hasConceptScore W4375868939C76155785 @default.
- W4375868939 hasLocation W43758689391 @default.
- W4375868939 hasOpenAccess W4375868939 @default.
- W4375868939 hasPrimaryLocation W43758689391 @default.
- W4375868939 hasRelatedWork W1899364738 @default.
- W4375868939 hasRelatedWork W2018638282 @default.
- W4375868939 hasRelatedWork W2103413230 @default.
- W4375868939 hasRelatedWork W2116300362 @default.
- W4375868939 hasRelatedWork W2138569648 @default.
- W4375868939 hasRelatedWork W2143020626 @default.
- W4375868939 hasRelatedWork W2663901905 @default.
- W4375868939 hasRelatedWork W2908959303 @default.
- W4375868939 hasRelatedWork W43171467 @default.
- W4375868939 hasRelatedWork W2126942212 @default.
- W4375868939 isParatext "false" @default.
- W4375868939 isRetracted "false" @default.
- W4375868939 workType "article" @default.