FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3109360095> ?p ?o ?g. }

• W3109360095 abstract "Whenever we speak, our voice is accompanied by facial movements and expressions. Several recent works have shown the synthesis of highly photo-realistic videos of talking faces, but they either require a source video to drive the target face or only generate videos with a fixed head pose. This lack of facial movement is because most of these works focus on the lip movement in sync with the audio while assuming the remaining facial keypoints' fixed nature. To address this, a unique audio-keypoint dataset of over 150,000 videos at 224p and 25fps is introduced that relates the facial keypoint movement for the given audio. This dataset is then further used to train the model, Audio2Keypoint, a novel approach for synthesizing facial keypoint movement to go with the audio. Given a single image of the target person and an audio sequence (in any language), Audio2Keypoint generates a plausible keypoint movement sequence in sync with the input audio, conditioned on the input image to preserve the target person's facial characteristics. To the best of our knowledge, this is the first work that proposes an audio-keypoint dataset and learns a model to output the plausible keypoint sequence to go with audio of any arbitrary length. Audio2Keypoint generalizes across unseen people with a different facial structure allowing us to generate the sequence with the voice from any source or even synthetic voices. Instead of learning a direct mapping from audio to video domain, this work aims to learn the audio-keypoint mapping that allows for in-plane and out-of-plane head rotations, while preserving the person's identity using a Pose Invariant (PIV) Encoder." @default.
• W3109360095 created "2020-12-07" @default.
• W3109360095 creator A5026261105 @default.
• W3109360095 creator A5041308578 @default.
• W3109360095 date "2020-11-02" @default.
• W3109360095 modified "2023-09-27" @default.
• W3109360095 title "Facial Keypoint Sequence Generation from Audio." @default.
• W3109360095 cites W1522301498 @default.
• W3109360095 cites W1569907127 @default.
• W3109360095 cites W1901129140 @default.
• W3109360095 cites W1974604838 @default.
• W3109360095 cites W2045831935 @default.
• W3109360095 cites W2087147962 @default.
• W3109360095 cites W2107310362 @default.
• W3109360095 cites W2125389028 @default.
• W3109360095 cites W2172803778 @default.
• W3109360095 cites W2301937176 @default.
• W3109360095 cites W2515372520 @default.
• W3109360095 cites W2613087992 @default.
• W3109360095 cites W2738406145 @default.
• W3109360095 cites W2788357188 @default.
• W3109360095 cites W2796931171 @default.
• W3109360095 cites W2804600264 @default.
• W3109360095 cites W2808631503 @default.
• W3109360095 cites W2884460600 @default.
• W3109360095 cites W2910577860 @default.
• W3109360095 cites W2942074357 @default.
• W3109360095 cites W2945052639 @default.
• W3109360095 cites W2948627769 @default.
• W3109360095 cites W2963073614 @default.
• W3109360095 cites W2963290645 @default.
• W3109360095 cites W2995238198 @default.
• W3109360095 cites W2999966482 @default.
• W3109360095 cites W3025498998 @default.
• W3109360095 hasPublicationYear "2020" @default.
• W3109360095 type Work @default.
• W3109360095 sameAs 3109360095 @default.
• W3109360095 citedByCount "0" @default.
• W3109360095 crossrefType "posted-content" @default.
• W3109360095 hasAuthorship W3109360095A5026261105 @default.
• W3109360095 hasAuthorship W3109360095A5041308578 @default.
• W3109360095 hasConcept C107038049 @default.
• W3109360095 hasConcept C126042441 @default.
• W3109360095 hasConcept C138885662 @default.
• W3109360095 hasConcept C13895895 @default.
• W3109360095 hasConcept C144024400 @default.
• W3109360095 hasConcept C154945302 @default.
• W3109360095 hasConcept C2778112365 @default.
• W3109360095 hasConcept C2779304628 @default.
• W3109360095 hasConcept C2780226923 @default.
• W3109360095 hasConcept C28490314 @default.
• W3109360095 hasConcept C31972630 @default.
• W3109360095 hasConcept C36289849 @default.
• W3109360095 hasConcept C3913047 @default.
• W3109360095 hasConcept C41008148 @default.
• W3109360095 hasConcept C54355233 @default.
• W3109360095 hasConcept C64922751 @default.
• W3109360095 hasConcept C76155785 @default.
• W3109360095 hasConcept C86803240 @default.
• W3109360095 hasConceptScore W3109360095C107038049 @default.
• W3109360095 hasConceptScore W3109360095C126042441 @default.
• W3109360095 hasConceptScore W3109360095C138885662 @default.
• W3109360095 hasConceptScore W3109360095C13895895 @default.
• W3109360095 hasConceptScore W3109360095C144024400 @default.
• W3109360095 hasConceptScore W3109360095C154945302 @default.
• W3109360095 hasConceptScore W3109360095C2778112365 @default.
• W3109360095 hasConceptScore W3109360095C2779304628 @default.
• W3109360095 hasConceptScore W3109360095C2780226923 @default.
• W3109360095 hasConceptScore W3109360095C28490314 @default.
• W3109360095 hasConceptScore W3109360095C31972630 @default.
• W3109360095 hasConceptScore W3109360095C36289849 @default.
• W3109360095 hasConceptScore W3109360095C3913047 @default.
• W3109360095 hasConceptScore W3109360095C41008148 @default.
• W3109360095 hasConceptScore W3109360095C54355233 @default.
• W3109360095 hasConceptScore W3109360095C64922751 @default.
• W3109360095 hasConceptScore W3109360095C76155785 @default.
• W3109360095 hasConceptScore W3109360095C86803240 @default.
• W3109360095 hasLocation W31093600951 @default.
• W3109360095 hasOpenAccess W3109360095 @default.
• W3109360095 hasPrimaryLocation W31093600951 @default.
• W3109360095 hasRelatedWork W1985583374 @default.
• W3109360095 hasRelatedWork W1995712965 @default.
• W3109360095 hasRelatedWork W2613087992 @default.
• W3109360095 hasRelatedWork W2621109248 @default.
• W3109360095 hasRelatedWork W2903511133 @default.
• W3109360095 hasRelatedWork W2914217321 @default.
• W3109360095 hasRelatedWork W2970250044 @default.
• W3109360095 hasRelatedWork W2996520109 @default.
• W3109360095 hasRelatedWork W3004048296 @default.
• W3109360095 hasRelatedWork W3034600609 @default.
• W3109360095 hasRelatedWork W3088751268 @default.
• W3109360095 hasRelatedWork W3109875893 @default.
• W3109360095 hasRelatedWork W3110383967 @default.
• W3109360095 hasRelatedWork W3125022071 @default.
• W3109360095 hasRelatedWork W3129072917 @default.
• W3109360095 hasRelatedWork W3133148637 @default.
• W3109360095 hasRelatedWork W3150091376 @default.
• W3109360095 hasRelatedWork W3197199219 @default.
• W3109360095 hasRelatedWork W798873776 @default.
• W3109360095 hasRelatedWork W3118160031 @default.

• next