Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386075984> ?p ?o ?g. }
- W4386075984 abstract "This work addresses the problem of generating 3D holistic body motions from human speech. Given a speech recording, we synthesize sequences of 3D body poses, hand gestures, and facial expressions that are realistic and diverse. To achieve this, we first build a high-quality dataset of 3D holistic body meshes with synchronous speech. We then define a novel speech-to-motion generation framework in which the face, body, and hands are modeled separately. The separated modeling stems from the fact that face articulation strongly correlates with human speech, while body poses and hand gestures are less correlated. Specifically, we employ an autoencoder for face motions, and a compositional vector-quantized variational autoencoder (VQ- VAE) for the body and hand motions. The compositional VQ-VAE is key to generating diverse results. Additionally, we propose a cross-conditional autoregressive model that generates body poses and hand gestures, leading to coherent and realistic motions. Extensive experiments and user studies demonstrate that our proposed approach achieves state-of-the-art performance both qualitatively and quantitatively. Our dataset and code are released for research purposes at https://talkshow.is.tue.mpg.de/." @default.
- W4386075984 created "2023-08-23" @default.
- W4386075984 creator A5008425887 @default.
- W4386075984 creator A5021889091 @default.
- W4386075984 creator A5025958423 @default.
- W4386075984 creator A5065396778 @default.
- W4386075984 creator A5070584981 @default.
- W4386075984 creator A5072908756 @default.
- W4386075984 creator A5074103823 @default.
- W4386075984 creator A5082151648 @default.
- W4386075984 date "2023-06-01" @default.
- W4386075984 modified "2023-09-27" @default.
- W4386075984 title "Generating Holistic 3D Human Motion from Speech" @default.
- W4386075984 cites W1498883201 @default.
- W4386075984 cites W2007337857 @default.
- W4386075984 cites W2011611983 @default.
- W4386075984 cites W2022214202 @default.
- W4386075984 cites W2024536104 @default.
- W4386075984 cites W2062826588 @default.
- W4386075984 cites W215088529 @default.
- W4386075984 cites W2154961933 @default.
- W4386075984 cites W2235920218 @default.
- W4386075984 cites W2559085405 @default.
- W4386075984 cites W2739192055 @default.
- W4386075984 cites W2741633070 @default.
- W4386075984 cites W2804619907 @default.
- W4386075984 cites W2901285216 @default.
- W4386075984 cites W2922298118 @default.
- W4386075984 cites W2962795401 @default.
- W4386075984 cites W2963515833 @default.
- W4386075984 cites W2963995996 @default.
- W4386075984 cites W2965115183 @default.
- W4386075984 cites W2967443589 @default.
- W4386075984 cites W2969985801 @default.
- W4386075984 cites W2978956737 @default.
- W4386075984 cites W2981263323 @default.
- W4386075984 cites W3009042479 @default.
- W4386075984 cites W3019952993 @default.
- W4386075984 cites W3034938233 @default.
- W4386075984 cites W3035581100 @default.
- W4386075984 cites W3083173864 @default.
- W4386075984 cites W3098994456 @default.
- W4386075984 cites W3109875893 @default.
- W4386075984 cites W3154411171 @default.
- W4386075984 cites W3171007011 @default.
- W4386075984 cites W3180794345 @default.
- W4386075984 cites W3188493377 @default.
- W4386075984 cites W3194872882 @default.
- W4386075984 cites W3198131199 @default.
- W4386075984 cites W3204956438 @default.
- W4386075984 cites W4200630629 @default.
- W4386075984 cites W4214544731 @default.
- W4386075984 cites W4225964194 @default.
- W4386075984 cites W4230312136 @default.
- W4386075984 cites W4230429791 @default.
- W4386075984 cites W4312309978 @default.
- W4386075984 cites W4312326867 @default.
- W4386075984 cites W4312671789 @default.
- W4386075984 cites W4312674262 @default.
- W4386075984 cites W4312908079 @default.
- W4386075984 cites W4386071471 @default.
- W4386075984 cites W4386072477 @default.
- W4386075984 cites W4386076106 @default.
- W4386075984 doi "https://doi.org/10.1109/cvpr52729.2023.00053" @default.
- W4386075984 hasPublicationYear "2023" @default.
- W4386075984 type Work @default.
- W4386075984 citedByCount "6" @default.
- W4386075984 countsByYear W43860759842023 @default.
- W4386075984 crossrefType "proceedings-article" @default.
- W4386075984 hasAuthorship W4386075984A5008425887 @default.
- W4386075984 hasAuthorship W4386075984A5021889091 @default.
- W4386075984 hasAuthorship W4386075984A5025958423 @default.
- W4386075984 hasAuthorship W4386075984A5065396778 @default.
- W4386075984 hasAuthorship W4386075984A5070584981 @default.
- W4386075984 hasAuthorship W4386075984A5072908756 @default.
- W4386075984 hasAuthorship W4386075984A5074103823 @default.
- W4386075984 hasAuthorship W4386075984A5082151648 @default.
- W4386075984 hasConcept C101738243 @default.
- W4386075984 hasConcept C104114177 @default.
- W4386075984 hasConcept C108583219 @default.
- W4386075984 hasConcept C121684516 @default.
- W4386075984 hasConcept C144024400 @default.
- W4386075984 hasConcept C149782125 @default.
- W4386075984 hasConcept C154945302 @default.
- W4386075984 hasConcept C159877910 @default.
- W4386075984 hasConcept C177264268 @default.
- W4386075984 hasConcept C199360897 @default.
- W4386075984 hasConcept C207347870 @default.
- W4386075984 hasConcept C2776760102 @default.
- W4386075984 hasConcept C2779304628 @default.
- W4386075984 hasConcept C28490314 @default.
- W4386075984 hasConcept C31487907 @default.
- W4386075984 hasConcept C31972630 @default.
- W4386075984 hasConcept C33923547 @default.
- W4386075984 hasConcept C36289849 @default.
- W4386075984 hasConcept C41008148 @default.
- W4386075984 hasConcept C48007421 @default.
- W4386075984 hasConceptScore W4386075984C101738243 @default.
- W4386075984 hasConceptScore W4386075984C104114177 @default.
- W4386075984 hasConceptScore W4386075984C108583219 @default.