FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4285981714> ?p ?o ?g. }

• W4285981714 abstract "Recent deep learning-based approaches have shown promising results for synthesizing plausible 3D human gestures from speech input. However, these approaches typically offer limited freedom to incorporate user control. Furthermore, training such models in a supervised manner often does not capture the multi-modal nature of the data, particularly because the same audio input can produce different gesture outputs. To address these problems, we present an approach for generating controllable 3D gestures that combines the advantage of database matching and deep generative modeling. Our method predicts 3D body motion by sequentially searching for the most plausible audio-gesture clips from a database using a k-Nearest Neighbors (k-NN) algorithm that considers the similarity to both the input audio and the previous body pose information. To further improve the synthesis quality, we propose a conditional Generative Adversarial Network (cGAN) model to provide a data-driven refinement to the k-NN result by comparing its plausibility against the ground truth audio-gesture pairs. Our novel approach enables direct and more varied control manipulation that is not possible with prior learning-based counterparts. Our experiments show that our proposed approach outperforms recent models on control-based synthesis tasks using high-level signals such as motion statistics while enabling flexible and effective user control for lower-level signals. 1" @default.
• W4285981714 created "2022-07-20" @default.
• W4285981714 creator A5010909245 @default.
• W4285981714 creator A5013628099 @default.
• W4285981714 creator A5020664641 @default.
• W4285981714 creator A5030586293 @default.
• W4285981714 creator A5056783532 @default.
• W4285981714 creator A5079162835 @default.
• W4285981714 creator A5086801323 @default.
• W4285981714 date "2022-08-07" @default.
• W4285981714 modified "2023-10-11" @default.
• W4285981714 title "A Motion Matching-based Framework for Controllable Gesture Synthesis from Speech" @default.
• W4285981714 cites W114912394 @default.
• W4285981714 cites W1974597084 @default.
• W4285981714 cites W2008208299 @default.
• W4285981714 cites W2027247754 @default.
• W4285981714 cites W2131734538 @default.
• W4285981714 cites W216945601 @default.
• W4285981714 cites W2243558602 @default.
• W4285981714 cites W2249800031 @default.
• W4285981714 cites W2559085405 @default.
• W4285981714 cites W2604379605 @default.
• W4285981714 cites W2737477199 @default.
• W4285981714 cites W2901872500 @default.
• W4285981714 cites W2962795401 @default.
• W4285981714 cites W2963544341 @default.
• W4285981714 cites W2967443589 @default.
• W4285981714 cites W2981802563 @default.
• W4285981714 cites W3009042479 @default.
• W4285981714 cites W3048665613 @default.
• W4285981714 cites W3083173864 @default.
• W4285981714 cites W3093647117 @default.
• W4285981714 cites W3099402851 @default.
• W4285981714 cites W3115266783 @default.
• W4285981714 cites W3153551559 @default.
• W4285981714 cites W3172764674 @default.
• W4285981714 cites W3188493377 @default.
• W4285981714 cites W3198131199 @default.
• W4285981714 cites W341184420 @default.
• W4285981714 cites W4214544731 @default.
• W4285981714 cites W4230312136 @default.
• W4285981714 cites W4230429791 @default.
• W4285981714 doi "https://doi.org/10.1145/3528233.3530750" @default.
• W4285981714 hasPublicationYear "2022" @default.
• W4285981714 type Work @default.
• W4285981714 citedByCount "7" @default.
• W4285981714 countsByYear W42859817142022 @default.
• W4285981714 countsByYear W42859817142023 @default.
• W4285981714 crossrefType "proceedings-article" @default.
• W4285981714 hasAuthorship W4285981714A5010909245 @default.
• W4285981714 hasAuthorship W4285981714A5013628099 @default.
• W4285981714 hasAuthorship W4285981714A5020664641 @default.
• W4285981714 hasAuthorship W4285981714A5030586293 @default.
• W4285981714 hasAuthorship W4285981714A5056783532 @default.
• W4285981714 hasAuthorship W4285981714A5079162835 @default.
• W4285981714 hasAuthorship W4285981714A5086801323 @default.
• W4285981714 hasBestOaLocation W42859817141 @default.
• W4285981714 hasConcept C103278499 @default.
• W4285981714 hasConcept C104114177 @default.
• W4285981714 hasConcept C105795698 @default.
• W4285981714 hasConcept C108583219 @default.
• W4285981714 hasConcept C115961682 @default.
• W4285981714 hasConcept C119857082 @default.
• W4285981714 hasConcept C154945302 @default.
• W4285981714 hasConcept C159437735 @default.
• W4285981714 hasConcept C165064840 @default.
• W4285981714 hasConcept C167966045 @default.
• W4285981714 hasConcept C207347870 @default.
• W4285981714 hasConcept C28490314 @default.
• W4285981714 hasConcept C31972630 @default.
• W4285981714 hasConcept C33923547 @default.
• W4285981714 hasConcept C39890363 @default.
• W4285981714 hasConcept C41008148 @default.
• W4285981714 hasConcept C48007421 @default.
• W4285981714 hasConceptScore W4285981714C103278499 @default.
• W4285981714 hasConceptScore W4285981714C104114177 @default.
• W4285981714 hasConceptScore W4285981714C105795698 @default.
• W4285981714 hasConceptScore W4285981714C108583219 @default.
• W4285981714 hasConceptScore W4285981714C115961682 @default.
• W4285981714 hasConceptScore W4285981714C119857082 @default.
• W4285981714 hasConceptScore W4285981714C154945302 @default.
• W4285981714 hasConceptScore W4285981714C159437735 @default.
• W4285981714 hasConceptScore W4285981714C165064840 @default.
• W4285981714 hasConceptScore W4285981714C167966045 @default.
• W4285981714 hasConceptScore W4285981714C207347870 @default.
• W4285981714 hasConceptScore W4285981714C28490314 @default.
• W4285981714 hasConceptScore W4285981714C31972630 @default.
• W4285981714 hasConceptScore W4285981714C33923547 @default.
• W4285981714 hasConceptScore W4285981714C39890363 @default.
• W4285981714 hasConceptScore W4285981714C41008148 @default.
• W4285981714 hasConceptScore W4285981714C48007421 @default.
• W4285981714 hasFunder F4320334678 @default.
• W4285981714 hasLocation W42859817141 @default.
• W4285981714 hasOpenAccess W4285981714 @default.
• W4285981714 hasPrimaryLocation W42859817141 @default.
• W4285981714 hasRelatedWork W1033489 @default.
• W4285981714 hasRelatedWork W1851213814 @default.
• W4285981714 hasRelatedWork W2029399117 @default.
• W4285981714 hasRelatedWork W2348818095 @default.
• W4285981714 hasRelatedWork W3111216657 @default.

• next