Matches in SemOpenAlex for { <https://semopenalex.org/work/W3084056225> ?p ?o ?g. }
- W3084056225 endingPage "374" @default.
- W3084056225 startingPage "355" @default.
- W3084056225 abstract "Communicative gestures and speech acoustic are tightly linked. Our objective is to predict the timing of gestures according to the acoustic. That is, we want to predict when a certain gesture occurs. We develop a model based on a recurrent neural network with attention mechanism. The model is trained on a corpus of natural dyadic interaction where the speech acoustic and the gesture phases and types have been annotated. The input of the model is a sequence of speech acoustic and the output is a sequence of gesture classes. The classes we are using for the model output is based on a combination of gesture phases and gesture types. We use a sequence comparison technique to evaluate the model performance. We find that the model can predict better certain gesture classes than others. We also perform ablation studies which reveal that fundamental frequency is a relevant feature for gesture prediction task. In another sub-experiment, we find that including eyebrow movements as acting as beat gesture improves the performance. Besides, we also find that a model trained on the data of one given speaker also works for the other speaker of the same conversation. We also perform a subjective experiment to measure how respondents judge the naturalness, the time consistency, and the semantic consistency of the generated gesture timing of a virtual agent. Our respondents rate the output of our model favorably." @default.
- W3084056225 created "2020-09-14" @default.
- W3084056225 creator A5064876801 @default.
- W3084056225 creator A5079026902 @default.
- W3084056225 creator A5071810186 @default.
- W3084056225 date "2021-01-01" @default.
- W3084056225 modified "2023-10-01" @default.
- W3084056225 title "Sequence-to-Sequence Predictive Model: From Prosody to Communicative Gestures" @default.
- W3084056225 cites W1534876773 @default.
- W3084056225 cites W1626120957 @default.
- W3084056225 cites W164929510 @default.
- W3084056225 cites W1988932066 @default.
- W3084056225 cites W1998021300 @default.
- W3084056225 cites W2007337857 @default.
- W3084056225 cites W2044707281 @default.
- W3084056225 cites W2085662862 @default.
- W3084056225 cites W2087430784 @default.
- W3084056225 cites W2091735588 @default.
- W3084056225 cites W2095137065 @default.
- W3084056225 cites W2109264992 @default.
- W3084056225 cites W2140124249 @default.
- W3084056225 cites W2141855524 @default.
- W3084056225 cites W2145054858 @default.
- W3084056225 cites W2235920218 @default.
- W3084056225 cites W2548862549 @default.
- W3084056225 cites W2609580779 @default.
- W3084056225 cites W2767244968 @default.
- W3084056225 cites W2807126412 @default.
- W3084056225 cites W2901468574 @default.
- W3084056225 cites W2901872500 @default.
- W3084056225 cites W2922298118 @default.
- W3084056225 cites W2954064854 @default.
- W3084056225 cites W2962795401 @default.
- W3084056225 cites W2962826786 @default.
- W3084056225 cites W2972268621 @default.
- W3084056225 cites W2981298105 @default.
- W3084056225 cites W2981802563 @default.
- W3084056225 cites W2982625143 @default.
- W3084056225 cites W3093647117 @default.
- W3084056225 cites W3094632886 @default.
- W3084056225 cites W4206906090 @default.
- W3084056225 cites W4251603968 @default.
- W3084056225 cites W51962996 @default.
- W3084056225 doi "https://doi.org/10.1007/978-3-030-77817-0_25" @default.
- W3084056225 hasPublicationYear "2021" @default.
- W3084056225 type Work @default.
- W3084056225 sameAs 3084056225 @default.
- W3084056225 citedByCount "4" @default.
- W3084056225 countsByYear W30840562252021 @default.
- W3084056225 countsByYear W30840562252022 @default.
- W3084056225 countsByYear W30840562252023 @default.
- W3084056225 crossrefType "book-chapter" @default.
- W3084056225 hasAuthorship W3084056225A5064876801 @default.
- W3084056225 hasAuthorship W3084056225A5071810186 @default.
- W3084056225 hasAuthorship W3084056225A5079026902 @default.
- W3084056225 hasBestOaLocation W30840562252 @default.
- W3084056225 hasConcept C121332964 @default.
- W3084056225 hasConcept C134537474 @default.
- W3084056225 hasConcept C144024400 @default.
- W3084056225 hasConcept C154945302 @default.
- W3084056225 hasConcept C159437735 @default.
- W3084056225 hasConcept C204321447 @default.
- W3084056225 hasConcept C207347870 @default.
- W3084056225 hasConcept C23224414 @default.
- W3084056225 hasConcept C2776436953 @default.
- W3084056225 hasConcept C2777200299 @default.
- W3084056225 hasConcept C2778112365 @default.
- W3084056225 hasConcept C28490314 @default.
- W3084056225 hasConcept C41008148 @default.
- W3084056225 hasConcept C46312422 @default.
- W3084056225 hasConcept C542774811 @default.
- W3084056225 hasConcept C54355233 @default.
- W3084056225 hasConcept C62520636 @default.
- W3084056225 hasConcept C86803240 @default.
- W3084056225 hasConceptScore W3084056225C121332964 @default.
- W3084056225 hasConceptScore W3084056225C134537474 @default.
- W3084056225 hasConceptScore W3084056225C144024400 @default.
- W3084056225 hasConceptScore W3084056225C154945302 @default.
- W3084056225 hasConceptScore W3084056225C159437735 @default.
- W3084056225 hasConceptScore W3084056225C204321447 @default.
- W3084056225 hasConceptScore W3084056225C207347870 @default.
- W3084056225 hasConceptScore W3084056225C23224414 @default.
- W3084056225 hasConceptScore W3084056225C2776436953 @default.
- W3084056225 hasConceptScore W3084056225C2777200299 @default.
- W3084056225 hasConceptScore W3084056225C2778112365 @default.
- W3084056225 hasConceptScore W3084056225C28490314 @default.
- W3084056225 hasConceptScore W3084056225C41008148 @default.
- W3084056225 hasConceptScore W3084056225C46312422 @default.
- W3084056225 hasConceptScore W3084056225C542774811 @default.
- W3084056225 hasConceptScore W3084056225C54355233 @default.
- W3084056225 hasConceptScore W3084056225C62520636 @default.
- W3084056225 hasConceptScore W3084056225C86803240 @default.
- W3084056225 hasLocation W30840562251 @default.
- W3084056225 hasLocation W30840562252 @default.
- W3084056225 hasLocation W30840562253 @default.
- W3084056225 hasLocation W30840562254 @default.
- W3084056225 hasLocation W30840562255 @default.
- W3084056225 hasOpenAccess W3084056225 @default.