Matches in SemOpenAlex for { <https://semopenalex.org/work/W4304080460> ?p ?o ?g. }
- W4304080460 abstract "Current co-speech gestures synthesis methods struggle with generating diverse motions and typically collapse to single or few frequent motion sequences, which are trained on original data distribution with customized models and strategies. We tackle this problem by temporally clustering motion sequences into content and rhythm segments and then training on content-balanced data distribution. In particular, by clustering motion sequences, we have observed for each rhythm pattern, some motions appear frequently, while others appear less. This imbalance results in the difficulty of generating low frequent occurrence motions and it cannot be easily solved by resampling, due to the inherent many-to-many mapping between content and rhythm. Therefore, we present DisCo, which disentangles motion into implicit content and rhythm features by contrastive loss for adopting different data balance strategies. Besides, to model the inherent mapping between content and rhythm features, we design a diversity-and-inclusion network (DIN), which firstly generates content features candidates and then selects one candidate by learned voting. Experiments on two public datasets, Trinity and S2G-Ellen, justify that DisCo generates more realistic and diverse motions than state-of-the-art methods. Code and data are available at https://pantomatrix.github.io/DisCo/" @default.
- W4304080460 created "2022-10-10" @default.
- W4304080460 creator A5002342231 @default.
- W4304080460 creator A5008479554 @default.
- W4304080460 creator A5050472737 @default.
- W4304080460 creator A5065075576 @default.
- W4304080460 creator A5072077909 @default.
- W4304080460 creator A5084406173 @default.
- W4304080460 creator A5087709696 @default.
- W4304080460 date "2022-10-10" @default.
- W4304080460 modified "2023-10-14" @default.
- W4304080460 title "DisCo" @default.
- W4304080460 cites W114912394 @default.
- W4304080460 cites W1974597084 @default.
- W4304080460 cites W1995628331 @default.
- W4304080460 cites W2008208299 @default.
- W4304080460 cites W2021291367 @default.
- W4304080460 cites W2127365090 @default.
- W4304080460 cites W2131734538 @default.
- W4304080460 cites W2132791018 @default.
- W4304080460 cites W2148143831 @default.
- W4304080460 cites W2191779130 @default.
- W4304080460 cites W2194775991 @default.
- W4304080460 cites W2339172597 @default.
- W4304080460 cites W2407080277 @default.
- W4304080460 cites W2427232300 @default.
- W4304080460 cites W2440599146 @default.
- W4304080460 cites W2530983305 @default.
- W4304080460 cites W2612744935 @default.
- W4304080460 cites W2737047298 @default.
- W4304080460 cites W2767106145 @default.
- W4304080460 cites W2901285216 @default.
- W4304080460 cites W2901872500 @default.
- W4304080460 cites W2902579619 @default.
- W4304080460 cites W2922509574 @default.
- W4304080460 cites W2952056941 @default.
- W4304080460 cites W2962795401 @default.
- W4304080460 cites W2962896489 @default.
- W4304080460 cites W2962933664 @default.
- W4304080460 cites W2963691377 @default.
- W4304080460 cites W3008869465 @default.
- W4304080460 cites W3024902055 @default.
- W4304080460 cites W3025893035 @default.
- W4304080460 cites W3034601242 @default.
- W4304080460 cites W3083173864 @default.
- W4304080460 cites W3107914916 @default.
- W4304080460 cites W3115266783 @default.
- W4304080460 cites W3125277150 @default.
- W4304080460 cites W3125747099 @default.
- W4304080460 cites W3159890710 @default.
- W4304080460 cites W3161050153 @default.
- W4304080460 cites W3188493377 @default.
- W4304080460 cites W3194872882 @default.
- W4304080460 cites W3204221554 @default.
- W4304080460 cites W3207529040 @default.
- W4304080460 cites W4214544731 @default.
- W4304080460 cites W4230312136 @default.
- W4304080460 cites W4230429791 @default.
- W4304080460 doi "https://doi.org/10.1145/3503161.3548400" @default.
- W4304080460 hasPublicationYear "2022" @default.
- W4304080460 type Work @default.
- W4304080460 citedByCount "6" @default.
- W4304080460 countsByYear W43040804602023 @default.
- W4304080460 crossrefType "proceedings-article" @default.
- W4304080460 hasAuthorship W4304080460A5002342231 @default.
- W4304080460 hasAuthorship W4304080460A5008479554 @default.
- W4304080460 hasAuthorship W4304080460A5050472737 @default.
- W4304080460 hasAuthorship W4304080460A5065075576 @default.
- W4304080460 hasAuthorship W4304080460A5072077909 @default.
- W4304080460 hasAuthorship W4304080460A5084406173 @default.
- W4304080460 hasAuthorship W4304080460A5087709696 @default.
- W4304080460 hasBestOaLocation W43040804601 @default.
- W4304080460 hasConcept C104114177 @default.
- W4304080460 hasConcept C107038049 @default.
- W4304080460 hasConcept C135343436 @default.
- W4304080460 hasConcept C138885662 @default.
- W4304080460 hasConcept C150921843 @default.
- W4304080460 hasConcept C153180895 @default.
- W4304080460 hasConcept C154945302 @default.
- W4304080460 hasConcept C177264268 @default.
- W4304080460 hasConcept C17744445 @default.
- W4304080460 hasConcept C199360897 @default.
- W4304080460 hasConcept C199539241 @default.
- W4304080460 hasConcept C207347870 @default.
- W4304080460 hasConcept C2776760102 @default.
- W4304080460 hasConcept C41008148 @default.
- W4304080460 hasConcept C520049643 @default.
- W4304080460 hasConcept C73555534 @default.
- W4304080460 hasConcept C94625758 @default.
- W4304080460 hasConceptScore W4304080460C104114177 @default.
- W4304080460 hasConceptScore W4304080460C107038049 @default.
- W4304080460 hasConceptScore W4304080460C135343436 @default.
- W4304080460 hasConceptScore W4304080460C138885662 @default.
- W4304080460 hasConceptScore W4304080460C150921843 @default.
- W4304080460 hasConceptScore W4304080460C153180895 @default.
- W4304080460 hasConceptScore W4304080460C154945302 @default.
- W4304080460 hasConceptScore W4304080460C177264268 @default.
- W4304080460 hasConceptScore W4304080460C17744445 @default.
- W4304080460 hasConceptScore W4304080460C199360897 @default.
- W4304080460 hasConceptScore W4304080460C199539241 @default.