Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313389712> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W4313389712 abstract "Video emotion recognition aims to infer human emotional states from the audio, visual, and text modalities. Previous approaches are centered around designing sophisticated fusion mechanisms, but usually ignore the fact that text contains global semantic information, while speech and face video show more fine-grained temporal dynamics of emotion. From the perspective of cognitive sciences, the process of emotion expression, either through facial expression or speech, is implicitly regulated by high-level semantics. Inspired by this fact, we propose a multimodal interaction enhanced representation learning framework for emotion recognition from face video, where a semantic enhancement module is first designed to guide the audio/visual encoder using the semantic information from text, then the multimodal bottleneck Transformer is adopted to further reinforce the audio and visual representations by modeling the cross-modal dynamic interactions between the two feature sequences. Experimental results on two benchmark emotion databases indicate the superiority of our proposed method. With the semantic enhanced audio and visual features, it outperforms the state-of-the-art models which fuse the features or decisions from the audio, visual and text modalities." @default.
- W4313389712 created "2023-01-06" @default.
- W4313389712 creator A5049930476 @default.
- W4313389712 creator A5069084947 @default.
- W4313389712 creator A5090914417 @default.
- W4313389712 date "2022-12-19" @default.
- W4313389712 modified "2023-09-26" @default.
- W4313389712 title "Multimodal interaction enhanced representation learning for video emotion recognition" @default.
- W4313389712 cites W2080289724 @default.
- W4313389712 cites W2095176743 @default.
- W4313389712 cites W2146334809 @default.
- W4313389712 cites W2157684370 @default.
- W4313389712 cites W2250539671 @default.
- W4313389712 cites W2526050071 @default.
- W4313389712 cites W2745497104 @default.
- W4313389712 cites W2799041689 @default.
- W4313389712 cites W2807126412 @default.
- W4313389712 cites W2883409523 @default.
- W4313389712 cites W2889466822 @default.
- W4313389712 cites W2907891676 @default.
- W4313389712 cites W2964051877 @default.
- W4313389712 cites W2972797781 @default.
- W4313389712 cites W3037572520 @default.
- W4313389712 cites W3080495370 @default.
- W4313389712 cites W3093051361 @default.
- W4313389712 cites W3128412859 @default.
- W4313389712 cites W3137646246 @default.
- W4313389712 cites W3153807302 @default.
- W4313389712 cites W3160574821 @default.
- W4313389712 cites W3200612871 @default.
- W4313389712 cites W3206529771 @default.
- W4313389712 cites W3208332648 @default.
- W4313389712 cites W3208639589 @default.
- W4313389712 cites W4206396243 @default.
- W4313389712 cites W4210611093 @default.
- W4313389712 cites W4220887861 @default.
- W4313389712 cites W4221163935 @default.
- W4313389712 cites W4293517975 @default.
- W4313389712 doi "https://doi.org/10.3389/fnins.2022.1086380" @default.
- W4313389712 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/36601594" @default.
- W4313389712 hasPublicationYear "2022" @default.
- W4313389712 type Work @default.
- W4313389712 citedByCount "1" @default.
- W4313389712 countsByYear W43133897122023 @default.
- W4313389712 crossrefType "journal-article" @default.
- W4313389712 hasAuthorship W4313389712A5049930476 @default.
- W4313389712 hasAuthorship W4313389712A5069084947 @default.
- W4313389712 hasAuthorship W4313389712A5090914417 @default.
- W4313389712 hasBestOaLocation W43133897121 @default.
- W4313389712 hasConcept C111919701 @default.
- W4313389712 hasConcept C118505674 @default.
- W4313389712 hasConcept C144024400 @default.
- W4313389712 hasConcept C154945302 @default.
- W4313389712 hasConcept C184337299 @default.
- W4313389712 hasConcept C195704467 @default.
- W4313389712 hasConcept C199360897 @default.
- W4313389712 hasConcept C204321447 @default.
- W4313389712 hasConcept C2779903281 @default.
- W4313389712 hasConcept C2780660688 @default.
- W4313389712 hasConcept C28490314 @default.
- W4313389712 hasConcept C36289849 @default.
- W4313389712 hasConcept C41008148 @default.
- W4313389712 hasConcept C59404180 @default.
- W4313389712 hasConceptScore W4313389712C111919701 @default.
- W4313389712 hasConceptScore W4313389712C118505674 @default.
- W4313389712 hasConceptScore W4313389712C144024400 @default.
- W4313389712 hasConceptScore W4313389712C154945302 @default.
- W4313389712 hasConceptScore W4313389712C184337299 @default.
- W4313389712 hasConceptScore W4313389712C195704467 @default.
- W4313389712 hasConceptScore W4313389712C199360897 @default.
- W4313389712 hasConceptScore W4313389712C204321447 @default.
- W4313389712 hasConceptScore W4313389712C2779903281 @default.
- W4313389712 hasConceptScore W4313389712C2780660688 @default.
- W4313389712 hasConceptScore W4313389712C28490314 @default.
- W4313389712 hasConceptScore W4313389712C36289849 @default.
- W4313389712 hasConceptScore W4313389712C41008148 @default.
- W4313389712 hasConceptScore W4313389712C59404180 @default.
- W4313389712 hasFunder F4320321001 @default.
- W4313389712 hasFunder F4320336350 @default.
- W4313389712 hasLocation W43133897121 @default.
- W4313389712 hasLocation W43133897122 @default.
- W4313389712 hasLocation W43133897123 @default.
- W4313389712 hasLocation W43133897124 @default.
- W4313389712 hasOpenAccess W4313389712 @default.
- W4313389712 hasPrimaryLocation W43133897121 @default.
- W4313389712 hasRelatedWork W2148463593 @default.
- W4313389712 hasRelatedWork W2470996195 @default.
- W4313389712 hasRelatedWork W2613677041 @default.
- W4313389712 hasRelatedWork W2949249399 @default.
- W4313389712 hasRelatedWork W2949296282 @default.
- W4313389712 hasRelatedWork W3199271201 @default.
- W4313389712 hasRelatedWork W4283722442 @default.
- W4313389712 hasRelatedWork W4290996278 @default.
- W4313389712 hasRelatedWork W4319049579 @default.
- W4313389712 hasRelatedWork W4386254667 @default.
- W4313389712 hasVolume "16" @default.
- W4313389712 isParatext "false" @default.
- W4313389712 isRetracted "false" @default.
- W4313389712 workType "article" @default.