Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385484760> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W4385484760 abstract "Multimodal emotion recognition comprehensively identifies the emotion contained in multimodal data by bridging the gaps between heterogeneous dataset. In recent years, multimodal emotion recognition methods have gained significant attention and been shown to surpass single-modal approaches. Most of the existing multimodal emotion analysis methods simply combine different modalities to improve the recognition capability of consistent emotion expressions across multimodal data. However, it remains challenging to recognize the right emotion when multiple modalities' contents carry inconsistent or even contradictory emotions. To solve this problem, we propose a novel image-text emotion recognition model named Multimodal Cross-Attention Bayesian Network(MCABN). The entire network exploits Bayesian theory to learn the distribution of its weight parameters, making optimization directions and results of parameters interpretable. What's more, the model leverages the consistency and complementarity between visual content and textual description to arrive at accurate decisions. Specifically, for each modality, multiple explainable features (color, texture, and shape feature in the image, while adjective, adverb, verb, noun, and negative feature in the text) and one unexplainable feature are fused as its feature representation to reinforce emotion-related features. Then two single-modal attention modules(Visual Attention Module and Textual Attention Module) capture the most discriminative features in a single image and text; Two cross-modal attention modules(Image-guided Text Attention Module and Text-guided Image Attention Module) extract the complementary and dominant features between two modalities by interactive learning. Finally, the outputs of four attention modules are integrated through intermediate fusion to predict the final emotion. The experimental results on the NVTD and MVSA-Multiple dataset indicate that the proposed MCABN outperforms state-of-the-art baselines by substantial margins." @default.
- W4385484760 created "2023-08-03" @default.
- W4385484760 creator A5024801841 @default.
- W4385484760 creator A5031597539 @default.
- W4385484760 creator A5036388641 @default.
- W4385484760 creator A5045197865 @default.
- W4385484760 creator A5054463951 @default.
- W4385484760 creator A5067265615 @default.
- W4385484760 date "2023-06-18" @default.
- W4385484760 modified "2023-09-26" @default.
- W4385484760 title "Multimodal Cross-Attention Bayesian Network for Social News Emotion Recognition" @default.
- W4385484760 cites W1965555277 @default.
- W4385484760 cites W2065895060 @default.
- W4385484760 cites W2075456404 @default.
- W4385484760 cites W2077943861 @default.
- W4385484760 cites W2110700950 @default.
- W4385484760 cites W2126792281 @default.
- W4385484760 cites W2194775991 @default.
- W4385484760 cites W2518273597 @default.
- W4385484760 cites W2583643061 @default.
- W4385484760 cites W2587838525 @default.
- W4385484760 cites W2744979708 @default.
- W4385484760 cites W2910191085 @default.
- W4385484760 cites W2958208506 @default.
- W4385484760 cites W2998091506 @default.
- W4385484760 cites W3024507639 @default.
- W4385484760 cites W3041730883 @default.
- W4385484760 cites W3095024162 @default.
- W4385484760 cites W3124019418 @default.
- W4385484760 cites W3124608533 @default.
- W4385484760 cites W3138516171 @default.
- W4385484760 cites W3143658568 @default.
- W4385484760 cites W4210532528 @default.
- W4385484760 cites W4220696353 @default.
- W4385484760 cites W4223555601 @default.
- W4385484760 cites W4226150137 @default.
- W4385484760 cites W80158660 @default.
- W4385484760 doi "https://doi.org/10.1109/ijcnn54540.2023.10191298" @default.
- W4385484760 hasPublicationYear "2023" @default.
- W4385484760 type Work @default.
- W4385484760 citedByCount "0" @default.
- W4385484760 crossrefType "proceedings-article" @default.
- W4385484760 hasAuthorship W4385484760A5024801841 @default.
- W4385484760 hasAuthorship W4385484760A5031597539 @default.
- W4385484760 hasAuthorship W4385484760A5036388641 @default.
- W4385484760 hasAuthorship W4385484760A5045197865 @default.
- W4385484760 hasAuthorship W4385484760A5054463951 @default.
- W4385484760 hasAuthorship W4385484760A5067265615 @default.
- W4385484760 hasConcept C119857082 @default.
- W4385484760 hasConcept C138885662 @default.
- W4385484760 hasConcept C144024400 @default.
- W4385484760 hasConcept C153180895 @default.
- W4385484760 hasConcept C154945302 @default.
- W4385484760 hasConcept C204321447 @default.
- W4385484760 hasConcept C2776401178 @default.
- W4385484760 hasConcept C2779903281 @default.
- W4385484760 hasConcept C36289849 @default.
- W4385484760 hasConcept C41008148 @default.
- W4385484760 hasConcept C41895202 @default.
- W4385484760 hasConcept C59404180 @default.
- W4385484760 hasConcept C97931131 @default.
- W4385484760 hasConceptScore W4385484760C119857082 @default.
- W4385484760 hasConceptScore W4385484760C138885662 @default.
- W4385484760 hasConceptScore W4385484760C144024400 @default.
- W4385484760 hasConceptScore W4385484760C153180895 @default.
- W4385484760 hasConceptScore W4385484760C154945302 @default.
- W4385484760 hasConceptScore W4385484760C204321447 @default.
- W4385484760 hasConceptScore W4385484760C2776401178 @default.
- W4385484760 hasConceptScore W4385484760C2779903281 @default.
- W4385484760 hasConceptScore W4385484760C36289849 @default.
- W4385484760 hasConceptScore W4385484760C41008148 @default.
- W4385484760 hasConceptScore W4385484760C41895202 @default.
- W4385484760 hasConceptScore W4385484760C59404180 @default.
- W4385484760 hasConceptScore W4385484760C97931131 @default.
- W4385484760 hasFunder F4320321001 @default.
- W4385484760 hasLocation W43854847601 @default.
- W4385484760 hasOpenAccess W4385484760 @default.
- W4385484760 hasPrimaryLocation W43854847601 @default.
- W4385484760 hasRelatedWork W2050806332 @default.
- W4385484760 hasRelatedWork W2061273563 @default.
- W4385484760 hasRelatedWork W2507989420 @default.
- W4385484760 hasRelatedWork W2573334707 @default.
- W4385484760 hasRelatedWork W2905846897 @default.
- W4385484760 hasRelatedWork W2944661354 @default.
- W4385484760 hasRelatedWork W2970216048 @default.
- W4385484760 hasRelatedWork W2998168123 @default.
- W4385484760 hasRelatedWork W4287995534 @default.
- W4385484760 hasRelatedWork W4386159699 @default.
- W4385484760 isParatext "false" @default.
- W4385484760 isRetracted "false" @default.
- W4385484760 workType "article" @default.