Matches in SemOpenAlex for { <https://semopenalex.org/work/W3112864462> ?p ?o ?g. }
- W3112864462 abstract "Multimodal learning mimics the reasoning process of the human multi-sensory system, which is used to perceive the surrounding world. While making a prediction, the human brain tends to relate crucial cues from multiple sources of information. In this work, we propose a novel multimodal fusion module that learns to emphasize more contributive features across all modalities. Specifically, the proposed Multimodal Split Attention Fusion (MSAF) module splits each modality into channel-wise equal feature blocks and creates a joint representation that is used to generate soft attention for each channel across the feature blocks. Further, the MSAF module is designed to be compatible with features of various spatial dimensions and sequence lengths, suitable for both CNNs and RNNs. Thus, MSAF can be easily added to fuse features of any unimodal networks and utilize existing pretrained unimodal model weights. To demonstrate the effectiveness of our fusion module, we design three multimodal networks with MSAF for emotion recognition, sentiment analysis, and action recognition tasks. Our approach achieves competitive results in each task and outperforms other application-specific networks and multimodal fusion benchmarks." @default.
- W3112864462 created "2020-12-21" @default.
- W3112864462 creator A5030291480 @default.
- W3112864462 creator A5031991761 @default.
- W3112864462 creator A5041516478 @default.
- W3112864462 creator A5079750612 @default.
- W3112864462 date "2020-12-13" @default.
- W3112864462 modified "2023-09-27" @default.
- W3112864462 title "MSAF: Multimodal Split Attention Fusion." @default.
- W3112864462 cites W1523385540 @default.
- W3112864462 cites W1534131679 @default.
- W3112864462 cites W2085497785 @default.
- W3112864462 cites W2095176743 @default.
- W3112864462 cites W2116038117 @default.
- W3112864462 cites W2116787917 @default.
- W3112864462 cites W2120121005 @default.
- W3112864462 cites W22229905 @default.
- W3112864462 cites W2270470215 @default.
- W3112864462 cites W2465534249 @default.
- W3112864462 cites W2470413457 @default.
- W3112864462 cites W2549139847 @default.
- W3112864462 cites W2619383789 @default.
- W3112864462 cites W2799211965 @default.
- W3112864462 cites W2803193013 @default.
- W3112864462 cites W2805783416 @default.
- W3112864462 cites W2883409523 @default.
- W3112864462 cites W2883430806 @default.
- W3112864462 cites W2888471892 @default.
- W3112864462 cites W2890166761 @default.
- W3112864462 cites W2895368507 @default.
- W3112864462 cites W28988658 @default.
- W3112864462 cites W2901809396 @default.
- W3112864462 cites W2915602689 @default.
- W3112864462 cites W2954869531 @default.
- W3112864462 cites W2958722525 @default.
- W3112864462 cites W2962850006 @default.
- W3112864462 cites W2962934715 @default.
- W3112864462 cites W2963066927 @default.
- W3112864462 cites W2963192057 @default.
- W3112864462 cites W2963273301 @default.
- W3112864462 cites W2963341956 @default.
- W3112864462 cites W2963369114 @default.
- W3112864462 cites W2963383024 @default.
- W3112864462 cites W2963420686 @default.
- W3112864462 cites W2963524571 @default.
- W3112864462 cites W2963541336 @default.
- W3112864462 cites W2963685106 @default.
- W3112864462 cites W2964010806 @default.
- W3112864462 cites W2964121744 @default.
- W3112864462 cites W2964134613 @default.
- W3112864462 cites W2972921424 @default.
- W3112864462 cites W2997258743 @default.
- W3112864462 cites W3008546095 @default.
- W3112864462 cites W3011934170 @default.
- W3112864462 cites W3015267357 @default.
- W3112864462 cites W3016234935 @default.
- W3112864462 cites W3016719260 @default.
- W3112864462 cites W3024115689 @default.
- W3112864462 cites W3035570025 @default.
- W3112864462 cites W3037572520 @default.
- W3112864462 cites W3093051361 @default.
- W3112864462 cites W3099202502 @default.
- W3112864462 cites W3105354225 @default.
- W3112864462 hasPublicationYear "2020" @default.
- W3112864462 type Work @default.
- W3112864462 sameAs 3112864462 @default.
- W3112864462 citedByCount "1" @default.
- W3112864462 countsByYear W31128644622021 @default.
- W3112864462 crossrefType "posted-content" @default.
- W3112864462 hasAuthorship W3112864462A5030291480 @default.
- W3112864462 hasAuthorship W3112864462A5031991761 @default.
- W3112864462 hasAuthorship W3112864462A5041516478 @default.
- W3112864462 hasAuthorship W3112864462A5079750612 @default.
- W3112864462 hasConcept C111919701 @default.
- W3112864462 hasConcept C119599485 @default.
- W3112864462 hasConcept C119857082 @default.
- W3112864462 hasConcept C127413603 @default.
- W3112864462 hasConcept C136764020 @default.
- W3112864462 hasConcept C138885662 @default.
- W3112864462 hasConcept C141353440 @default.
- W3112864462 hasConcept C147168706 @default.
- W3112864462 hasConcept C153180895 @default.
- W3112864462 hasConcept C154945302 @default.
- W3112864462 hasConcept C201995342 @default.
- W3112864462 hasConcept C2776401178 @default.
- W3112864462 hasConcept C2780226545 @default.
- W3112864462 hasConcept C2780451532 @default.
- W3112864462 hasConcept C2780910867 @default.
- W3112864462 hasConcept C41008148 @default.
- W3112864462 hasConcept C41895202 @default.
- W3112864462 hasConcept C50644808 @default.
- W3112864462 hasConcept C98045186 @default.
- W3112864462 hasConceptScore W3112864462C111919701 @default.
- W3112864462 hasConceptScore W3112864462C119599485 @default.
- W3112864462 hasConceptScore W3112864462C119857082 @default.
- W3112864462 hasConceptScore W3112864462C127413603 @default.
- W3112864462 hasConceptScore W3112864462C136764020 @default.
- W3112864462 hasConceptScore W3112864462C138885662 @default.
- W3112864462 hasConceptScore W3112864462C141353440 @default.
- W3112864462 hasConceptScore W3112864462C147168706 @default.