Matches in SemOpenAlex for { <https://semopenalex.org/work/W4224932526> ?p ?o ?g. }
- W4224932526 abstract "A challenging task in audiovisual emotion recognition is to implement neural network architectures that can leverage and fuse multimodal information while temporally aligning modalities, handling missing modalities, and capturing information from all modalities without losing information during training. These requirements are important to achieve model robustness and to increase accuracy on the emotion recognition task. A recent approach to perform multimodal fusion is to use the transformer architecture to properly fuse and align the modalities. This study proposes the AuxFormer framework, which addresses in a principled way the aforementioned challenges. AuxFormer combines the transformer framework with auxiliary networks. It uses shared losses to infuse information from single-modality networks that are separately embedded. The extra layer of audiovisual information added to our main network retains information that would otherwise be lost during training. The results show that the AuxFormer architecture achieves macro and micro F1Scores of 71.3% and 71.7%, respectively, on the CREMA-D corpus. For the MSP-IMPROV corpus, AuxFormer achieves a macro and micro F1-Scores of 70.4% and 76.5%, respectively. The results for both corpora are significantly better than strong baselines, indicating that our framework benefits from auxiliary networks. We also show that under non-ideal conditions (e.g., missing modalities) our architecture is able to sustain strong performance under audio-only and video-only scenarios, benefiting from a optimized training strategy." @default.
- W4224932526 created "2022-04-28" @default.
- W4224932526 creator A5017966455 @default.
- W4224932526 creator A5040793194 @default.
- W4224932526 date "2022-05-23" @default.
- W4224932526 modified "2023-10-16" @default.
- W4224932526 title "AuxFormer: Robust Approach to Audiovisual Emotion Recognition" @default.
- W4224932526 cites W1976725440 @default.
- W4224932526 cites W2012237712 @default.
- W4224932526 cites W2030931454 @default.
- W4224932526 cites W2080830759 @default.
- W4224932526 cites W2096391593 @default.
- W4224932526 cites W2097117768 @default.
- W4224932526 cites W2144005487 @default.
- W4224932526 cites W2155765376 @default.
- W4224932526 cites W2163026698 @default.
- W4224932526 cites W2325939864 @default.
- W4224932526 cites W2342475039 @default.
- W4224932526 cites W2525412388 @default.
- W4224932526 cites W2790326622 @default.
- W4224932526 cites W2897067191 @default.
- W4224932526 cites W2963702064 @default.
- W4224932526 cites W2964051877 @default.
- W4224932526 cites W2964266095 @default.
- W4224932526 cites W2972602947 @default.
- W4224932526 cites W3007589762 @default.
- W4224932526 cites W3034266838 @default.
- W4224932526 cites W3035118106 @default.
- W4224932526 cites W3106250896 @default.
- W4224932526 cites W3114214226 @default.
- W4224932526 doi "https://doi.org/10.1109/icassp43922.2022.9747157" @default.
- W4224932526 hasPublicationYear "2022" @default.
- W4224932526 type Work @default.
- W4224932526 citedByCount "4" @default.
- W4224932526 countsByYear W42249325262022 @default.
- W4224932526 countsByYear W42249325262023 @default.
- W4224932526 crossrefType "proceedings-article" @default.
- W4224932526 hasAuthorship W4224932526A5017966455 @default.
- W4224932526 hasAuthorship W4224932526A5040793194 @default.
- W4224932526 hasConcept C104317684 @default.
- W4224932526 hasConcept C119599485 @default.
- W4224932526 hasConcept C119857082 @default.
- W4224932526 hasConcept C123657996 @default.
- W4224932526 hasConcept C127413603 @default.
- W4224932526 hasConcept C141353440 @default.
- W4224932526 hasConcept C142362112 @default.
- W4224932526 hasConcept C144024400 @default.
- W4224932526 hasConcept C153083717 @default.
- W4224932526 hasConcept C153349607 @default.
- W4224932526 hasConcept C154945302 @default.
- W4224932526 hasConcept C165801399 @default.
- W4224932526 hasConcept C166955791 @default.
- W4224932526 hasConcept C185592680 @default.
- W4224932526 hasConcept C199360897 @default.
- W4224932526 hasConcept C2779903281 @default.
- W4224932526 hasConcept C2780226545 @default.
- W4224932526 hasConcept C28490314 @default.
- W4224932526 hasConcept C36289849 @default.
- W4224932526 hasConcept C41008148 @default.
- W4224932526 hasConcept C50644808 @default.
- W4224932526 hasConcept C55493867 @default.
- W4224932526 hasConcept C63479239 @default.
- W4224932526 hasConcept C66322947 @default.
- W4224932526 hasConceptScore W4224932526C104317684 @default.
- W4224932526 hasConceptScore W4224932526C119599485 @default.
- W4224932526 hasConceptScore W4224932526C119857082 @default.
- W4224932526 hasConceptScore W4224932526C123657996 @default.
- W4224932526 hasConceptScore W4224932526C127413603 @default.
- W4224932526 hasConceptScore W4224932526C141353440 @default.
- W4224932526 hasConceptScore W4224932526C142362112 @default.
- W4224932526 hasConceptScore W4224932526C144024400 @default.
- W4224932526 hasConceptScore W4224932526C153083717 @default.
- W4224932526 hasConceptScore W4224932526C153349607 @default.
- W4224932526 hasConceptScore W4224932526C154945302 @default.
- W4224932526 hasConceptScore W4224932526C165801399 @default.
- W4224932526 hasConceptScore W4224932526C166955791 @default.
- W4224932526 hasConceptScore W4224932526C185592680 @default.
- W4224932526 hasConceptScore W4224932526C199360897 @default.
- W4224932526 hasConceptScore W4224932526C2779903281 @default.
- W4224932526 hasConceptScore W4224932526C2780226545 @default.
- W4224932526 hasConceptScore W4224932526C28490314 @default.
- W4224932526 hasConceptScore W4224932526C36289849 @default.
- W4224932526 hasConceptScore W4224932526C41008148 @default.
- W4224932526 hasConceptScore W4224932526C50644808 @default.
- W4224932526 hasConceptScore W4224932526C55493867 @default.
- W4224932526 hasConceptScore W4224932526C63479239 @default.
- W4224932526 hasConceptScore W4224932526C66322947 @default.
- W4224932526 hasLocation W42249325261 @default.
- W4224932526 hasOpenAccess W4224932526 @default.
- W4224932526 hasPrimaryLocation W42249325261 @default.
- W4224932526 hasRelatedWork W2154469718 @default.
- W4224932526 hasRelatedWork W3153347230 @default.
- W4224932526 hasRelatedWork W3171735296 @default.
- W4224932526 hasRelatedWork W3211951101 @default.
- W4224932526 hasRelatedWork W4200381230 @default.
- W4224932526 hasRelatedWork W4287204696 @default.
- W4224932526 hasRelatedWork W4293518096 @default.
- W4224932526 hasRelatedWork W4308080854 @default.
- W4224932526 hasRelatedWork W4310877696 @default.
- W4224932526 hasRelatedWork W4383993410 @default.