Matches in SemOpenAlex for { <https://semopenalex.org/work/W3022508977> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W3022508977 abstract "The human language has heterogeneous sources of information, including tones of voice, facial gestures, and spoken language. Recent advances introduced computational models to combine these multimodal sources and yielded strong performance on human-centric tasks. Nevertheless, most of the models are often black-box, which comes with the price of lacking interpretability. In this paper, we propose Multimodal Routing to separate the contributions to the prediction from each modality and the interactions between modalities. At the heart of our method is a routing mechanism that represents each prediction as a concept, i.e., a vector in a Euclidean space. The concept assumes a linear aggregation from the contributions of multimodal features. Then, the routing procedure iteratively 1) associates a feature and a concept by checking how this concept agrees with this feature and 2) updates the concept based on the associations. In our experiments, we provide both global and local interpretation using Multimodal Routing on sentiment analysis and emotion prediction, without loss of performance compared to state-of-the-art methods. For example, we observe that our model relies mostly on the text modality for neutral sentiment predictions, the acoustic modality for extremely negative predictions, and the text-acoustic bimodal interaction for extremely positive predictions." @default.
- W3022508977 created "2020-05-13" @default.
- W3022508977 creator A5012381843 @default.
- W3022508977 creator A5015826285 @default.
- W3022508977 creator A5060335438 @default.
- W3022508977 creator A5071983998 @default.
- W3022508977 creator A5081398601 @default.
- W3022508977 date "2020-04-29" @default.
- W3022508977 modified "2023-10-18" @default.
- W3022508977 title "Interpretable Multimodal Routing for Human Multimodal Language." @default.
- W3022508977 cites W1679149859 @default.
- W3022508977 cites W2015394094 @default.
- W3022508977 cites W2057409323 @default.
- W3022508977 cites W2064675550 @default.
- W3022508977 cites W2095176743 @default.
- W3022508977 cites W2184188583 @default.
- W3022508977 cites W2250539671 @default.
- W3022508977 cites W2282821441 @default.
- W3022508977 cites W2785994986 @default.
- W3022508977 cites W2797583072 @default.
- W3022508977 cites W2798683079 @default.
- W3022508977 cites W2803193013 @default.
- W3022508977 cites W2883409523 @default.
- W3022508977 cites W2963383024 @default.
- W3022508977 cites W2963703618 @default.
- W3022508977 cites W2963871344 @default.
- W3022508977 cites W2964216663 @default.
- W3022508977 hasPublicationYear "2020" @default.
- W3022508977 type Work @default.
- W3022508977 sameAs 3022508977 @default.
- W3022508977 citedByCount "2" @default.
- W3022508977 countsByYear W30225089772021 @default.
- W3022508977 crossrefType "posted-content" @default.
- W3022508977 hasAuthorship W3022508977A5012381843 @default.
- W3022508977 hasAuthorship W3022508977A5015826285 @default.
- W3022508977 hasAuthorship W3022508977A5060335438 @default.
- W3022508977 hasAuthorship W3022508977A5071983998 @default.
- W3022508977 hasAuthorship W3022508977A5081398601 @default.
- W3022508977 hasConcept C138885662 @default.
- W3022508977 hasConcept C144024400 @default.
- W3022508977 hasConcept C154945302 @default.
- W3022508977 hasConcept C204321447 @default.
- W3022508977 hasConcept C207347870 @default.
- W3022508977 hasConcept C2776401178 @default.
- W3022508977 hasConcept C2779903281 @default.
- W3022508977 hasConcept C2780226545 @default.
- W3022508977 hasConcept C2781067378 @default.
- W3022508977 hasConcept C36289849 @default.
- W3022508977 hasConcept C41008148 @default.
- W3022508977 hasConcept C41895202 @default.
- W3022508977 hasConcept C83665646 @default.
- W3022508977 hasConceptScore W3022508977C138885662 @default.
- W3022508977 hasConceptScore W3022508977C144024400 @default.
- W3022508977 hasConceptScore W3022508977C154945302 @default.
- W3022508977 hasConceptScore W3022508977C204321447 @default.
- W3022508977 hasConceptScore W3022508977C207347870 @default.
- W3022508977 hasConceptScore W3022508977C2776401178 @default.
- W3022508977 hasConceptScore W3022508977C2779903281 @default.
- W3022508977 hasConceptScore W3022508977C2780226545 @default.
- W3022508977 hasConceptScore W3022508977C2781067378 @default.
- W3022508977 hasConceptScore W3022508977C36289849 @default.
- W3022508977 hasConceptScore W3022508977C41008148 @default.
- W3022508977 hasConceptScore W3022508977C41895202 @default.
- W3022508977 hasConceptScore W3022508977C83665646 @default.
- W3022508977 hasLocation W30225089771 @default.
- W3022508977 hasOpenAccess W3022508977 @default.
- W3022508977 hasPrimaryLocation W30225089771 @default.
- W3022508977 hasRelatedWork W2121407213 @default.
- W3022508977 hasRelatedWork W2133943532 @default.
- W3022508977 hasRelatedWork W2556299351 @default.
- W3022508977 hasRelatedWork W2747797848 @default.
- W3022508977 hasRelatedWork W2800026222 @default.
- W3022508977 hasRelatedWork W2904742344 @default.
- W3022508977 hasRelatedWork W2907174776 @default.
- W3022508977 hasRelatedWork W2907233095 @default.
- W3022508977 hasRelatedWork W2920873876 @default.
- W3022508977 hasRelatedWork W2952663444 @default.
- W3022508977 hasRelatedWork W2954367631 @default.
- W3022508977 hasRelatedWork W2990609234 @default.
- W3022508977 hasRelatedWork W2991007094 @default.
- W3022508977 hasRelatedWork W3086578443 @default.
- W3022508977 hasRelatedWork W3094498998 @default.
- W3022508977 hasRelatedWork W3102475290 @default.
- W3022508977 hasRelatedWork W3155230099 @default.
- W3022508977 hasRelatedWork W3176910517 @default.
- W3022508977 hasRelatedWork W3176939811 @default.
- W3022508977 hasRelatedWork W3129809057 @default.
- W3022508977 isParatext "false" @default.
- W3022508977 isRetracted "false" @default.
- W3022508977 magId "3022508977" @default.
- W3022508977 workType "article" @default.