Matches in SemOpenAlex for { <https://semopenalex.org/work/W4301491314> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W4301491314 abstract "Deep models that are both effective and explainable are desirable in many settings; prior explainable models have been unimodal, offering either image-based visualization of attention weights or text-based generation of post-hoc justifications. We propose a multimodal approach to explanation, and argue that the two modalities provide complementary explanatory strengths. We collect two new datasets to define and evaluate this task, and propose a novel model which can provide joint textual rationale generation and attention visualization. Our datasets define visual and textual justifications of a classification decision for activity recognition tasks (ACT-X) and for visual question answering tasks (VQA-X). We quantitatively show that training with the textual explanations not only yields better textual justification models, but also better localizes the evidence that supports the decision. We also qualitatively show cases where visual explanation is more insightful than textual explanation, and vice versa, supporting our thesis that multimodal explanation models offer significant benefits over unimodal approaches." @default.
- W4301491314 created "2022-10-05" @default.
- W4301491314 creator A5020758501 @default.
- W4301491314 creator A5024481540 @default.
- W4301491314 creator A5027383005 @default.
- W4301491314 creator A5029105520 @default.
- W4301491314 creator A5037747070 @default.
- W4301491314 creator A5040372929 @default.
- W4301491314 creator A5051534545 @default.
- W4301491314 date "2018-02-15" @default.
- W4301491314 modified "2023-09-26" @default.
- W4301491314 title "Multimodal Explanations: Justifying Decisions and Pointing to the Evidence" @default.
- W4301491314 doi "https://doi.org/10.48550/arxiv.1802.08129" @default.
- W4301491314 hasPublicationYear "2018" @default.
- W4301491314 type Work @default.
- W4301491314 citedByCount "0" @default.
- W4301491314 crossrefType "posted-content" @default.
- W4301491314 hasAuthorship W4301491314A5020758501 @default.
- W4301491314 hasAuthorship W4301491314A5024481540 @default.
- W4301491314 hasAuthorship W4301491314A5027383005 @default.
- W4301491314 hasAuthorship W4301491314A5029105520 @default.
- W4301491314 hasAuthorship W4301491314A5037747070 @default.
- W4301491314 hasAuthorship W4301491314A5040372929 @default.
- W4301491314 hasAuthorship W4301491314A5051534545 @default.
- W4301491314 hasBestOaLocation W43014913141 @default.
- W4301491314 hasConcept C119857082 @default.
- W4301491314 hasConcept C144024400 @default.
- W4301491314 hasConcept C154945302 @default.
- W4301491314 hasConcept C162324750 @default.
- W4301491314 hasConcept C187736073 @default.
- W4301491314 hasConcept C204321447 @default.
- W4301491314 hasConcept C2779903281 @default.
- W4301491314 hasConcept C2780451532 @default.
- W4301491314 hasConcept C36289849 @default.
- W4301491314 hasConcept C36464697 @default.
- W4301491314 hasConcept C41008148 @default.
- W4301491314 hasConceptScore W4301491314C119857082 @default.
- W4301491314 hasConceptScore W4301491314C144024400 @default.
- W4301491314 hasConceptScore W4301491314C154945302 @default.
- W4301491314 hasConceptScore W4301491314C162324750 @default.
- W4301491314 hasConceptScore W4301491314C187736073 @default.
- W4301491314 hasConceptScore W4301491314C204321447 @default.
- W4301491314 hasConceptScore W4301491314C2779903281 @default.
- W4301491314 hasConceptScore W4301491314C2780451532 @default.
- W4301491314 hasConceptScore W4301491314C36289849 @default.
- W4301491314 hasConceptScore W4301491314C36464697 @default.
- W4301491314 hasConceptScore W4301491314C41008148 @default.
- W4301491314 hasLocation W43014913141 @default.
- W4301491314 hasOpenAccess W4301491314 @default.
- W4301491314 hasPrimaryLocation W43014913141 @default.
- W4301491314 hasRelatedWork W1493022169 @default.
- W4301491314 hasRelatedWork W2081647779 @default.
- W4301491314 hasRelatedWork W2611614995 @default.
- W4301491314 hasRelatedWork W2961085424 @default.
- W4301491314 hasRelatedWork W3107474891 @default.
- W4301491314 hasRelatedWork W4286629047 @default.
- W4301491314 hasRelatedWork W4306321456 @default.
- W4301491314 hasRelatedWork W4306674287 @default.
- W4301491314 hasRelatedWork W1549056443 @default.
- W4301491314 hasRelatedWork W4224009465 @default.
- W4301491314 isParatext "false" @default.
- W4301491314 isRetracted "false" @default.
- W4301491314 workType "article" @default.