Matches in SemOpenAlex for { <https://semopenalex.org/work/W3206218097> ?p ?o ?g. }
- W3206218097 abstract "Given a question about an image, a Visual Commonsense Reasoning (VCR) model needs to provide not only a correct answer, but also a rationale to justify the answer. It is a challenging task due to the requirements of diverse visual content understanding, abstract language comprehending, and complicated inter-modality relationship reasoning. To solve above challenges, previous methods either resort to holistic attention mechanism or explore transformer-based model with pre-training, which, however, cannot perform comprehensive understanding and usually suffer from heavy computing burden. In this paper, we propose a novel multi-level counterfactual contrastive learning network for VCR by jointly modeling the hierarchical visual contents and the inter-modality relationships between the visual and linguistic domains. The proposed method enjoys several merits. First, with sufficient instance-level, image-level, and semantic-level contrastive learning, our model can extract discriminative features and perform comprehensive understanding for the image and linguistic expressions. Second, taking advantage of counterfactual thinking, we can generate informative factual and counterfactual samples for contrastive learning, resulting in stronger perception ability of our model. Third, an auxiliary contrast module is incorporated into our method to directly optimize the answer prediction in VCR, which further facilitates the representation learning. Extensive experiments on the VCR dataset demonstrate that our approach performs favorably against the state-of-the-arts." @default.
- W3206218097 created "2021-10-25" @default.
- W3206218097 creator A5022636178 @default.
- W3206218097 creator A5055213066 @default.
- W3206218097 creator A5070538645 @default.
- W3206218097 date "2021-10-17" @default.
- W3206218097 modified "2023-10-16" @default.
- W3206218097 title "Multi-Level Counterfactual Contrast for Visual Commonsense Reasoning" @default.
- W3206218097 cites W2138621090 @default.
- W3206218097 cites W2194775991 @default.
- W3206218097 cites W2471094925 @default.
- W3206218097 cites W2608787653 @default.
- W3206218097 cites W2745461083 @default.
- W3206218097 cites W2798991696 @default.
- W3206218097 cites W2914699769 @default.
- W3206218097 cites W2962858109 @default.
- W3206218097 cites W2963115613 @default.
- W3206218097 cites W2963159690 @default.
- W3206218097 cites W2963717374 @default.
- W3206218097 cites W2970869018 @default.
- W3206218097 cites W2997531716 @default.
- W3206218097 cites W2998388430 @default.
- W3206218097 cites W3021007069 @default.
- W3206218097 cites W3034298080 @default.
- W3206218097 cites W3034682719 @default.
- W3206218097 cites W3035463379 @default.
- W3206218097 cites W3035497460 @default.
- W3206218097 cites W3035512383 @default.
- W3206218097 cites W3035517717 @default.
- W3206218097 cites W3035524453 @default.
- W3206218097 cites W3035651653 @default.
- W3206218097 cites W3090449556 @default.
- W3206218097 cites W3093314701 @default.
- W3206218097 cites W3093344337 @default.
- W3206218097 cites W3093355642 @default.
- W3206218097 cites W3093385053 @default.
- W3206218097 cites W3099884329 @default.
- W3206218097 doi "https://doi.org/10.1145/3474085.3475328" @default.
- W3206218097 hasPublicationYear "2021" @default.
- W3206218097 type Work @default.
- W3206218097 sameAs 3206218097 @default.
- W3206218097 citedByCount "6" @default.
- W3206218097 countsByYear W32062180972022 @default.
- W3206218097 countsByYear W32062180972023 @default.
- W3206218097 crossrefType "proceedings-article" @default.
- W3206218097 hasAuthorship W3206218097A5022636178 @default.
- W3206218097 hasAuthorship W3206218097A5055213066 @default.
- W3206218097 hasAuthorship W3206218097A5070538645 @default.
- W3206218097 hasConcept C108650721 @default.
- W3206218097 hasConcept C119857082 @default.
- W3206218097 hasConcept C154945302 @default.
- W3206218097 hasConcept C15744967 @default.
- W3206218097 hasConcept C169760540 @default.
- W3206218097 hasConcept C17744445 @default.
- W3206218097 hasConcept C193221554 @default.
- W3206218097 hasConcept C199539241 @default.
- W3206218097 hasConcept C204321447 @default.
- W3206218097 hasConcept C26760741 @default.
- W3206218097 hasConcept C2776359362 @default.
- W3206218097 hasConcept C2776502983 @default.
- W3206218097 hasConcept C2777508537 @default.
- W3206218097 hasConcept C2780226545 @default.
- W3206218097 hasConcept C41008148 @default.
- W3206218097 hasConcept C77805123 @default.
- W3206218097 hasConcept C94625758 @default.
- W3206218097 hasConcept C97931131 @default.
- W3206218097 hasConceptScore W3206218097C108650721 @default.
- W3206218097 hasConceptScore W3206218097C119857082 @default.
- W3206218097 hasConceptScore W3206218097C154945302 @default.
- W3206218097 hasConceptScore W3206218097C15744967 @default.
- W3206218097 hasConceptScore W3206218097C169760540 @default.
- W3206218097 hasConceptScore W3206218097C17744445 @default.
- W3206218097 hasConceptScore W3206218097C193221554 @default.
- W3206218097 hasConceptScore W3206218097C199539241 @default.
- W3206218097 hasConceptScore W3206218097C204321447 @default.
- W3206218097 hasConceptScore W3206218097C26760741 @default.
- W3206218097 hasConceptScore W3206218097C2776359362 @default.
- W3206218097 hasConceptScore W3206218097C2776502983 @default.
- W3206218097 hasConceptScore W3206218097C2777508537 @default.
- W3206218097 hasConceptScore W3206218097C2780226545 @default.
- W3206218097 hasConceptScore W3206218097C41008148 @default.
- W3206218097 hasConceptScore W3206218097C77805123 @default.
- W3206218097 hasConceptScore W3206218097C94625758 @default.
- W3206218097 hasConceptScore W3206218097C97931131 @default.
- W3206218097 hasFunder F4320321001 @default.
- W3206218097 hasFunder F4320335768 @default.
- W3206218097 hasLocation W32062180971 @default.
- W3206218097 hasOpenAccess W3206218097 @default.
- W3206218097 hasPrimaryLocation W32062180971 @default.
- W3206218097 hasRelatedWork W2026121273 @default.
- W3206218097 hasRelatedWork W2102106825 @default.
- W3206218097 hasRelatedWork W2801772698 @default.
- W3206218097 hasRelatedWork W2961085424 @default.
- W3206218097 hasRelatedWork W2983744209 @default.
- W3206218097 hasRelatedWork W3206218097 @default.
- W3206218097 hasRelatedWork W4225297951 @default.
- W3206218097 hasRelatedWork W4306674287 @default.
- W3206218097 hasRelatedWork W4383704084 @default.
- W3206218097 hasRelatedWork W66955737 @default.
- W3206218097 isParatext "false" @default.