Matches in SemOpenAlex for { <https://semopenalex.org/work/W4312493728> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W4312493728 abstract "Integrating multimodal knowledge for abstractive summarization task is a work-in-progress research area, with present techniques inheriting fusion-then-generation paradigm. Due to semantic gaps between computer vision and natural language processing, current methods often treat multiple data points as separate objects and rely on attention mechanisms to search for connection in order to fuse together. In addition, missing awareness of cross-modal matching from many frameworks leads to performance reduction. To solve these two drawbacks, we propose an Iterative Contrastive Alignment Framework (ICAF) that uses recurrent alignment and contrast to capture the coherences between images and texts. Specifically, we design a recurrent alignment (RA) layer to gradually investigate fine-grained semantical relationships between image patches and text tokens. At each step during the encoding process, crossmodal contrastive losses are applied to directly optimize the embedding space. According to ROUGE, relevance scores, and human evaluation, our model outperforms the state-of-the-art baselines on MSMO dataset. Experiments on the applicability of our proposed framework and hyperparameters settings have been also conducted." @default.
- W4312493728 created "2023-01-05" @default.
- W4312493728 creator A5000122982 @default.
- W4312493728 creator A5012988764 @default.
- W4312493728 creator A5016038454 @default.
- W4312493728 creator A5018866860 @default.
- W4312493728 creator A5052441498 @default.
- W4312493728 creator A5060335470 @default.
- W4312493728 date "2022-07-18" @default.
- W4312493728 modified "2023-09-28" @default.
- W4312493728 title "ICAF: Iterative Contrastive Alignment Framework for Multimodal Abstractive Summarization" @default.
- W4312493728 cites W2510403706 @default.
- W4312493728 cites W2593341061 @default.
- W4312493728 cites W2809191921 @default.
- W4312493728 cites W2890721473 @default.
- W4312493728 cites W2891533927 @default.
- W4312493728 cites W2962964995 @default.
- W4312493728 cites W2963407669 @default.
- W4312493728 cites W2970231061 @default.
- W4312493728 cites W2970419734 @default.
- W4312493728 cites W2970641574 @default.
- W4312493728 cites W2980884691 @default.
- W4312493728 cites W2986670728 @default.
- W4312493728 cites W2997326549 @default.
- W4312493728 cites W2998733554 @default.
- W4312493728 cites W3034999214 @default.
- W4312493728 cites W3091588028 @default.
- W4312493728 cites W3100439847 @default.
- W4312493728 cites W3104210310 @default.
- W4312493728 cites W3156636935 @default.
- W4312493728 cites W3165529210 @default.
- W4312493728 cites W3174700550 @default.
- W4312493728 cites W3176675602 @default.
- W4312493728 cites W3199294715 @default.
- W4312493728 doi "https://doi.org/10.1109/ijcnn55064.2022.9892884" @default.
- W4312493728 hasPublicationYear "2022" @default.
- W4312493728 type Work @default.
- W4312493728 citedByCount "0" @default.
- W4312493728 crossrefType "proceedings-article" @default.
- W4312493728 hasAuthorship W4312493728A5000122982 @default.
- W4312493728 hasAuthorship W4312493728A5012988764 @default.
- W4312493728 hasAuthorship W4312493728A5016038454 @default.
- W4312493728 hasAuthorship W4312493728A5018866860 @default.
- W4312493728 hasAuthorship W4312493728A5052441498 @default.
- W4312493728 hasAuthorship W4312493728A5060335470 @default.
- W4312493728 hasBestOaLocation W43124937282 @default.
- W4312493728 hasConcept C111919701 @default.
- W4312493728 hasConcept C154945302 @default.
- W4312493728 hasConcept C158154518 @default.
- W4312493728 hasConcept C170858558 @default.
- W4312493728 hasConcept C17744445 @default.
- W4312493728 hasConcept C199539241 @default.
- W4312493728 hasConcept C204321447 @default.
- W4312493728 hasConcept C41008148 @default.
- W4312493728 hasConcept C98045186 @default.
- W4312493728 hasConceptScore W4312493728C111919701 @default.
- W4312493728 hasConceptScore W4312493728C154945302 @default.
- W4312493728 hasConceptScore W4312493728C158154518 @default.
- W4312493728 hasConceptScore W4312493728C170858558 @default.
- W4312493728 hasConceptScore W4312493728C17744445 @default.
- W4312493728 hasConceptScore W4312493728C199539241 @default.
- W4312493728 hasConceptScore W4312493728C204321447 @default.
- W4312493728 hasConceptScore W4312493728C41008148 @default.
- W4312493728 hasConceptScore W4312493728C98045186 @default.
- W4312493728 hasLocation W43124937281 @default.
- W4312493728 hasLocation W43124937282 @default.
- W4312493728 hasOpenAccess W4312493728 @default.
- W4312493728 hasPrimaryLocation W43124937281 @default.
- W4312493728 hasRelatedWork W1571972440 @default.
- W4312493728 hasRelatedWork W2015895495 @default.
- W4312493728 hasRelatedWork W2106813246 @default.
- W4312493728 hasRelatedWork W2264373260 @default.
- W4312493728 hasRelatedWork W2293457016 @default.
- W4312493728 hasRelatedWork W2747680751 @default.
- W4312493728 hasRelatedWork W2989698750 @default.
- W4312493728 hasRelatedWork W3014410397 @default.
- W4312493728 hasRelatedWork W3107474891 @default.
- W4312493728 hasRelatedWork W4323363096 @default.
- W4312493728 isParatext "false" @default.
- W4312493728 isRetracted "false" @default.
- W4312493728 workType "article" @default.