Matches in SemOpenAlex for { <https://semopenalex.org/work/W3115803208> ?p ?o ?g. }
- W3115803208 abstract "This paper studies the problem of generating a summary for a given sentence-image pair. Existing multimodal sequence-to-sequence approaches mainly focus on enhancing the decoder by visual signals, while ignoring that the image can improve the ability of the encoder to identify highlights of a news event or a document. Thus, we propose a multimodal selective gate network that considers reciprocal relationships between textual and multi-level visual features, including global image descriptor, activation grids, and object proposals, to select highlights of the event when encoding the source sentence. In addition, we introduce a modality regularization to encourage the summary to capture the highlights embedded in the image more accurately. To verify the generalization of our model, we adopt the multimodal selective gate to the text-based decoder and multimodal-based decoder. Experimental results on a public multimodal sentence summarization dataset demonstrate the advantage of our models over baselines. Further analysis suggests that our proposed multimodal selective gate network can effectively select important information in the input sentence." @default.
- W3115803208 created "2021-01-05" @default.
- W3115803208 creator A5001541516 @default.
- W3115803208 creator A5006794114 @default.
- W3115803208 creator A5015809194 @default.
- W3115803208 creator A5048159038 @default.
- W3115803208 date "2020-01-01" @default.
- W3115803208 modified "2023-09-27" @default.
- W3115803208 title "Multimodal Sentence Summarization via Multimodal Selective Encoding" @default.
- W3115803208 cites W1514535095 @default.
- W3115803208 cites W1525595230 @default.
- W3115803208 cites W1815076433 @default.
- W3115803208 cites W1895577753 @default.
- W3115803208 cites W1940872118 @default.
- W3115803208 cites W1975879668 @default.
- W3115803208 cites W2091428895 @default.
- W3115803208 cites W2095705004 @default.
- W3115803208 cites W2108598243 @default.
- W3115803208 cites W2109326756 @default.
- W3115803208 cites W2115322217 @default.
- W3115803208 cites W2144506857 @default.
- W3115803208 cites W2154652894 @default.
- W3115803208 cites W2194775991 @default.
- W3115803208 cites W2277195237 @default.
- W3115803208 cites W2467173223 @default.
- W3115803208 cites W2567525733 @default.
- W3115803208 cites W2573425638 @default.
- W3115803208 cites W2581101319 @default.
- W3115803208 cites W2593341061 @default.
- W3115803208 cites W2606974598 @default.
- W3115803208 cites W2609482285 @default.
- W3115803208 cites W2612920290 @default.
- W3115803208 cites W2726413184 @default.
- W3115803208 cites W2741375528 @default.
- W3115803208 cites W2767361967 @default.
- W3115803208 cites W2789204155 @default.
- W3115803208 cites W2808413133 @default.
- W3115803208 cites W2858627132 @default.
- W3115803208 cites W2888070626 @default.
- W3115803208 cites W2889545026 @default.
- W3115803208 cites W2890721473 @default.
- W3115803208 cites W2891444075 @default.
- W3115803208 cites W2902031175 @default.
- W3115803208 cites W2903268415 @default.
- W3115803208 cites W2903343986 @default.
- W3115803208 cites W2912759951 @default.
- W3115803208 cites W2950692458 @default.
- W3115803208 cites W2962944953 @default.
- W3115803208 cites W2962965405 @default.
- W3115803208 cites W2962974924 @default.
- W3115803208 cites W2963407669 @default.
- W3115803208 cites W2963548995 @default.
- W3115803208 cites W2963676814 @default.
- W3115803208 cites W2963926728 @default.
- W3115803208 cites W2963929190 @default.
- W3115803208 cites W2963978266 @default.
- W3115803208 cites W2964159778 @default.
- W3115803208 cites W2964192290 @default.
- W3115803208 cites W2964308564 @default.
- W3115803208 cites W2971246534 @default.
- W3115803208 cites W2988981729 @default.
- W3115803208 cites W2997326549 @default.
- W3115803208 cites W2998559045 @default.
- W3115803208 cites W2998733554 @default.
- W3115803208 cites W3105157853 @default.
- W3115803208 cites W639708223 @default.
- W3115803208 cites W1558018769 @default.
- W3115803208 doi "https://doi.org/10.18653/v1/2020.coling-main.496" @default.
- W3115803208 hasPublicationYear "2020" @default.
- W3115803208 type Work @default.
- W3115803208 sameAs 3115803208 @default.
- W3115803208 citedByCount "11" @default.
- W3115803208 countsByYear W31158032082021 @default.
- W3115803208 countsByYear W31158032082022 @default.
- W3115803208 countsByYear W31158032082023 @default.
- W3115803208 crossrefType "proceedings-article" @default.
- W3115803208 hasAuthorship W3115803208A5001541516 @default.
- W3115803208 hasAuthorship W3115803208A5006794114 @default.
- W3115803208 hasAuthorship W3115803208A5015809194 @default.
- W3115803208 hasAuthorship W3115803208A5048159038 @default.
- W3115803208 hasBestOaLocation W31158032081 @default.
- W3115803208 hasConcept C111919701 @default.
- W3115803208 hasConcept C11413529 @default.
- W3115803208 hasConcept C118505674 @default.
- W3115803208 hasConcept C120665830 @default.
- W3115803208 hasConcept C121332964 @default.
- W3115803208 hasConcept C125411270 @default.
- W3115803208 hasConcept C153180895 @default.
- W3115803208 hasConcept C154945302 @default.
- W3115803208 hasConcept C170858558 @default.
- W3115803208 hasConcept C192209626 @default.
- W3115803208 hasConcept C204321447 @default.
- W3115803208 hasConcept C2776135515 @default.
- W3115803208 hasConcept C2777530160 @default.
- W3115803208 hasConcept C2779662365 @default.
- W3115803208 hasConcept C41008148 @default.
- W3115803208 hasConcept C57273362 @default.
- W3115803208 hasConcept C62520636 @default.
- W3115803208 hasConceptScore W3115803208C111919701 @default.
- W3115803208 hasConceptScore W3115803208C11413529 @default.