Matches in SemOpenAlex for { <https://semopenalex.org/work/W2971337608> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W2971337608 abstract "In this paper, we propose to guide the video caption generation with Part-of-Speech (POS) information, based on a gated fusion of multiple representations of input videos. We construct a novel gated fusion network, with one particularly designed cross-gating (CG) block, to effectively encode and fuse different types of representations, e.g., the motion and content features of an input video. One POS sequence generator relies on this fused representation to predict the global syntactic structure, which is thereafter leveraged to guide the video captioning generation and control the syntax of the generated sentence. Specifically, a gating strategy is proposed to dynamically and adaptively incorporate the global syntactic POS information into the decoder for generating each word. Experimental results on two benchmark datasets, namely MSR-VTT and MSVD, demonstrate that the proposed model can well exploit complementary information from multiple representations, resulting in improved performances. Moreover, the generated global POS information can well capture the global syntactic structure of the sentence, and thus be exploited to control the syntactic structure of the description. Such POS information not only boosts the video captioning performance but also improves the diversity of the generated captions. Our code is at: https://github.com/vsislab/Controllable_XGating." @default.
- W2971337608 created "2019-09-05" @default.
- W2971337608 creator A5008341143 @default.
- W2971337608 creator A5017116858 @default.
- W2971337608 creator A5024453719 @default.
- W2971337608 creator A5038500960 @default.
- W2971337608 creator A5071037763 @default.
- W2971337608 creator A5090866405 @default.
- W2971337608 date "2019-08-27" @default.
- W2971337608 modified "2023-10-18" @default.
- W2971337608 title "Controllable Video Captioning with POS Sequence Guidance Based on Gated Fusion Network" @default.
- W2971337608 cites W1927052826 @default.
- W2971337608 cites W1956340063 @default.
- W2971337608 cites W2204302769 @default.
- W2971337608 cites W2607151106 @default.
- W2971337608 cites W2962937869 @default.
- W2971337608 cites W2963084599 @default.
- W2971337608 cites W2963177403 @default.
- W2971337608 doi "https://doi.org/10.48550/arxiv.1908.10072" @default.
- W2971337608 hasPublicationYear "2019" @default.
- W2971337608 type Work @default.
- W2971337608 sameAs 2971337608 @default.
- W2971337608 citedByCount "3" @default.
- W2971337608 countsByYear W29713376082020 @default.
- W2971337608 countsByYear W29713376082021 @default.
- W2971337608 crossrefType "posted-content" @default.
- W2971337608 hasAuthorship W2971337608A5008341143 @default.
- W2971337608 hasAuthorship W2971337608A5017116858 @default.
- W2971337608 hasAuthorship W2971337608A5024453719 @default.
- W2971337608 hasAuthorship W2971337608A5038500960 @default.
- W2971337608 hasAuthorship W2971337608A5071037763 @default.
- W2971337608 hasAuthorship W2971337608A5090866405 @default.
- W2971337608 hasBestOaLocation W29713376081 @default.
- W2971337608 hasConcept C104317684 @default.
- W2971337608 hasConcept C115961682 @default.
- W2971337608 hasConcept C119599485 @default.
- W2971337608 hasConcept C121332964 @default.
- W2971337608 hasConcept C127413603 @default.
- W2971337608 hasConcept C13280743 @default.
- W2971337608 hasConcept C141353440 @default.
- W2971337608 hasConcept C154945302 @default.
- W2971337608 hasConcept C157657479 @default.
- W2971337608 hasConcept C163258240 @default.
- W2971337608 hasConcept C185592680 @default.
- W2971337608 hasConcept C185798385 @default.
- W2971337608 hasConcept C204321447 @default.
- W2971337608 hasConcept C205649164 @default.
- W2971337608 hasConcept C2524010 @default.
- W2971337608 hasConcept C2777210771 @default.
- W2971337608 hasConcept C2777530160 @default.
- W2971337608 hasConcept C2780992000 @default.
- W2971337608 hasConcept C28490314 @default.
- W2971337608 hasConcept C33923547 @default.
- W2971337608 hasConcept C41008148 @default.
- W2971337608 hasConcept C55493867 @default.
- W2971337608 hasConcept C60048249 @default.
- W2971337608 hasConcept C62520636 @default.
- W2971337608 hasConcept C66746571 @default.
- W2971337608 hasConceptScore W2971337608C104317684 @default.
- W2971337608 hasConceptScore W2971337608C115961682 @default.
- W2971337608 hasConceptScore W2971337608C119599485 @default.
- W2971337608 hasConceptScore W2971337608C121332964 @default.
- W2971337608 hasConceptScore W2971337608C127413603 @default.
- W2971337608 hasConceptScore W2971337608C13280743 @default.
- W2971337608 hasConceptScore W2971337608C141353440 @default.
- W2971337608 hasConceptScore W2971337608C154945302 @default.
- W2971337608 hasConceptScore W2971337608C157657479 @default.
- W2971337608 hasConceptScore W2971337608C163258240 @default.
- W2971337608 hasConceptScore W2971337608C185592680 @default.
- W2971337608 hasConceptScore W2971337608C185798385 @default.
- W2971337608 hasConceptScore W2971337608C204321447 @default.
- W2971337608 hasConceptScore W2971337608C205649164 @default.
- W2971337608 hasConceptScore W2971337608C2524010 @default.
- W2971337608 hasConceptScore W2971337608C2777210771 @default.
- W2971337608 hasConceptScore W2971337608C2777530160 @default.
- W2971337608 hasConceptScore W2971337608C2780992000 @default.
- W2971337608 hasConceptScore W2971337608C28490314 @default.
- W2971337608 hasConceptScore W2971337608C33923547 @default.
- W2971337608 hasConceptScore W2971337608C41008148 @default.
- W2971337608 hasConceptScore W2971337608C55493867 @default.
- W2971337608 hasConceptScore W2971337608C60048249 @default.
- W2971337608 hasConceptScore W2971337608C62520636 @default.
- W2971337608 hasConceptScore W2971337608C66746571 @default.
- W2971337608 hasLocation W29713376081 @default.
- W2971337608 hasOpenAccess W2971337608 @default.
- W2971337608 hasPrimaryLocation W29713376081 @default.
- W2971337608 hasRelatedWork W1978971213 @default.
- W2971337608 hasRelatedWork W2891955747 @default.
- W2971337608 hasRelatedWork W2949789546 @default.
- W2971337608 hasRelatedWork W3093026747 @default.
- W2971337608 hasRelatedWork W3151908889 @default.
- W2971337608 hasRelatedWork W3170826848 @default.
- W2971337608 hasRelatedWork W3171594500 @default.
- W2971337608 hasRelatedWork W38394648 @default.
- W2971337608 hasRelatedWork W4287125478 @default.
- W2971337608 hasRelatedWork W4320016117 @default.
- W2971337608 isParatext "false" @default.
- W2971337608 isRetracted "false" @default.
- W2971337608 magId "2971337608" @default.
- W2971337608 workType "article" @default.