Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313483410> ?p ?o ?g. }
Showing items 1 to 73 of
73
with 100 items per page.
- W4313483410 abstract "A video storyboard is a roadmap for video creation which consists of shot-by-shot images to visualize key plots in a text synopsis. Creating video storyboards, however, remains challenging which not only requires cross-modal association between high-level texts and images but also demands long-term reasoning to make transitions smooth across shots. In this paper, we propose a new task called Text synopsis to Video Storyboard (TeViS) which aims to retrieve an ordered sequence of images as the video storyboard to visualize the text synopsis. We construct a MovieNet-TeViS dataset based on the public MovieNet dataset. It contains 10K text synopses each paired with keyframes manually selected from corresponding movies by considering both relevance and cinematic coherence. To benchmark the task, we present strong CLIP-based baselines and a novel VQ-Trans. VQ-Trans first encodes text synopsis and images into a joint embedding space and uses vector quantization (VQ) to improve the visual representation. Then, it auto-regressively generates a sequence of visual features for retrieval and ordering. Experimental results demonstrate that VQ-Trans significantly outperforms prior methods and the CLIP-based baselines. Nevertheless, there is still a large gap compared to human performance suggesting room for promising future work. The code and data are available at: url{https://ruc-aimind.github.io/projects/TeViS/}" @default.
- W4313483410 created "2023-01-06" @default.
- W4313483410 creator A5002534392 @default.
- W4313483410 creator A5005103723 @default.
- W4313483410 creator A5027479331 @default.
- W4313483410 creator A5046676712 @default.
- W4313483410 creator A5054278847 @default.
- W4313483410 creator A5055218960 @default.
- W4313483410 creator A5080249662 @default.
- W4313483410 date "2022-12-31" @default.
- W4313483410 modified "2023-09-27" @default.
- W4313483410 title "TeViS:Translating Text Synopses to Video Storyboards" @default.
- W4313483410 doi "https://doi.org/10.48550/arxiv.2301.00135" @default.
- W4313483410 hasPublicationYear "2022" @default.
- W4313483410 type Work @default.
- W4313483410 citedByCount "0" @default.
- W4313483410 crossrefType "posted-content" @default.
- W4313483410 hasAuthorship W4313483410A5002534392 @default.
- W4313483410 hasAuthorship W4313483410A5005103723 @default.
- W4313483410 hasAuthorship W4313483410A5027479331 @default.
- W4313483410 hasAuthorship W4313483410A5046676712 @default.
- W4313483410 hasAuthorship W4313483410A5054278847 @default.
- W4313483410 hasAuthorship W4313483410A5055218960 @default.
- W4313483410 hasAuthorship W4313483410A5080249662 @default.
- W4313483410 hasBestOaLocation W43134834101 @default.
- W4313483410 hasConcept C153180895 @default.
- W4313483410 hasConcept C154945302 @default.
- W4313483410 hasConcept C162324750 @default.
- W4313483410 hasConcept C170858558 @default.
- W4313483410 hasConcept C178790620 @default.
- W4313483410 hasConcept C185592680 @default.
- W4313483410 hasConcept C187736073 @default.
- W4313483410 hasConcept C199360897 @default.
- W4313483410 hasConcept C204321447 @default.
- W4313483410 hasConcept C23123220 @default.
- W4313483410 hasConcept C2777080924 @default.
- W4313483410 hasConcept C2778344882 @default.
- W4313483410 hasConcept C2780451532 @default.
- W4313483410 hasConcept C2780801425 @default.
- W4313483410 hasConcept C41008148 @default.
- W4313483410 hasConcept C49774154 @default.
- W4313483410 hasConceptScore W4313483410C153180895 @default.
- W4313483410 hasConceptScore W4313483410C154945302 @default.
- W4313483410 hasConceptScore W4313483410C162324750 @default.
- W4313483410 hasConceptScore W4313483410C170858558 @default.
- W4313483410 hasConceptScore W4313483410C178790620 @default.
- W4313483410 hasConceptScore W4313483410C185592680 @default.
- W4313483410 hasConceptScore W4313483410C187736073 @default.
- W4313483410 hasConceptScore W4313483410C199360897 @default.
- W4313483410 hasConceptScore W4313483410C204321447 @default.
- W4313483410 hasConceptScore W4313483410C23123220 @default.
- W4313483410 hasConceptScore W4313483410C2777080924 @default.
- W4313483410 hasConceptScore W4313483410C2778344882 @default.
- W4313483410 hasConceptScore W4313483410C2780451532 @default.
- W4313483410 hasConceptScore W4313483410C2780801425 @default.
- W4313483410 hasConceptScore W4313483410C41008148 @default.
- W4313483410 hasConceptScore W4313483410C49774154 @default.
- W4313483410 hasLocation W43134834101 @default.
- W4313483410 hasOpenAccess W4313483410 @default.
- W4313483410 hasPrimaryLocation W43134834101 @default.
- W4313483410 hasRelatedWork W132250100 @default.
- W4313483410 hasRelatedWork W2093597205 @default.
- W4313483410 hasRelatedWork W2132417599 @default.
- W4313483410 hasRelatedWork W2134443199 @default.
- W4313483410 hasRelatedWork W2389846579 @default.
- W4313483410 hasRelatedWork W2392495745 @default.
- W4313483410 hasRelatedWork W2725657302 @default.
- W4313483410 hasRelatedWork W4250804536 @default.
- W4313483410 hasRelatedWork W4312271230 @default.
- W4313483410 hasRelatedWork W4315471354 @default.
- W4313483410 isParatext "false" @default.
- W4313483410 isRetracted "false" @default.
- W4313483410 workType "article" @default.