Matches in SemOpenAlex for { <https://semopenalex.org/work/W4376167014> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W4376167014 abstract "The proliferation of video content demands efficient and flexible neural network based approaches for generating new video content. In this paper, we propose a novel approach that combines zero-shot text-to-video generation with ControlNet to improve the output of these models. Our method takes multiple sketched frames as input and generates video output that matches the flow of these frames, building upon the Text-to-Video Zero architecture and incorporating ControlNet to enable additional input conditions. By first interpolating frames between the inputted sketches and then running Text-to-Video Zero using the new interpolated frames video as the control technique, we leverage the benefits of both zero-shot text-to-video generation and the robust control provided by ControlNet. Experiments demonstrate that our method excels at producing high-quality and remarkably consistent video content that more accurately aligns with the user's intended motion for the subject within the video. We provide a comprehensive resource package, including a demo video, project website, open-source GitHub repository, and a Colab playground to foster further research and application of our proposed method." @default.
- W4376167014 created "2023-05-12" @default.
- W4376167014 creator A5050979907 @default.
- W4376167014 creator A5091926826 @default.
- W4376167014 date "2023-05-09" @default.
- W4376167014 modified "2023-09-30" @default.
- W4376167014 title "Sketching the Future (STF): Applying Conditional Control Techniques to Text-to-Video Models" @default.
- W4376167014 doi "https://doi.org/10.48550/arxiv.2305.05845" @default.
- W4376167014 hasPublicationYear "2023" @default.
- W4376167014 type Work @default.
- W4376167014 citedByCount "0" @default.
- W4376167014 crossrefType "posted-content" @default.
- W4376167014 hasAuthorship W4376167014A5050979907 @default.
- W4376167014 hasAuthorship W4376167014A5091926826 @default.
- W4376167014 hasBestOaLocation W43761670141 @default.
- W4376167014 hasConcept C103910844 @default.
- W4376167014 hasConcept C104114177 @default.
- W4376167014 hasConcept C128840427 @default.
- W4376167014 hasConcept C153083717 @default.
- W4376167014 hasConcept C154945302 @default.
- W4376167014 hasConcept C162324750 @default.
- W4376167014 hasConcept C176217482 @default.
- W4376167014 hasConcept C178790620 @default.
- W4376167014 hasConcept C185592680 @default.
- W4376167014 hasConcept C202474056 @default.
- W4376167014 hasConcept C21547014 @default.
- W4376167014 hasConcept C2778344882 @default.
- W4376167014 hasConcept C31972630 @default.
- W4376167014 hasConcept C41008148 @default.
- W4376167014 hasConcept C49774154 @default.
- W4376167014 hasConcept C65483669 @default.
- W4376167014 hasConceptScore W4376167014C103910844 @default.
- W4376167014 hasConceptScore W4376167014C104114177 @default.
- W4376167014 hasConceptScore W4376167014C128840427 @default.
- W4376167014 hasConceptScore W4376167014C153083717 @default.
- W4376167014 hasConceptScore W4376167014C154945302 @default.
- W4376167014 hasConceptScore W4376167014C162324750 @default.
- W4376167014 hasConceptScore W4376167014C176217482 @default.
- W4376167014 hasConceptScore W4376167014C178790620 @default.
- W4376167014 hasConceptScore W4376167014C185592680 @default.
- W4376167014 hasConceptScore W4376167014C202474056 @default.
- W4376167014 hasConceptScore W4376167014C21547014 @default.
- W4376167014 hasConceptScore W4376167014C2778344882 @default.
- W4376167014 hasConceptScore W4376167014C31972630 @default.
- W4376167014 hasConceptScore W4376167014C41008148 @default.
- W4376167014 hasConceptScore W4376167014C49774154 @default.
- W4376167014 hasConceptScore W4376167014C65483669 @default.
- W4376167014 hasLocation W43761670141 @default.
- W4376167014 hasOpenAccess W4376167014 @default.
- W4376167014 hasPrimaryLocation W43761670141 @default.
- W4376167014 hasRelatedWork W1994355679 @default.
- W4376167014 hasRelatedWork W2046284878 @default.
- W4376167014 hasRelatedWork W2111667101 @default.
- W4376167014 hasRelatedWork W2117314780 @default.
- W4376167014 hasRelatedWork W2359327030 @default.
- W4376167014 hasRelatedWork W2375636617 @default.
- W4376167014 hasRelatedWork W2541131230 @default.
- W4376167014 hasRelatedWork W2777451288 @default.
- W4376167014 hasRelatedWork W2906530481 @default.
- W4376167014 hasRelatedWork W2909251800 @default.
- W4376167014 isParatext "false" @default.
- W4376167014 isRetracted "false" @default.
- W4376167014 workType "article" @default.