Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385964458> ?p ?o ?g. }
Showing items 1 to 49 of
49
with 100 items per page.
- W4385964458 abstract "Large text-to-image diffusion models have achieved remarkable success in generating diverse, high-quality images. Additionally, these models have been successfully leveraged to edit input images by just changing the text prompt. But when these models are applied to videos, the main challenge is to ensure temporal consistency and coherence across frames. In this paper, we propose InFusion, a framework for zero-shot text-based video editing leveraging large pre-trained image diffusion models. Our framework specifically supports editing of multiple concepts with pixel-level control over diverse concepts mentioned in the editing prompt. Specifically, we inject the difference in features obtained with source and edit prompts from U-Net residual blocks of decoder layers. When these are combined with injected attention features, it becomes feasible to query the source contents and scale edited concepts along with the injection of unedited parts. The editing is further controlled in a fine-grained manner with mask extraction and attention fusion, which cut the edited part from the source and paste it into the denoising pipeline for the editing prompt. Our framework is a low-cost alternative to one-shot tuned models for editing since it does not require training. We demonstrated complex concept editing with a generalised image model (Stable Diffusion v1.5) using LoRA. Adaptation is compatible with all the existing image diffusion techniques. Extensive experimental results demonstrate the effectiveness of existing methods in rendering high-quality and temporally consistent videos." @default.
- W4385964458 created "2023-08-18" @default.
- W4385964458 creator A5002245577 @default.
- W4385964458 date "2023-07-22" @default.
- W4385964458 modified "2023-09-23" @default.
- W4385964458 title "InFusion: Inject and Attention Fusion for Multi Concept Zero-Shot Text-based Video Editing" @default.
- W4385964458 doi "https://doi.org/10.48550/arxiv.2308.00135" @default.
- W4385964458 hasPublicationYear "2023" @default.
- W4385964458 type Work @default.
- W4385964458 citedByCount "0" @default.
- W4385964458 crossrefType "posted-content" @default.
- W4385964458 hasAuthorship W4385964458A5002245577 @default.
- W4385964458 hasBestOaLocation W43859644581 @default.
- W4385964458 hasConcept C115961682 @default.
- W4385964458 hasConcept C154945302 @default.
- W4385964458 hasConcept C199360897 @default.
- W4385964458 hasConcept C205711294 @default.
- W4385964458 hasConcept C23123220 @default.
- W4385964458 hasConcept C2776674983 @default.
- W4385964458 hasConcept C2780310081 @default.
- W4385964458 hasConcept C31972630 @default.
- W4385964458 hasConcept C41008148 @default.
- W4385964458 hasConcept C43521106 @default.
- W4385964458 hasConceptScore W4385964458C115961682 @default.
- W4385964458 hasConceptScore W4385964458C154945302 @default.
- W4385964458 hasConceptScore W4385964458C199360897 @default.
- W4385964458 hasConceptScore W4385964458C205711294 @default.
- W4385964458 hasConceptScore W4385964458C23123220 @default.
- W4385964458 hasConceptScore W4385964458C2776674983 @default.
- W4385964458 hasConceptScore W4385964458C2780310081 @default.
- W4385964458 hasConceptScore W4385964458C31972630 @default.
- W4385964458 hasConceptScore W4385964458C41008148 @default.
- W4385964458 hasConceptScore W4385964458C43521106 @default.
- W4385964458 hasLocation W43859644581 @default.
- W4385964458 hasOpenAccess W4385964458 @default.
- W4385964458 hasPrimaryLocation W43859644581 @default.
- W4385964458 hasRelatedWork W1503414886 @default.
- W4385964458 hasRelatedWork W1863533157 @default.
- W4385964458 hasRelatedWork W2048402902 @default.
- W4385964458 hasRelatedWork W2095660797 @default.
- W4385964458 hasRelatedWork W2112614329 @default.
- W4385964458 hasRelatedWork W2740010476 @default.
- W4385964458 hasRelatedWork W2797881514 @default.
- W4385964458 hasRelatedWork W2899307613 @default.
- W4385964458 hasRelatedWork W3187331046 @default.
- W4385964458 hasRelatedWork W3182299699 @default.
- W4385964458 isParatext "false" @default.
- W4385964458 isRetracted "false" @default.
- W4385964458 workType "article" @default.