Matches in SemOpenAlex for { <https://semopenalex.org/work/W4311034013> ?p ?o ?g. }
- W4311034013 abstract "The ability of Generative Adversarial Networks to encode rich semantics within their latent space has been widely adopted for facial image editing. However, replicating their success with videos has proven challenging. Applying StyleGAN editing to real videos introduces two main challenges: (i) StyleGAN operates over aligned crops. When editing videos, these crops need to be pasted back into the frame, resulting in a spatial inconsistency. (ii) Videos introduce a fundamental barrier to overcome — temporal coherency. To address the first challenge, we propose a novel stitching-tuning procedure. The generator is carefully tuned to overcome the spatial artifacts at crop borders, resulting in smooth transitions even when difficult backgrounds are involved. Turning to temporal coherence, we propose that this challenge is largely artificial. The source video is already temporally coherent, and deviations arise in part due to careless treatment of individual components in the editing pipeline. We leverage the natural alignment of StyleGAN and the tendency of neural networks to learn low-frequency functions, and demonstrate that they provide a strongly consistent prior. These components are combined in an end-to-end framework for semantic editing of facial videos. We compare our pipeline to the current state-of-the-art and demonstrate significant improvements. Our method produces meaningful manipulations and maintains greater spatial and temporal consistency, even on challenging talking head videos which current methods struggle with. Our code and videos are available at https://stitch-time.github.io/." @default.
- W4311034013 created "2022-12-22" @default.
- W4311034013 creator A5001922143 @default.
- W4311034013 creator A5017234862 @default.
- W4311034013 creator A5036688260 @default.
- W4311034013 creator A5036936828 @default.
- W4311034013 creator A5057080001 @default.
- W4311034013 date "2022-11-29" @default.
- W4311034013 modified "2023-10-05" @default.
- W4311034013 title "Stitch it in Time: GAN-Based Facial Editing of Real Videos" @default.
- W4311034013 cites W2519536754 @default.
- W4311034013 cites W2939645724 @default.
- W4311034013 cites W2954609848 @default.
- W4311034013 cites W2962770929 @default.
- W4311034013 cites W2962785568 @default.
- W4311034013 cites W2963092440 @default.
- W4311034013 cites W2963767194 @default.
- W4311034013 cites W2969985801 @default.
- W4311034013 cites W2981731258 @default.
- W4311034013 cites W2985068832 @default.
- W4311034013 cites W3003162010 @default.
- W4311034013 cites W3014859719 @default.
- W4311034013 cites W3034431451 @default.
- W4311034013 cites W3034600949 @default.
- W4311034013 cites W3034625979 @default.
- W4311034013 cites W3035355202 @default.
- W4311034013 cites W3035574324 @default.
- W4311034013 cites W3109224353 @default.
- W4311034013 cites W3166541011 @default.
- W4311034013 cites W3176913662 @default.
- W4311034013 cites W3196904463 @default.
- W4311034013 cites W3201739204 @default.
- W4311034013 cites W3203420446 @default.
- W4311034013 cites W3204663154 @default.
- W4311034013 cites W3217427959 @default.
- W4311034013 cites W4214926101 @default.
- W4311034013 cites W4285981707 @default.
- W4311034013 cites W4312423208 @default.
- W4311034013 doi "https://doi.org/10.1145/3550469.3555382" @default.
- W4311034013 hasPublicationYear "2022" @default.
- W4311034013 type Work @default.
- W4311034013 citedByCount "19" @default.
- W4311034013 countsByYear W43110340132022 @default.
- W4311034013 countsByYear W43110340132023 @default.
- W4311034013 crossrefType "proceedings-article" @default.
- W4311034013 hasAuthorship W4311034013A5001922143 @default.
- W4311034013 hasAuthorship W4311034013A5017234862 @default.
- W4311034013 hasAuthorship W4311034013A5036688260 @default.
- W4311034013 hasAuthorship W4311034013A5036936828 @default.
- W4311034013 hasAuthorship W4311034013A5057080001 @default.
- W4311034013 hasBestOaLocation W43110340132 @default.
- W4311034013 hasConcept C104317684 @default.
- W4311034013 hasConcept C115961682 @default.
- W4311034013 hasConcept C121332964 @default.
- W4311034013 hasConcept C153083717 @default.
- W4311034013 hasConcept C154945302 @default.
- W4311034013 hasConcept C163258240 @default.
- W4311034013 hasConcept C185592680 @default.
- W4311034013 hasConcept C199360897 @default.
- W4311034013 hasConcept C2776674983 @default.
- W4311034013 hasConcept C2780310081 @default.
- W4311034013 hasConcept C2780992000 @default.
- W4311034013 hasConcept C29081049 @default.
- W4311034013 hasConcept C31972630 @default.
- W4311034013 hasConcept C41008148 @default.
- W4311034013 hasConcept C43521106 @default.
- W4311034013 hasConcept C55493867 @default.
- W4311034013 hasConcept C62520636 @default.
- W4311034013 hasConcept C66746571 @default.
- W4311034013 hasConceptScore W4311034013C104317684 @default.
- W4311034013 hasConceptScore W4311034013C115961682 @default.
- W4311034013 hasConceptScore W4311034013C121332964 @default.
- W4311034013 hasConceptScore W4311034013C153083717 @default.
- W4311034013 hasConceptScore W4311034013C154945302 @default.
- W4311034013 hasConceptScore W4311034013C163258240 @default.
- W4311034013 hasConceptScore W4311034013C185592680 @default.
- W4311034013 hasConceptScore W4311034013C199360897 @default.
- W4311034013 hasConceptScore W4311034013C2776674983 @default.
- W4311034013 hasConceptScore W4311034013C2780310081 @default.
- W4311034013 hasConceptScore W4311034013C2780992000 @default.
- W4311034013 hasConceptScore W4311034013C29081049 @default.
- W4311034013 hasConceptScore W4311034013C31972630 @default.
- W4311034013 hasConceptScore W4311034013C41008148 @default.
- W4311034013 hasConceptScore W4311034013C43521106 @default.
- W4311034013 hasConceptScore W4311034013C55493867 @default.
- W4311034013 hasConceptScore W4311034013C62520636 @default.
- W4311034013 hasConceptScore W4311034013C66746571 @default.
- W4311034013 hasLocation W43110340131 @default.
- W4311034013 hasLocation W43110340132 @default.
- W4311034013 hasOpenAccess W4311034013 @default.
- W4311034013 hasPrimaryLocation W43110340131 @default.
- W4311034013 hasRelatedWork W176621693 @default.
- W4311034013 hasRelatedWork W2003909330 @default.
- W4311034013 hasRelatedWork W2035528444 @default.
- W4311034013 hasRelatedWork W2071240554 @default.
- W4311034013 hasRelatedWork W2890988828 @default.
- W4311034013 hasRelatedWork W2905778683 @default.
- W4311034013 hasRelatedWork W2955608365 @default.
- W4311034013 hasRelatedWork W296527428 @default.
- W4311034013 hasRelatedWork W4313400571 @default.