Matches in SemOpenAlex for { <https://semopenalex.org/work/W4295676887> ?p ?o ?g. }
Showing items 1 to 47 of
47
with 100 items per page.
- W4295676887 abstract "We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to transfer the full 3D head position, head rotation, face expression, eye gaze, and eye blinking from a source actor to a portrait video of a target actor. The core of our approach is a generative neural network with a novel space-time architecture. The network takes as input synthetic renderings of a parametric face model, based on which it predicts photo-realistic video frames for a given target actor. The realism in this rendering-to-video transfer is achieved by careful adversarial training, and as a result, we can create modified target videos that mimic the behavior of the synthetically-created input. In order to enable source-to-target video re-animation, we render a synthetic target video with the reconstructed head animation parameters from a source video, and feed it into the trained network -- thus taking full control of the target. With the ability to freely recombine source and target parameters, we are able to demonstrate a large variety of video rewrite applications without explicitly modeling hair, body or background. For instance, we can reenact the full head using interactive user-controlled editing, and realize high-fidelity visual dubbing. To demonstrate the high quality of our output, we conduct an extensive series of experiments and evaluations, where for instance a user study shows that our video edits are hard to detect." @default.
- W4295676887 created "2022-09-14" @default.
- W4295676887 creator A5005789795 @default.
- W4295676887 creator A5020664641 @default.
- W4295676887 creator A5036392768 @default.
- W4295676887 creator A5038921073 @default.
- W4295676887 creator A5039500794 @default.
- W4295676887 creator A5046744046 @default.
- W4295676887 creator A5075797855 @default.
- W4295676887 creator A5076170578 @default.
- W4295676887 creator A5088583491 @default.
- W4295676887 creator A5090657753 @default.
- W4295676887 date "2018-05-29" @default.
- W4295676887 modified "2023-09-27" @default.
- W4295676887 title "Deep Video Portraits" @default.
- W4295676887 doi "https://doi.org/10.48550/arxiv.1805.11714" @default.
- W4295676887 hasPublicationYear "2018" @default.
- W4295676887 type Work @default.
- W4295676887 citedByCount "0" @default.
- W4295676887 crossrefType "posted-content" @default.
- W4295676887 hasAuthorship W4295676887A5005789795 @default.
- W4295676887 hasAuthorship W4295676887A5020664641 @default.
- W4295676887 hasAuthorship W4295676887A5036392768 @default.
- W4295676887 hasAuthorship W4295676887A5038921073 @default.
- W4295676887 hasAuthorship W4295676887A5039500794 @default.
- W4295676887 hasAuthorship W4295676887A5046744046 @default.
- W4295676887 hasAuthorship W4295676887A5075797855 @default.
- W4295676887 hasAuthorship W4295676887A5076170578 @default.
- W4295676887 hasAuthorship W4295676887A5088583491 @default.
- W4295676887 hasAuthorship W4295676887A5090657753 @default.
- W4295676887 hasBestOaLocation W42956768871 @default.
- W4295676887 hasLocation W42956768871 @default.
- W4295676887 hasOpenAccess W4295676887 @default.
- W4295676887 hasPrimaryLocation W42956768871 @default.
- W4295676887 hasRelatedWork W1195109582 @default.
- W4295676887 hasRelatedWork W2025844337 @default.
- W4295676887 hasRelatedWork W2074809060 @default.
- W4295676887 hasRelatedWork W2109229345 @default.
- W4295676887 hasRelatedWork W2112614329 @default.
- W4295676887 hasRelatedWork W2138495364 @default.
- W4295676887 hasRelatedWork W2146183910 @default.
- W4295676887 hasRelatedWork W2166044122 @default.
- W4295676887 hasRelatedWork W2167803927 @default.
- W4295676887 hasRelatedWork W2598042504 @default.
- W4295676887 isParatext "false" @default.
- W4295676887 isRetracted "false" @default.
- W4295676887 workType "article" @default.