Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287239498> ?p ?o ?g. }
Showing items 1 to 59 of
59
with 100 items per page.
- W4287239498 abstract "We introduce a non-parametric approach for infinite video texture synthesis using a representation learned via contrastive learning. We take inspiration from Video Textures, which showed that plausible new videos could be generated from a single one by stitching its frames together in a novel yet consistent order. This classic work, however, was constrained by its use of hand-designed distance metrics, limiting its use to simple, repetitive videos. We draw on recent techniques from self-supervised learning to learn this distance metric, allowing us to compare frames in a manner that scales to more challenging dynamics, and to condition on other data, such as audio. We learn representations for video frames and frame-to-frame transition probabilities by fitting a video-specific model trained using contrastive learning. To synthesize a texture, we randomly sample frames with high transition probabilities to generate diverse temporally smooth videos with novel sequences and transitions. The model naturally extends to an audio-conditioned setting without requiring any finetuning. Our model outperforms baselines on human perceptual scores, can handle a diverse range of input videos, and can combine semantic and audio-visual cues in order to synthesize videos that synchronize well with an audio signal." @default.
- W4287239498 created "2022-07-25" @default.
- W4287239498 creator A5009491631 @default.
- W4287239498 creator A5029105520 @default.
- W4287239498 creator A5059142581 @default.
- W4287239498 creator A5077436220 @default.
- W4287239498 creator A5080036318 @default.
- W4287239498 date "2021-04-06" @default.
- W4287239498 modified "2023-09-26" @default.
- W4287239498 title "Strumming to the Beat: Audio-Conditioned Contrastive Video Textures" @default.
- W4287239498 doi "https://doi.org/10.48550/arxiv.2104.02687" @default.
- W4287239498 hasPublicationYear "2021" @default.
- W4287239498 type Work @default.
- W4287239498 citedByCount "0" @default.
- W4287239498 crossrefType "posted-content" @default.
- W4287239498 hasAuthorship W4287239498A5009491631 @default.
- W4287239498 hasAuthorship W4287239498A5029105520 @default.
- W4287239498 hasAuthorship W4287239498A5059142581 @default.
- W4287239498 hasAuthorship W4287239498A5077436220 @default.
- W4287239498 hasAuthorship W4287239498A5080036318 @default.
- W4287239498 hasBestOaLocation W42872394981 @default.
- W4287239498 hasConcept C105795698 @default.
- W4287239498 hasConcept C117251300 @default.
- W4287239498 hasConcept C126042441 @default.
- W4287239498 hasConcept C153180895 @default.
- W4287239498 hasConcept C154945302 @default.
- W4287239498 hasConcept C28490314 @default.
- W4287239498 hasConcept C29081049 @default.
- W4287239498 hasConcept C31972630 @default.
- W4287239498 hasConcept C33923547 @default.
- W4287239498 hasConcept C41008148 @default.
- W4287239498 hasConcept C76155785 @default.
- W4287239498 hasConceptScore W4287239498C105795698 @default.
- W4287239498 hasConceptScore W4287239498C117251300 @default.
- W4287239498 hasConceptScore W4287239498C126042441 @default.
- W4287239498 hasConceptScore W4287239498C153180895 @default.
- W4287239498 hasConceptScore W4287239498C154945302 @default.
- W4287239498 hasConceptScore W4287239498C28490314 @default.
- W4287239498 hasConceptScore W4287239498C29081049 @default.
- W4287239498 hasConceptScore W4287239498C31972630 @default.
- W4287239498 hasConceptScore W4287239498C33923547 @default.
- W4287239498 hasConceptScore W4287239498C41008148 @default.
- W4287239498 hasConceptScore W4287239498C76155785 @default.
- W4287239498 hasLocation W42872394981 @default.
- W4287239498 hasOpenAccess W4287239498 @default.
- W4287239498 hasPrimaryLocation W42872394981 @default.
- W4287239498 hasRelatedWork W176621693 @default.
- W4287239498 hasRelatedWork W2003909330 @default.
- W4287239498 hasRelatedWork W2035528444 @default.
- W4287239498 hasRelatedWork W2071240554 @default.
- W4287239498 hasRelatedWork W2890988828 @default.
- W4287239498 hasRelatedWork W2905778683 @default.
- W4287239498 hasRelatedWork W2960220629 @default.
- W4287239498 hasRelatedWork W296527428 @default.
- W4287239498 hasRelatedWork W4313400571 @default.
- W4287239498 hasRelatedWork W1970924103 @default.
- W4287239498 isParatext "false" @default.
- W4287239498 isRetracted "false" @default.
- W4287239498 workType "article" @default.