Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287777323> ?p ?o ?g. }
Showing items 1 to 63 of
63
with 100 items per page.
- W4287777323 abstract "The goal of this work is to synchronise audio and video of a talking face using deep neural network models. Existing works have trained networks on proxy tasks such as cross-modal similarity learning, and then computed similarities between audio and video frames using a sliding window approach. While these methods demonstrate satisfactory performance, the networks are not trained directly on the task. To this end, we propose an end-to-end trained network that can directly predict the offset between an audio stream and the corresponding video stream. The similarity matrix between the two modalities is first computed from the features, then the inference of the offset can be considered to be a pattern recognition problem where the matrix is considered equivalent to an image. The feature extractor and the classifier are trained jointly. We demonstrate that the proposed approach outperforms the previous work by a large margin on LRS2 and LRS3 datasets." @default.
- W4287777323 created "2022-07-26" @default.
- W4287777323 creator A5022133103 @default.
- W4287777323 creator A5027484701 @default.
- W4287777323 creator A5046276512 @default.
- W4287777323 creator A5086369397 @default.
- W4287777323 date "2020-05-18" @default.
- W4287777323 modified "2023-09-29" @default.
- W4287777323 title "End-to-End Lip Synchronisation Based on Pattern Classification" @default.
- W4287777323 doi "https://doi.org/10.48550/arxiv.2005.08606" @default.
- W4287777323 hasPublicationYear "2020" @default.
- W4287777323 type Work @default.
- W4287777323 citedByCount "0" @default.
- W4287777323 crossrefType "posted-content" @default.
- W4287777323 hasAuthorship W4287777323A5022133103 @default.
- W4287777323 hasAuthorship W4287777323A5027484701 @default.
- W4287777323 hasAuthorship W4287777323A5046276512 @default.
- W4287777323 hasAuthorship W4287777323A5086369397 @default.
- W4287777323 hasBestOaLocation W42877773231 @default.
- W4287777323 hasConcept C102392041 @default.
- W4287777323 hasConcept C111919701 @default.
- W4287777323 hasConcept C153180895 @default.
- W4287777323 hasConcept C154945302 @default.
- W4287777323 hasConcept C175291020 @default.
- W4287777323 hasConcept C199360897 @default.
- W4287777323 hasConcept C2776214188 @default.
- W4287777323 hasConcept C2778751112 @default.
- W4287777323 hasConcept C28490314 @default.
- W4287777323 hasConcept C41008148 @default.
- W4287777323 hasConcept C50644808 @default.
- W4287777323 hasConcept C52622490 @default.
- W4287777323 hasConcept C74296488 @default.
- W4287777323 hasConcept C95623464 @default.
- W4287777323 hasConceptScore W4287777323C102392041 @default.
- W4287777323 hasConceptScore W4287777323C111919701 @default.
- W4287777323 hasConceptScore W4287777323C153180895 @default.
- W4287777323 hasConceptScore W4287777323C154945302 @default.
- W4287777323 hasConceptScore W4287777323C175291020 @default.
- W4287777323 hasConceptScore W4287777323C199360897 @default.
- W4287777323 hasConceptScore W4287777323C2776214188 @default.
- W4287777323 hasConceptScore W4287777323C2778751112 @default.
- W4287777323 hasConceptScore W4287777323C28490314 @default.
- W4287777323 hasConceptScore W4287777323C41008148 @default.
- W4287777323 hasConceptScore W4287777323C50644808 @default.
- W4287777323 hasConceptScore W4287777323C52622490 @default.
- W4287777323 hasConceptScore W4287777323C74296488 @default.
- W4287777323 hasConceptScore W4287777323C95623464 @default.
- W4287777323 hasLocation W42877773231 @default.
- W4287777323 hasOpenAccess W4287777323 @default.
- W4287777323 hasPrimaryLocation W42877773231 @default.
- W4287777323 hasRelatedWork W1964805666 @default.
- W4287777323 hasRelatedWork W2188464267 @default.
- W4287777323 hasRelatedWork W2563096758 @default.
- W4287777323 hasRelatedWork W2738461075 @default.
- W4287777323 hasRelatedWork W2784352036 @default.
- W4287777323 hasRelatedWork W2807311372 @default.
- W4287777323 hasRelatedWork W2811390910 @default.
- W4287777323 hasRelatedWork W2905846897 @default.
- W4287777323 hasRelatedWork W2995914718 @default.
- W4287777323 hasRelatedWork W3004316149 @default.
- W4287777323 isParatext "false" @default.
- W4287777323 isRetracted "false" @default.
- W4287777323 workType "article" @default.