Matches in SemOpenAlex for { <https://semopenalex.org/work/W4380558574> ?p ?o ?g. }
Showing items 1 to 67 of
67
with 100 items per page.
- W4380558574 abstract "Deepfake technologies empowered by deep learning are rapidly evolving, creating new security concerns for society. Existing multimodal detection methods usually capture audio-visual inconsistencies to expose Deepfake videos. More seriously, the advanced Deepfake technology realizes the audio-visual calibration of the critical phoneme-viseme regions, achieving a more realistic tampering effect, which brings new challenges. To address this problem, we propose a novel Deepfake detection method to mine the correlation between Non-critical Phonemes and Visemes, termed NPVForensics. Firstly, we propose the Local Feature Aggregation block with Swin Transformer (LFA-ST) to construct non-critical phoneme-viseme and corresponding facial feature streams effectively. Secondly, we design a loss function for the fine-grained motion of the talking face to measure the evolutionary consistency of non-critical phoneme-viseme. Next, we design a phoneme-viseme awareness module for cross-modal feature fusion and representation alignment, so that the modality gap can be reduced and the intrinsic complementarity of the two modalities can be better explored. Finally, a self-supervised pre-training strategy is leveraged to thoroughly learn the audio-visual correspondences in natural videos. In this manner, our model can be easily adapted to the downstream Deepfake datasets with fine-tuning. Extensive experiments on existing benchmarks demonstrate that the proposed approach outperforms state-of-the-art methods." @default.
- W4380558574 created "2023-06-14" @default.
- W4380558574 creator A5007154515 @default.
- W4380558574 creator A5028127027 @default.
- W4380558574 creator A5040091210 @default.
- W4380558574 creator A5052676364 @default.
- W4380558574 creator A5088385429 @default.
- W4380558574 date "2023-06-12" @default.
- W4380558574 modified "2023-09-23" @default.
- W4380558574 title "NPVForensics: Jointing Non-critical Phonemes and Visemes for Deepfake Detection" @default.
- W4380558574 doi "https://doi.org/10.48550/arxiv.2306.06885" @default.
- W4380558574 hasPublicationYear "2023" @default.
- W4380558574 type Work @default.
- W4380558574 citedByCount "0" @default.
- W4380558574 crossrefType "posted-content" @default.
- W4380558574 hasAuthorship W4380558574A5007154515 @default.
- W4380558574 hasAuthorship W4380558574A5028127027 @default.
- W4380558574 hasAuthorship W4380558574A5040091210 @default.
- W4380558574 hasAuthorship W4380558574A5052676364 @default.
- W4380558574 hasAuthorship W4380558574A5088385429 @default.
- W4380558574 hasBestOaLocation W43805585741 @default.
- W4380558574 hasConcept C119857082 @default.
- W4380558574 hasConcept C138885662 @default.
- W4380558574 hasConcept C144024400 @default.
- W4380558574 hasConcept C153180895 @default.
- W4380558574 hasConcept C154945302 @default.
- W4380558574 hasConcept C2776401178 @default.
- W4380558574 hasConcept C2776436953 @default.
- W4380558574 hasConcept C2779903281 @default.
- W4380558574 hasConcept C28490314 @default.
- W4380558574 hasConcept C33767174 @default.
- W4380558574 hasConcept C36289849 @default.
- W4380558574 hasConcept C41008148 @default.
- W4380558574 hasConcept C41895202 @default.
- W4380558574 hasConcept C504749915 @default.
- W4380558574 hasConcept C61328038 @default.
- W4380558574 hasConceptScore W4380558574C119857082 @default.
- W4380558574 hasConceptScore W4380558574C138885662 @default.
- W4380558574 hasConceptScore W4380558574C144024400 @default.
- W4380558574 hasConceptScore W4380558574C153180895 @default.
- W4380558574 hasConceptScore W4380558574C154945302 @default.
- W4380558574 hasConceptScore W4380558574C2776401178 @default.
- W4380558574 hasConceptScore W4380558574C2776436953 @default.
- W4380558574 hasConceptScore W4380558574C2779903281 @default.
- W4380558574 hasConceptScore W4380558574C28490314 @default.
- W4380558574 hasConceptScore W4380558574C33767174 @default.
- W4380558574 hasConceptScore W4380558574C36289849 @default.
- W4380558574 hasConceptScore W4380558574C41008148 @default.
- W4380558574 hasConceptScore W4380558574C41895202 @default.
- W4380558574 hasConceptScore W4380558574C504749915 @default.
- W4380558574 hasConceptScore W4380558574C61328038 @default.
- W4380558574 hasLocation W43805585741 @default.
- W4380558574 hasOpenAccess W4380558574 @default.
- W4380558574 hasPrimaryLocation W43805585741 @default.
- W4380558574 hasRelatedWork W1971623867 @default.
- W4380558574 hasRelatedWork W2016461833 @default.
- W4380558574 hasRelatedWork W2052253960 @default.
- W4380558574 hasRelatedWork W2147802381 @default.
- W4380558574 hasRelatedWork W2382607599 @default.
- W4380558574 hasRelatedWork W2546942002 @default.
- W4380558574 hasRelatedWork W2554403468 @default.
- W4380558574 hasRelatedWork W2760085659 @default.
- W4380558574 hasRelatedWork W2929240682 @default.
- W4380558574 hasRelatedWork W3197541072 @default.
- W4380558574 isParatext "false" @default.
- W4380558574 isRetracted "false" @default.
- W4380558574 workType "article" @default.