Matches in SemOpenAlex for { <https://semopenalex.org/work/W4312763739> ?p ?o ?g. }
- W4312763739 endingPage "514" @default.
- W4312763739 startingPage "497" @default.
- W4312763739 abstract "Retrieving desired videos using natural language queries has attracted increasing attention in research and industry fields as a huge number of videos appear on the internet. Some existing methods attempted to address this video retrieval problem by exploiting multi-modal information, especially audio-visual data of videos. However, many videos often have mismatched visual and audio cues for several reasons including background music, noise, and even missing sound. Therefore, the naive fusion of such mismatched visual and audio cues can negatively affect the semantic embedding of video scenes. Mismatch condition can be categorized into two cases: (i) Audio itself does not exist (ii) Audio exists but does not match with visual. To deal with (i), we introduce audio-visual associative memory (AVA-Memory) to associate audio cues even from videos without audio data. The associated audio cues can guide the video embedding feature to be aware of audio information even in the missing audio condition. To address (ii), we propose audio embedding adjustment by considering the degree of matching between visual and audio data. In this procedure, constructed AVA-Memory enables to figure out how well the visual and audio in the video are matched and to adjust the weighting between actual audio and associated audio. Experimental results show that the proposed method outperforms other state-of-the-art video retrieval methods. Further, we validate the effectiveness of the proposed network designs with ablation studies and analyses." @default.
- W4312763739 created "2023-01-05" @default.
- W4312763739 creator A5001550074 @default.
- W4312763739 creator A5029235915 @default.
- W4312763739 creator A5063272963 @default.
- W4312763739 date "2022-01-01" @default.
- W4312763739 modified "2023-09-30" @default.
- W4312763739 title "Audio-Visual Mismatch-Aware Video Retrieval via Association and Adjustment" @default.
- W4312763739 cites W1905882502 @default.
- W4312763739 cites W2194775991 @default.
- W4312763739 cites W2425121537 @default.
- W4312763739 cites W2490414731 @default.
- W4312763739 cites W2549139847 @default.
- W4312763739 cites W2808399042 @default.
- W4312763739 cites W2885775891 @default.
- W4312763739 cites W2897439619 @default.
- W4312763739 cites W2956018683 @default.
- W4312763739 cites W2963293463 @default.
- W4312763739 cites W2963471260 @default.
- W4312763739 cites W2963524571 @default.
- W4312763739 cites W2963680240 @default.
- W4312763739 cites W2972073579 @default.
- W4312763739 cites W2975813532 @default.
- W4312763739 cites W2979304729 @default.
- W4312763739 cites W2981716253 @default.
- W4312763739 cites W2984008963 @default.
- W4312763739 cites W2987228832 @default.
- W4312763739 cites W2989322838 @default.
- W4312763739 cites W2990153998 @default.
- W4312763739 cites W3035212740 @default.
- W4312763739 cites W3035240825 @default.
- W4312763739 cites W3035309251 @default.
- W4312763739 cites W3035339264 @default.
- W4312763739 cites W3035356601 @default.
- W4312763739 cites W3035635319 @default.
- W4312763739 cites W3035730922 @default.
- W4312763739 cites W3043840704 @default.
- W4312763739 cites W3043990051 @default.
- W4312763739 cites W3102887392 @default.
- W4312763739 cites W3107973541 @default.
- W4312763739 cites W3115964123 @default.
- W4312763739 cites W3145807616 @default.
- W4312763739 cites W3171668871 @default.
- W4312763739 cites W3174225630 @default.
- W4312763739 cites W3174873881 @default.
- W4312763739 cites W3175888430 @default.
- W4312763739 cites W3176451698 @default.
- W4312763739 cites W3180463990 @default.
- W4312763739 cites W3181942264 @default.
- W4312763739 cites W3202329597 @default.
- W4312763739 cites W3203789665 @default.
- W4312763739 cites W3204588463 @default.
- W4312763739 cites W3205408642 @default.
- W4312763739 cites W4212841753 @default.
- W4312763739 cites W4312439456 @default.
- W4312763739 cites W877909479 @default.
- W4312763739 doi "https://doi.org/10.1007/978-3-031-19781-9_29" @default.
- W4312763739 hasPublicationYear "2022" @default.
- W4312763739 type Work @default.
- W4312763739 citedByCount "0" @default.
- W4312763739 crossrefType "book-chapter" @default.
- W4312763739 hasAuthorship W4312763739A5001550074 @default.
- W4312763739 hasAuthorship W4312763739A5029235915 @default.
- W4312763739 hasAuthorship W4312763739A5063272963 @default.
- W4312763739 hasConcept C111370547 @default.
- W4312763739 hasConcept C126838900 @default.
- W4312763739 hasConcept C13895895 @default.
- W4312763739 hasConcept C154945302 @default.
- W4312763739 hasConcept C155635449 @default.
- W4312763739 hasConcept C157968479 @default.
- W4312763739 hasConcept C183115368 @default.
- W4312763739 hasConcept C28490314 @default.
- W4312763739 hasConcept C3017588708 @default.
- W4312763739 hasConcept C31972630 @default.
- W4312763739 hasConcept C41008148 @default.
- W4312763739 hasConcept C41608201 @default.
- W4312763739 hasConcept C49774154 @default.
- W4312763739 hasConcept C61328038 @default.
- W4312763739 hasConcept C64922751 @default.
- W4312763739 hasConcept C71924100 @default.
- W4312763739 hasConceptScore W4312763739C111370547 @default.
- W4312763739 hasConceptScore W4312763739C126838900 @default.
- W4312763739 hasConceptScore W4312763739C13895895 @default.
- W4312763739 hasConceptScore W4312763739C154945302 @default.
- W4312763739 hasConceptScore W4312763739C155635449 @default.
- W4312763739 hasConceptScore W4312763739C157968479 @default.
- W4312763739 hasConceptScore W4312763739C183115368 @default.
- W4312763739 hasConceptScore W4312763739C28490314 @default.
- W4312763739 hasConceptScore W4312763739C3017588708 @default.
- W4312763739 hasConceptScore W4312763739C31972630 @default.
- W4312763739 hasConceptScore W4312763739C41008148 @default.
- W4312763739 hasConceptScore W4312763739C41608201 @default.
- W4312763739 hasConceptScore W4312763739C49774154 @default.
- W4312763739 hasConceptScore W4312763739C61328038 @default.
- W4312763739 hasConceptScore W4312763739C64922751 @default.
- W4312763739 hasConceptScore W4312763739C71924100 @default.
- W4312763739 hasLocation W43127637391 @default.
- W4312763739 hasOpenAccess W4312763739 @default.