Matches in SemOpenAlex for { <https://semopenalex.org/work/W4312761738> ?p ?o ?g. }
- W4312761738 abstract "Image-text matching, as a fundamental task, bridges the gap between vision and language. The key of this task is to accurately measure similarity between these two modalities. Prior work measuring this similarity mainly based on matched fragments (i.e., word/region with high relevance), while underestimating or even ignoring the effect of mismatched fragments (i.e., word/region with low relevance), e.g., via a typical LeaklyReLU or ReLU operation that forces negative scores close or exact to zero in attention. This work argues that mismatched textual fragments, which contain rich mismatching clues, are also crucial for image-text matching. We thereby propose a novel Negative-Aware Attention Framework (NAAF), which explicitly exploits both the positive effect of matched fragments and the negative effect of mismatched fragments to jointly infer image-text similarity. NAAF (1) delicately designs an iterative optimization method to maximally mine the mismatched fragments, facilitating more discriminative and robust negative effects, and (2) devises the two-branch matching mechanism to precisely calculate similarity/dissimilarity degrees for matched/mismatched fragments with different masks. Extensive experiments on two benchmark datasets, i.e., Flickr30K and MSCOCO, demonstrate the superior effectiveness of our NAAF, achieving state-of-the-art performance. Code will be released at: https://github.com/CrossmodalGroup/NAAF." @default.
- W4312761738 created "2023-01-05" @default.
- W4312761738 creator A5016038041 @default.
- W4312761738 creator A5023341829 @default.
- W4312761738 creator A5046305086 @default.
- W4312761738 creator A5063131315 @default.
- W4312761738 date "2022-06-01" @default.
- W4312761738 modified "2023-09-30" @default.
- W4312761738 title "Negative-Aware Attention Framework for Image-Text Matching" @default.
- W4312761738 cites W1773149199 @default.
- W4312761738 cites W1905882502 @default.
- W4312761738 cites W1916445035 @default.
- W4312761738 cites W1957706851 @default.
- W4312761738 cites W2194775991 @default.
- W4312761738 cites W2250539671 @default.
- W4312761738 cites W2277195237 @default.
- W4312761738 cites W2739759426 @default.
- W4312761738 cites W2745461083 @default.
- W4312761738 cites W2955273087 @default.
- W4312761738 cites W2956018683 @default.
- W4312761738 cites W2963040148 @default.
- W4312761738 cites W2963389687 @default.
- W4312761738 cites W2963467339 @default.
- W4312761738 cites W2964120214 @default.
- W4312761738 cites W2964727037 @default.
- W4312761738 cites W2965809241 @default.
- W4312761738 cites W2965848243 @default.
- W4312761738 cites W2974497444 @default.
- W4312761738 cites W2979304729 @default.
- W4312761738 cites W2981448908 @default.
- W4312761738 cites W2981586349 @default.
- W4312761738 cites W2982078236 @default.
- W4312761738 cites W2988823324 @default.
- W4312761738 cites W2990571534 @default.
- W4312761738 cites W2997403743 @default.
- W4312761738 cites W2998215884 @default.
- W4312761738 cites W3006683596 @default.
- W4312761738 cites W3010277541 @default.
- W4312761738 cites W3035212740 @default.
- W4312761738 cites W3035454331 @default.
- W4312761738 cites W3035552787 @default.
- W4312761738 cites W3035605030 @default.
- W4312761738 cites W3108373531 @default.
- W4312761738 cites W3110042533 @default.
- W4312761738 cites W3118694826 @default.
- W4312761738 cites W3155230099 @default.
- W4312761738 cites W3175888430 @default.
- W4312761738 cites W3177343494 @default.
- W4312761738 cites W3190055600 @default.
- W4312761738 cites W3206477365 @default.
- W4312761738 doi "https://doi.org/10.1109/cvpr52688.2022.01521" @default.
- W4312761738 hasPublicationYear "2022" @default.
- W4312761738 type Work @default.
- W4312761738 citedByCount "16" @default.
- W4312761738 countsByYear W43127617382023 @default.
- W4312761738 crossrefType "proceedings-article" @default.
- W4312761738 hasAuthorship W4312761738A5016038041 @default.
- W4312761738 hasAuthorship W4312761738A5023341829 @default.
- W4312761738 hasAuthorship W4312761738A5046305086 @default.
- W4312761738 hasAuthorship W4312761738A5063131315 @default.
- W4312761738 hasConcept C103278499 @default.
- W4312761738 hasConcept C105795698 @default.
- W4312761738 hasConcept C115961682 @default.
- W4312761738 hasConcept C13280743 @default.
- W4312761738 hasConcept C153180895 @default.
- W4312761738 hasConcept C154945302 @default.
- W4312761738 hasConcept C158154518 @default.
- W4312761738 hasConcept C162324750 @default.
- W4312761738 hasConcept C165064840 @default.
- W4312761738 hasConcept C177264268 @default.
- W4312761738 hasConcept C17744445 @default.
- W4312761738 hasConcept C185798385 @default.
- W4312761738 hasConcept C187736073 @default.
- W4312761738 hasConcept C199360897 @default.
- W4312761738 hasConcept C199539241 @default.
- W4312761738 hasConcept C204321447 @default.
- W4312761738 hasConcept C205649164 @default.
- W4312761738 hasConcept C2524010 @default.
- W4312761738 hasConcept C2776760102 @default.
- W4312761738 hasConcept C2780451532 @default.
- W4312761738 hasConcept C33923547 @default.
- W4312761738 hasConcept C41008148 @default.
- W4312761738 hasConcept C90805587 @default.
- W4312761738 hasConcept C97931131 @default.
- W4312761738 hasConceptScore W4312761738C103278499 @default.
- W4312761738 hasConceptScore W4312761738C105795698 @default.
- W4312761738 hasConceptScore W4312761738C115961682 @default.
- W4312761738 hasConceptScore W4312761738C13280743 @default.
- W4312761738 hasConceptScore W4312761738C153180895 @default.
- W4312761738 hasConceptScore W4312761738C154945302 @default.
- W4312761738 hasConceptScore W4312761738C158154518 @default.
- W4312761738 hasConceptScore W4312761738C162324750 @default.
- W4312761738 hasConceptScore W4312761738C165064840 @default.
- W4312761738 hasConceptScore W4312761738C177264268 @default.
- W4312761738 hasConceptScore W4312761738C17744445 @default.
- W4312761738 hasConceptScore W4312761738C185798385 @default.
- W4312761738 hasConceptScore W4312761738C187736073 @default.
- W4312761738 hasConceptScore W4312761738C199360897 @default.
- W4312761738 hasConceptScore W4312761738C199539241 @default.
- W4312761738 hasConceptScore W4312761738C204321447 @default.