Matches in SemOpenAlex for { <https://semopenalex.org/work/W2896798564> ?p ?o ?g. }
- W2896798564 abstract "In image-sentence retrieval task, correlated images and sentences involve different levels of semantic relevance. However, existing multi-modal representation learning paradigms fail to capture the meaningful component relation on word and phrase level, while the attention-based methods still suffer from component-level mismatching and huge computation burden. We propose a Joint Global and Co-Attentive Representation learning method (JGCAR) for image-sentence retrieval. We formulate a global representation learning task which utilizes both intra-modal and inter-modal relative similarity to optimize the semantic consistency of the visual/textual component representations. We further develop a co-attention learning procedure to fully exploit different levels of visual-linguistic relations. We design a novel softmax-like bi-directional ranking loss to learn the co-attentive representation for image-sentence similarity computation. It is capable of discovering the correlative components and rectifying inappropriate component-level correlation to produce more accurate sentence-level ranking results. By joint global and co-attentive representation learning, the latter benefits from the former by producing more semantically consistent component representation, and the former also benefits from the latter by back-propagating the contextual information. Image-sentence retrieval is performed as a two-step process in the testing stage, inheriting advantages on both effectiveness and efficiency. Experiments show that JGCAR outperforms existing methods on MSCOCO and Flickr30K image-sentence retrieval tasks." @default.
- W2896798564 created "2018-10-26" @default.
- W2896798564 creator A5001393670 @default.
- W2896798564 creator A5027950083 @default.
- W2896798564 creator A5028597017 @default.
- W2896798564 creator A5034112897 @default.
- W2896798564 creator A5048381575 @default.
- W2896798564 date "2018-10-15" @default.
- W2896798564 modified "2023-09-30" @default.
- W2896798564 title "Joint Global and Co-Attentive Representation Learning for Image-Sentence Retrieval" @default.
- W2896798564 cites W1773149199 @default.
- W2896798564 cites W1861492603 @default.
- W2896798564 cites W1895577753 @default.
- W2896798564 cites W1905882502 @default.
- W2896798564 cites W1916445035 @default.
- W2896798564 cites W1933349210 @default.
- W2896798564 cites W1949478088 @default.
- W2896798564 cites W1957706851 @default.
- W2896798564 cites W2049705550 @default.
- W2896798564 cites W2049993534 @default.
- W2896798564 cites W2064675550 @default.
- W2896798564 cites W2071207147 @default.
- W2896798564 cites W2097117768 @default.
- W2896798564 cites W2102765684 @default.
- W2896798564 cites W2106277773 @default.
- W2896798564 cites W2125436662 @default.
- W2896798564 cites W2149557440 @default.
- W2896798564 cites W2164530430 @default.
- W2896798564 cites W2185175083 @default.
- W2896798564 cites W2199369932 @default.
- W2896798564 cites W2210322478 @default.
- W2896798564 cites W2266728343 @default.
- W2896798564 cites W2295088417 @default.
- W2896798564 cites W2316082076 @default.
- W2896798564 cites W2430055109 @default.
- W2896798564 cites W2549070563 @default.
- W2896798564 cites W2604880013 @default.
- W2896798564 cites W2623201052 @default.
- W2896798564 cites W2726755599 @default.
- W2896798564 cites W2751486419 @default.
- W2896798564 cites W2963389687 @default.
- W2896798564 cites W2963656855 @default.
- W2896798564 cites W2963954913 @default.
- W2896798564 cites W3000226596 @default.
- W2896798564 doi "https://doi.org/10.1145/3240508.3240535" @default.
- W2896798564 hasPublicationYear "2018" @default.
- W2896798564 type Work @default.
- W2896798564 sameAs 2896798564 @default.
- W2896798564 citedByCount "55" @default.
- W2896798564 countsByYear W28967985642019 @default.
- W2896798564 countsByYear W28967985642020 @default.
- W2896798564 countsByYear W28967985642021 @default.
- W2896798564 countsByYear W28967985642022 @default.
- W2896798564 countsByYear W28967985642023 @default.
- W2896798564 crossrefType "proceedings-article" @default.
- W2896798564 hasAuthorship W2896798564A5001393670 @default.
- W2896798564 hasAuthorship W2896798564A5027950083 @default.
- W2896798564 hasAuthorship W2896798564A5028597017 @default.
- W2896798564 hasAuthorship W2896798564A5034112897 @default.
- W2896798564 hasAuthorship W2896798564A5048381575 @default.
- W2896798564 hasConcept C108583219 @default.
- W2896798564 hasConcept C115961682 @default.
- W2896798564 hasConcept C121332964 @default.
- W2896798564 hasConcept C153180895 @default.
- W2896798564 hasConcept C154945302 @default.
- W2896798564 hasConcept C158154518 @default.
- W2896798564 hasConcept C1667742 @default.
- W2896798564 hasConcept C168167062 @default.
- W2896798564 hasConcept C17744445 @default.
- W2896798564 hasConcept C188441871 @default.
- W2896798564 hasConcept C189391414 @default.
- W2896798564 hasConcept C189430467 @default.
- W2896798564 hasConcept C199539241 @default.
- W2896798564 hasConcept C204321447 @default.
- W2896798564 hasConcept C2776359362 @default.
- W2896798564 hasConcept C2776436953 @default.
- W2896798564 hasConcept C2777530160 @default.
- W2896798564 hasConcept C41008148 @default.
- W2896798564 hasConcept C59404180 @default.
- W2896798564 hasConcept C94625758 @default.
- W2896798564 hasConcept C97355855 @default.
- W2896798564 hasConceptScore W2896798564C108583219 @default.
- W2896798564 hasConceptScore W2896798564C115961682 @default.
- W2896798564 hasConceptScore W2896798564C121332964 @default.
- W2896798564 hasConceptScore W2896798564C153180895 @default.
- W2896798564 hasConceptScore W2896798564C154945302 @default.
- W2896798564 hasConceptScore W2896798564C158154518 @default.
- W2896798564 hasConceptScore W2896798564C1667742 @default.
- W2896798564 hasConceptScore W2896798564C168167062 @default.
- W2896798564 hasConceptScore W2896798564C17744445 @default.
- W2896798564 hasConceptScore W2896798564C188441871 @default.
- W2896798564 hasConceptScore W2896798564C189391414 @default.
- W2896798564 hasConceptScore W2896798564C189430467 @default.
- W2896798564 hasConceptScore W2896798564C199539241 @default.
- W2896798564 hasConceptScore W2896798564C204321447 @default.
- W2896798564 hasConceptScore W2896798564C2776359362 @default.
- W2896798564 hasConceptScore W2896798564C2776436953 @default.
- W2896798564 hasConceptScore W2896798564C2777530160 @default.
- W2896798564 hasConceptScore W2896798564C41008148 @default.
- W2896798564 hasConceptScore W2896798564C59404180 @default.