Matches in SemOpenAlex for { <https://semopenalex.org/work/W4315475891> ?p ?o ?g. }
- W4315475891 endingPage "110280" @default.
- W4315475891 startingPage "110280" @default.
- W4315475891 abstract "Although there is a long line of research on bidirectional image–text matching, the problem remains a challenge due to the well-known semantic gap between visual and textual modalities. Popular solutions usually first detect the objects and then find the association between visual objects and the textual words to estimate the relevance; however, these methods only focus on the visual object features while ignoring the semantic attributions of the detected regions, which is an important clue in terms of bridging the semantic gap. To remedy this issue, we propose a generative multiattribution tag fusion method that further includes region attribution to alleviate the semantic gap. In particular, our method comprises three steps: the extraction of image features, the extraction of text features, and the matching of image and text by an attention mechanism. We first divide the image into blocks to obtain the region image features and region attribute labels. Then, we fuse them to reduce the semantic gap between the image features and text features. Second, BERT and bi-GRU are used to extract text features, and third, we use the attention mechanism to match each area in the image with each word in the text with the same meaning. The quantitative and qualitative results on the public datasets Flickr30K and MS-COCO demonstrate the effectiveness of our method. The source code is released on Github https://github.com/smileslabsh/Generative-Label-Fused-Network." @default.
- W4315475891 created "2023-01-11" @default.
- W4315475891 creator A5014825654 @default.
- W4315475891 creator A5021834960 @default.
- W4315475891 creator A5037124719 @default.
- W4315475891 creator A5055163674 @default.
- W4315475891 creator A5061897793 @default.
- W4315475891 creator A5079805574 @default.
- W4315475891 date "2023-03-01" @default.
- W4315475891 modified "2023-10-05" @default.
- W4315475891 title "Generative label fused network for image–text matching" @default.
- W4315475891 cites W1491300635 @default.
- W4315475891 cites W1861492603 @default.
- W4315475891 cites W1905882502 @default.
- W4315475891 cites W1949478088 @default.
- W4315475891 cites W1964073652 @default.
- W4315475891 cites W2022398331 @default.
- W4315475891 cites W2030899956 @default.
- W4315475891 cites W2053667957 @default.
- W4315475891 cites W2070753207 @default.
- W4315475891 cites W2071207147 @default.
- W4315475891 cites W2100235303 @default.
- W4315475891 cites W2102605133 @default.
- W4315475891 cites W2106277773 @default.
- W4315475891 cites W2138118304 @default.
- W4315475891 cites W2157530295 @default.
- W4315475891 cites W2194775991 @default.
- W4315475891 cites W2210322478 @default.
- W4315475891 cites W2277195237 @default.
- W4315475891 cites W2295088417 @default.
- W4315475891 cites W2342543219 @default.
- W4315475891 cites W2546696630 @default.
- W4315475891 cites W2552579943 @default.
- W4315475891 cites W2563587296 @default.
- W4315475891 cites W2565591417 @default.
- W4315475891 cites W2568262903 @default.
- W4315475891 cites W2600067905 @default.
- W4315475891 cites W2725249286 @default.
- W4315475891 cites W2745461083 @default.
- W4315475891 cites W2778940641 @default.
- W4315475891 cites W2897135094 @default.
- W4315475891 cites W2962964995 @default.
- W4315475891 cites W2963040148 @default.
- W4315475891 cites W2963467339 @default.
- W4315475891 cites W2963527096 @default.
- W4315475891 cites W2964120214 @default.
- W4315475891 cites W2965848243 @default.
- W4315475891 cites W2974592692 @default.
- W4315475891 cites W2999309750 @default.
- W4315475891 cites W3029678209 @default.
- W4315475891 cites W3035502324 @default.
- W4315475891 cites W3099206234 @default.
- W4315475891 cites W3102166635 @default.
- W4315475891 cites W3176074827 @default.
- W4315475891 doi "https://doi.org/10.1016/j.knosys.2023.110280" @default.
- W4315475891 hasPublicationYear "2023" @default.
- W4315475891 type Work @default.
- W4315475891 citedByCount "2" @default.
- W4315475891 countsByYear W43154758912023 @default.
- W4315475891 crossrefType "journal-article" @default.
- W4315475891 hasAuthorship W4315475891A5014825654 @default.
- W4315475891 hasAuthorship W4315475891A5021834960 @default.
- W4315475891 hasAuthorship W4315475891A5037124719 @default.
- W4315475891 hasAuthorship W4315475891A5055163674 @default.
- W4315475891 hasAuthorship W4315475891A5061897793 @default.
- W4315475891 hasAuthorship W4315475891A5079805574 @default.
- W4315475891 hasConcept C105795698 @default.
- W4315475891 hasConcept C115961682 @default.
- W4315475891 hasConcept C119599485 @default.
- W4315475891 hasConcept C120665830 @default.
- W4315475891 hasConcept C121332964 @default.
- W4315475891 hasConcept C127413603 @default.
- W4315475891 hasConcept C138885662 @default.
- W4315475891 hasConcept C141353440 @default.
- W4315475891 hasConcept C153180895 @default.
- W4315475891 hasConcept C154945302 @default.
- W4315475891 hasConcept C165064840 @default.
- W4315475891 hasConcept C1667742 @default.
- W4315475891 hasConcept C174348530 @default.
- W4315475891 hasConcept C192209626 @default.
- W4315475891 hasConcept C204321447 @default.
- W4315475891 hasConcept C23123220 @default.
- W4315475891 hasConcept C31258907 @default.
- W4315475891 hasConcept C33923547 @default.
- W4315475891 hasConcept C39890363 @default.
- W4315475891 hasConcept C41008148 @default.
- W4315475891 hasConcept C41895202 @default.
- W4315475891 hasConcept C86034646 @default.
- W4315475891 hasConcept C90805587 @default.
- W4315475891 hasConceptScore W4315475891C105795698 @default.
- W4315475891 hasConceptScore W4315475891C115961682 @default.
- W4315475891 hasConceptScore W4315475891C119599485 @default.
- W4315475891 hasConceptScore W4315475891C120665830 @default.
- W4315475891 hasConceptScore W4315475891C121332964 @default.
- W4315475891 hasConceptScore W4315475891C127413603 @default.
- W4315475891 hasConceptScore W4315475891C138885662 @default.
- W4315475891 hasConceptScore W4315475891C141353440 @default.
- W4315475891 hasConceptScore W4315475891C153180895 @default.