Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386076665> ?p ?o ?g. }
Showing items 1 to 94 of
94
with 100 items per page.
- W4386076665 abstract "Contrastive Language-Image Pre-training (CLIP) is attracting increasing attention for its impressive zero-shot recognition performance on different down-stream tasks. However, training CLIP is data-hungry and requires lots of image-text pairs to memorize various semantic concepts. In this paper, we propose a novel and efficient framework: Retrieval Augmented Contrastive Language-Image Pre-training (RA-CLIP) to augment embeddings by online retrieval. Specifically, we sample part of image-text data as a hold-out reference set. Given an input image, relevant image-text pairs are retrieved from the reference set to enrich the representation of input image. This process can be considered as an open-book exam: with the reference set as a cheat sheet, the proposed method doesn't need to memorize all visual concepts in the training data. It explores how to recognize visual concepts by exploiting correspondence between images and texts in the cheat sheet. The proposed RA-CLIP implements this idea and comprehensive experiments are conducted to show how RA-CLIP works. Performances on 10 image classification datasets and 2 object detection datasets show that RA-CLIP outperforms vanilla CLIP baseline by a large margin on zero-shot image classification task (+12.7%), linear probe image classification task (+6.9%) and zero-shot ROI classification task (+2.8%)." @default.
- W4386076665 created "2023-08-23" @default.
- W4386076665 creator A5003143385 @default.
- W4386076665 creator A5008256750 @default.
- W4386076665 creator A5015045452 @default.
- W4386076665 creator A5020748457 @default.
- W4386076665 creator A5057864403 @default.
- W4386076665 creator A5083902118 @default.
- W4386076665 date "2023-06-01" @default.
- W4386076665 modified "2023-09-27" @default.
- W4386076665 title "RA-CLIP: Retrieval Augmented Contrastive Language-Image Pre-Training" @default.
- W4386076665 cites W1977295328 @default.
- W4386076665 cites W1977766639 @default.
- W4386076665 cites W2047643928 @default.
- W4386076665 cites W2102605133 @default.
- W4386076665 cites W2108598243 @default.
- W4386076665 cites W2155904486 @default.
- W4386076665 cites W2194775991 @default.
- W4386076665 cites W2250384498 @default.
- W4386076665 cites W2948672349 @default.
- W4386076665 cites W3035682985 @default.
- W4386076665 cites W3159481202 @default.
- W4386076665 cites W3176641147 @default.
- W4386076665 cites W4312407537 @default.
- W4386076665 cites W4312504063 @default.
- W4386076665 doi "https://doi.org/10.1109/cvpr52729.2023.01846" @default.
- W4386076665 hasPublicationYear "2023" @default.
- W4386076665 type Work @default.
- W4386076665 citedByCount "0" @default.
- W4386076665 crossrefType "proceedings-article" @default.
- W4386076665 hasAuthorship W4386076665A5003143385 @default.
- W4386076665 hasAuthorship W4386076665A5008256750 @default.
- W4386076665 hasAuthorship W4386076665A5015045452 @default.
- W4386076665 hasAuthorship W4386076665A5020748457 @default.
- W4386076665 hasAuthorship W4386076665A5057864403 @default.
- W4386076665 hasAuthorship W4386076665A5083902118 @default.
- W4386076665 hasConcept C115961682 @default.
- W4386076665 hasConcept C119857082 @default.
- W4386076665 hasConcept C145420912 @default.
- W4386076665 hasConcept C153180895 @default.
- W4386076665 hasConcept C154945302 @default.
- W4386076665 hasConcept C162324750 @default.
- W4386076665 hasConcept C1667742 @default.
- W4386076665 hasConcept C177264268 @default.
- W4386076665 hasConcept C180462255 @default.
- W4386076665 hasConcept C187736073 @default.
- W4386076665 hasConcept C199360897 @default.
- W4386076665 hasConcept C204321447 @default.
- W4386076665 hasConcept C2780451532 @default.
- W4386076665 hasConcept C2781238097 @default.
- W4386076665 hasConcept C30038468 @default.
- W4386076665 hasConcept C31972630 @default.
- W4386076665 hasConcept C33923547 @default.
- W4386076665 hasConcept C41008148 @default.
- W4386076665 hasConcept C75294576 @default.
- W4386076665 hasConcept C774472 @default.
- W4386076665 hasConcept C9417928 @default.
- W4386076665 hasConceptScore W4386076665C115961682 @default.
- W4386076665 hasConceptScore W4386076665C119857082 @default.
- W4386076665 hasConceptScore W4386076665C145420912 @default.
- W4386076665 hasConceptScore W4386076665C153180895 @default.
- W4386076665 hasConceptScore W4386076665C154945302 @default.
- W4386076665 hasConceptScore W4386076665C162324750 @default.
- W4386076665 hasConceptScore W4386076665C1667742 @default.
- W4386076665 hasConceptScore W4386076665C177264268 @default.
- W4386076665 hasConceptScore W4386076665C180462255 @default.
- W4386076665 hasConceptScore W4386076665C187736073 @default.
- W4386076665 hasConceptScore W4386076665C199360897 @default.
- W4386076665 hasConceptScore W4386076665C204321447 @default.
- W4386076665 hasConceptScore W4386076665C2780451532 @default.
- W4386076665 hasConceptScore W4386076665C2781238097 @default.
- W4386076665 hasConceptScore W4386076665C30038468 @default.
- W4386076665 hasConceptScore W4386076665C31972630 @default.
- W4386076665 hasConceptScore W4386076665C33923547 @default.
- W4386076665 hasConceptScore W4386076665C41008148 @default.
- W4386076665 hasConceptScore W4386076665C75294576 @default.
- W4386076665 hasConceptScore W4386076665C774472 @default.
- W4386076665 hasConceptScore W4386076665C9417928 @default.
- W4386076665 hasLocation W43860766651 @default.
- W4386076665 hasOpenAccess W4386076665 @default.
- W4386076665 hasPrimaryLocation W43860766651 @default.
- W4386076665 hasRelatedWork W1837097281 @default.
- W4386076665 hasRelatedWork W1966410754 @default.
- W4386076665 hasRelatedWork W2007544051 @default.
- W4386076665 hasRelatedWork W2030539674 @default.
- W4386076665 hasRelatedWork W2095705906 @default.
- W4386076665 hasRelatedWork W2325242284 @default.
- W4386076665 hasRelatedWork W2363840281 @default.
- W4386076665 hasRelatedWork W2732308154 @default.
- W4386076665 hasRelatedWork W2789220062 @default.
- W4386076665 hasRelatedWork W2975200075 @default.
- W4386076665 isParatext "false" @default.
- W4386076665 isRetracted "false" @default.
- W4386076665 workType "article" @default.