Matches in SemOpenAlex for { <https://semopenalex.org/work/W3205071530> ?p ?o ?g. }
- W3205071530 abstract "learning with the InfoNCE objective is exceptionally successful in various self-supervised learning tasks. Recently, the CLIP model yielded impressive results on zero-shot transfer learning when using InfoNCE for learning visual representations from natural language supervision. However, InfoNCE as a lower bound on the mutual information has been shown to perform poorly for high mutual information. In contrast, the InfoLOOB upper bound (leave one out bound) works well for high mutual information but suffers from large variance and instabilities. We introduce Contrastive Leave One Out Boost (CLOOB), where modern Hopfield networks boost learning with the InfoLOOB objective. Modern Hopfield networks replace the original embeddings by retrieved embeddings in the InfoLOOB objective. The retrieved embeddings give InfoLOOB two assets. Firstly, the retrieved embeddings stabilize InfoLOOB, since they are less noisy and more similar to one another than the original embeddings. Secondly, they are enriched by correlations, since the covariance structure of embeddings is reinforced through retrievals. We compare CLOOB to CLIP after learning on the Conceptual Captions and the YFCC dataset with respect to their zero-shot transfer learning performance on other datasets. CLOOB consistently outperforms CLIP at zero-shot transfer learning across all considered architectures and datasets." @default.
- W3205071530 created "2021-10-25" @default.
- W3205071530 creator A5001718242 @default.
- W3205071530 creator A5007562104 @default.
- W3205071530 creator A5047051172 @default.
- W3205071530 creator A5053148274 @default.
- W3205071530 creator A5054118554 @default.
- W3205071530 creator A5054806825 @default.
- W3205071530 creator A5058591743 @default.
- W3205071530 creator A5066221961 @default.
- W3205071530 creator A5076046328 @default.
- W3205071530 creator A5079632405 @default.
- W3205071530 creator A5080874073 @default.
- W3205071530 date "2021-10-21" @default.
- W3205071530 modified "2023-09-27" @default.
- W3205071530 title "CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP" @default.
- W3205071530 cites W2087334523 @default.
- W3205071530 cites W2102591969 @default.
- W3205071530 cites W2108598243 @default.
- W3205071530 cites W2112246162 @default.
- W3205071530 cites W2152790380 @default.
- W3205071530 cites W2169269897 @default.
- W3205071530 cites W2194775991 @default.
- W3205071530 cites W2250384498 @default.
- W3205071530 cites W24089286 @default.
- W3205071530 cites W2518108298 @default.
- W3205071530 cites W2798991696 @default.
- W3205071530 cites W2886641317 @default.
- W3205071530 cites W2900148439 @default.
- W3205071530 cites W2944828972 @default.
- W3205071530 cites W2949416428 @default.
- W3205071530 cites W2949759968 @default.
- W3205071530 cites W2950133940 @default.
- W3205071530 cites W2950541952 @default.
- W3205071530 cites W2962940432 @default.
- W3205071530 cites W2963341956 @default.
- W3205071530 cites W2963644595 @default.
- W3205071530 cites W3005680577 @default.
- W3205071530 cites W3016970897 @default.
- W3205071530 cites W3022061250 @default.
- W3205071530 cites W3034781633 @default.
- W3205071530 cites W3035060554 @default.
- W3205071530 cites W3036928441 @default.
- W3205071530 cites W3102889924 @default.
- W3205071530 cites W3104911444 @default.
- W3205071530 cites W3135367836 @default.
- W3205071530 cites W3139488800 @default.
- W3205071530 cites W3152496470 @default.
- W3205071530 cites W3152798676 @default.
- W3205071530 cites W3156636935 @default.
- W3205071530 cites W3166049810 @default.
- W3205071530 cites W3168770756 @default.
- W3205071530 cites W3173181308 @default.
- W3205071530 cites W3174301209 @default.
- W3205071530 cites W3182475814 @default.
- W3205071530 cites W3183477904 @default.
- W3205071530 cites W3186358883 @default.
- W3205071530 cites W3190434222 @default.
- W3205071530 cites W3195577433 @default.
- W3205071530 cites W3198377975 @default.
- W3205071530 cites W3125808012 @default.
- W3205071530 hasPublicationYear "2021" @default.
- W3205071530 type Work @default.
- W3205071530 sameAs 3205071530 @default.
- W3205071530 citedByCount "0" @default.
- W3205071530 crossrefType "posted-content" @default.
- W3205071530 hasAuthorship W3205071530A5001718242 @default.
- W3205071530 hasAuthorship W3205071530A5007562104 @default.
- W3205071530 hasAuthorship W3205071530A5047051172 @default.
- W3205071530 hasAuthorship W3205071530A5053148274 @default.
- W3205071530 hasAuthorship W3205071530A5054118554 @default.
- W3205071530 hasAuthorship W3205071530A5054806825 @default.
- W3205071530 hasAuthorship W3205071530A5058591743 @default.
- W3205071530 hasAuthorship W3205071530A5066221961 @default.
- W3205071530 hasAuthorship W3205071530A5076046328 @default.
- W3205071530 hasAuthorship W3205071530A5079632405 @default.
- W3205071530 hasAuthorship W3205071530A5080874073 @default.
- W3205071530 hasConcept C105795698 @default.
- W3205071530 hasConcept C119857082 @default.
- W3205071530 hasConcept C121955636 @default.
- W3205071530 hasConcept C134306372 @default.
- W3205071530 hasConcept C138885662 @default.
- W3205071530 hasConcept C144133560 @default.
- W3205071530 hasConcept C150899416 @default.
- W3205071530 hasConcept C152139883 @default.
- W3205071530 hasConcept C153180895 @default.
- W3205071530 hasConcept C154945302 @default.
- W3205071530 hasConcept C178650346 @default.
- W3205071530 hasConcept C196083921 @default.
- W3205071530 hasConcept C2776502983 @default.
- W3205071530 hasConcept C2780813799 @default.
- W3205071530 hasConcept C33923547 @default.
- W3205071530 hasConcept C41008148 @default.
- W3205071530 hasConcept C41895202 @default.
- W3205071530 hasConcept C77553402 @default.
- W3205071530 hasConceptScore W3205071530C105795698 @default.
- W3205071530 hasConceptScore W3205071530C119857082 @default.
- W3205071530 hasConceptScore W3205071530C121955636 @default.
- W3205071530 hasConceptScore W3205071530C134306372 @default.
- W3205071530 hasConceptScore W3205071530C138885662 @default.