Matches in SemOpenAlex for { <https://semopenalex.org/work/W3174331338> ?p ?o ?g. }
- W3174331338 abstract "Instance-level contrastive learning techniques, which rely on data augmentation and a contrastive loss function, have found great success in the domain of visual representation learning. They are not suitable for exploiting the rich dynamical structure of video however, as operations are done on many augmented instances. In this paper we propose Video Cross-Stream Prototypical Contrasting, a novel method which predicts consistent prototype assignments from both RGB and optical flow views, operating on sets of samples. Specifically, we alternate the optimization process; while optimizing one of the streams, all views are mapped to one set of stream prototype vectors. Each of the assignments is predicted with all views except the one matching the prediction, pushing representations closer to their assigned prototypes. As a result, more efficient video embeddings with ingrained motion information are learned, without the explicit need for optical flow computation during inference. We obtain state-of-the-art results on nearest-neighbour video retrieval and action recognition, outperforming previous best by +3.2% on UCF101 using the S3D backbone (90.5% Top-1 acc), and by +7.2% on UCF101 and +15.1% on HMDB51 using the R(2+1)D backbone. <sup xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sup>" @default.
- W3174331338 created "2021-07-05" @default.
- W3174331338 creator A5021995111 @default.
- W3174331338 creator A5029129530 @default.
- W3174331338 creator A5079566054 @default.
- W3174331338 creator A5082440705 @default.
- W3174331338 date "2022-01-01" @default.
- W3174331338 modified "2023-10-06" @default.
- W3174331338 title "Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting" @default.
- W3174331338 cites W1522734439 @default.
- W3174331338 cites W1979285635 @default.
- W3174331338 cites W2006117756 @default.
- W3174331338 cites W2082627290 @default.
- W3174331338 cites W2099634219 @default.
- W3174331338 cites W2108598243 @default.
- W3174331338 cites W2114996241 @default.
- W3174331338 cites W2126579184 @default.
- W3174331338 cites W219040644 @default.
- W3174331338 cites W2342505190 @default.
- W3174331338 cites W2487442924 @default.
- W3174331338 cites W2550462002 @default.
- W3174331338 cites W2593116425 @default.
- W3174331338 cites W2799087757 @default.
- W3174331338 cites W2883451034 @default.
- W3174331338 cites W2883725317 @default.
- W3174331338 cites W2947084868 @default.
- W3174331338 cites W2948242301 @default.
- W3174331338 cites W2962934715 @default.
- W3174331338 cites W2963524571 @default.
- W3174331338 cites W2963631366 @default.
- W3174331338 cites W2963814513 @default.
- W3174331338 cites W2964037671 @default.
- W3174331338 cites W2964207322 @default.
- W3174331338 cites W2964700958 @default.
- W3174331338 cites W2984008963 @default.
- W3174331338 cites W2997907976 @default.
- W3174331338 cites W3009812836 @default.
- W3174331338 cites W3010874390 @default.
- W3174331338 cites W3015371781 @default.
- W3174331338 cites W3034215340 @default.
- W3174331338 cites W3034345981 @default.
- W3174331338 cites W3034576826 @default.
- W3174331338 cites W3034781633 @default.
- W3174331338 cites W3034915791 @default.
- W3174331338 cites W3035524453 @default.
- W3174331338 cites W3035635319 @default.
- W3174331338 cites W3110306138 @default.
- W3174331338 cites W3115964123 @default.
- W3174331338 cites W3145385912 @default.
- W3174331338 cites W3159040138 @default.
- W3174331338 cites W4206471589 @default.
- W3174331338 doi "https://doi.org/10.1109/wacv51458.2022.00092" @default.
- W3174331338 hasPublicationYear "2022" @default.
- W3174331338 type Work @default.
- W3174331338 sameAs 3174331338 @default.
- W3174331338 citedByCount "7" @default.
- W3174331338 countsByYear W31743313382022 @default.
- W3174331338 countsByYear W31743313382023 @default.
- W3174331338 crossrefType "proceedings-article" @default.
- W3174331338 hasAuthorship W3174331338A5021995111 @default.
- W3174331338 hasAuthorship W3174331338A5029129530 @default.
- W3174331338 hasAuthorship W3174331338A5079566054 @default.
- W3174331338 hasAuthorship W3174331338A5082440705 @default.
- W3174331338 hasBestOaLocation W31743313382 @default.
- W3174331338 hasConcept C105795698 @default.
- W3174331338 hasConcept C115961682 @default.
- W3174331338 hasConcept C153180895 @default.
- W3174331338 hasConcept C154945302 @default.
- W3174331338 hasConcept C155542232 @default.
- W3174331338 hasConcept C165064840 @default.
- W3174331338 hasConcept C177264268 @default.
- W3174331338 hasConcept C17744445 @default.
- W3174331338 hasConcept C199360897 @default.
- W3174331338 hasConcept C199539241 @default.
- W3174331338 hasConcept C2776214188 @default.
- W3174331338 hasConcept C2776359362 @default.
- W3174331338 hasConcept C33923547 @default.
- W3174331338 hasConcept C41008148 @default.
- W3174331338 hasConcept C59404180 @default.
- W3174331338 hasConcept C82990744 @default.
- W3174331338 hasConcept C94625758 @default.
- W3174331338 hasConceptScore W3174331338C105795698 @default.
- W3174331338 hasConceptScore W3174331338C115961682 @default.
- W3174331338 hasConceptScore W3174331338C153180895 @default.
- W3174331338 hasConceptScore W3174331338C154945302 @default.
- W3174331338 hasConceptScore W3174331338C155542232 @default.
- W3174331338 hasConceptScore W3174331338C165064840 @default.
- W3174331338 hasConceptScore W3174331338C177264268 @default.
- W3174331338 hasConceptScore W3174331338C17744445 @default.
- W3174331338 hasConceptScore W3174331338C199360897 @default.
- W3174331338 hasConceptScore W3174331338C199539241 @default.
- W3174331338 hasConceptScore W3174331338C2776214188 @default.
- W3174331338 hasConceptScore W3174331338C2776359362 @default.
- W3174331338 hasConceptScore W3174331338C33923547 @default.
- W3174331338 hasConceptScore W3174331338C41008148 @default.
- W3174331338 hasConceptScore W3174331338C59404180 @default.
- W3174331338 hasConceptScore W3174331338C82990744 @default.
- W3174331338 hasConceptScore W3174331338C94625758 @default.
- W3174331338 hasLocation W31743313381 @default.
- W3174331338 hasLocation W31743313382 @default.