Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313011746> ?p ?o ?g. }
- W4313011746 endingPage "56" @default.
- W4313011746 startingPage "38" @default.
- W4313011746 abstract "Video-Text Pre-training (VTP) aims to learn transferable representations for various downstream tasks from large-scale web videos. To date, almost all existing VTP methods are limited to retrieval-based downstream tasks, e.g., video retrieval, whereas their transfer potentials on localization-based tasks, e.g., temporal grounding, are under-explored. In this paper, we experimentally analyze and demonstrate the incompatibility of current VTP methods with localization tasks, and propose a novel Localization-oriented Video-Text Pre-training framework, dubbed as LocVTP. Specifically, we perform the fine-grained contrastive alignment as a complement to the coarse-grained one by a clip-word correspondence discovery scheme. To further enhance the temporal reasoning ability of the learned feature, we propose a context projection head and a temporal aware contrastive loss to perceive the contextual relationships. Extensive experiments on four downstream tasks across six datasets demonstrate that our LocVTP achieves state-of-the-art performance on both retrieval-based and localization-based tasks. Furthermore, we conduct comprehensive ablation studies and thorough analyses to explore the optimum model designs and training strategies. Codes are available at https://github.com/mengcaopku/LocVTP ." @default.
- W4313011746 created "2023-01-05" @default.
- W4313011746 creator A5002795838 @default.
- W4313011746 creator A5066493600 @default.
- W4313011746 creator A5067002890 @default.
- W4313011746 creator A5076036593 @default.
- W4313011746 creator A5076252609 @default.
- W4313011746 creator A5087641779 @default.
- W4313011746 date "2022-01-01" @default.
- W4313011746 modified "2023-10-14" @default.
- W4313011746 title "LocVTP: Video-Text Pre-training for Temporal Localization" @default.
- W4313011746 cites W2016053056 @default.
- W4313011746 cites W2078238240 @default.
- W4313011746 cites W2111078031 @default.
- W4313011746 cites W2277195237 @default.
- W4313011746 cites W2425121537 @default.
- W4313011746 cites W2606982687 @default.
- W4313011746 cites W2798991696 @default.
- W4313011746 cites W2885775891 @default.
- W4313011746 cites W2886641317 @default.
- W4313011746 cites W2889326414 @default.
- W4313011746 cites W2952132648 @default.
- W4313011746 cites W2957775769 @default.
- W4313011746 cites W2962795934 @default.
- W4313011746 cites W2963350250 @default.
- W4313011746 cites W2963775347 @default.
- W4313011746 cites W2963916161 @default.
- W4313011746 cites W2964089981 @default.
- W4313011746 cites W2964094654 @default.
- W4313011746 cites W2970231061 @default.
- W4313011746 cites W2970401629 @default.
- W4313011746 cites W2981851019 @default.
- W4313011746 cites W2984008963 @default.
- W4313011746 cites W2997429269 @default.
- W4313011746 cites W2997762001 @default.
- W4313011746 cites W3035265375 @default.
- W4313011746 cites W3035524453 @default.
- W4313011746 cites W3035635319 @default.
- W4313011746 cites W3043840704 @default.
- W4313011746 cites W3090449556 @default.
- W4313011746 cites W3092739351 @default.
- W4313011746 cites W3105232955 @default.
- W4313011746 cites W3108225446 @default.
- W4313011746 cites W3143320354 @default.
- W4313011746 cites W3145385912 @default.
- W4313011746 cites W3145807616 @default.
- W4313011746 cites W3167366812 @default.
- W4313011746 cites W3168640669 @default.
- W4313011746 cites W3168822201 @default.
- W4313011746 cites W3174364033 @default.
- W4313011746 cites W3174421047 @default.
- W4313011746 cites W3174873881 @default.
- W4313011746 cites W3176398504 @default.
- W4313011746 cites W3176481196 @default.
- W4313011746 cites W3176780013 @default.
- W4313011746 cites W3180297372 @default.
- W4313011746 cites W3190981030 @default.
- W4313011746 cites W3197828817 @default.
- W4313011746 cites W3199858703 @default.
- W4313011746 cites W3203711169 @default.
- W4313011746 cites W3204588463 @default.
- W4313011746 cites W3204670646 @default.
- W4313011746 cites W3206019042 @default.
- W4313011746 cites W3208474254 @default.
- W4313011746 cites W3211772574 @default.
- W4313011746 cites W3216763528 @default.
- W4313011746 cites W3217102353 @default.
- W4313011746 cites W4285606530 @default.
- W4313011746 cites W4289535637 @default.
- W4313011746 cites W4312275869 @default.
- W4313011746 doi "https://doi.org/10.1007/978-3-031-19809-0_3" @default.
- W4313011746 hasPublicationYear "2022" @default.
- W4313011746 type Work @default.
- W4313011746 citedByCount "5" @default.
- W4313011746 countsByYear W43130117462023 @default.
- W4313011746 crossrefType "book-chapter" @default.
- W4313011746 hasAuthorship W4313011746A5002795838 @default.
- W4313011746 hasAuthorship W4313011746A5066493600 @default.
- W4313011746 hasAuthorship W4313011746A5067002890 @default.
- W4313011746 hasAuthorship W4313011746A5076036593 @default.
- W4313011746 hasAuthorship W4313011746A5076252609 @default.
- W4313011746 hasAuthorship W4313011746A5087641779 @default.
- W4313011746 hasBestOaLocation W43130117462 @default.
- W4313011746 hasConcept C104317684 @default.
- W4313011746 hasConcept C112313634 @default.
- W4313011746 hasConcept C11413529 @default.
- W4313011746 hasConcept C127716648 @default.
- W4313011746 hasConcept C138885662 @default.
- W4313011746 hasConcept C151730666 @default.
- W4313011746 hasConcept C154945302 @default.
- W4313011746 hasConcept C185592680 @default.
- W4313011746 hasConcept C188082640 @default.
- W4313011746 hasConcept C204321447 @default.
- W4313011746 hasConcept C2776401178 @default.
- W4313011746 hasConcept C2779343474 @default.
- W4313011746 hasConcept C41008148 @default.
- W4313011746 hasConcept C41895202 @default.
- W4313011746 hasConcept C55493867 @default.