Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313055276> ?p ?o ?g. }
- W4313055276 abstract "Action recognition models have shown a promising capability to classify human actions in short video clips. In a real scenario, multiple correlated human actions commonly occur in particular orders, forming semantically meaningful human activities. Conventional action recognition approaches focus on analyzing single actions. However, they fail to fully reason about the contextual relations between adjacent actions, which provide potential temporal logic for understanding long videos. In this paper, we propose a prompt-based framework, Bridge-Prompt (Br-Prompt), to model the semantics across adjacent actions, so that it simultaneously exploits both out-of-context and contextual information from a series of ordinal actions in instructional videos. More specifically, we reformulate the individual action labels as integrated text prompts for super-vision, which bridge the gap between individual action semantics. The generated text prompts are paired with corresponding video clips, and together co-train the text encoder and the video encoder via a contrastive approach. The learned vision encoder has a stronger capability for ordinal-action-related downstream tasks, e.g. action segmentation and human activity recognition. We evaluate the performances of our approach on several video datasets: Georgia Tech Egocentric Activities (GTEA), 50Salads, and the Breakfast dataset. Br-Prompt achieves state-of-the-art on multiple benchmarks. Code is available at: https://github.com/ttlmh/Bridge-Prompt." @default.
- W4313055276 created "2023-01-06" @default.
- W4313055276 creator A5010357390 @default.
- W4313055276 creator A5010738468 @default.
- W4313055276 creator A5031311605 @default.
- W4313055276 creator A5038160474 @default.
- W4313055276 creator A5042676951 @default.
- W4313055276 creator A5084679040 @default.
- W4313055276 creator A5090079801 @default.
- W4313055276 date "2022-06-01" @default.
- W4313055276 modified "2023-09-30" @default.
- W4313055276 title "Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos" @default.
- W4313055276 cites W1522734439 @default.
- W4313055276 cites W2031688197 @default.
- W4313055276 cites W2099614498 @default.
- W4313055276 cites W2109698606 @default.
- W4313055276 cites W2550143307 @default.
- W4313055276 cites W2608988379 @default.
- W4313055276 cites W2952132648 @default.
- W4313055276 cites W2957775769 @default.
- W4313055276 cites W2963524571 @default.
- W4313055276 cites W2963722382 @default.
- W4313055276 cites W2963853051 @default.
- W4313055276 cites W2964094654 @default.
- W4313055276 cites W2990503944 @default.
- W4313055276 cites W3034373833 @default.
- W4313055276 cites W3034802267 @default.
- W4313055276 cites W3083550439 @default.
- W4313055276 cites W3098267758 @default.
- W4313055276 cites W3108772932 @default.
- W4313055276 cites W3119038403 @default.
- W4313055276 cites W3166363426 @default.
- W4313055276 cites W3176747907 @default.
- W4313055276 cites W3180463990 @default.
- W4313055276 cites W3204193736 @default.
- W4313055276 cites W3210314917 @default.
- W4313055276 cites W4214612132 @default.
- W4313055276 doi "https://doi.org/10.1109/cvpr52688.2022.01926" @default.
- W4313055276 hasPublicationYear "2022" @default.
- W4313055276 type Work @default.
- W4313055276 citedByCount "9" @default.
- W4313055276 countsByYear W43130552762022 @default.
- W4313055276 countsByYear W43130552762023 @default.
- W4313055276 crossrefType "proceedings-article" @default.
- W4313055276 hasAuthorship W4313055276A5010357390 @default.
- W4313055276 hasAuthorship W4313055276A5010738468 @default.
- W4313055276 hasAuthorship W4313055276A5031311605 @default.
- W4313055276 hasAuthorship W4313055276A5038160474 @default.
- W4313055276 hasAuthorship W4313055276A5042676951 @default.
- W4313055276 hasAuthorship W4313055276A5084679040 @default.
- W4313055276 hasAuthorship W4313055276A5090079801 @default.
- W4313055276 hasBestOaLocation W43130552762 @default.
- W4313055276 hasConcept C100776233 @default.
- W4313055276 hasConcept C107457646 @default.
- W4313055276 hasConcept C111919701 @default.
- W4313055276 hasConcept C118505674 @default.
- W4313055276 hasConcept C121332964 @default.
- W4313055276 hasConcept C126322002 @default.
- W4313055276 hasConcept C151730666 @default.
- W4313055276 hasConcept C154945302 @default.
- W4313055276 hasConcept C177264268 @default.
- W4313055276 hasConcept C184337299 @default.
- W4313055276 hasConcept C199360897 @default.
- W4313055276 hasConcept C204321447 @default.
- W4313055276 hasConcept C2776760102 @default.
- W4313055276 hasConcept C2777212361 @default.
- W4313055276 hasConcept C2779343474 @default.
- W4313055276 hasConcept C2780791683 @default.
- W4313055276 hasConcept C2987834672 @default.
- W4313055276 hasConcept C41008148 @default.
- W4313055276 hasConcept C62520636 @default.
- W4313055276 hasConcept C71924100 @default.
- W4313055276 hasConcept C86803240 @default.
- W4313055276 hasConcept C89600930 @default.
- W4313055276 hasConceptScore W4313055276C100776233 @default.
- W4313055276 hasConceptScore W4313055276C107457646 @default.
- W4313055276 hasConceptScore W4313055276C111919701 @default.
- W4313055276 hasConceptScore W4313055276C118505674 @default.
- W4313055276 hasConceptScore W4313055276C121332964 @default.
- W4313055276 hasConceptScore W4313055276C126322002 @default.
- W4313055276 hasConceptScore W4313055276C151730666 @default.
- W4313055276 hasConceptScore W4313055276C154945302 @default.
- W4313055276 hasConceptScore W4313055276C177264268 @default.
- W4313055276 hasConceptScore W4313055276C184337299 @default.
- W4313055276 hasConceptScore W4313055276C199360897 @default.
- W4313055276 hasConceptScore W4313055276C204321447 @default.
- W4313055276 hasConceptScore W4313055276C2776760102 @default.
- W4313055276 hasConceptScore W4313055276C2777212361 @default.
- W4313055276 hasConceptScore W4313055276C2779343474 @default.
- W4313055276 hasConceptScore W4313055276C2780791683 @default.
- W4313055276 hasConceptScore W4313055276C2987834672 @default.
- W4313055276 hasConceptScore W4313055276C41008148 @default.
- W4313055276 hasConceptScore W4313055276C62520636 @default.
- W4313055276 hasConceptScore W4313055276C71924100 @default.
- W4313055276 hasConceptScore W4313055276C86803240 @default.
- W4313055276 hasConceptScore W4313055276C89600930 @default.
- W4313055276 hasLocation W43130552761 @default.
- W4313055276 hasLocation W43130552762 @default.
- W4313055276 hasOpenAccess W4313055276 @default.
- W4313055276 hasPrimaryLocation W43130552761 @default.