Matches in SemOpenAlex for { <https://semopenalex.org/work/W4312544061> ?p ?o ?g. }
- W4312544061 abstract "Finding relevant moments and highlights in videos according to natural language queries is a natural and highly valuable common need in the current video content explosion era. Nevertheless, jointly conducting moment retrieval and highlight detection is an emerging research topic, even though its component problems and some related tasks have already been studied for a while. In this paper, we present the first unified framework, named Unified Multi-modal Transformers (UMT), capable of realizing such joint optimization while can also be easily degenerated for solving individual problems. As far as we are aware, this is the first scheme to integrate multi-modal (visual-audio) learning for either joint optimization or the individual moment retrieval task, and tackles moment retrieval as a keypoint detection problem using a novel query generator and query decoder. Extensive comparisons with existing methods and ablation studies on QVHighlights, Charades-STA, YouTube Highlights, and TVSum datasets demonstrate the effectiveness, superiority, and flexibility of the proposed method under various settings. Source code and pre-trained models are available at https://github.com/TencentARC/UMT." @default.
- W4312544061 created "2023-01-05" @default.
- W4312544061 creator A5002277899 @default.
- W4312544061 creator A5018742393 @default.
- W4312544061 creator A5039877879 @default.
- W4312544061 creator A5055640195 @default.
- W4312544061 creator A5072608526 @default.
- W4312544061 creator A5088475144 @default.
- W4312544061 date "2022-06-01" @default.
- W4312544061 modified "2023-10-16" @default.
- W4312544061 title "UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection" @default.
- W4312544061 cites W1522734439 @default.
- W4312544061 cites W2111078031 @default.
- W4312544061 cites W2167851108 @default.
- W4312544061 cites W2194345886 @default.
- W4312544061 cites W2250539671 @default.
- W4312544061 cites W2467794422 @default.
- W4312544061 cites W2490414731 @default.
- W4312544061 cites W2737677090 @default.
- W4312544061 cites W2904824998 @default.
- W4312544061 cites W2905354574 @default.
- W4312544061 cites W2919974746 @default.
- W4312544061 cites W2962869524 @default.
- W4312544061 cites W2963017553 @default.
- W4312544061 cites W2963095467 @default.
- W4312544061 cites W2963351448 @default.
- W4312544061 cites W2963524571 @default.
- W4312544061 cites W2963729528 @default.
- W4312544061 cites W2964089981 @default.
- W4312544061 cites W2968356596 @default.
- W4312544061 cites W2990503944 @default.
- W4312544061 cites W2997429269 @default.
- W4312544061 cites W3094550259 @default.
- W4312544061 cites W3176005985 @default.
- W4312544061 cites W3196253003 @default.
- W4312544061 cites W3201832684 @default.
- W4312544061 cites W3202168743 @default.
- W4312544061 doi "https://doi.org/10.1109/cvpr52688.2022.00305" @default.
- W4312544061 hasPublicationYear "2022" @default.
- W4312544061 type Work @default.
- W4312544061 citedByCount "10" @default.
- W4312544061 countsByYear W43125440612023 @default.
- W4312544061 crossrefType "proceedings-article" @default.
- W4312544061 hasAuthorship W4312544061A5002277899 @default.
- W4312544061 hasAuthorship W4312544061A5018742393 @default.
- W4312544061 hasAuthorship W4312544061A5039877879 @default.
- W4312544061 hasAuthorship W4312544061A5055640195 @default.
- W4312544061 hasAuthorship W4312544061A5072608526 @default.
- W4312544061 hasAuthorship W4312544061A5088475144 @default.
- W4312544061 hasBestOaLocation W43125440612 @default.
- W4312544061 hasConcept C105795698 @default.
- W4312544061 hasConcept C111919701 @default.
- W4312544061 hasConcept C121332964 @default.
- W4312544061 hasConcept C124101348 @default.
- W4312544061 hasConcept C127413603 @default.
- W4312544061 hasConcept C154945302 @default.
- W4312544061 hasConcept C165801399 @default.
- W4312544061 hasConcept C170154142 @default.
- W4312544061 hasConcept C179254644 @default.
- W4312544061 hasConcept C18555067 @default.
- W4312544061 hasConcept C185592680 @default.
- W4312544061 hasConcept C188027245 @default.
- W4312544061 hasConcept C2780598303 @default.
- W4312544061 hasConcept C33923547 @default.
- W4312544061 hasConcept C41008148 @default.
- W4312544061 hasConcept C43126263 @default.
- W4312544061 hasConcept C62520636 @default.
- W4312544061 hasConcept C66322947 @default.
- W4312544061 hasConcept C71139939 @default.
- W4312544061 hasConcept C74650414 @default.
- W4312544061 hasConceptScore W4312544061C105795698 @default.
- W4312544061 hasConceptScore W4312544061C111919701 @default.
- W4312544061 hasConceptScore W4312544061C121332964 @default.
- W4312544061 hasConceptScore W4312544061C124101348 @default.
- W4312544061 hasConceptScore W4312544061C127413603 @default.
- W4312544061 hasConceptScore W4312544061C154945302 @default.
- W4312544061 hasConceptScore W4312544061C165801399 @default.
- W4312544061 hasConceptScore W4312544061C170154142 @default.
- W4312544061 hasConceptScore W4312544061C179254644 @default.
- W4312544061 hasConceptScore W4312544061C18555067 @default.
- W4312544061 hasConceptScore W4312544061C185592680 @default.
- W4312544061 hasConceptScore W4312544061C188027245 @default.
- W4312544061 hasConceptScore W4312544061C2780598303 @default.
- W4312544061 hasConceptScore W4312544061C33923547 @default.
- W4312544061 hasConceptScore W4312544061C41008148 @default.
- W4312544061 hasConceptScore W4312544061C43126263 @default.
- W4312544061 hasConceptScore W4312544061C62520636 @default.
- W4312544061 hasConceptScore W4312544061C66322947 @default.
- W4312544061 hasConceptScore W4312544061C71139939 @default.
- W4312544061 hasConceptScore W4312544061C74650414 @default.
- W4312544061 hasLocation W43125440611 @default.
- W4312544061 hasLocation W43125440612 @default.
- W4312544061 hasOpenAccess W4312544061 @default.
- W4312544061 hasPrimaryLocation W43125440611 @default.
- W4312544061 hasRelatedWork W2002071806 @default.
- W4312544061 hasRelatedWork W2002881056 @default.
- W4312544061 hasRelatedWork W2020894530 @default.
- W4312544061 hasRelatedWork W2027246577 @default.
- W4312544061 hasRelatedWork W2030530201 @default.
- W4312544061 hasRelatedWork W2164324468 @default.