Matches in SemOpenAlex for { <https://semopenalex.org/work/W3086458729> ?p ?o ?g. }
- W3086458729 abstract "Video Question Answering (Video QA) requires fine-grained understanding of both video and language modalities to answer the given questions. In this paper, we propose novel training schemes for multiple-choice video question answering with a self-supervised pre-training stage and a supervised contrastive learning in the main stage as an auxiliary learning. In the self-supervised pre-training stage, we transform the original problem format of predicting the correct answer into the one that predicts the relevant question to provide a model with broader contextual inputs without any further dataset or annotation. For contrastive learning in the main stage, we add a masking noise to the input corresponding to the ground-truth answer, and consider the original input of the ground-truth answer as a positive sample, while treating the rest as negative samples. By mapping the positive sample closer to the masked input, we show that the model performance is improved. We further employ locally aligned attention to focus more effectively on the video frames that are particularly relevant to the given corresponding subtitle sentences. We evaluate our proposed model on highly competitive benchmark datasets related to multiple-choice video QA: TVQA, TVQA+, and DramaQA. Experimental results show that our model achieves state-of-the-art performance on all datasets. We also validate our approaches through further analyses." @default.
- W3086458729 created "2020-09-21" @default.
- W3086458729 creator A5021025665 @default.
- W3086458729 creator A5061978920 @default.
- W3086458729 creator A5066654727 @default.
- W3086458729 creator A5075692629 @default.
- W3086458729 creator A5084897975 @default.
- W3086458729 date "2020-09-16" @default.
- W3086458729 modified "2023-09-25" @default.
- W3086458729 title "Self-supervised pre-training and contrastive representation learning for multiple-choice video QA" @default.
- W3086458729 cites W1889081078 @default.
- W3086458729 cites W1933349210 @default.
- W3086458729 cites W2108598243 @default.
- W3086458729 cites W2138621090 @default.
- W3086458729 cites W2148349024 @default.
- W3086458729 cites W2194775991 @default.
- W3086458729 cites W2412400526 @default.
- W3086458729 cites W2560730294 @default.
- W3086458729 cites W2613718673 @default.
- W3086458729 cites W2726160912 @default.
- W3086458729 cites W2798354744 @default.
- W3086458729 cites W2890124903 @default.
- W3086458729 cites W2940906331 @default.
- W3086458729 cites W2949844032 @default.
- W3086458729 cites W2950371778 @default.
- W3086458729 cites W2950761309 @default.
- W3086458729 cites W2956387449 @default.
- W3086458729 cites W2963341956 @default.
- W3086458729 cites W2963351113 @default.
- W3086458729 cites W2963656855 @default.
- W3086458729 cites W2963781647 @default.
- W3086458729 cites W2963916161 @default.
- W3086458729 cites W2963954913 @default.
- W3086458729 cites W2965373594 @default.
- W3086458729 cites W2969127500 @default.
- W3086458729 cites W2981852735 @default.
- W3086458729 cites W3005680577 @default.
- W3086458729 cites W3010593057 @default.
- W3086458729 cites W3024690827 @default.
- W3086458729 cites W3025269113 @default.
- W3086458729 cites W3026092005 @default.
- W3086458729 cites W3035524453 @default.
- W3086458729 cites W3100345210 @default.
- W3086458729 doi "https://doi.org/10.48550/arxiv.2009.08043" @default.
- W3086458729 hasPublicationYear "2020" @default.
- W3086458729 type Work @default.
- W3086458729 sameAs 3086458729 @default.
- W3086458729 citedByCount "3" @default.
- W3086458729 countsByYear W30864587292021 @default.
- W3086458729 crossrefType "posted-content" @default.
- W3086458729 hasAuthorship W3086458729A5021025665 @default.
- W3086458729 hasAuthorship W3086458729A5061978920 @default.
- W3086458729 hasAuthorship W3086458729A5066654727 @default.
- W3086458729 hasAuthorship W3086458729A5075692629 @default.
- W3086458729 hasAuthorship W3086458729A5084897975 @default.
- W3086458729 hasBestOaLocation W30864587291 @default.
- W3086458729 hasConcept C111919701 @default.
- W3086458729 hasConcept C119857082 @default.
- W3086458729 hasConcept C120665830 @default.
- W3086458729 hasConcept C121332964 @default.
- W3086458729 hasConcept C13280743 @default.
- W3086458729 hasConcept C142362112 @default.
- W3086458729 hasConcept C144024400 @default.
- W3086458729 hasConcept C146849305 @default.
- W3086458729 hasConcept C153349607 @default.
- W3086458729 hasConcept C154945302 @default.
- W3086458729 hasConcept C17744445 @default.
- W3086458729 hasConcept C185592680 @default.
- W3086458729 hasConcept C185798385 @default.
- W3086458729 hasConcept C192209626 @default.
- W3086458729 hasConcept C198531522 @default.
- W3086458729 hasConcept C199539241 @default.
- W3086458729 hasConcept C204321447 @default.
- W3086458729 hasConcept C205649164 @default.
- W3086458729 hasConcept C2776359362 @default.
- W3086458729 hasConcept C2777402240 @default.
- W3086458729 hasConcept C2779903281 @default.
- W3086458729 hasConcept C2780364048 @default.
- W3086458729 hasConcept C36289849 @default.
- W3086458729 hasConcept C41008148 @default.
- W3086458729 hasConcept C43617362 @default.
- W3086458729 hasConcept C94625758 @default.
- W3086458729 hasConceptScore W3086458729C111919701 @default.
- W3086458729 hasConceptScore W3086458729C119857082 @default.
- W3086458729 hasConceptScore W3086458729C120665830 @default.
- W3086458729 hasConceptScore W3086458729C121332964 @default.
- W3086458729 hasConceptScore W3086458729C13280743 @default.
- W3086458729 hasConceptScore W3086458729C142362112 @default.
- W3086458729 hasConceptScore W3086458729C144024400 @default.
- W3086458729 hasConceptScore W3086458729C146849305 @default.
- W3086458729 hasConceptScore W3086458729C153349607 @default.
- W3086458729 hasConceptScore W3086458729C154945302 @default.
- W3086458729 hasConceptScore W3086458729C17744445 @default.
- W3086458729 hasConceptScore W3086458729C185592680 @default.
- W3086458729 hasConceptScore W3086458729C185798385 @default.
- W3086458729 hasConceptScore W3086458729C192209626 @default.
- W3086458729 hasConceptScore W3086458729C198531522 @default.
- W3086458729 hasConceptScore W3086458729C199539241 @default.
- W3086458729 hasConceptScore W3086458729C204321447 @default.
- W3086458729 hasConceptScore W3086458729C205649164 @default.