Matches in SemOpenAlex for { <https://semopenalex.org/work/W3139243190> ?p ?o ?g. }
- W3139243190 abstract "This paper studies zero-shot cross-lingual transfer of vision-language models. Specifically, we focus on multilingual text-to-video search and propose a Transformer-based model that learns contextualized multilingual multimodal embeddings. Under a zero-shot setting, we empirically demonstrate that performance degrades significantly when we query the multilingual text-video model with non-English sentences. To address this problem, we introduce a multilingual multimodal pre-training strategy, and collect a new multilingual instructional video dataset (MultiHowTo100M) for pre-training. Experiments on VTT show that our method significantly improves video search in non-English languages without additional annotations. Furthermore, when multilingual annotations are available, our method outperforms recent baselines by a large margin in multilingual text-to-video search on VTT and VATEX; as well as in multilingual text-to-image search on Multi30K. Our model and Multi-HowTo100M is available at http://github.com/berniebear/Multi-HT100M." @default.
- W3139243190 created "2021-03-29" @default.
- W3139243190 creator A5057806352 @default.
- W3139243190 creator A5062546146 @default.
- W3139243190 creator A5063149046 @default.
- W3139243190 creator A5068811427 @default.
- W3139243190 creator A5085262529 @default.
- W3139243190 creator A5085263462 @default.
- W3139243190 date "2021-03-16" @default.
- W3139243190 modified "2023-10-03" @default.
- W3139243190 title "Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models" @default.
- W3139243190 cites W1527575280 @default.
- W3139243190 cites W1818534184 @default.
- W3139243190 cites W1902237438 @default.
- W3139243190 cites W2087095333 @default.
- W3139243190 cites W2152790380 @default.
- W3139243190 cites W2164290393 @default.
- W3139243190 cites W2185175083 @default.
- W3139243190 cites W2251033195 @default.
- W3139243190 cites W2295781714 @default.
- W3139243190 cites W2560730294 @default.
- W3139243190 cites W2594047108 @default.
- W3139243190 cites W2741602058 @default.
- W3139243190 cites W2842511635 @default.
- W3139243190 cites W2885775891 @default.
- W3139243190 cites W2887920589 @default.
- W3139243190 cites W2915128308 @default.
- W3139243190 cites W2943152387 @default.
- W3139243190 cites W2949474740 @default.
- W3139243190 cites W2950162424 @default.
- W3139243190 cites W2950577311 @default.
- W3139243190 cites W2953106684 @default.
- W3139243190 cites W2962739339 @default.
- W3139243190 cites W2962795934 @default.
- W3139243190 cites W2963026768 @default.
- W3139243190 cites W2963155035 @default.
- W3139243190 cites W2963341956 @default.
- W3139243190 cites W2963403868 @default.
- W3139243190 cites W2963496089 @default.
- W3139243190 cites W2963721344 @default.
- W3139243190 cites W2963729324 @default.
- W3139243190 cites W2963756346 @default.
- W3139243190 cites W2963899908 @default.
- W3139243190 cites W2964040984 @default.
- W3139243190 cites W2964114970 @default.
- W3139243190 cites W2964121744 @default.
- W3139243190 cites W2970608575 @default.
- W3139243190 cites W2970632400 @default.
- W3139243190 cites W2970854433 @default.
- W3139243190 cites W2971863715 @default.
- W3139243190 cites W2972073579 @default.
- W3139243190 cites W2972573244 @default.
- W3139243190 cites W2975813532 @default.
- W3139243190 cites W2980037812 @default.
- W3139243190 cites W2981473723 @default.
- W3139243190 cites W2984008963 @default.
- W3139243190 cites W2989322838 @default.
- W3139243190 cites W2995558462 @default.
- W3139243190 cites W2997786945 @default.
- W3139243190 cites W3009380496 @default.
- W3139243190 cites W3013840636 @default.
- W3139243190 cites W3015354748 @default.
- W3139243190 cites W3023441976 @default.
- W3139243190 cites W3033733952 @default.
- W3139243190 cites W3034469191 @default.
- W3139243190 cites W3034636873 @default.
- W3139243190 cites W3034815696 @default.
- W3139243190 cites W3034978746 @default.
- W3139243190 cites W3035119608 @default.
- W3139243190 cites W3035144493 @default.
- W3139243190 cites W3035276082 @default.
- W3139243190 cites W3035313462 @default.
- W3139243190 cites W3035356601 @default.
- W3139243190 cites W3035497479 @default.
- W3139243190 cites W3035635319 @default.
- W3139243190 cites W3101498587 @default.
- W3139243190 cites W3111865597 @default.
- W3139243190 cites W3122640483 @default.
- W3139243190 cites W342285082 @default.
- W3139243190 doi "https://doi.org/10.48550/arxiv.2103.08849" @default.
- W3139243190 hasPublicationYear "2021" @default.
- W3139243190 type Work @default.
- W3139243190 sameAs 3139243190 @default.
- W3139243190 citedByCount "4" @default.
- W3139243190 countsByYear W31392431902021 @default.
- W3139243190 countsByYear W31392431902022 @default.
- W3139243190 crossrefType "posted-content" @default.
- W3139243190 hasAuthorship W3139243190A5057806352 @default.
- W3139243190 hasAuthorship W3139243190A5062546146 @default.
- W3139243190 hasAuthorship W3139243190A5063149046 @default.
- W3139243190 hasAuthorship W3139243190A5068811427 @default.
- W3139243190 hasAuthorship W3139243190A5085262529 @default.
- W3139243190 hasAuthorship W3139243190A5085263462 @default.
- W3139243190 hasBestOaLocation W31392431901 @default.
- W3139243190 hasConcept C119857082 @default.
- W3139243190 hasConcept C120665830 @default.
- W3139243190 hasConcept C121332964 @default.
- W3139243190 hasConcept C138885662 @default.
- W3139243190 hasConcept C154945302 @default.
- W3139243190 hasConcept C165801399 @default.