Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385569837> ?p ?o ?g. }
Showing items 1 to 59 of
59
with 100 items per page.
- W4385569837 abstract "In this paper, we introduce Cross-View Language Modeling, a simple and effective pre-training framework that unifies cross-lingual and cross-modal pre-training with shared architectures and objectives. Our approach is motivated by a key observation that cross-lingual and cross-modal pre-training share the same goal of aligning two different views of the same object into a common semantic space. To this end, the cross-view language modeling framework considers both multi-modal data (i.e., image-caption pairs) and multi-lingual data (i.e., parallel sentence pairs) as two different views of the same object, and trains the model to align the two views by maximizing the mutual information between them with conditional masked language modeling and contrastive learning. We pre-train CCLM, a Cross-lingual Cross-modal Language Model, with the cross-view language modeling framework. Empirical results on IGLUE, a multi-lingual multi-modal benchmark, and two multi-lingual image-text retrieval datasets show that while conceptually simpler, CCLM significantly outperforms the prior state-of-the-art with an average absolute improvement of over 10%. Moreover, CCLM is the first multi-lingual multi-modal pre-trained model that surpasses the translate-test performance of representative English vision-language models by zero-shot cross-lingual transfer." @default.
- W4385569837 created "2023-08-05" @default.
- W4385569837 creator A5003019532 @default.
- W4385569837 creator A5034164931 @default.
- W4385569837 creator A5034877894 @default.
- W4385569837 creator A5068814419 @default.
- W4385569837 creator A5074508950 @default.
- W4385569837 date "2023-01-01" @default.
- W4385569837 modified "2023-09-26" @default.
- W4385569837 title "Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training" @default.
- W4385569837 doi "https://doi.org/10.18653/v1/2023.acl-long.315" @default.
- W4385569837 hasPublicationYear "2023" @default.
- W4385569837 type Work @default.
- W4385569837 citedByCount "0" @default.
- W4385569837 crossrefType "proceedings-article" @default.
- W4385569837 hasAuthorship W4385569837A5003019532 @default.
- W4385569837 hasAuthorship W4385569837A5034164931 @default.
- W4385569837 hasAuthorship W4385569837A5034877894 @default.
- W4385569837 hasAuthorship W4385569837A5068814419 @default.
- W4385569837 hasAuthorship W4385569837A5074508950 @default.
- W4385569837 hasBestOaLocation W43855698371 @default.
- W4385569837 hasConcept C13280743 @default.
- W4385569837 hasConcept C137293760 @default.
- W4385569837 hasConcept C154945302 @default.
- W4385569837 hasConcept C185592680 @default.
- W4385569837 hasConcept C185798385 @default.
- W4385569837 hasConcept C188027245 @default.
- W4385569837 hasConcept C204321447 @default.
- W4385569837 hasConcept C205649164 @default.
- W4385569837 hasConcept C2777530160 @default.
- W4385569837 hasConcept C41008148 @default.
- W4385569837 hasConcept C71139939 @default.
- W4385569837 hasConceptScore W4385569837C13280743 @default.
- W4385569837 hasConceptScore W4385569837C137293760 @default.
- W4385569837 hasConceptScore W4385569837C154945302 @default.
- W4385569837 hasConceptScore W4385569837C185592680 @default.
- W4385569837 hasConceptScore W4385569837C185798385 @default.
- W4385569837 hasConceptScore W4385569837C188027245 @default.
- W4385569837 hasConceptScore W4385569837C204321447 @default.
- W4385569837 hasConceptScore W4385569837C205649164 @default.
- W4385569837 hasConceptScore W4385569837C2777530160 @default.
- W4385569837 hasConceptScore W4385569837C41008148 @default.
- W4385569837 hasConceptScore W4385569837C71139939 @default.
- W4385569837 hasLocation W43855698371 @default.
- W4385569837 hasOpenAccess W4385569837 @default.
- W4385569837 hasPrimaryLocation W43855698371 @default.
- W4385569837 hasRelatedWork W1562892804 @default.
- W4385569837 hasRelatedWork W159132833 @default.
- W4385569837 hasRelatedWork W20999564 @default.
- W4385569837 hasRelatedWork W2359001871 @default.
- W4385569837 hasRelatedWork W3093843097 @default.
- W4385569837 hasRelatedWork W3114537677 @default.
- W4385569837 hasRelatedWork W3209984204 @default.
- W4385569837 hasRelatedWork W4206566594 @default.
- W4385569837 hasRelatedWork W4297797377 @default.
- W4385569837 hasRelatedWork W4297919955 @default.
- W4385569837 isParatext "false" @default.
- W4385569837 isRetracted "false" @default.
- W4385569837 workType "article" @default.