Matches in SemOpenAlex for { <https://semopenalex.org/work/W4283399653> ?p ?o ?g. }
- W4283399653 abstract "Multi-modal machine translation (MMT) aims to augment the linguistic machine translation frameworks by incorporating aligned vision information. As the core research challenge for MMT, how to fuse the image information and further align it with the bilingual data remains critical. Existing works have either focused on a methodological alignment in the space of bilingual text or emphasized the combination of the one-sided text and given image. In this work, we entertain the possibility of a triplet alignment, among the source and target text together with the image instance. In particular, we propose Multi-aspect AlignmenT (MAT) model that augments the MMT tasks to three sub-tasks --- namely cross-language translation alignment, cross-modal captioning alignment and multi-modal hybrid alignment tasks. Core to this model consists of a hybrid vocabulary which compiles the visually depictable entity (nouns) occurrence on both sides of the text as well as the detected object labels appearing in the images. Through this sub-task, we postulate that MAT manages to further align the modalities by casting three instances into a shared domain, as compared against previously proposed methods. Extensive experiments and analyses demonstrate the superiority of our approaches, which achieve several state-of-the-art results on two benchmark datasets of the MMT task." @default.
- W4283399653 created "2022-06-25" @default.
- W4283399653 creator A5017828551 @default.
- W4283399653 creator A5018350882 @default.
- W4283399653 creator A5020162825 @default.
- W4283399653 date "2022-06-27" @default.
- W4283399653 modified "2023-09-27" @default.
- W4283399653 title "HybridVocab: Towards Multi-Modal Machine Translation via Multi-Aspect Alignment" @default.
- W4283399653 cites W1895577753 @default.
- W4283399653 cites W2133459682 @default.
- W4283399653 cites W2509282593 @default.
- W4283399653 cites W2513263213 @default.
- W4283399653 cites W2552839021 @default.
- W4283399653 cites W2560747010 @default.
- W4283399653 cites W2581101319 @default.
- W4283399653 cites W2593341061 @default.
- W4283399653 cites W2730360481 @default.
- W4283399653 cites W2745461083 @default.
- W4283399653 cites W2888070626 @default.
- W4283399653 cites W2897964062 @default.
- W4283399653 cites W2902031175 @default.
- W4283399653 cites W2933138175 @default.
- W4283399653 cites W2950207430 @default.
- W4283399653 cites W2950886580 @default.
- W4283399653 cites W2962784628 @default.
- W4283399653 cites W2963331233 @default.
- W4283399653 cites W2963347649 @default.
- W4283399653 cites W2963652649 @default.
- W4283399653 cites W2963909453 @default.
- W4283399653 cites W2982112268 @default.
- W4283399653 cites W2995427493 @default.
- W4283399653 cites W3034773362 @default.
- W4283399653 cites W3034871396 @default.
- W4283399653 cites W3102475290 @default.
- W4283399653 cites W3119746927 @default.
- W4283399653 cites W3176471072 @default.
- W4283399653 cites W4255421341 @default.
- W4283399653 doi "https://doi.org/10.1145/3512527.3531386" @default.
- W4283399653 hasPublicationYear "2022" @default.
- W4283399653 type Work @default.
- W4283399653 citedByCount "0" @default.
- W4283399653 crossrefType "proceedings-article" @default.
- W4283399653 hasAuthorship W4283399653A5017828551 @default.
- W4283399653 hasAuthorship W4283399653A5018350882 @default.
- W4283399653 hasAuthorship W4283399653A5020162825 @default.
- W4283399653 hasConcept C104317684 @default.
- W4283399653 hasConcept C105580179 @default.
- W4283399653 hasConcept C115961682 @default.
- W4283399653 hasConcept C13280743 @default.
- W4283399653 hasConcept C134306372 @default.
- W4283399653 hasConcept C138885662 @default.
- W4283399653 hasConcept C149364088 @default.
- W4283399653 hasConcept C154945302 @default.
- W4283399653 hasConcept C157657479 @default.
- W4283399653 hasConcept C162324750 @default.
- W4283399653 hasConcept C185592680 @default.
- W4283399653 hasConcept C185798385 @default.
- W4283399653 hasConcept C187736073 @default.
- W4283399653 hasConcept C188027245 @default.
- W4283399653 hasConcept C203005215 @default.
- W4283399653 hasConcept C204321447 @default.
- W4283399653 hasConcept C205649164 @default.
- W4283399653 hasConcept C2777601683 @default.
- W4283399653 hasConcept C2780451532 @default.
- W4283399653 hasConcept C33923547 @default.
- W4283399653 hasConcept C36503486 @default.
- W4283399653 hasConcept C41008148 @default.
- W4283399653 hasConcept C41895202 @default.
- W4283399653 hasConcept C55493867 @default.
- W4283399653 hasConcept C71139939 @default.
- W4283399653 hasConceptScore W4283399653C104317684 @default.
- W4283399653 hasConceptScore W4283399653C105580179 @default.
- W4283399653 hasConceptScore W4283399653C115961682 @default.
- W4283399653 hasConceptScore W4283399653C13280743 @default.
- W4283399653 hasConceptScore W4283399653C134306372 @default.
- W4283399653 hasConceptScore W4283399653C138885662 @default.
- W4283399653 hasConceptScore W4283399653C149364088 @default.
- W4283399653 hasConceptScore W4283399653C154945302 @default.
- W4283399653 hasConceptScore W4283399653C157657479 @default.
- W4283399653 hasConceptScore W4283399653C162324750 @default.
- W4283399653 hasConceptScore W4283399653C185592680 @default.
- W4283399653 hasConceptScore W4283399653C185798385 @default.
- W4283399653 hasConceptScore W4283399653C187736073 @default.
- W4283399653 hasConceptScore W4283399653C188027245 @default.
- W4283399653 hasConceptScore W4283399653C203005215 @default.
- W4283399653 hasConceptScore W4283399653C204321447 @default.
- W4283399653 hasConceptScore W4283399653C205649164 @default.
- W4283399653 hasConceptScore W4283399653C2777601683 @default.
- W4283399653 hasConceptScore W4283399653C2780451532 @default.
- W4283399653 hasConceptScore W4283399653C33923547 @default.
- W4283399653 hasConceptScore W4283399653C36503486 @default.
- W4283399653 hasConceptScore W4283399653C41008148 @default.
- W4283399653 hasConceptScore W4283399653C41895202 @default.
- W4283399653 hasConceptScore W4283399653C55493867 @default.
- W4283399653 hasConceptScore W4283399653C71139939 @default.
- W4283399653 hasLocation W42833996531 @default.
- W4283399653 hasOpenAccess W4283399653 @default.
- W4283399653 hasPrimaryLocation W42833996531 @default.
- W4283399653 hasRelatedWork W1539050421 @default.
- W4283399653 hasRelatedWork W2140460368 @default.