Matches in SemOpenAlex for { <https://semopenalex.org/work/W2971325152> ?p ?o ?g. }
- W2971325152 abstract "Recent literature shows that large-scale language modeling provides excellent reusable sentence representations with both recurrent and self-attentive architectures. However, there has been less clarity on the commonalities and differences in the representational properties induced by the two architectures. It also has been shown that visual information serves as one of the means for grounding sentence representations. In this paper, we present a meta-study assessing the representational quality of models where the training signal is obtained from different modalities, in particular, language modeling, image features prediction, and both textual and multimodal machine translation. We evaluate textual and visual features of sentence representations obtained using predominant approaches on image retrieval and semantic textual similarity. Our experiments reveal that on moderate-sized datasets, a sentence counterpart in a target language or visual modality provides much stronger training signal for sentence representation than language modeling. Importantly, we observe that while the Transformer models achieve superior machine translation quality, representations from the recurrent neural network based models perform significantly better over tasks focused on semantic relevance." @default.
- W2971325152 created "2019-09-05" @default.
- W2971325152 creator A5055155740 @default.
- W2971325152 creator A5061045500 @default.
- W2971325152 date "2019-08-29" @default.
- W2971325152 modified "2023-09-23" @default.
- W2971325152 title "Probing Representations Learned by Multimodal Recurrent and Transformer Models." @default.
- W2971325152 cites W179875071 @default.
- W2971325152 cites W1854884267 @default.
- W2971325152 cites W1861492603 @default.
- W2971325152 cites W1949478088 @default.
- W2971325152 cites W2025341678 @default.
- W2971325152 cites W2100235303 @default.
- W2971325152 cites W2143623448 @default.
- W2971325152 cites W2194775991 @default.
- W2971325152 cites W2251861449 @default.
- W2971325152 cites W2462305634 @default.
- W2971325152 cites W2581101319 @default.
- W2971325152 cites W2606134370 @default.
- W2971325152 cites W2626778328 @default.
- W2971325152 cites W2735217275 @default.
- W2971325152 cites W2889903020 @default.
- W2971325152 cites W2892156241 @default.
- W2971325152 cites W2902031175 @default.
- W2971325152 cites W2911748701 @default.
- W2971325152 cites W2950848235 @default.
- W2971325152 cites W2962739339 @default.
- W2971325152 cites W2962929176 @default.
- W2971325152 cites W2963310665 @default.
- W2971325152 cites W2963341956 @default.
- W2971325152 cites W2963407669 @default.
- W2971325152 cites W2963871344 @default.
- W2971325152 cites W2963898017 @default.
- W2971325152 cites W2963918774 @default.
- W2971325152 cites W2963988211 @default.
- W2971325152 cites W2964165804 @default.
- W2971325152 cites W2964199361 @default.
- W2971325152 cites W2964308564 @default.
- W2971325152 cites W630532510 @default.
- W2971325152 cites W92662927 @default.
- W2971325152 hasPublicationYear "2019" @default.
- W2971325152 type Work @default.
- W2971325152 sameAs 2971325152 @default.
- W2971325152 citedByCount "0" @default.
- W2971325152 crossrefType "posted-content" @default.
- W2971325152 hasAuthorship W2971325152A5055155740 @default.
- W2971325152 hasAuthorship W2971325152A5061045500 @default.
- W2971325152 hasConcept C121332964 @default.
- W2971325152 hasConcept C137293760 @default.
- W2971325152 hasConcept C154945302 @default.
- W2971325152 hasConcept C165801399 @default.
- W2971325152 hasConcept C17744445 @default.
- W2971325152 hasConcept C199539241 @default.
- W2971325152 hasConcept C203005215 @default.
- W2971325152 hasConcept C204321447 @default.
- W2971325152 hasConcept C2776359362 @default.
- W2971325152 hasConcept C2777530160 @default.
- W2971325152 hasConcept C41008148 @default.
- W2971325152 hasConcept C62520636 @default.
- W2971325152 hasConcept C66322947 @default.
- W2971325152 hasConcept C94625758 @default.
- W2971325152 hasConceptScore W2971325152C121332964 @default.
- W2971325152 hasConceptScore W2971325152C137293760 @default.
- W2971325152 hasConceptScore W2971325152C154945302 @default.
- W2971325152 hasConceptScore W2971325152C165801399 @default.
- W2971325152 hasConceptScore W2971325152C17744445 @default.
- W2971325152 hasConceptScore W2971325152C199539241 @default.
- W2971325152 hasConceptScore W2971325152C203005215 @default.
- W2971325152 hasConceptScore W2971325152C204321447 @default.
- W2971325152 hasConceptScore W2971325152C2776359362 @default.
- W2971325152 hasConceptScore W2971325152C2777530160 @default.
- W2971325152 hasConceptScore W2971325152C41008148 @default.
- W2971325152 hasConceptScore W2971325152C62520636 @default.
- W2971325152 hasConceptScore W2971325152C66322947 @default.
- W2971325152 hasConceptScore W2971325152C94625758 @default.
- W2971325152 hasLocation W29713251521 @default.
- W2971325152 hasOpenAccess W2971325152 @default.
- W2971325152 hasPrimaryLocation W29713251521 @default.
- W2971325152 hasRelatedWork W1562955078 @default.
- W2971325152 hasRelatedWork W2137735870 @default.
- W2971325152 hasRelatedWork W2250742840 @default.
- W2971325152 hasRelatedWork W2399989473 @default.
- W2971325152 hasRelatedWork W2740762087 @default.
- W2971325152 hasRelatedWork W2887710902 @default.
- W2971325152 hasRelatedWork W2888329843 @default.
- W2971325152 hasRelatedWork W2891454293 @default.
- W2971325152 hasRelatedWork W2892282605 @default.
- W2971325152 hasRelatedWork W2903147334 @default.
- W2971325152 hasRelatedWork W2963356835 @default.
- W2971325152 hasRelatedWork W2964126458 @default.
- W2971325152 hasRelatedWork W2973992035 @default.
- W2971325152 hasRelatedWork W2995335655 @default.
- W2971325152 hasRelatedWork W3015005951 @default.
- W2971325152 hasRelatedWork W3016899578 @default.
- W2971325152 hasRelatedWork W3095012062 @default.
- W2971325152 hasRelatedWork W3102226577 @default.
- W2971325152 hasRelatedWork W3113032096 @default.
- W2971325152 hasRelatedWork W3127331431 @default.
- W2971325152 isParatext "false" @default.
- W2971325152 isRetracted "false" @default.