Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386076401> ?p ?o ?g. }
- W4386076401 abstract "This paper explores the tasks of leveraging auxiliary modalities which are only available at training to enhance multimodal representation learning through cross-modal Knowledge Distillation (KD). The widely adopted mutual information maximization-based objective leads to a short-cut solution of the weak teacher, i.e., achieving the maximum mutual information by simply making the teacher model as weak as the student model. To prevent such a weak solution, we introduce an additional objective term, i.e., the mutual information between the teacher and the auxiliary modality model. Besides, to narrow down the information gap between the student and teacher, we further propose to minimize the conditional entropy of the teacher given the student. Novel training schemes based on contrastive learning and adversarial learning are designed to optimize the mutual information and the conditional entropy, respectively. Experimental results on three popular multimodal benchmark datasets have shown that the proposed method outperforms a range of state-of-the-art approaches for video recognition, video retrieval and emotion classification." @default.
- W4386076401 created "2023-08-23" @default.
- W4386076401 creator A5032351288 @default.
- W4386076401 creator A5039412958 @default.
- W4386076401 creator A5079594267 @default.
- W4386076401 creator A5091861643 @default.
- W4386076401 date "2023-06-01" @default.
- W4386076401 modified "2023-10-18" @default.
- W4386076401 title "Enhanced Multimodal Representation Learning with Cross-modal KD" @default.
- W4386076401 cites W1927052826 @default.
- W4386076401 cites W2146334809 @default.
- W4386076401 cites W2146950091 @default.
- W4386076401 cites W2463402750 @default.
- W4386076401 cites W2883451034 @default.
- W4386076401 cites W2947084868 @default.
- W4386076401 cites W2963507023 @default.
- W4386076401 cites W2963882942 @default.
- W4386076401 cites W2972758308 @default.
- W4386076401 cites W3094550259 @default.
- W4386076401 cites W3108655343 @default.
- W4386076401 cites W3162322471 @default.
- W4386076401 cites W3171536535 @default.
- W4386076401 cites W3176404283 @default.
- W4386076401 cites W3177378457 @default.
- W4386076401 cites W4214507144 @default.
- W4386076401 cites W4214689917 @default.
- W4386076401 doi "https://doi.org/10.1109/cvpr52729.2023.01132" @default.
- W4386076401 hasPublicationYear "2023" @default.
- W4386076401 type Work @default.
- W4386076401 citedByCount "0" @default.
- W4386076401 crossrefType "proceedings-article" @default.
- W4386076401 hasAuthorship W4386076401A5032351288 @default.
- W4386076401 hasAuthorship W4386076401A5039412958 @default.
- W4386076401 hasAuthorship W4386076401A5079594267 @default.
- W4386076401 hasAuthorship W4386076401A5091861643 @default.
- W4386076401 hasConcept C106301342 @default.
- W4386076401 hasConcept C119857082 @default.
- W4386076401 hasConcept C121332964 @default.
- W4386076401 hasConcept C126255220 @default.
- W4386076401 hasConcept C13280743 @default.
- W4386076401 hasConcept C136764020 @default.
- W4386076401 hasConcept C144024400 @default.
- W4386076401 hasConcept C152139883 @default.
- W4386076401 hasConcept C154945302 @default.
- W4386076401 hasConcept C17744445 @default.
- W4386076401 hasConcept C185592680 @default.
- W4386076401 hasConcept C185798385 @default.
- W4386076401 hasConcept C188027245 @default.
- W4386076401 hasConcept C199539241 @default.
- W4386076401 hasConcept C205649164 @default.
- W4386076401 hasConcept C2776330181 @default.
- W4386076401 hasConcept C2776359362 @default.
- W4386076401 hasConcept C2779903281 @default.
- W4386076401 hasConcept C2780660688 @default.
- W4386076401 hasConcept C2780910867 @default.
- W4386076401 hasConcept C33923547 @default.
- W4386076401 hasConcept C36289849 @default.
- W4386076401 hasConcept C41008148 @default.
- W4386076401 hasConcept C59404180 @default.
- W4386076401 hasConcept C62520636 @default.
- W4386076401 hasConcept C71139939 @default.
- W4386076401 hasConcept C94625758 @default.
- W4386076401 hasConceptScore W4386076401C106301342 @default.
- W4386076401 hasConceptScore W4386076401C119857082 @default.
- W4386076401 hasConceptScore W4386076401C121332964 @default.
- W4386076401 hasConceptScore W4386076401C126255220 @default.
- W4386076401 hasConceptScore W4386076401C13280743 @default.
- W4386076401 hasConceptScore W4386076401C136764020 @default.
- W4386076401 hasConceptScore W4386076401C144024400 @default.
- W4386076401 hasConceptScore W4386076401C152139883 @default.
- W4386076401 hasConceptScore W4386076401C154945302 @default.
- W4386076401 hasConceptScore W4386076401C17744445 @default.
- W4386076401 hasConceptScore W4386076401C185592680 @default.
- W4386076401 hasConceptScore W4386076401C185798385 @default.
- W4386076401 hasConceptScore W4386076401C188027245 @default.
- W4386076401 hasConceptScore W4386076401C199539241 @default.
- W4386076401 hasConceptScore W4386076401C205649164 @default.
- W4386076401 hasConceptScore W4386076401C2776330181 @default.
- W4386076401 hasConceptScore W4386076401C2776359362 @default.
- W4386076401 hasConceptScore W4386076401C2779903281 @default.
- W4386076401 hasConceptScore W4386076401C2780660688 @default.
- W4386076401 hasConceptScore W4386076401C2780910867 @default.
- W4386076401 hasConceptScore W4386076401C33923547 @default.
- W4386076401 hasConceptScore W4386076401C36289849 @default.
- W4386076401 hasConceptScore W4386076401C41008148 @default.
- W4386076401 hasConceptScore W4386076401C59404180 @default.
- W4386076401 hasConceptScore W4386076401C62520636 @default.
- W4386076401 hasConceptScore W4386076401C71139939 @default.
- W4386076401 hasConceptScore W4386076401C94625758 @default.
- W4386076401 hasFunder F4320321885 @default.
- W4386076401 hasLocation W43860764011 @default.
- W4386076401 hasOpenAccess W4386076401 @default.
- W4386076401 hasPrimaryLocation W43860764011 @default.
- W4386076401 hasRelatedWork W2474574787 @default.
- W4386076401 hasRelatedWork W2546190447 @default.
- W4386076401 hasRelatedWork W2949074159 @default.
- W4386076401 hasRelatedWork W2952745240 @default.
- W4386076401 hasRelatedWork W3211385060 @default.
- W4386076401 hasRelatedWork W4298715519 @default.
- W4386076401 hasRelatedWork W4301143707 @default.