Matches in SemOpenAlex for { <https://semopenalex.org/work/W4297999738> ?p ?o ?g. }
- W4297999738 endingPage "22" @default.
- W4297999738 startingPage "1" @default.
- W4297999738 abstract "Making each modality in multi-modal data contribute is of vital importance to learning a versatile multi-modal model. Existing methods, however, are often dominated by one or few of modalities during model training, resulting in sub-optimal performance. In this article, we refer to this problem as modality bias and attempt to study it in the context of multi-modal classification systematically and comprehensively. After stepping into several empirical analyses, we recognize that one modality affects the model prediction more just because this modality has a spurious correlation with instance labels. To primarily facilitate the evaluation on the modality bias problem, we construct two datasets, respectively, for the colored digit recognition and video action recognition tasks in line with the Out-of-Distribution (OoD) protocol. Collaborating with the benchmarks in the visual question answering task, we empirically justify the performance degradation of the existing methods on these OoD datasets, which serves as evidence to justify the modality bias learning. In addition, to overcome this problem, we propose a plug-and-play loss function method, whereby the feature space for each label is adaptively learned according to the training set statistics. Thereafter, we apply this method on 10 baselines in total to test its effectiveness. From the results on four datasets regarding the above three tasks, our method yields remarkable performance improvements compared with the baselines, demonstrating its superiority on reducing the modality bias problem." @default.
- W4297999738 created "2022-10-01" @default.
- W4297999738 creator A5016415049 @default.
- W4297999738 creator A5038612499 @default.
- W4297999738 creator A5054313646 @default.
- W4297999738 creator A5059602960 @default.
- W4297999738 creator A5068843001 @default.
- W4297999738 creator A5081506611 @default.
- W4297999738 date "2023-02-25" @default.
- W4297999738 modified "2023-09-27" @default.
- W4297999738 title "On Modality Bias Recognition and Reduction" @default.
- W4297999738 cites W1933349210 @default.
- W4297999738 cites W2112796928 @default.
- W4297999738 cites W2194775991 @default.
- W4297999738 cites W2560730294 @default.
- W4297999738 cites W2561715562 @default.
- W4297999738 cites W2603777577 @default.
- W4297999738 cites W2745461083 @default.
- W4297999738 cites W2760103357 @default.
- W4297999738 cites W2791170418 @default.
- W4297999738 cites W2893425640 @default.
- W4297999738 cites W2944668088 @default.
- W4297999738 cites W2949386440 @default.
- W4297999738 cites W2962898354 @default.
- W4297999738 cites W2962990575 @default.
- W4297999738 cites W2962997291 @default.
- W4297999738 cites W2963383024 @default.
- W4297999738 cites W2963524571 @default.
- W4297999738 cites W2963644680 @default.
- W4297999738 cites W2964118342 @default.
- W4297999738 cites W2969985801 @default.
- W4297999738 cites W2970019270 @default.
- W4297999738 cites W2970231061 @default.
- W4297999738 cites W2982232682 @default.
- W4297999738 cites W2982358316 @default.
- W4297999738 cites W2983256121 @default.
- W4297999738 cites W2990751682 @default.
- W4297999738 cites W2997072136 @default.
- W4297999738 cites W3016658915 @default.
- W4297999738 cites W3030949666 @default.
- W4297999738 cites W3035517717 @default.
- W4297999738 cites W3037492894 @default.
- W4297999738 cites W3101004475 @default.
- W4297999738 cites W3113148327 @default.
- W4297999738 cites W3154503495 @default.
- W4297999738 cites W3157539197 @default.
- W4297999738 cites W3157574109 @default.
- W4297999738 cites W3172990466 @default.
- W4297999738 cites W3174366534 @default.
- W4297999738 cites W3175997347 @default.
- W4297999738 cites W3175998650 @default.
- W4297999738 cites W3192587235 @default.
- W4297999738 cites W3196660344 @default.
- W4297999738 cites W3202521030 @default.
- W4297999738 cites W3203690435 @default.
- W4297999738 cites W3204222276 @default.
- W4297999738 cites W4214612132 @default.
- W4297999738 doi "https://doi.org/10.1145/3565266" @default.
- W4297999738 hasPublicationYear "2023" @default.
- W4297999738 type Work @default.
- W4297999738 citedByCount "0" @default.
- W4297999738 crossrefType "journal-article" @default.
- W4297999738 hasAuthorship W4297999738A5016415049 @default.
- W4297999738 hasAuthorship W4297999738A5038612499 @default.
- W4297999738 hasAuthorship W4297999738A5054313646 @default.
- W4297999738 hasAuthorship W4297999738A5059602960 @default.
- W4297999738 hasAuthorship W4297999738A5068843001 @default.
- W4297999738 hasAuthorship W4297999738A5081506611 @default.
- W4297999738 hasBestOaLocation W42979997381 @default.
- W4297999738 hasConcept C119857082 @default.
- W4297999738 hasConcept C138885662 @default.
- W4297999738 hasConcept C144024400 @default.
- W4297999738 hasConcept C151730666 @default.
- W4297999738 hasConcept C153180895 @default.
- W4297999738 hasConcept C154945302 @default.
- W4297999738 hasConcept C162324750 @default.
- W4297999738 hasConcept C177264268 @default.
- W4297999738 hasConcept C185592680 @default.
- W4297999738 hasConcept C187736073 @default.
- W4297999738 hasConcept C188027245 @default.
- W4297999738 hasConcept C199360897 @default.
- W4297999738 hasConcept C2776401178 @default.
- W4297999738 hasConcept C2779343474 @default.
- W4297999738 hasConcept C2779903281 @default.
- W4297999738 hasConcept C2780226545 @default.
- W4297999738 hasConcept C2780451532 @default.
- W4297999738 hasConcept C36289849 @default.
- W4297999738 hasConcept C41008148 @default.
- W4297999738 hasConcept C41895202 @default.
- W4297999738 hasConcept C71139939 @default.
- W4297999738 hasConcept C86803240 @default.
- W4297999738 hasConcept C97256817 @default.
- W4297999738 hasConceptScore W4297999738C119857082 @default.
- W4297999738 hasConceptScore W4297999738C138885662 @default.
- W4297999738 hasConceptScore W4297999738C144024400 @default.
- W4297999738 hasConceptScore W4297999738C151730666 @default.
- W4297999738 hasConceptScore W4297999738C153180895 @default.
- W4297999738 hasConceptScore W4297999738C154945302 @default.