Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385606949> ?p ?o ?g. }
- W4385606949 endingPage "104466" @default.
- W4385606949 startingPage "104466" @default.
- W4385606949 abstract "With the increasing amount and growing variety of healthcare data, multimodal machine learning supporting integrated modeling of structured and unstructured data is an increasingly important tool for clinical machine learning tasks. However, it is non-trivial to manage the differences in dimensionality, volume, and temporal characteristics of data modalities in the context of a shared target task. Furthermore, patients can have substantial variations in the availability of data, while existing multimodal modeling methods typically assume data completeness and lack a mechanism to handle missing modalities. We propose a Transformer-based fusion model with modality-specific tokens that summarize the corresponding modalities to achieve effective cross-modal interaction accommodating missing modalities in the clinical context. The model is further refined by inter-modal, inter-sample contrastive learning to improve the representations for better predictive performance. We denote the model as Attention-based cRoss-MOdal fUsion with contRast (ARMOUR). We evaluate ARMOUR using two input modalities (structured measurements and unstructured text), six clinical prediction tasks, and two evaluation regimes, either including or excluding samples with missing modalities. Our model shows improved performances over unimodal or multimodal baselines in both evaluation regimes, including or excluding patients with missing modalities in the input. The contrastive learning improves the representation power and is shown to be essential for better results. The simple setup of modality-specific tokens enables ARMOUR to handle patients with missing modalities and allows comparison with existing unimodal benchmark results. We propose a multimodal model for robust clinical prediction to achieve improved performance while accommodating patients with missing modalities. This work lays a foundation for future work to study the effective incorporation of multiple modalities of clinical data into a single model." @default.
- W4385606949 created "2023-08-06" @default.
- W4385606949 creator A5012453035 @default.
- W4385606949 creator A5023213398 @default.
- W4385606949 creator A5074297656 @default.
- W4385606949 creator A5084069668 @default.
- W4385606949 date "2023-09-01" @default.
- W4385606949 modified "2023-10-10" @default.
- W4385606949 title "Attention-based multimodal fusion with contrast for robust clinical prediction in the face of missing modalities" @default.
- W4385606949 cites W2178355895 @default.
- W4385606949 cites W2396881363 @default.
- W4385606949 cites W2528047932 @default.
- W4385606949 cites W2556418146 @default.
- W4385606949 cites W2619383789 @default.
- W4385606949 cites W2753840835 @default.
- W4385606949 cites W2767290858 @default.
- W4385606949 cites W2806031239 @default.
- W4385606949 cites W2896893468 @default.
- W4385606949 cites W2938221441 @default.
- W4385606949 cites W2964010366 @default.
- W4385606949 cites W2967771861 @default.
- W4385606949 cites W2995225687 @default.
- W4385606949 cites W2997629435 @default.
- W4385606949 cites W3002682974 @default.
- W4385606949 cites W3007211628 @default.
- W4385606949 cites W3012413426 @default.
- W4385606949 cites W3014524604 @default.
- W4385606949 cites W3091927171 @default.
- W4385606949 cites W3094595351 @default.
- W4385606949 cites W3095791468 @default.
- W4385606949 cites W3098949126 @default.
- W4385606949 cites W3100369282 @default.
- W4385606949 cites W3101973032 @default.
- W4385606949 cites W3122582799 @default.
- W4385606949 cites W3130634310 @default.
- W4385606949 cites W3174700141 @default.
- W4385606949 cites W3175546201 @default.
- W4385606949 cites W3176404283 @default.
- W4385606949 cites W4200310129 @default.
- W4385606949 cites W4205805845 @default.
- W4385606949 cites W4220918265 @default.
- W4385606949 cites W4224541024 @default.
- W4385606949 cites W4225493996 @default.
- W4385606949 cites W4281784915 @default.
- W4385606949 cites W4286567174 @default.
- W4385606949 cites W4295308760 @default.
- W4385606949 cites W4295951577 @default.
- W4385606949 cites W4296633037 @default.
- W4385606949 cites W4296776307 @default.
- W4385606949 cites W4313439128 @default.
- W4385606949 doi "https://doi.org/10.1016/j.jbi.2023.104466" @default.
- W4385606949 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/37549722" @default.
- W4385606949 hasPublicationYear "2023" @default.
- W4385606949 type Work @default.
- W4385606949 citedByCount "0" @default.
- W4385606949 crossrefType "journal-article" @default.
- W4385606949 hasAuthorship W4385606949A5012453035 @default.
- W4385606949 hasAuthorship W4385606949A5023213398 @default.
- W4385606949 hasAuthorship W4385606949A5074297656 @default.
- W4385606949 hasAuthorship W4385606949A5084069668 @default.
- W4385606949 hasBestOaLocation W43856069491 @default.
- W4385606949 hasConcept C119857082 @default.
- W4385606949 hasConcept C13280743 @default.
- W4385606949 hasConcept C144024400 @default.
- W4385606949 hasConcept C151730666 @default.
- W4385606949 hasConcept C154945302 @default.
- W4385606949 hasConcept C185798385 @default.
- W4385606949 hasConcept C205649164 @default.
- W4385606949 hasConcept C2776502983 @default.
- W4385606949 hasConcept C2779343474 @default.
- W4385606949 hasConcept C2779903281 @default.
- W4385606949 hasConcept C2780226545 @default.
- W4385606949 hasConcept C2780660688 @default.
- W4385606949 hasConcept C36289849 @default.
- W4385606949 hasConcept C41008148 @default.
- W4385606949 hasConcept C59404180 @default.
- W4385606949 hasConcept C86803240 @default.
- W4385606949 hasConcept C9357733 @default.
- W4385606949 hasConceptScore W4385606949C119857082 @default.
- W4385606949 hasConceptScore W4385606949C13280743 @default.
- W4385606949 hasConceptScore W4385606949C144024400 @default.
- W4385606949 hasConceptScore W4385606949C151730666 @default.
- W4385606949 hasConceptScore W4385606949C154945302 @default.
- W4385606949 hasConceptScore W4385606949C185798385 @default.
- W4385606949 hasConceptScore W4385606949C205649164 @default.
- W4385606949 hasConceptScore W4385606949C2776502983 @default.
- W4385606949 hasConceptScore W4385606949C2779343474 @default.
- W4385606949 hasConceptScore W4385606949C2779903281 @default.
- W4385606949 hasConceptScore W4385606949C2780226545 @default.
- W4385606949 hasConceptScore W4385606949C2780660688 @default.
- W4385606949 hasConceptScore W4385606949C36289849 @default.
- W4385606949 hasConceptScore W4385606949C41008148 @default.
- W4385606949 hasConceptScore W4385606949C59404180 @default.
- W4385606949 hasConceptScore W4385606949C86803240 @default.
- W4385606949 hasConceptScore W4385606949C9357733 @default.
- W4385606949 hasLocation W43856069491 @default.
- W4385606949 hasLocation W43856069492 @default.
- W4385606949 hasOpenAccess W4385606949 @default.