Matches in SemOpenAlex for { <https://semopenalex.org/work/W4310632757> ?p ?o ?g. }
Showing items 1 to 70 of
70
with 100 items per page.
- W4310632757 abstract "Multimodal learning pipelines have benefited from the success of pretrained language models. However, this comes at the cost of increased model parameters. In this work, we propose Adapted Multimodal BERT (AMB), a BERT-based architecture for multimodal tasks that uses a combination of adapter modules and intermediate fusion layers. The adapter adjusts the pretrained language model for the task at hand, while the fusion layers perform task-specific, layer-wise fusion of audio-visual information with textual BERT representations. During the adaptation process the pre-trained language model parameters remain frozen, allowing for fast, parameter-efficient training. In our ablations we see that this approach leads to efficient models, that can outperform their fine-tuned counterparts and are robust to input noise. Our experiments on sentiment analysis with CMU-MOSEI show that AMB outperforms the current state-of-the-art across metrics, with 3.4% relative reduction in the resulting error and 2.1% relative improvement in 7-class classification accuracy." @default.
- W4310632757 created "2022-12-13" @default.
- W4310632757 creator A5026032406 @default.
- W4310632757 creator A5063982404 @default.
- W4310632757 creator A5084949286 @default.
- W4310632757 date "2022-12-01" @default.
- W4310632757 modified "2023-10-16" @default.
- W4310632757 title "Adapted Multimodal BERT with Layer-wise Fusion for Sentiment Analysis" @default.
- W4310632757 doi "https://doi.org/10.48550/arxiv.2212.00678" @default.
- W4310632757 hasPublicationYear "2022" @default.
- W4310632757 type Work @default.
- W4310632757 citedByCount "0" @default.
- W4310632757 crossrefType "posted-content" @default.
- W4310632757 hasAuthorship W4310632757A5026032406 @default.
- W4310632757 hasAuthorship W4310632757A5063982404 @default.
- W4310632757 hasAuthorship W4310632757A5084949286 @default.
- W4310632757 hasBestOaLocation W43106327571 @default.
- W4310632757 hasConcept C111919701 @default.
- W4310632757 hasConcept C119857082 @default.
- W4310632757 hasConcept C137293760 @default.
- W4310632757 hasConcept C138885662 @default.
- W4310632757 hasConcept C154945302 @default.
- W4310632757 hasConcept C158525013 @default.
- W4310632757 hasConcept C162324750 @default.
- W4310632757 hasConcept C177284502 @default.
- W4310632757 hasConcept C178790620 @default.
- W4310632757 hasConcept C185592680 @default.
- W4310632757 hasConcept C187736073 @default.
- W4310632757 hasConcept C204321447 @default.
- W4310632757 hasConcept C2779227376 @default.
- W4310632757 hasConcept C2780451532 @default.
- W4310632757 hasConcept C28490314 @default.
- W4310632757 hasConcept C40969351 @default.
- W4310632757 hasConcept C41008148 @default.
- W4310632757 hasConcept C41895202 @default.
- W4310632757 hasConceptScore W4310632757C111919701 @default.
- W4310632757 hasConceptScore W4310632757C119857082 @default.
- W4310632757 hasConceptScore W4310632757C137293760 @default.
- W4310632757 hasConceptScore W4310632757C138885662 @default.
- W4310632757 hasConceptScore W4310632757C154945302 @default.
- W4310632757 hasConceptScore W4310632757C158525013 @default.
- W4310632757 hasConceptScore W4310632757C162324750 @default.
- W4310632757 hasConceptScore W4310632757C177284502 @default.
- W4310632757 hasConceptScore W4310632757C178790620 @default.
- W4310632757 hasConceptScore W4310632757C185592680 @default.
- W4310632757 hasConceptScore W4310632757C187736073 @default.
- W4310632757 hasConceptScore W4310632757C204321447 @default.
- W4310632757 hasConceptScore W4310632757C2779227376 @default.
- W4310632757 hasConceptScore W4310632757C2780451532 @default.
- W4310632757 hasConceptScore W4310632757C28490314 @default.
- W4310632757 hasConceptScore W4310632757C40969351 @default.
- W4310632757 hasConceptScore W4310632757C41008148 @default.
- W4310632757 hasConceptScore W4310632757C41895202 @default.
- W4310632757 hasLocation W43106327571 @default.
- W4310632757 hasLocation W43106327572 @default.
- W4310632757 hasOpenAccess W4310632757 @default.
- W4310632757 hasPrimaryLocation W43106327571 @default.
- W4310632757 hasRelatedWork W1546181631 @default.
- W4310632757 hasRelatedWork W1989705153 @default.
- W4310632757 hasRelatedWork W2047094413 @default.
- W4310632757 hasRelatedWork W2080458333 @default.
- W4310632757 hasRelatedWork W2111405065 @default.
- W4310632757 hasRelatedWork W2359001871 @default.
- W4310632757 hasRelatedWork W2913200330 @default.
- W4310632757 hasRelatedWork W3080136773 @default.
- W4310632757 hasRelatedWork W4205820553 @default.
- W4310632757 hasRelatedWork W4380605396 @default.
- W4310632757 isParatext "false" @default.
- W4310632757 isRetracted "false" @default.
- W4310632757 workType "article" @default.