Matches in SemOpenAlex for { <https://semopenalex.org/work/W1930223417> ?p ?o ?g. }
- W1930223417 endingPage "2020" @default.
- W1930223417 startingPage "2008" @default.
- W1930223417 abstract "Social media has been a convenient platform for voicing opinions through posting messages, ranging from tweeting a short text to uploading a media file, or any combination of messages. Understanding the perceived emotions inherently underlying these user-generated contents (UGC) could bring light to emerging applications such as advertising and media analytics. Existing research efforts on affective computation are mostly dedicated to single media, either text captions or visual content. Few attempts for combined analysis of multiple media are made, despite that emotion can be viewed as an expression of multimodal experience. In this paper, we explore the learning of highly non-linear relationships that exist among low-level features across different modalities for emotion prediction. Using the deep Bolzmann machine (DBM), a joint density model over the space of multimodal inputs, including visual, auditory, and textual modalities, is developed. The model is trained directly using UGC data without any labeling efforts. While the model learns a joint representation over multimodal inputs, training samples in absence of certain modalities can also be leveraged. More importantly, the joint representation enables emotion-oriented cross-modal retrieval, for example, retrieval of videos using the text query “crazy cat”. The model does not restrict the types of input and output, and hence, in principle, emotion prediction and retrieval on any combinations of media are feasible. Extensive experiments on web videos and images show that the learnt joint representation could be very compact and be complementary to hand-crafted features, leading to performance improvement in both emotion classification and cross-modal retrieval." @default.
- W1930223417 created "2016-06-24" @default.
- W1930223417 creator A5002829835 @default.
- W1930223417 creator A5015432362 @default.
- W1930223417 creator A5050416778 @default.
- W1930223417 date "2015-11-01" @default.
- W1930223417 modified "2023-10-02" @default.
- W1930223417 title "Deep Multimodal Learning for Affective Analysis and Retrieval" @default.
- W1930223417 cites W1566135517 @default.
- W1930223417 cites W1964073652 @default.
- W1930223417 cites W1974894717 @default.
- W1930223417 cites W2017411072 @default.
- W1930223417 cites W2025768430 @default.
- W1930223417 cites W2063948594 @default.
- W1930223417 cites W2074356411 @default.
- W1930223417 cites W2075456404 @default.
- W1930223417 cites W2100495367 @default.
- W1930223417 cites W2107377023 @default.
- W1930223417 cites W2113317774 @default.
- W1930223417 cites W2114516315 @default.
- W1930223417 cites W2116825644 @default.
- W1930223417 cites W2123442489 @default.
- W1930223417 cites W2144502914 @default.
- W1930223417 cites W2150529939 @default.
- W1930223417 cites W2151103935 @default.
- W1930223417 cites W2156709807 @default.
- W1930223417 cites W2161969291 @default.
- W1930223417 cites W2163293471 @default.
- W1930223417 cites W2163352848 @default.
- W1930223417 cites W2167969117 @default.
- W1930223417 cites W4231109964 @default.
- W1930223417 cites W4239946314 @default.
- W1930223417 cites W44815768 @default.
- W1930223417 doi "https://doi.org/10.1109/tmm.2015.2482228" @default.
- W1930223417 hasPublicationYear "2015" @default.
- W1930223417 type Work @default.
- W1930223417 sameAs 1930223417 @default.
- W1930223417 citedByCount "112" @default.
- W1930223417 countsByYear W19302234172016 @default.
- W1930223417 countsByYear W19302234172017 @default.
- W1930223417 countsByYear W19302234172018 @default.
- W1930223417 countsByYear W19302234172019 @default.
- W1930223417 countsByYear W19302234172020 @default.
- W1930223417 countsByYear W19302234172021 @default.
- W1930223417 countsByYear W19302234172022 @default.
- W1930223417 countsByYear W19302234172023 @default.
- W1930223417 crossrefType "journal-article" @default.
- W1930223417 hasAuthorship W1930223417A5002829835 @default.
- W1930223417 hasAuthorship W1930223417A5015432362 @default.
- W1930223417 hasAuthorship W1930223417A5050416778 @default.
- W1930223417 hasBestOaLocation W19302234172 @default.
- W1930223417 hasConcept C108583219 @default.
- W1930223417 hasConcept C119857082 @default.
- W1930223417 hasConcept C136764020 @default.
- W1930223417 hasConcept C144024400 @default.
- W1930223417 hasConcept C154945302 @default.
- W1930223417 hasConcept C170858558 @default.
- W1930223417 hasConcept C17744445 @default.
- W1930223417 hasConcept C199539241 @default.
- W1930223417 hasConcept C204321447 @default.
- W1930223417 hasConcept C206310091 @default.
- W1930223417 hasConcept C23123220 @default.
- W1930223417 hasConcept C2776359362 @default.
- W1930223417 hasConcept C2779903281 @default.
- W1930223417 hasConcept C2780660688 @default.
- W1930223417 hasConcept C2780910867 @default.
- W1930223417 hasConcept C36289849 @default.
- W1930223417 hasConcept C41008148 @default.
- W1930223417 hasConcept C518677369 @default.
- W1930223417 hasConcept C59404180 @default.
- W1930223417 hasConcept C71901391 @default.
- W1930223417 hasConcept C94625758 @default.
- W1930223417 hasConceptScore W1930223417C108583219 @default.
- W1930223417 hasConceptScore W1930223417C119857082 @default.
- W1930223417 hasConceptScore W1930223417C136764020 @default.
- W1930223417 hasConceptScore W1930223417C144024400 @default.
- W1930223417 hasConceptScore W1930223417C154945302 @default.
- W1930223417 hasConceptScore W1930223417C170858558 @default.
- W1930223417 hasConceptScore W1930223417C17744445 @default.
- W1930223417 hasConceptScore W1930223417C199539241 @default.
- W1930223417 hasConceptScore W1930223417C204321447 @default.
- W1930223417 hasConceptScore W1930223417C206310091 @default.
- W1930223417 hasConceptScore W1930223417C23123220 @default.
- W1930223417 hasConceptScore W1930223417C2776359362 @default.
- W1930223417 hasConceptScore W1930223417C2779903281 @default.
- W1930223417 hasConceptScore W1930223417C2780660688 @default.
- W1930223417 hasConceptScore W1930223417C2780910867 @default.
- W1930223417 hasConceptScore W1930223417C36289849 @default.
- W1930223417 hasConceptScore W1930223417C41008148 @default.
- W1930223417 hasConceptScore W1930223417C518677369 @default.
- W1930223417 hasConceptScore W1930223417C59404180 @default.
- W1930223417 hasConceptScore W1930223417C71901391 @default.
- W1930223417 hasConceptScore W1930223417C94625758 @default.
- W1930223417 hasIssue "11" @default.
- W1930223417 hasLocation W19302234171 @default.
- W1930223417 hasLocation W19302234172 @default.
- W1930223417 hasOpenAccess W1930223417 @default.
- W1930223417 hasPrimaryLocation W19302234171 @default.