Matches in SemOpenAlex for { <https://semopenalex.org/work/W4301304876> ?p ?o ?g. }
Showing items 1 to 72 of
72
with 100 items per page.
- W4301304876 abstract "Diverse input data modalities can provide complementary cues for several tasks, usually leading to more robust algorithms and better performance. However, while a (training) dataset could be accurately designed to include a variety of sensory inputs, it is often the case that not all modalities could be available in real life (testing) scenarios, where a model has to be deployed. This raises the challenge of how to learn robust representations leveraging multimodal data in the training stage, while considering limitations at test time, such as noisy or missing modalities. This paper presents a new approach for multimodal video action recognition, developed within the unified frameworks of distillation and privileged information, named generalized distillation. Particularly, we consider the case of learning representations from depth and RGB videos, while relying on RGB data only at test time. We propose a new approach to train an hallucination network that learns to distill depth features through multiplicative connections of spatiotemporal representations, leveraging soft labels and hard labels, as well as distance between feature maps. We report state-of-the-art results on video action classification on the largest multimodal dataset available for this task, the NTU RGB+D. Code available at https://github.com/ncgarcia/modality-distillation ." @default.
- W4301304876 created "2022-10-05" @default.
- W4301304876 creator A5007242502 @default.
- W4301304876 creator A5017103754 @default.
- W4301304876 creator A5021852786 @default.
- W4301304876 date "2018-06-19" @default.
- W4301304876 modified "2023-09-26" @default.
- W4301304876 title "Modality Distillation with Multiple Stream Networks for Action Recognition" @default.
- W4301304876 doi "https://doi.org/10.48550/arxiv.1806.07110" @default.
- W4301304876 hasPublicationYear "2018" @default.
- W4301304876 type Work @default.
- W4301304876 citedByCount "0" @default.
- W4301304876 crossrefType "posted-content" @default.
- W4301304876 hasAuthorship W4301304876A5007242502 @default.
- W4301304876 hasAuthorship W4301304876A5017103754 @default.
- W4301304876 hasAuthorship W4301304876A5021852786 @default.
- W4301304876 hasBestOaLocation W43013048761 @default.
- W4301304876 hasConcept C119857082 @default.
- W4301304876 hasConcept C121332964 @default.
- W4301304876 hasConcept C136197465 @default.
- W4301304876 hasConcept C138885662 @default.
- W4301304876 hasConcept C144024400 @default.
- W4301304876 hasConcept C153180895 @default.
- W4301304876 hasConcept C154945302 @default.
- W4301304876 hasConcept C162324750 @default.
- W4301304876 hasConcept C187736073 @default.
- W4301304876 hasConcept C2776401178 @default.
- W4301304876 hasConcept C2779903281 @default.
- W4301304876 hasConcept C2780226545 @default.
- W4301304876 hasConcept C2780451532 @default.
- W4301304876 hasConcept C2780791683 @default.
- W4301304876 hasConcept C36289849 @default.
- W4301304876 hasConcept C41008148 @default.
- W4301304876 hasConcept C41895202 @default.
- W4301304876 hasConcept C62520636 @default.
- W4301304876 hasConcept C82990744 @default.
- W4301304876 hasConceptScore W4301304876C119857082 @default.
- W4301304876 hasConceptScore W4301304876C121332964 @default.
- W4301304876 hasConceptScore W4301304876C136197465 @default.
- W4301304876 hasConceptScore W4301304876C138885662 @default.
- W4301304876 hasConceptScore W4301304876C144024400 @default.
- W4301304876 hasConceptScore W4301304876C153180895 @default.
- W4301304876 hasConceptScore W4301304876C154945302 @default.
- W4301304876 hasConceptScore W4301304876C162324750 @default.
- W4301304876 hasConceptScore W4301304876C187736073 @default.
- W4301304876 hasConceptScore W4301304876C2776401178 @default.
- W4301304876 hasConceptScore W4301304876C2779903281 @default.
- W4301304876 hasConceptScore W4301304876C2780226545 @default.
- W4301304876 hasConceptScore W4301304876C2780451532 @default.
- W4301304876 hasConceptScore W4301304876C2780791683 @default.
- W4301304876 hasConceptScore W4301304876C36289849 @default.
- W4301304876 hasConceptScore W4301304876C41008148 @default.
- W4301304876 hasConceptScore W4301304876C41895202 @default.
- W4301304876 hasConceptScore W4301304876C62520636 @default.
- W4301304876 hasConceptScore W4301304876C82990744 @default.
- W4301304876 hasLocation W43013048761 @default.
- W4301304876 hasLocation W43013048762 @default.
- W4301304876 hasOpenAccess W4301304876 @default.
- W4301304876 hasPrimaryLocation W43013048761 @default.
- W4301304876 hasRelatedWork W2012466265 @default.
- W4301304876 hasRelatedWork W2059143058 @default.
- W4301304876 hasRelatedWork W2613123485 @default.
- W4301304876 hasRelatedWork W2914599329 @default.
- W4301304876 hasRelatedWork W2948157954 @default.
- W4301304876 hasRelatedWork W311766550 @default.
- W4301304876 hasRelatedWork W4205137593 @default.
- W4301304876 hasRelatedWork W4236838349 @default.
- W4301304876 hasRelatedWork W4285890913 @default.
- W4301304876 hasRelatedWork W4309345936 @default.
- W4301304876 isParatext "false" @default.
- W4301304876 isRetracted "false" @default.
- W4301304876 workType "article" @default.