Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287182863> ?p ?o ?g. }
Showing items 1 to 73 of
73
with 100 items per page.
- W4287182863 abstract "Multi-modal learning, which focuses on utilizing various modalities to improve the performance of a model, is widely used in video recognition. While traditional multi-modal learning offers excellent recognition results, its computational expense limits its impact for many real-world applications. In this paper, we propose an adaptive multi-modal learning framework, called AdaMML, that selects on-the-fly the optimal modalities for each segment conditioned on the input for efficient video recognition. Specifically, given a video segment, a multi-modal policy network is used to decide what modalities should be used for processing by the recognition model, with the goal of improving both accuracy and efficiency. We efficiently train the policy network jointly with the recognition model using standard back-propagation. Extensive experiments on four challenging diverse datasets demonstrate that our proposed adaptive approach yields 35%-55% reduction in computation when compared to the traditional baseline that simply uses all the modalities irrespective of the input, while also achieving consistent improvements in accuracy over the state-of-the-art methods." @default.
- W4287182863 created "2022-07-25" @default.
- W4287182863 creator A5021031074 @default.
- W4287182863 creator A5021257546 @default.
- W4287182863 creator A5025006492 @default.
- W4287182863 creator A5049734237 @default.
- W4287182863 creator A5052325109 @default.
- W4287182863 creator A5075906727 @default.
- W4287182863 creator A5080417608 @default.
- W4287182863 date "2021-05-11" @default.
- W4287182863 modified "2023-09-29" @default.
- W4287182863 title "AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition" @default.
- W4287182863 doi "https://doi.org/10.48550/arxiv.2105.05165" @default.
- W4287182863 hasPublicationYear "2021" @default.
- W4287182863 type Work @default.
- W4287182863 citedByCount "0" @default.
- W4287182863 crossrefType "posted-content" @default.
- W4287182863 hasAuthorship W4287182863A5021031074 @default.
- W4287182863 hasAuthorship W4287182863A5021257546 @default.
- W4287182863 hasAuthorship W4287182863A5025006492 @default.
- W4287182863 hasAuthorship W4287182863A5049734237 @default.
- W4287182863 hasAuthorship W4287182863A5052325109 @default.
- W4287182863 hasAuthorship W4287182863A5075906727 @default.
- W4287182863 hasAuthorship W4287182863A5080417608 @default.
- W4287182863 hasBestOaLocation W42871828631 @default.
- W4287182863 hasConcept C111335779 @default.
- W4287182863 hasConcept C11413529 @default.
- W4287182863 hasConcept C119857082 @default.
- W4287182863 hasConcept C144024400 @default.
- W4287182863 hasConcept C153180895 @default.
- W4287182863 hasConcept C154945302 @default.
- W4287182863 hasConcept C185592680 @default.
- W4287182863 hasConcept C188027245 @default.
- W4287182863 hasConcept C2524010 @default.
- W4287182863 hasConcept C2779903281 @default.
- W4287182863 hasConcept C2780226545 @default.
- W4287182863 hasConcept C33923547 @default.
- W4287182863 hasConcept C36289849 @default.
- W4287182863 hasConcept C41008148 @default.
- W4287182863 hasConcept C45374587 @default.
- W4287182863 hasConcept C71139939 @default.
- W4287182863 hasConceptScore W4287182863C111335779 @default.
- W4287182863 hasConceptScore W4287182863C11413529 @default.
- W4287182863 hasConceptScore W4287182863C119857082 @default.
- W4287182863 hasConceptScore W4287182863C144024400 @default.
- W4287182863 hasConceptScore W4287182863C153180895 @default.
- W4287182863 hasConceptScore W4287182863C154945302 @default.
- W4287182863 hasConceptScore W4287182863C185592680 @default.
- W4287182863 hasConceptScore W4287182863C188027245 @default.
- W4287182863 hasConceptScore W4287182863C2524010 @default.
- W4287182863 hasConceptScore W4287182863C2779903281 @default.
- W4287182863 hasConceptScore W4287182863C2780226545 @default.
- W4287182863 hasConceptScore W4287182863C33923547 @default.
- W4287182863 hasConceptScore W4287182863C36289849 @default.
- W4287182863 hasConceptScore W4287182863C41008148 @default.
- W4287182863 hasConceptScore W4287182863C45374587 @default.
- W4287182863 hasConceptScore W4287182863C71139939 @default.
- W4287182863 hasLocation W42871828631 @default.
- W4287182863 hasOpenAccess W4287182863 @default.
- W4287182863 hasPrimaryLocation W42871828631 @default.
- W4287182863 hasRelatedWork W2354062721 @default.
- W4287182863 hasRelatedWork W2807776204 @default.
- W4287182863 hasRelatedWork W2961085424 @default.
- W4287182863 hasRelatedWork W3046775127 @default.
- W4287182863 hasRelatedWork W3107474891 @default.
- W4287182863 hasRelatedWork W3136151093 @default.
- W4287182863 hasRelatedWork W4205958290 @default.
- W4287182863 hasRelatedWork W4283077296 @default.
- W4287182863 hasRelatedWork W4286629047 @default.
- W4287182863 hasRelatedWork W4224009465 @default.
- W4287182863 isParatext "false" @default.
- W4287182863 isRetracted "false" @default.
- W4287182863 workType "article" @default.