Matches in SemOpenAlex for { <https://semopenalex.org/work/W3136512936> ?p ?o ?g. }
- W3136512936 abstract "Recent research in dynamic convolution shows substantial performance boost for efficient CNNs, due to the adaptive aggregation of K static convolution kernels. It has two limitations: (a) it increases the number of convolutional weights by K-times, and (b) the joint optimization of dynamic attention and static convolution kernels is challenging. In this paper, we revisit it from a new perspective of matrix decomposition and reveal the key issue is that dynamic convolution applies dynamic attention over channel groups after projecting into a higher dimensional latent space. To address this issue, we propose dynamic channel fusion to replace dynamic attention over channel groups. Dynamic channel fusion not only enables significant dimension reduction of the latent space, but also mitigates the joint optimization difficulty. As a result, our method is easier to train and requires significantly fewer parameters without sacrificing accuracy. Source code is at https://github.com/liyunsheng13/dcd." @default.
- W3136512936 created "2021-03-29" @default.
- W3136512936 creator A5007557621 @default.
- W3136512936 creator A5008610307 @default.
- W3136512936 creator A5023214243 @default.
- W3136512936 creator A5029523095 @default.
- W3136512936 creator A5044339131 @default.
- W3136512936 creator A5046214153 @default.
- W3136512936 creator A5048295582 @default.
- W3136512936 creator A5057293861 @default.
- W3136512936 creator A5071908018 @default.
- W3136512936 creator A5077341571 @default.
- W3136512936 date "2021-03-15" @default.
- W3136512936 modified "2023-09-27" @default.
- W3136512936 title "Revisiting Dynamic Convolution via Matrix Decomposition" @default.
- W3136512936 cites W1665214252 @default.
- W3136512936 cites W2013912476 @default.
- W3136512936 cites W2095705004 @default.
- W3136512936 cites W2108598243 @default.
- W3136512936 cites W2131524184 @default.
- W3136512936 cites W2167215970 @default.
- W3136512936 cites W2177847924 @default.
- W3136512936 cites W2194775991 @default.
- W3136512936 cites W2612445135 @default.
- W3136512936 cites W2883780447 @default.
- W3136512936 cites W2922509574 @default.
- W3136512936 cites W2955425717 @default.
- W3136512936 cites W2963125010 @default.
- W3136512936 cites W2963163009 @default.
- W3136512936 cites W2963399829 @default.
- W3136512936 cites W2963420686 @default.
- W3136512936 cites W2963766446 @default.
- W3136512936 cites W2970107519 @default.
- W3136512936 cites W2982083293 @default.
- W3136512936 cites W3014030224 @default.
- W3136512936 cites W3022419825 @default.
- W3136512936 cites W3034344052 @default.
- W3136512936 cites W3034421924 @default.
- W3136512936 cites W3034633006 @default.
- W3136512936 cites W3034971973 @default.
- W3136512936 cites W3035414587 @default.
- W3136512936 cites W3040385575 @default.
- W3136512936 cites W3041180677 @default.
- W3136512936 cites W3044734608 @default.
- W3136512936 cites W3048878373 @default.
- W3136512936 cites W3106546328 @default.
- W3136512936 doi "https://doi.org/10.48550/arxiv.2103.08756" @default.
- W3136512936 hasPublicationYear "2021" @default.
- W3136512936 type Work @default.
- W3136512936 sameAs 3136512936 @default.
- W3136512936 citedByCount "1" @default.
- W3136512936 countsByYear W31365129362021 @default.
- W3136512936 crossrefType "posted-content" @default.
- W3136512936 hasAuthorship W3136512936A5007557621 @default.
- W3136512936 hasAuthorship W3136512936A5008610307 @default.
- W3136512936 hasAuthorship W3136512936A5023214243 @default.
- W3136512936 hasAuthorship W3136512936A5029523095 @default.
- W3136512936 hasAuthorship W3136512936A5044339131 @default.
- W3136512936 hasAuthorship W3136512936A5046214153 @default.
- W3136512936 hasAuthorship W3136512936A5048295582 @default.
- W3136512936 hasAuthorship W3136512936A5057293861 @default.
- W3136512936 hasAuthorship W3136512936A5071908018 @default.
- W3136512936 hasAuthorship W3136512936A5077341571 @default.
- W3136512936 hasBestOaLocation W31365129361 @default.
- W3136512936 hasConcept C106487976 @default.
- W3136512936 hasConcept C111335779 @default.
- W3136512936 hasConcept C11413529 @default.
- W3136512936 hasConcept C124681953 @default.
- W3136512936 hasConcept C127162648 @default.
- W3136512936 hasConcept C154945302 @default.
- W3136512936 hasConcept C159985019 @default.
- W3136512936 hasConcept C177264268 @default.
- W3136512936 hasConcept C18903297 @default.
- W3136512936 hasConcept C192562407 @default.
- W3136512936 hasConcept C199360897 @default.
- W3136512936 hasConcept C202444582 @default.
- W3136512936 hasConcept C2524010 @default.
- W3136512936 hasConcept C26517878 @default.
- W3136512936 hasConcept C2776760102 @default.
- W3136512936 hasConcept C33676613 @default.
- W3136512936 hasConcept C33923547 @default.
- W3136512936 hasConcept C38652104 @default.
- W3136512936 hasConcept C41008148 @default.
- W3136512936 hasConcept C45347329 @default.
- W3136512936 hasConcept C50644808 @default.
- W3136512936 hasConcept C70518039 @default.
- W3136512936 hasConcept C76155785 @default.
- W3136512936 hasConcept C86803240 @default.
- W3136512936 hasConceptScore W3136512936C106487976 @default.
- W3136512936 hasConceptScore W3136512936C111335779 @default.
- W3136512936 hasConceptScore W3136512936C11413529 @default.
- W3136512936 hasConceptScore W3136512936C124681953 @default.
- W3136512936 hasConceptScore W3136512936C127162648 @default.
- W3136512936 hasConceptScore W3136512936C154945302 @default.
- W3136512936 hasConceptScore W3136512936C159985019 @default.
- W3136512936 hasConceptScore W3136512936C177264268 @default.
- W3136512936 hasConceptScore W3136512936C18903297 @default.
- W3136512936 hasConceptScore W3136512936C192562407 @default.
- W3136512936 hasConceptScore W3136512936C199360897 @default.
- W3136512936 hasConceptScore W3136512936C202444582 @default.