Matches in SemOpenAlex for { <https://semopenalex.org/work/W2945908093> ?p ?o ?g. }
- W2945908093 abstract "Self-attention (SA) mechanisms can capture effectively global dependencies in deep neural networks, and have been applied to natural language processing and image processing successfully. However, SA modules for image reconstruction have high time and space complexity, which restrict their applications to higher-resolution images. In this paper, we refine the SA module in self-attention generative adversarial networks (SAGAN) via adapting a non-local operation, revising the connectivity among the units in SA module and re-implementing its computational pattern, such that its time and space complexity is reduced from $text{O}(n^2)$ to $text{O}(n)$, but it is still equivalent to the original SA module. Further, we explore the principles behind the module and discover that our module is a special kind of channel attention mechanisms. Experimental results based on two benchmark datasets of image reconstruction, verify that under the same computational environment, two models can achieve comparable effectiveness for image reconstruction, but the proposed one runs faster and takes up less memory space." @default.
- W2945908093 created "2019-05-29" @default.
- W2945908093 creator A5009887822 @default.
- W2945908093 creator A5061223741 @default.
- W2945908093 creator A5073794006 @default.
- W2945908093 creator A5082429626 @default.
- W2945908093 date "2019-05-20" @default.
- W2945908093 modified "2023-09-27" @default.
- W2945908093 title "Less Memory, Faster Speed: Refining Self-Attention Module for Image Reconstruction." @default.
- W2945908093 cites W1514535095 @default.
- W2945908093 cites W1522301498 @default.
- W2945908093 cites W2064675550 @default.
- W2945908093 cites W2097073572 @default.
- W2945908093 cites W2101926813 @default.
- W2945908093 cites W2117539524 @default.
- W2945908093 cites W2147800946 @default.
- W2945908093 cites W2194775991 @default.
- W2945908093 cites W2432004435 @default.
- W2945908093 cites W2782980316 @default.
- W2945908093 cites W2785678896 @default.
- W2945908093 cites W2866634454 @default.
- W2945908093 cites W2893749619 @default.
- W2945908093 cites W2950738719 @default.
- W2945908093 cites W2950893734 @default.
- W2945908093 cites W2952191002 @default.
- W2945908093 cites W2962741254 @default.
- W2945908093 cites W2963470893 @default.
- W2945908093 cites W2963954913 @default.
- W2945908093 cites W2963981733 @default.
- W2945908093 cites W2964308564 @default.
- W2945908093 hasPublicationYear "2019" @default.
- W2945908093 type Work @default.
- W2945908093 sameAs 2945908093 @default.
- W2945908093 citedByCount "0" @default.
- W2945908093 crossrefType "posted-content" @default.
- W2945908093 hasAuthorship W2945908093A5009887822 @default.
- W2945908093 hasAuthorship W2945908093A5061223741 @default.
- W2945908093 hasAuthorship W2945908093A5073794006 @default.
- W2945908093 hasAuthorship W2945908093A5082429626 @default.
- W2945908093 hasConcept C111919701 @default.
- W2945908093 hasConcept C113775141 @default.
- W2945908093 hasConcept C11413529 @default.
- W2945908093 hasConcept C115961682 @default.
- W2945908093 hasConcept C127162648 @default.
- W2945908093 hasConcept C13280743 @default.
- W2945908093 hasConcept C141379421 @default.
- W2945908093 hasConcept C147789679 @default.
- W2945908093 hasConcept C154945302 @default.
- W2945908093 hasConcept C179799912 @default.
- W2945908093 hasConcept C185592680 @default.
- W2945908093 hasConcept C185798385 @default.
- W2945908093 hasConcept C205649164 @default.
- W2945908093 hasConcept C2778572836 @default.
- W2945908093 hasConcept C31258907 @default.
- W2945908093 hasConcept C31972630 @default.
- W2945908093 hasConcept C39890363 @default.
- W2945908093 hasConcept C41008148 @default.
- W2945908093 hasConcept C60044698 @default.
- W2945908093 hasConcept C80444323 @default.
- W2945908093 hasConceptScore W2945908093C111919701 @default.
- W2945908093 hasConceptScore W2945908093C113775141 @default.
- W2945908093 hasConceptScore W2945908093C11413529 @default.
- W2945908093 hasConceptScore W2945908093C115961682 @default.
- W2945908093 hasConceptScore W2945908093C127162648 @default.
- W2945908093 hasConceptScore W2945908093C13280743 @default.
- W2945908093 hasConceptScore W2945908093C141379421 @default.
- W2945908093 hasConceptScore W2945908093C147789679 @default.
- W2945908093 hasConceptScore W2945908093C154945302 @default.
- W2945908093 hasConceptScore W2945908093C179799912 @default.
- W2945908093 hasConceptScore W2945908093C185592680 @default.
- W2945908093 hasConceptScore W2945908093C185798385 @default.
- W2945908093 hasConceptScore W2945908093C205649164 @default.
- W2945908093 hasConceptScore W2945908093C2778572836 @default.
- W2945908093 hasConceptScore W2945908093C31258907 @default.
- W2945908093 hasConceptScore W2945908093C31972630 @default.
- W2945908093 hasConceptScore W2945908093C39890363 @default.
- W2945908093 hasConceptScore W2945908093C41008148 @default.
- W2945908093 hasConceptScore W2945908093C60044698 @default.
- W2945908093 hasConceptScore W2945908093C80444323 @default.
- W2945908093 hasLocation W29459080931 @default.
- W2945908093 hasOpenAccess W2945908093 @default.
- W2945908093 hasPrimaryLocation W29459080931 @default.
- W2945908093 hasRelatedWork W28109220 @default.
- W2945908093 hasRelatedWork W2935824555 @default.
- W2945908093 hasRelatedWork W2953277752 @default.
- W2945908093 hasRelatedWork W2984957176 @default.
- W2945908093 hasRelatedWork W2998325381 @default.
- W2945908093 hasRelatedWork W3011351556 @default.
- W2945908093 hasRelatedWork W3014413722 @default.
- W2945908093 hasRelatedWork W3015734825 @default.
- W2945908093 hasRelatedWork W3118490733 @default.
- W2945908093 hasRelatedWork W3160029842 @default.
- W2945908093 hasRelatedWork W3171831078 @default.
- W2945908093 hasRelatedWork W3180468378 @default.
- W2945908093 hasRelatedWork W3181267127 @default.
- W2945908093 hasRelatedWork W3183862065 @default.
- W2945908093 hasRelatedWork W3187180326 @default.
- W2945908093 hasRelatedWork W3194489714 @default.
- W2945908093 hasRelatedWork W3197776610 @default.
- W2945908093 hasRelatedWork W3204614423 @default.