Matches in SemOpenAlex for { <https://semopenalex.org/work/W3011199263> ?p ?o ?g. }
- W3011199263 abstract "Convolution exploits locality for efficiency at a cost of missing long range context. Self-attention has been adopted to augment CNNs with non-local interactions. Recent works prove it possible to stack self-attention layers to obtain a fully attentional network by restricting the attention to a local region. In this paper, we attempt to remove this constraint by factorizing 2D self-attention into two 1D self-attentions. This reduces computation complexity and allows performing attention within a larger or even global region. In companion, we also propose a position-sensitive self-attention design. Combining both yields our position-sensitive axial-attention layer, a novel building block that one could stack to form axial-attention models for image classification and dense prediction. We demonstrate the effectiveness of our model on four large-scale datasets. In particular, our model outperforms all existing stand-alone self-attention models on ImageNet. Our Axial-DeepLab improves 2.8% PQ over bottom-up state-of-the-art on COCO test-dev. This previous state-of-the-art is attained by our small variant that is 3.8x parameter-efficient and 27x computation-efficient. Axial-DeepLab also achieves state-of-the-art results on Mapillary Vistas and Cityscapes." @default.
- W3011199263 created "2020-03-23" @default.
- W3011199263 creator A5006455453 @default.
- W3011199263 creator A5028001282 @default.
- W3011199263 creator A5030402556 @default.
- W3011199263 creator A5034551921 @default.
- W3011199263 creator A5086706224 @default.
- W3011199263 creator A5090034335 @default.
- W3011199263 date "2020-03-17" @default.
- W3011199263 modified "2023-10-03" @default.
- W3011199263 title "Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation" @default.
- W3011199263 cites W1514535095 @default.
- W3011199263 cites W1610060839 @default.
- W3011199263 cites W1686810756 @default.
- W3011199263 cites W1836465849 @default.
- W3011199263 cites W1861492603 @default.
- W3011199263 cites W1949049686 @default.
- W3011199263 cites W1996901117 @default.
- W3011199263 cites W2042492924 @default.
- W3011199263 cites W2097073572 @default.
- W3011199263 cites W2112796928 @default.
- W3011199263 cites W2116988482 @default.
- W3011199263 cites W2117539524 @default.
- W3011199263 cites W2124260943 @default.
- W3011199263 cites W2163605009 @default.
- W3011199263 cites W2164877691 @default.
- W3011199263 cites W2183341477 @default.
- W3011199263 cites W2194775991 @default.
- W3011199263 cites W22745672 @default.
- W3011199263 cites W2327501763 @default.
- W3011199263 cites W2340897893 @default.
- W3011199263 cites W2402144811 @default.
- W3011199263 cites W2412782625 @default.
- W3011199263 cites W2525778437 @default.
- W3011199263 cites W2531409750 @default.
- W3011199263 cites W2549139847 @default.
- W3011199263 cites W2557889580 @default.
- W3011199263 cites W2560023338 @default.
- W3011199263 cites W2565639579 @default.
- W3011199263 cites W2598666589 @default.
- W3011199263 cites W2601564443 @default.
- W3011199263 cites W2612445135 @default.
- W3011199263 cites W2618011341 @default.
- W3011199263 cites W2622263826 @default.
- W3011199263 cites W2630837129 @default.
- W3011199263 cites W2781228439 @default.
- W3011199263 cites W2809110088 @default.
- W3011199263 cites W2891778567 @default.
- W3011199263 cites W2893749619 @default.
- W3011199263 cites W2893813411 @default.
- W3011199263 cites W2895065325 @default.
- W3011199263 cites W2902499724 @default.
- W3011199263 cites W2910628332 @default.
- W3011199263 cites W2911831070 @default.
- W3011199263 cites W2913314773 @default.
- W3011199263 cites W2919624000 @default.
- W3011199263 cites W2925552749 @default.
- W3011199263 cites W2944779197 @default.
- W3011199263 cites W2949391068 @default.
- W3011199263 cites W2950739196 @default.
- W3011199263 cites W2950893734 @default.
- W3011199263 cites W2953022181 @default.
- W3011199263 cites W2955058313 @default.
- W3011199263 cites W2962872506 @default.
- W3011199263 cites W2963091558 @default.
- W3011199263 cites W2963136578 @default.
- W3011199263 cites W2963150697 @default.
- W3011199263 cites W2963163009 @default.
- W3011199263 cites W2963236837 @default.
- W3011199263 cites W2963341956 @default.
- W3011199263 cites W2963350373 @default.
- W3011199263 cites W2963374479 @default.
- W3011199263 cites W2963393688 @default.
- W3011199263 cites W2963403868 @default.
- W3011199263 cites W2963420686 @default.
- W3011199263 cites W2963446712 @default.
- W3011199263 cites W2963677766 @default.
- W3011199263 cites W2963775509 @default.
- W3011199263 cites W2963857746 @default.
- W3011199263 cites W2963925437 @default.
- W3011199263 cites W2964080601 @default.
- W3011199263 cites W2964091144 @default.
- W3011199263 cites W2964110616 @default.
- W3011199263 cites W2964153283 @default.
- W3011199263 cites W2964254867 @default.
- W3011199263 cites W2964288706 @default.
- W3011199263 cites W2964308564 @default.
- W3011199263 cites W2964309882 @default.
- W3011199263 cites W2965182628 @default.
- W3011199263 cites W2966926453 @default.
- W3011199263 cites W2969825080 @default.
- W3011199263 cites W2970389371 @default.
- W3011199263 cites W2970803838 @default.
- W3011199263 cites W2974371958 @default.
- W3011199263 cites W2978575470 @default.
- W3011199263 cites W2980689730 @default.
- W3011199263 cites W2981413347 @default.
- W3011199263 cites W2981689412 @default.
- W3011199263 cites W2981899103 @default.
- W3011199263 cites W2982083293 @default.