Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320342244> ?p ?o ?g. }
Showing items 1 to 79 of
79
with 100 items per page.
- W4320342244 abstract "More and more evidence has shown that strengthening layer interactions can enhance the representation power of a deep neural network, while self-attention excels at learning interdependencies by retrieving query-activated information. Motivated by this, we devise a cross-layer attention mechanism, called multi-head recurrent layer attention (MRLA), that sends a query representation of the current layer to all previous layers to retrieve query-related information from different levels of receptive fields. A light-weighted version of MRLA is also proposed to reduce the quadratic computation cost. The proposed layer attention mechanism can enrich the representation power of many state-of-the-art vision networks, including CNNs and vision transformers. Its effectiveness has been extensively evaluated in image classification, object detection and instance segmentation tasks, where improvements can be consistently observed. For example, our MRLA can improve 1.6% Top-1 accuracy on ResNet-50, while only introducing 0.16M parameters and 0.07B FLOPs. Surprisingly, it can boost the performances by a large margin of 3-4% box AP and mask AP in dense prediction tasks. Our code is available at https://github.com/joyfang1106/MRLA." @default.
- W4320342244 created "2023-02-13" @default.
- W4320342244 creator A5023258354 @default.
- W4320342244 creator A5027334799 @default.
- W4320342244 creator A5031863879 @default.
- W4320342244 creator A5058773578 @default.
- W4320342244 creator A5065076327 @default.
- W4320342244 creator A5088460924 @default.
- W4320342244 date "2023-02-08" @default.
- W4320342244 modified "2023-09-23" @default.
- W4320342244 title "Cross-Layer Retrospective Retrieving via Layer Attention" @default.
- W4320342244 doi "https://doi.org/10.48550/arxiv.2302.03985" @default.
- W4320342244 hasPublicationYear "2023" @default.
- W4320342244 type Work @default.
- W4320342244 citedByCount "0" @default.
- W4320342244 crossrefType "posted-content" @default.
- W4320342244 hasAuthorship W4320342244A5023258354 @default.
- W4320342244 hasAuthorship W4320342244A5027334799 @default.
- W4320342244 hasAuthorship W4320342244A5031863879 @default.
- W4320342244 hasAuthorship W4320342244A5058773578 @default.
- W4320342244 hasAuthorship W4320342244A5065076327 @default.
- W4320342244 hasAuthorship W4320342244A5088460924 @default.
- W4320342244 hasBestOaLocation W43203422441 @default.
- W4320342244 hasConcept C108583219 @default.
- W4320342244 hasConcept C11413529 @default.
- W4320342244 hasConcept C119857082 @default.
- W4320342244 hasConcept C153180895 @default.
- W4320342244 hasConcept C154945302 @default.
- W4320342244 hasConcept C177264268 @default.
- W4320342244 hasConcept C17744445 @default.
- W4320342244 hasConcept C178790620 @default.
- W4320342244 hasConcept C185592680 @default.
- W4320342244 hasConcept C199360897 @default.
- W4320342244 hasConcept C199539241 @default.
- W4320342244 hasConcept C2776359362 @default.
- W4320342244 hasConcept C2776760102 @default.
- W4320342244 hasConcept C2779227376 @default.
- W4320342244 hasConcept C41008148 @default.
- W4320342244 hasConcept C45374587 @default.
- W4320342244 hasConcept C50644808 @default.
- W4320342244 hasConcept C774472 @default.
- W4320342244 hasConcept C89600930 @default.
- W4320342244 hasConcept C94625758 @default.
- W4320342244 hasConceptScore W4320342244C108583219 @default.
- W4320342244 hasConceptScore W4320342244C11413529 @default.
- W4320342244 hasConceptScore W4320342244C119857082 @default.
- W4320342244 hasConceptScore W4320342244C153180895 @default.
- W4320342244 hasConceptScore W4320342244C154945302 @default.
- W4320342244 hasConceptScore W4320342244C177264268 @default.
- W4320342244 hasConceptScore W4320342244C17744445 @default.
- W4320342244 hasConceptScore W4320342244C178790620 @default.
- W4320342244 hasConceptScore W4320342244C185592680 @default.
- W4320342244 hasConceptScore W4320342244C199360897 @default.
- W4320342244 hasConceptScore W4320342244C199539241 @default.
- W4320342244 hasConceptScore W4320342244C2776359362 @default.
- W4320342244 hasConceptScore W4320342244C2776760102 @default.
- W4320342244 hasConceptScore W4320342244C2779227376 @default.
- W4320342244 hasConceptScore W4320342244C41008148 @default.
- W4320342244 hasConceptScore W4320342244C45374587 @default.
- W4320342244 hasConceptScore W4320342244C50644808 @default.
- W4320342244 hasConceptScore W4320342244C774472 @default.
- W4320342244 hasConceptScore W4320342244C89600930 @default.
- W4320342244 hasConceptScore W4320342244C94625758 @default.
- W4320342244 hasLocation W43203422441 @default.
- W4320342244 hasOpenAccess W4320342244 @default.
- W4320342244 hasPrimaryLocation W43203422441 @default.
- W4320342244 hasRelatedWork W2790662084 @default.
- W4320342244 hasRelatedWork W2948658236 @default.
- W4320342244 hasRelatedWork W3014300295 @default.
- W4320342244 hasRelatedWork W3162157813 @default.
- W4320342244 hasRelatedWork W4223943233 @default.
- W4320342244 hasRelatedWork W4225161397 @default.
- W4320342244 hasRelatedWork W4243168368 @default.
- W4320342244 hasRelatedWork W4293211451 @default.
- W4320342244 hasRelatedWork W4309045103 @default.
- W4320342244 hasRelatedWork W4312200629 @default.
- W4320342244 isParatext "false" @default.
- W4320342244 isRetracted "false" @default.
- W4320342244 workType "article" @default.