Matches in SemOpenAlex for { <https://semopenalex.org/work/W4225654624> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4225654624 abstract "Zigzag flattening (ZF) is commonly used in computer vision as a default option to unfold matrices, eg in patch slicing for Vision Transformer (ViT). However, when decomposing multi-scale-object web images, ZF cannot preserve the smoothness of local information well. To address this, we draw inspiration from Space-Filling Curves (SFC) and investigate Hilbert flattening (HF) as an alternative for visual models. We provide a comprehensive theoretical discussion and practical analysis, demonstrating the superiority of HF over other SFC in locality and multi-scale robustness. We leverage HF to alleviate the problem of the lack of locality bias in the shallow layers of ViT, which formulates our Localformer. Extensive experiments demonstrate that Localformer consistently improves performance for several common visual tasks. Additionally, upon inspection, we find that Localformer enhances representation learning and length extrapolation abilities of ViT." @default.
- W4225654624 created "2022-05-05" @default.
- W4225654624 creator A5025760393 @default.
- W4225654624 creator A5029667848 @default.
- W4225654624 creator A5033411069 @default.
- W4225654624 creator A5064237960 @default.
- W4225654624 creator A5072861783 @default.
- W4225654624 date "2022-02-21" @default.
- W4225654624 modified "2023-09-26" @default.
- W4225654624 title "Localformer: a Locality-Preserving Vision Transformer" @default.
- W4225654624 doi "https://doi.org/10.48550/arxiv.2202.10240" @default.
- W4225654624 hasPublicationYear "2022" @default.
- W4225654624 type Work @default.
- W4225654624 citedByCount "0" @default.
- W4225654624 crossrefType "posted-content" @default.
- W4225654624 hasAuthorship W4225654624A5025760393 @default.
- W4225654624 hasAuthorship W4225654624A5029667848 @default.
- W4225654624 hasAuthorship W4225654624A5033411069 @default.
- W4225654624 hasAuthorship W4225654624A5064237960 @default.
- W4225654624 hasAuthorship W4225654624A5072861783 @default.
- W4225654624 hasBestOaLocation W42256546241 @default.
- W4225654624 hasConcept C119599485 @default.
- W4225654624 hasConcept C127413603 @default.
- W4225654624 hasConcept C132459708 @default.
- W4225654624 hasConcept C134306372 @default.
- W4225654624 hasConcept C138885662 @default.
- W4225654624 hasConcept C153083717 @default.
- W4225654624 hasConcept C154945302 @default.
- W4225654624 hasConcept C165801399 @default.
- W4225654624 hasConcept C19444555 @default.
- W4225654624 hasConcept C2779808786 @default.
- W4225654624 hasConcept C31972630 @default.
- W4225654624 hasConcept C33923547 @default.
- W4225654624 hasConcept C41008148 @default.
- W4225654624 hasConcept C41895202 @default.
- W4225654624 hasConcept C66322947 @default.
- W4225654624 hasConcept C78519656 @default.
- W4225654624 hasConcept C80444323 @default.
- W4225654624 hasConceptScore W4225654624C119599485 @default.
- W4225654624 hasConceptScore W4225654624C127413603 @default.
- W4225654624 hasConceptScore W4225654624C132459708 @default.
- W4225654624 hasConceptScore W4225654624C134306372 @default.
- W4225654624 hasConceptScore W4225654624C138885662 @default.
- W4225654624 hasConceptScore W4225654624C153083717 @default.
- W4225654624 hasConceptScore W4225654624C154945302 @default.
- W4225654624 hasConceptScore W4225654624C165801399 @default.
- W4225654624 hasConceptScore W4225654624C19444555 @default.
- W4225654624 hasConceptScore W4225654624C2779808786 @default.
- W4225654624 hasConceptScore W4225654624C31972630 @default.
- W4225654624 hasConceptScore W4225654624C33923547 @default.
- W4225654624 hasConceptScore W4225654624C41008148 @default.
- W4225654624 hasConceptScore W4225654624C41895202 @default.
- W4225654624 hasConceptScore W4225654624C66322947 @default.
- W4225654624 hasConceptScore W4225654624C78519656 @default.
- W4225654624 hasConceptScore W4225654624C80444323 @default.
- W4225654624 hasLocation W42256546241 @default.
- W4225654624 hasOpenAccess W4225654624 @default.
- W4225654624 hasPrimaryLocation W42256546241 @default.
- W4225654624 hasRelatedWork W1510550274 @default.
- W4225654624 hasRelatedWork W1548317368 @default.
- W4225654624 hasRelatedWork W2363648756 @default.
- W4225654624 hasRelatedWork W2381880241 @default.
- W4225654624 hasRelatedWork W2576147416 @default.
- W4225654624 hasRelatedWork W2626799276 @default.
- W4225654624 hasRelatedWork W2886384632 @default.
- W4225654624 hasRelatedWork W2970121907 @default.
- W4225654624 hasRelatedWork W3163104128 @default.
- W4225654624 hasRelatedWork W4288094939 @default.
- W4225654624 isParatext "false" @default.
- W4225654624 isRetracted "false" @default.
- W4225654624 workType "article" @default.