Matches in SemOpenAlex for { <https://semopenalex.org/work/W3197408061> ?p ?o ?g. }
- W3197408061 abstract "We study the vision transformer structure in the mobile level in this paper, and find a dramatic performance drop. We analyze the reason behind this phenomenon, and propose a novel irregular patch embedding module and adaptive patch fusion module to improve the performance. We conjecture that the vision transformer blocks (which consist of multi-head attention and feed-forward network) are more suitable to handle high-level information than low-level features. The irregular patch embedding module extracts patches that contain rich high-level information with different receptive fields. The transformer blocks can obtain the most useful information from these irregular patches. Then the processed patches pass the adaptive patch merging module to get the final features for the classifier. With our proposed improvements, the traditional uniform vision transformer structure can achieve state-of-the-art results in mobile level. We improve the DeiT baseline by more than 9% under the mobile-level settings and surpass other transformer architectures like Swin and CoaT by a large margin." @default.
- W3197408061 created "2021-09-13" @default.
- W3197408061 creator A5035698330 @default.
- W3197408061 creator A5047318884 @default.
- W3197408061 creator A5052856441 @default.
- W3197408061 creator A5064499660 @default.
- W3197408061 creator A5076191641 @default.
- W3197408061 date "2021-08-30" @default.
- W3197408061 modified "2023-09-27" @default.
- W3197408061 title "Exploring and Improving Mobile Level Vision Transformers" @default.
- W3197408061 cites W2117539524 @default.
- W3197408061 cites W2147800946 @default.
- W3197408061 cites W2163605009 @default.
- W3197408061 cites W2194775991 @default.
- W3197408061 cites W2331143823 @default.
- W3197408061 cites W2549139847 @default.
- W3197408061 cites W2612445135 @default.
- W3197408061 cites W2622263826 @default.
- W3197408061 cites W2804047946 @default.
- W3197408061 cites W2883780447 @default.
- W3197408061 cites W2884585870 @default.
- W3197408061 cites W2922509574 @default.
- W3197408061 cites W2940744433 @default.
- W3197408061 cites W2955425717 @default.
- W3197408061 cites W2962835968 @default.
- W3197408061 cites W2962900737 @default.
- W3197408061 cites W2963091558 @default.
- W3197408061 cites W2963125010 @default.
- W3197408061 cites W2963163009 @default.
- W3197408061 cites W2963399829 @default.
- W3197408061 cites W2963403868 @default.
- W3197408061 cites W2963420686 @default.
- W3197408061 cites W2963495494 @default.
- W3197408061 cites W2963918968 @default.
- W3197408061 cites W2963975324 @default.
- W3197408061 cites W2964259004 @default.
- W3197408061 cites W2982083293 @default.
- W3197408061 cites W2988089665 @default.
- W3197408061 cites W2992308087 @default.
- W3197408061 cites W2998508940 @default.
- W3197408061 cites W3034363135 @default.
- W3197408061 cites W3034429256 @default.
- W3197408061 cites W3035452548 @default.
- W3197408061 cites W3102631365 @default.
- W3197408061 cites W3119786062 @default.
- W3197408061 cites W3131500599 @default.
- W3197408061 cites W3138516171 @default.
- W3197408061 cites W3145444543 @default.
- W3197408061 cites W3146091044 @default.
- W3197408061 cites W3156811085 @default.
- W3197408061 cites W3159663321 @default.
- W3197408061 cites W3170188883 @default.
- W3197408061 cites W3170874841 @default.
- W3197408061 cites W3204563069 @default.
- W3197408061 cites W3212756788 @default.
- W3197408061 hasPublicationYear "2021" @default.
- W3197408061 type Work @default.
- W3197408061 sameAs 3197408061 @default.
- W3197408061 citedByCount "0" @default.
- W3197408061 crossrefType "posted-content" @default.
- W3197408061 hasAuthorship W3197408061A5035698330 @default.
- W3197408061 hasAuthorship W3197408061A5047318884 @default.
- W3197408061 hasAuthorship W3197408061A5052856441 @default.
- W3197408061 hasAuthorship W3197408061A5064499660 @default.
- W3197408061 hasAuthorship W3197408061A5076191641 @default.
- W3197408061 hasConcept C119599485 @default.
- W3197408061 hasConcept C127413603 @default.
- W3197408061 hasConcept C154945302 @default.
- W3197408061 hasConcept C165801399 @default.
- W3197408061 hasConcept C31972630 @default.
- W3197408061 hasConcept C41008148 @default.
- W3197408061 hasConcept C41608201 @default.
- W3197408061 hasConcept C66322947 @default.
- W3197408061 hasConceptScore W3197408061C119599485 @default.
- W3197408061 hasConceptScore W3197408061C127413603 @default.
- W3197408061 hasConceptScore W3197408061C154945302 @default.
- W3197408061 hasConceptScore W3197408061C165801399 @default.
- W3197408061 hasConceptScore W3197408061C31972630 @default.
- W3197408061 hasConceptScore W3197408061C41008148 @default.
- W3197408061 hasConceptScore W3197408061C41608201 @default.
- W3197408061 hasConceptScore W3197408061C66322947 @default.
- W3197408061 hasLocation W31974080611 @default.
- W3197408061 hasOpenAccess W3197408061 @default.
- W3197408061 hasPrimaryLocation W31974080611 @default.
- W3197408061 hasRelatedWork W2592021490 @default.
- W3197408061 hasRelatedWork W2794119880 @default.
- W3197408061 hasRelatedWork W2798617638 @default.
- W3197408061 hasRelatedWork W2896911342 @default.
- W3197408061 hasRelatedWork W2921605747 @default.
- W3197408061 hasRelatedWork W2926332763 @default.
- W3197408061 hasRelatedWork W2940427740 @default.
- W3197408061 hasRelatedWork W2965903589 @default.
- W3197408061 hasRelatedWork W2982589917 @default.
- W3197408061 hasRelatedWork W3118440143 @default.
- W3197408061 hasRelatedWork W3121806817 @default.
- W3197408061 hasRelatedWork W3159757065 @default.
- W3197408061 hasRelatedWork W3168101492 @default.
- W3197408061 hasRelatedWork W3174738881 @default.
- W3197408061 hasRelatedWork W3176258108 @default.
- W3197408061 hasRelatedWork W3186564193 @default.