Matches in SemOpenAlex for { <https://semopenalex.org/work/W3167292079> ?p ?o ?g. }
- W3167292079 abstract "Inspired by biological evolution, we explain the rationality of Vision Transformer by analogy with the proven practical Evolutionary Algorithm (EA) and derive that both of them have consistent mathematical representation. Analogous to the dynamic local population in EA, we improve the existing transformer structure and propose a more efficient EAT model, and design task-related heads to deal with different tasks more flexibly. Moreover, we introduce the spatial-filling curve into the current vision transformer to sequence image data into a uniform sequential format. Thus we can design a unified EAT framework to address multi-modal tasks, separating the network architecture from the data format adaptation. Our approach achieves state-of-the-art results on the ImageNet classification task compared with recent vision transformer works while having smaller parameters and greater throughput. We further conduct multi-modal tasks to demonstrate the superiority of the unified EAT, e.g., Text-Based Image Retrieval, and our approach improves the rank-1 by +3.7 points over the baseline on the CSS dataset." @default.
- W3167292079 created "2021-06-22" @default.
- W3167292079 creator A5003625093 @default.
- W3167292079 creator A5004120702 @default.
- W3167292079 creator A5021861529 @default.
- W3167292079 creator A5022997052 @default.
- W3167292079 creator A5023834700 @default.
- W3167292079 creator A5028731909 @default.
- W3167292079 creator A5029021362 @default.
- W3167292079 creator A5030849116 @default.
- W3167292079 creator A5061136923 @default.
- W3167292079 creator A5067413001 @default.
- W3167292079 date "2021-05-31" @default.
- W3167292079 modified "2023-09-23" @default.
- W3167292079 title "Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model" @default.
- W3167292079 cites W13391147 @default.
- W3167292079 cites W1581846259 @default.
- W3167292079 cites W1589213590 @default.
- W3167292079 cites W1595159159 @default.
- W3167292079 cites W1857672529 @default.
- W3167292079 cites W1948251820 @default.
- W3167292079 cites W1986210140 @default.
- W3167292079 cites W2021179136 @default.
- W3167292079 cites W2040879131 @default.
- W3167292079 cites W2133927618 @default.
- W3167292079 cites W2136827689 @default.
- W3167292079 cites W2156194072 @default.
- W3167292079 cites W2194775991 @default.
- W3167292079 cites W2596367596 @default.
- W3167292079 cites W2662297521 @default.
- W3167292079 cites W2769954494 @default.
- W3167292079 cites W2787560479 @default.
- W3167292079 cites W2891952073 @default.
- W3167292079 cites W2898585845 @default.
- W3167292079 cites W2905544595 @default.
- W3167292079 cites W2950208273 @default.
- W3167292079 cites W2962858109 @default.
- W3167292079 cites W2963341956 @default.
- W3167292079 cites W2963403868 @default.
- W3167292079 cites W2963800628 @default.
- W3167292079 cites W2964211610 @default.
- W3167292079 cites W2966926453 @default.
- W3167292079 cites W2991186560 @default.
- W3167292079 cites W2993471286 @default.
- W3167292079 cites W2994673210 @default.
- W3167292079 cites W3028515492 @default.
- W3167292079 cites W3029385331 @default.
- W3167292079 cites W3030163527 @default.
- W3167292079 cites W3033210410 @default.
- W3167292079 cites W3033529678 @default.
- W3167292079 cites W3033936477 @default.
- W3167292079 cites W3034357629 @default.
- W3167292079 cites W3034445277 @default.
- W3167292079 cites W3046927816 @default.
- W3167292079 cites W3092052697 @default.
- W3167292079 cites W3092462694 @default.
- W3167292079 cites W3096407730 @default.
- W3167292079 cites W3096533519 @default.
- W3167292079 cites W3096609285 @default.
- W3167292079 cites W3109319753 @default.
- W3167292079 cites W3115860342 @default.
- W3167292079 cites W3116489684 @default.
- W3167292079 cites W3119786062 @default.
- W3167292079 cites W3120885796 @default.
- W3167292079 cites W3121523901 @default.
- W3167292079 cites W3125056032 @default.
- W3167292079 cites W3126721948 @default.
- W3167292079 cites W3127751679 @default.
- W3167292079 cites W3131500599 @default.
- W3167292079 cites W3132503749 @default.
- W3167292079 cites W3132890542 @default.
- W3167292079 cites W3133696297 @default.
- W3167292079 cites W3135593154 @default.
- W3167292079 cites W3135921327 @default.
- W3167292079 cites W3136416617 @default.
- W3167292079 cites W3137182587 @default.
- W3167292079 cites W3137963805 @default.
- W3167292079 cites W3138516171 @default.
- W3167292079 cites W3139049060 @default.
- W3167292079 cites W3139445856 @default.
- W3167292079 cites W3139773203 @default.
- W3167292079 cites W3143083666 @default.
- W3167292079 cites W3145450063 @default.
- W3167292079 cites W3146097248 @default.
- W3167292079 cites W3149806960 @default.
- W3167292079 cites W3156811085 @default.
- W3167292079 cites W3166513219 @default.
- W3167292079 cites W3170227631 @default.
- W3167292079 cites W3170841864 @default.
- W3167292079 cites W3171087525 @default.
- W3167292079 cites W3172509117 @default.
- W3167292079 cites W66010334 @default.
- W3167292079 cites W2770298516 @default.
- W3167292079 doi "https://doi.org/10.48550/arxiv.2105.15089" @default.
- W3167292079 hasPublicationYear "2021" @default.
- W3167292079 type Work @default.
- W3167292079 sameAs 3167292079 @default.
- W3167292079 citedByCount "0" @default.
- W3167292079 crossrefType "posted-content" @default.
- W3167292079 hasAuthorship W3167292079A5003625093 @default.