Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386875228> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4386875228 abstract "In recent years, remote sensing (RS) vision foundation models such as RingMo have emerged and achieved excellent performance in various downstream tasks. However, the high demand for computing resources limits the application of these models on edge devices. It is necessary to design a more lightweight foundation model to support on-orbit RS image interpretation. Existing methods face challenges in achieving lightweight solutions while retaining generalization in RS image interpretation. This is due to the complex high and low-frequency spectral components in RS images, which make traditional single CNN or Vision Transformer methods unsuitable for the task. Therefore, this paper proposes RingMo-lite, an RS multi-task lightweight network with a CNN-Transformer hybrid framework, which effectively exploits the frequency-domain properties of RS to optimize the interpretation process. It is combined by the Transformer module as a low-pass filter to extract global features of RS images through a dual-branch structure, and the CNN module as a stacked high-pass filter to extract fine-grained details effectively. Furthermore, in the pretraining stage, the designed frequency-domain masked image modeling (FD-MIM) combines each image patch's high-frequency and low-frequency characteristics, effectively capturing the latent feature representation in RS data. As shown in Fig. 1, compared with RingMo, the proposed RingMo-lite reduces the parameters over 60% in various RS image interpretation tasks, the average accuracy drops by less than 2% in most of the scenes and achieves SOTA performance compared to models of the similar size. In addition, our work will be integrated into the MindSpore computing platform in the near future." @default.
- W4386875228 created "2023-09-20" @default.
- W4386875228 creator A5001093841 @default.
- W4386875228 creator A5007124311 @default.
- W4386875228 creator A5016622484 @default.
- W4386875228 creator A5023538862 @default.
- W4386875228 creator A5030129271 @default.
- W4386875228 creator A5053611461 @default.
- W4386875228 creator A5062002874 @default.
- W4386875228 creator A5073939784 @default.
- W4386875228 creator A5084483088 @default.
- W4386875228 creator A5086327001 @default.
- W4386875228 creator A5088174174 @default.
- W4386875228 creator A5089561905 @default.
- W4386875228 date "2023-09-16" @default.
- W4386875228 modified "2023-09-27" @default.
- W4386875228 title "RingMo-lite: A Remote Sensing Multi-task Lightweight Network with CNN-Transformer Hybrid Framework" @default.
- W4386875228 doi "https://doi.org/10.48550/arxiv.2309.09003" @default.
- W4386875228 hasPublicationYear "2023" @default.
- W4386875228 type Work @default.
- W4386875228 citedByCount "0" @default.
- W4386875228 crossrefType "posted-content" @default.
- W4386875228 hasAuthorship W4386875228A5001093841 @default.
- W4386875228 hasAuthorship W4386875228A5007124311 @default.
- W4386875228 hasAuthorship W4386875228A5016622484 @default.
- W4386875228 hasAuthorship W4386875228A5023538862 @default.
- W4386875228 hasAuthorship W4386875228A5030129271 @default.
- W4386875228 hasAuthorship W4386875228A5053611461 @default.
- W4386875228 hasAuthorship W4386875228A5062002874 @default.
- W4386875228 hasAuthorship W4386875228A5073939784 @default.
- W4386875228 hasAuthorship W4386875228A5084483088 @default.
- W4386875228 hasAuthorship W4386875228A5086327001 @default.
- W4386875228 hasAuthorship W4386875228A5088174174 @default.
- W4386875228 hasAuthorship W4386875228A5089561905 @default.
- W4386875228 hasBestOaLocation W43868752281 @default.
- W4386875228 hasConcept C106131492 @default.
- W4386875228 hasConcept C119599485 @default.
- W4386875228 hasConcept C127413603 @default.
- W4386875228 hasConcept C154945302 @default.
- W4386875228 hasConcept C165696696 @default.
- W4386875228 hasConcept C165801399 @default.
- W4386875228 hasConcept C31972630 @default.
- W4386875228 hasConcept C38652104 @default.
- W4386875228 hasConcept C41008148 @default.
- W4386875228 hasConcept C66322947 @default.
- W4386875228 hasConceptScore W4386875228C106131492 @default.
- W4386875228 hasConceptScore W4386875228C119599485 @default.
- W4386875228 hasConceptScore W4386875228C127413603 @default.
- W4386875228 hasConceptScore W4386875228C154945302 @default.
- W4386875228 hasConceptScore W4386875228C165696696 @default.
- W4386875228 hasConceptScore W4386875228C165801399 @default.
- W4386875228 hasConceptScore W4386875228C31972630 @default.
- W4386875228 hasConceptScore W4386875228C38652104 @default.
- W4386875228 hasConceptScore W4386875228C41008148 @default.
- W4386875228 hasConceptScore W4386875228C66322947 @default.
- W4386875228 hasLocation W43868752281 @default.
- W4386875228 hasOpenAccess W4386875228 @default.
- W4386875228 hasPrimaryLocation W43868752281 @default.
- W4386875228 hasRelatedWork W1891287906 @default.
- W4386875228 hasRelatedWork W1969923398 @default.
- W4386875228 hasRelatedWork W2036807459 @default.
- W4386875228 hasRelatedWork W2166024367 @default.
- W4386875228 hasRelatedWork W2331043530 @default.
- W4386875228 hasRelatedWork W2393933887 @default.
- W4386875228 hasRelatedWork W2772917594 @default.
- W4386875228 hasRelatedWork W2775347418 @default.
- W4386875228 hasRelatedWork W2899084033 @default.
- W4386875228 hasRelatedWork W2997512100 @default.
- W4386875228 isParatext "false" @default.
- W4386875228 isRetracted "false" @default.
- W4386875228 workType "article" @default.