Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320855504> ?p ?o ?g. }
- W4320855504 abstract "Freezing the pre-trained backbone has become a standard paradigm to avoid overfitting in few-shot segmentation. In this paper, we rethink the paradigm and explore a new regime: {em fine-tuning a small part of parameters in the backbone}. We present a solution to overcome the overfitting problem, leading to better model generalization on learning novel classes. Our method decomposes backbone parameters into three successive matrices via the Singular Value Decomposition (SVD), then {em only fine-tunes the singular values} and keeps others frozen. The above design allows the model to adjust feature representations on novel classes while maintaining semantic clues within the pre-trained backbone. We evaluate our {em Singular Value Fine-tuning (SVF)} approach on various few-shot segmentation methods with different backbones. We achieve state-of-the-art results on both Pascal-5$^i$ and COCO-20$^i$ across 1-shot and 5-shot settings. Hopefully, this simple baseline will encourage researchers to rethink the role of backbone fine-tuning in few-shot settings. The source code and models will be available at https://github.com/syp2ysy/SVF." @default.
- W4320855504 created "2023-02-16" @default.
- W4320855504 creator A5005503474 @default.
- W4320855504 creator A5013260601 @default.
- W4320855504 creator A5017096005 @default.
- W4320855504 creator A5032764121 @default.
- W4320855504 creator A5034832697 @default.
- W4320855504 creator A5050031109 @default.
- W4320855504 creator A5052899332 @default.
- W4320855504 creator A5072506429 @default.
- W4320855504 creator A5073212256 @default.
- W4320855504 creator A5075880303 @default.
- W4320855504 date "2022-06-13" @default.
- W4320855504 modified "2023-09-27" @default.
- W4320855504 title "Singular Value Fine-tuning: Few-shot Segmentation requires Few-parameters Fine-tuning" @default.
- W4320855504 doi "https://doi.org/10.48550/arxiv.2206.06122" @default.
- W4320855504 hasPublicationYear "2022" @default.
- W4320855504 type Work @default.
- W4320855504 citedByCount "0" @default.
- W4320855504 crossrefType "posted-content" @default.
- W4320855504 hasAuthorship W4320855504A5005503474 @default.
- W4320855504 hasAuthorship W4320855504A5013260601 @default.
- W4320855504 hasAuthorship W4320855504A5017096005 @default.
- W4320855504 hasAuthorship W4320855504A5032764121 @default.
- W4320855504 hasAuthorship W4320855504A5034832697 @default.
- W4320855504 hasAuthorship W4320855504A5050031109 @default.
- W4320855504 hasAuthorship W4320855504A5052899332 @default.
- W4320855504 hasAuthorship W4320855504A5072506429 @default.
- W4320855504 hasAuthorship W4320855504A5073212256 @default.
- W4320855504 hasAuthorship W4320855504A5075880303 @default.
- W4320855504 hasBestOaLocation W43208555041 @default.
- W4320855504 hasConcept C109282560 @default.
- W4320855504 hasConcept C11413529 @default.
- W4320855504 hasConcept C120665830 @default.
- W4320855504 hasConcept C121332964 @default.
- W4320855504 hasConcept C134306372 @default.
- W4320855504 hasConcept C138885662 @default.
- W4320855504 hasConcept C153180895 @default.
- W4320855504 hasConcept C154945302 @default.
- W4320855504 hasConcept C158693339 @default.
- W4320855504 hasConcept C177148314 @default.
- W4320855504 hasConcept C177264268 @default.
- W4320855504 hasConcept C178790620 @default.
- W4320855504 hasConcept C185592680 @default.
- W4320855504 hasConcept C199360897 @default.
- W4320855504 hasConcept C22019652 @default.
- W4320855504 hasConcept C22789450 @default.
- W4320855504 hasConcept C2776401178 @default.
- W4320855504 hasConcept C2776760102 @default.
- W4320855504 hasConcept C2778344882 @default.
- W4320855504 hasConcept C3019835501 @default.
- W4320855504 hasConcept C33923547 @default.
- W4320855504 hasConcept C41008148 @default.
- W4320855504 hasConcept C41895202 @default.
- W4320855504 hasConcept C50644808 @default.
- W4320855504 hasConcept C62520636 @default.
- W4320855504 hasConcept C75608658 @default.
- W4320855504 hasConcept C89600930 @default.
- W4320855504 hasConceptScore W4320855504C109282560 @default.
- W4320855504 hasConceptScore W4320855504C11413529 @default.
- W4320855504 hasConceptScore W4320855504C120665830 @default.
- W4320855504 hasConceptScore W4320855504C121332964 @default.
- W4320855504 hasConceptScore W4320855504C134306372 @default.
- W4320855504 hasConceptScore W4320855504C138885662 @default.
- W4320855504 hasConceptScore W4320855504C153180895 @default.
- W4320855504 hasConceptScore W4320855504C154945302 @default.
- W4320855504 hasConceptScore W4320855504C158693339 @default.
- W4320855504 hasConceptScore W4320855504C177148314 @default.
- W4320855504 hasConceptScore W4320855504C177264268 @default.
- W4320855504 hasConceptScore W4320855504C178790620 @default.
- W4320855504 hasConceptScore W4320855504C185592680 @default.
- W4320855504 hasConceptScore W4320855504C199360897 @default.
- W4320855504 hasConceptScore W4320855504C22019652 @default.
- W4320855504 hasConceptScore W4320855504C22789450 @default.
- W4320855504 hasConceptScore W4320855504C2776401178 @default.
- W4320855504 hasConceptScore W4320855504C2776760102 @default.
- W4320855504 hasConceptScore W4320855504C2778344882 @default.
- W4320855504 hasConceptScore W4320855504C3019835501 @default.
- W4320855504 hasConceptScore W4320855504C33923547 @default.
- W4320855504 hasConceptScore W4320855504C41008148 @default.
- W4320855504 hasConceptScore W4320855504C41895202 @default.
- W4320855504 hasConceptScore W4320855504C50644808 @default.
- W4320855504 hasConceptScore W4320855504C62520636 @default.
- W4320855504 hasConceptScore W4320855504C75608658 @default.
- W4320855504 hasConceptScore W4320855504C89600930 @default.
- W4320855504 hasLocation W43208555041 @default.
- W4320855504 hasOpenAccess W4320855504 @default.
- W4320855504 hasPrimaryLocation W43208555041 @default.
- W4320855504 hasRelatedWork W2387675639 @default.
- W4320855504 hasRelatedWork W2913367650 @default.
- W4320855504 hasRelatedWork W2989932438 @default.
- W4320855504 hasRelatedWork W3011512764 @default.
- W4320855504 hasRelatedWork W3012997160 @default.
- W4320855504 hasRelatedWork W3081496756 @default.
- W4320855504 hasRelatedWork W3094668854 @default.
- W4320855504 hasRelatedWork W3149878926 @default.
- W4320855504 hasRelatedWork W3206592002 @default.
- W4320855504 hasRelatedWork W4226288566 @default.
- W4320855504 isParatext "false" @default.
- W4320855504 isRetracted "false" @default.