Matches in SemOpenAlex for { <https://semopenalex.org/work/W4367191133> ?p ?o ?g. }
Showing items 1 to 53 of
53
with 100 items per page.
- W4367191133 abstract "With growing size of Neural Networks (NNs), model sparsification to reduce the computational cost and memory demand for model inference has become of vital interest for both research and production. While many sparsification methods have been proposed and successfully applied on individual models, to the best of our knowledge their behavior and robustness has not yet been studied on large populations of models. With this paper, we address that gap by applying two popular sparsification methods on populations of models (so called model zoos) to create sparsified versions of the original zoos. We investigate the performance of these two methods for each zoo, compare sparsification layer-wise, and analyse agreement between original and sparsified populations. We find both methods to be very robust with magnitude pruning able outperform variational dropout with the exception of high sparsification ratios above 80%. Further, we find sparsified models agree to a high degree with their original non-sparsified counterpart, and that the performance of original and sparsified model is highly correlated. Finally, all models of the model zoos and their sparsified model twins are publicly available: modelzoos.cc." @default.
- W4367191133 created "2023-04-28" @default.
- W4367191133 creator A5007298146 @default.
- W4367191133 creator A5065722787 @default.
- W4367191133 creator A5076967889 @default.
- W4367191133 date "2023-04-26" @default.
- W4367191133 modified "2023-10-01" @default.
- W4367191133 title "Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models" @default.
- W4367191133 doi "https://doi.org/10.48550/arxiv.2304.13718" @default.
- W4367191133 hasPublicationYear "2023" @default.
- W4367191133 type Work @default.
- W4367191133 citedByCount "0" @default.
- W4367191133 crossrefType "posted-content" @default.
- W4367191133 hasAuthorship W4367191133A5007298146 @default.
- W4367191133 hasAuthorship W4367191133A5065722787 @default.
- W4367191133 hasAuthorship W4367191133A5076967889 @default.
- W4367191133 hasBestOaLocation W43671911331 @default.
- W4367191133 hasConcept C104317684 @default.
- W4367191133 hasConcept C119857082 @default.
- W4367191133 hasConcept C154945302 @default.
- W4367191133 hasConcept C2776145597 @default.
- W4367191133 hasConcept C2776214188 @default.
- W4367191133 hasConcept C41008148 @default.
- W4367191133 hasConcept C50644808 @default.
- W4367191133 hasConcept C55493867 @default.
- W4367191133 hasConcept C63479239 @default.
- W4367191133 hasConcept C86803240 @default.
- W4367191133 hasConceptScore W4367191133C104317684 @default.
- W4367191133 hasConceptScore W4367191133C119857082 @default.
- W4367191133 hasConceptScore W4367191133C154945302 @default.
- W4367191133 hasConceptScore W4367191133C2776145597 @default.
- W4367191133 hasConceptScore W4367191133C2776214188 @default.
- W4367191133 hasConceptScore W4367191133C41008148 @default.
- W4367191133 hasConceptScore W4367191133C50644808 @default.
- W4367191133 hasConceptScore W4367191133C55493867 @default.
- W4367191133 hasConceptScore W4367191133C63479239 @default.
- W4367191133 hasConceptScore W4367191133C86803240 @default.
- W4367191133 hasLocation W43671911331 @default.
- W4367191133 hasOpenAccess W4367191133 @default.
- W4367191133 hasPrimaryLocation W43671911331 @default.
- W4367191133 hasRelatedWork W2032391427 @default.
- W4367191133 hasRelatedWork W2280383998 @default.
- W4367191133 hasRelatedWork W2511279186 @default.
- W4367191133 hasRelatedWork W2963058055 @default.
- W4367191133 hasRelatedWork W3128220493 @default.
- W4367191133 hasRelatedWork W4210794429 @default.
- W4367191133 hasRelatedWork W4280534256 @default.
- W4367191133 hasRelatedWork W4280592718 @default.
- W4367191133 hasRelatedWork W4307654699 @default.
- W4367191133 hasRelatedWork W1629725936 @default.
- W4367191133 isParatext "false" @default.
- W4367191133 isRetracted "false" @default.
- W4367191133 workType "article" @default.