Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287113025> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4287113025 abstract "As edge devices become prevalent, deploying Deep Neural Networks (DNN) on edge devices has become a critical issue. However, DNN requires a high computational resource which is rarely available for edge devices. To handle this, we propose a novel model compression method for the devices with limited computational resources, called PQK consisting of pruning, quantization, and knowledge distillation (KD) processes. Unlike traditional pruning and KD, PQK makes use of unimportant weights pruned in the pruning process to make a teacher network for training a better student network without pre-training the teacher model. PQK has two phases. Phase 1 exploits iterative pruning and quantization-aware training to make a lightweight and power-efficient model. In phase 2, we make a teacher network by adding unimportant weights unused in phase 1 to a pruned network. By using this teacher network, we train the pruned network as a student network. In doing so, we do not need a pre-trained teacher network for the KD framework because the teacher and the student networks coexist within the same network. We apply our method to the recognition model and verify the effectiveness of PQK on keyword spotting (KWS) and image recognition." @default.
- W4287113025 created "2022-07-25" @default.
- W4287113025 creator A5018347257 @default.
- W4287113025 creator A5074026358 @default.
- W4287113025 creator A5084897975 @default.
- W4287113025 date "2021-06-25" @default.
- W4287113025 modified "2023-09-24" @default.
- W4287113025 title "PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation" @default.
- W4287113025 doi "https://doi.org/10.48550/arxiv.2106.14681" @default.
- W4287113025 hasPublicationYear "2021" @default.
- W4287113025 type Work @default.
- W4287113025 citedByCount "0" @default.
- W4287113025 crossrefType "posted-content" @default.
- W4287113025 hasAuthorship W4287113025A5018347257 @default.
- W4287113025 hasAuthorship W4287113025A5074026358 @default.
- W4287113025 hasAuthorship W4287113025A5084897975 @default.
- W4287113025 hasBestOaLocation W42871130251 @default.
- W4287113025 hasConcept C108010975 @default.
- W4287113025 hasConcept C111919701 @default.
- W4287113025 hasConcept C11413529 @default.
- W4287113025 hasConcept C119857082 @default.
- W4287113025 hasConcept C138236772 @default.
- W4287113025 hasConcept C154945302 @default.
- W4287113025 hasConcept C162307627 @default.
- W4287113025 hasConcept C165696696 @default.
- W4287113025 hasConcept C28855332 @default.
- W4287113025 hasConcept C38652104 @default.
- W4287113025 hasConcept C41008148 @default.
- W4287113025 hasConcept C50644808 @default.
- W4287113025 hasConcept C6557445 @default.
- W4287113025 hasConcept C79974875 @default.
- W4287113025 hasConcept C86803240 @default.
- W4287113025 hasConcept C98045186 @default.
- W4287113025 hasConceptScore W4287113025C108010975 @default.
- W4287113025 hasConceptScore W4287113025C111919701 @default.
- W4287113025 hasConceptScore W4287113025C11413529 @default.
- W4287113025 hasConceptScore W4287113025C119857082 @default.
- W4287113025 hasConceptScore W4287113025C138236772 @default.
- W4287113025 hasConceptScore W4287113025C154945302 @default.
- W4287113025 hasConceptScore W4287113025C162307627 @default.
- W4287113025 hasConceptScore W4287113025C165696696 @default.
- W4287113025 hasConceptScore W4287113025C28855332 @default.
- W4287113025 hasConceptScore W4287113025C38652104 @default.
- W4287113025 hasConceptScore W4287113025C41008148 @default.
- W4287113025 hasConceptScore W4287113025C50644808 @default.
- W4287113025 hasConceptScore W4287113025C6557445 @default.
- W4287113025 hasConceptScore W4287113025C79974875 @default.
- W4287113025 hasConceptScore W4287113025C86803240 @default.
- W4287113025 hasConceptScore W4287113025C98045186 @default.
- W4287113025 hasLocation W42871130251 @default.
- W4287113025 hasOpenAccess W4287113025 @default.
- W4287113025 hasPrimaryLocation W42871130251 @default.
- W4287113025 hasRelatedWork W3166954785 @default.
- W4287113025 hasRelatedWork W3174517946 @default.
- W4287113025 hasRelatedWork W3196438592 @default.
- W4287113025 hasRelatedWork W3199608561 @default.
- W4287113025 hasRelatedWork W4287113025 @default.
- W4287113025 hasRelatedWork W4293869292 @default.
- W4287113025 hasRelatedWork W4311454612 @default.
- W4287113025 hasRelatedWork W4313656027 @default.
- W4287113025 hasRelatedWork W4316042121 @default.
- W4287113025 hasRelatedWork W1629725936 @default.
- W4287113025 isParatext "false" @default.
- W4287113025 isRetracted "false" @default.
- W4287113025 workType "article" @default.