Matches in SemOpenAlex for { <https://semopenalex.org/work/W3117668840> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W3117668840 abstract "Learn in-situ is a growing trend for Edge AI. Training deep neural network (DNN) on edge devices is challenging because both energy and memory are constrained. Low precision training helps to reduce the energy cost of a single training iteration, but that does not necessarily translate to energy savings for the whole training process, because low precision could slows down the convergence rate. One evidence is that most works for low precision training keep an fp32 copy of the model during training, which in turn imposes memory requirements on edge devices. In this work we propose Adaptive Precision Training. It is able to save both total training energy cost and memory usage at the same time. We use model of the same precision for both forward and backward pass in order to reduce memory usage for training. Through evaluating the progress of training, APT allocates layer-wise precision dynamically so that the model learns quicker for longer time. APT provides an application specific hyper-parameter for users to play trade-off between training energy cost, memory usage and accuracy. Experiment shows that APT achieves more than 50% saving on training energy and memory usage with limited accuracy loss. 20% more savings of training energy and memory usage can be achieved in return for a 1% sacrifice in accuracy loss." @default.
- W3117668840 created "2021-01-05" @default.
- W3117668840 creator A5045125183 @default.
- W3117668840 creator A5050174081 @default.
- W3117668840 creator A5088757275 @default.
- W3117668840 date "2020-12-23" @default.
- W3117668840 modified "2023-10-18" @default.
- W3117668840 title "Adaptive Precision Training for Resource Constrained Devices" @default.
- W3117668840 cites W1677182931 @default.
- W3117668840 cites W2160815625 @default.
- W3117668840 cites W2194775991 @default.
- W3117668840 cites W2405920868 @default.
- W3117668840 cites W2469490737 @default.
- W3117668840 cites W2524428287 @default.
- W3117668840 cites W2560017826 @default.
- W3117668840 cites W2586654419 @default.
- W3117668840 cites W2612445135 @default.
- W3117668840 cites W2626792426 @default.
- W3117668840 cites W2809624076 @default.
- W3117668840 cites W2903260438 @default.
- W3117668840 cites W2947469857 @default.
- W3117668840 cites W2962958489 @default.
- W3117668840 cites W2963163009 @default.
- W3117668840 cites W2963374099 @default.
- W3117668840 cites W2963664311 @default.
- W3117668840 cites W2964004663 @default.
- W3117668840 cites W2964164125 @default.
- W3117668840 cites W2964299589 @default.
- W3117668840 cites W2982479999 @default.
- W3117668840 cites W2987221345 @default.
- W3117668840 cites W2990765879 @default.
- W3117668840 cites W3005714593 @default.
- W3117668840 cites W3118608800 @default.
- W3117668840 doi "https://doi.org/10.48550/arxiv.2012.12775" @default.
- W3117668840 hasPublicationYear "2020" @default.
- W3117668840 type Work @default.
- W3117668840 sameAs 3117668840 @default.
- W3117668840 citedByCount "0" @default.
- W3117668840 crossrefType "posted-content" @default.
- W3117668840 hasAuthorship W3117668840A5045125183 @default.
- W3117668840 hasAuthorship W3117668840A5050174081 @default.
- W3117668840 hasAuthorship W3117668840A5088757275 @default.
- W3117668840 hasBestOaLocation W31176688401 @default.
- W3117668840 hasConcept C105795698 @default.
- W3117668840 hasConcept C111919701 @default.
- W3117668840 hasConcept C121332964 @default.
- W3117668840 hasConcept C138236772 @default.
- W3117668840 hasConcept C153294291 @default.
- W3117668840 hasConcept C154945302 @default.
- W3117668840 hasConcept C162307627 @default.
- W3117668840 hasConcept C162324750 @default.
- W3117668840 hasConcept C186370098 @default.
- W3117668840 hasConcept C2777211547 @default.
- W3117668840 hasConcept C2777303404 @default.
- W3117668840 hasConcept C33923547 @default.
- W3117668840 hasConcept C41008148 @default.
- W3117668840 hasConcept C50522688 @default.
- W3117668840 hasConcept C50644808 @default.
- W3117668840 hasConcept C79403827 @default.
- W3117668840 hasConcept C79974875 @default.
- W3117668840 hasConcept C98045186 @default.
- W3117668840 hasConceptScore W3117668840C105795698 @default.
- W3117668840 hasConceptScore W3117668840C111919701 @default.
- W3117668840 hasConceptScore W3117668840C121332964 @default.
- W3117668840 hasConceptScore W3117668840C138236772 @default.
- W3117668840 hasConceptScore W3117668840C153294291 @default.
- W3117668840 hasConceptScore W3117668840C154945302 @default.
- W3117668840 hasConceptScore W3117668840C162307627 @default.
- W3117668840 hasConceptScore W3117668840C162324750 @default.
- W3117668840 hasConceptScore W3117668840C186370098 @default.
- W3117668840 hasConceptScore W3117668840C2777211547 @default.
- W3117668840 hasConceptScore W3117668840C2777303404 @default.
- W3117668840 hasConceptScore W3117668840C33923547 @default.
- W3117668840 hasConceptScore W3117668840C41008148 @default.
- W3117668840 hasConceptScore W3117668840C50522688 @default.
- W3117668840 hasConceptScore W3117668840C50644808 @default.
- W3117668840 hasConceptScore W3117668840C79403827 @default.
- W3117668840 hasConceptScore W3117668840C79974875 @default.
- W3117668840 hasConceptScore W3117668840C98045186 @default.
- W3117668840 hasLocation W31176688401 @default.
- W3117668840 hasOpenAccess W3117668840 @default.
- W3117668840 hasPrimaryLocation W31176688401 @default.
- W3117668840 hasRelatedWork W12388876 @default.
- W3117668840 hasRelatedWork W13086417 @default.
- W3117668840 hasRelatedWork W21705 @default.
- W3117668840 hasRelatedWork W256534 @default.
- W3117668840 hasRelatedWork W3781714 @default.
- W3117668840 hasRelatedWork W4235637 @default.
- W3117668840 hasRelatedWork W6770330 @default.
- W3117668840 hasRelatedWork W6873763 @default.
- W3117668840 hasRelatedWork W8821115 @default.
- W3117668840 hasRelatedWork W9321062 @default.
- W3117668840 isParatext "false" @default.
- W3117668840 isRetracted "false" @default.
- W3117668840 magId "3117668840" @default.
- W3117668840 workType "article" @default.