Matches in SemOpenAlex for { <https://semopenalex.org/work/W4286231608> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4286231608 abstract "The ever-increasing computational complexity of deep learning models makes their training and deployment difficult on various cloud and edge platforms. Replacing floating-point arithmetic with low-bit integer arithmetic is a promising approach to save energy, memory footprint, and latency of deep learning models. As such, quantization has attracted the attention of researchers in recent years. However, using integer numbers to form a fully functional integer training pipeline including forward pass, back-propagation, and stochastic gradient descent is not studied in detail. Our empirical and mathematical results reveal that integer arithmetic seems to be enough to train deep learning models. Unlike recent proposals, instead of quantization, we directly switch the number representation of computations. Our novel training method forms a fully integer training pipeline that does not change the trajectory of the loss and accuracy compared to floating-point, nor does it need any special hyper-parameter tuning, distribution adjustment, or gradient clipping. Our experimental results show that our proposed method is effective in a wide variety of tasks such as classification (including vision transformers), object detection, and semantic segmentation." @default.
- W4286231608 created "2022-07-21" @default.
- W4286231608 creator A5020178272 @default.
- W4286231608 creator A5022419434 @default.
- W4286231608 creator A5041134247 @default.
- W4286231608 creator A5052855957 @default.
- W4286231608 creator A5060567585 @default.
- W4286231608 date "2022-07-18" @default.
- W4286231608 modified "2023-10-01" @default.
- W4286231608 title "Is Integer Arithmetic Enough for Deep Learning Training?" @default.
- W4286231608 doi "https://doi.org/10.48550/arxiv.2207.08822" @default.
- W4286231608 hasPublicationYear "2022" @default.
- W4286231608 type Work @default.
- W4286231608 citedByCount "0" @default.
- W4286231608 crossrefType "posted-content" @default.
- W4286231608 hasAuthorship W4286231608A5020178272 @default.
- W4286231608 hasAuthorship W4286231608A5022419434 @default.
- W4286231608 hasAuthorship W4286231608A5041134247 @default.
- W4286231608 hasAuthorship W4286231608A5052855957 @default.
- W4286231608 hasAuthorship W4286231608A5060567585 @default.
- W4286231608 hasBestOaLocation W42862316081 @default.
- W4286231608 hasConcept C108583219 @default.
- W4286231608 hasConcept C111919701 @default.
- W4286231608 hasConcept C11413529 @default.
- W4286231608 hasConcept C154945302 @default.
- W4286231608 hasConcept C199360897 @default.
- W4286231608 hasConcept C28855332 @default.
- W4286231608 hasConcept C33923547 @default.
- W4286231608 hasConcept C41008148 @default.
- W4286231608 hasConcept C45374587 @default.
- W4286231608 hasConcept C74912251 @default.
- W4286231608 hasConcept C80444323 @default.
- W4286231608 hasConcept C84211073 @default.
- W4286231608 hasConcept C94375191 @default.
- W4286231608 hasConcept C97137487 @default.
- W4286231608 hasConceptScore W4286231608C108583219 @default.
- W4286231608 hasConceptScore W4286231608C111919701 @default.
- W4286231608 hasConceptScore W4286231608C11413529 @default.
- W4286231608 hasConceptScore W4286231608C154945302 @default.
- W4286231608 hasConceptScore W4286231608C199360897 @default.
- W4286231608 hasConceptScore W4286231608C28855332 @default.
- W4286231608 hasConceptScore W4286231608C33923547 @default.
- W4286231608 hasConceptScore W4286231608C41008148 @default.
- W4286231608 hasConceptScore W4286231608C45374587 @default.
- W4286231608 hasConceptScore W4286231608C74912251 @default.
- W4286231608 hasConceptScore W4286231608C80444323 @default.
- W4286231608 hasConceptScore W4286231608C84211073 @default.
- W4286231608 hasConceptScore W4286231608C94375191 @default.
- W4286231608 hasConceptScore W4286231608C97137487 @default.
- W4286231608 hasLocation W42862316081 @default.
- W4286231608 hasOpenAccess W4286231608 @default.
- W4286231608 hasPrimaryLocation W42862316081 @default.
- W4286231608 hasRelatedWork W1497669095 @default.
- W4286231608 hasRelatedWork W1988006935 @default.
- W4286231608 hasRelatedWork W2055956203 @default.
- W4286231608 hasRelatedWork W2074843875 @default.
- W4286231608 hasRelatedWork W2118569990 @default.
- W4286231608 hasRelatedWork W2120056071 @default.
- W4286231608 hasRelatedWork W2372917341 @default.
- W4286231608 hasRelatedWork W2950918715 @default.
- W4286231608 hasRelatedWork W3128751578 @default.
- W4286231608 hasRelatedWork W2892650353 @default.
- W4286231608 isParatext "false" @default.
- W4286231608 isRetracted "false" @default.
- W4286231608 workType "article" @default.