Matches in SemOpenAlex for { <https://semopenalex.org/work/W3102328843> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W3102328843 abstract "The Rectified Linear Unit (ReLU) is a widely used activation function in deep neural networks, and several works are devoted to designing its variants to improve performance. However, the output is unbounded for most of such functions, which brings severe accuracy degeneration when the full-precision model is quantized. To tackle the problem of unboundedness, Choi etal. (2019) introduce an activation clipping parameter for the standard ReLU. In this paper, we propose a Bilateral Clipping Parametric Rectified Linear Unit (BCPReLU) as a generalized version of ReLU and some variants of ReLU. Specifically, the trainable slope and truncation parameters for both positive and negative input are introduced in BCPReLU . We theoretically prove that BCPReLU has almost the same expressive ability as the corresponding unbounded one, and establish its convergence in low-bit quantization training. Numerical experiments on a range of popular models and datasets verify its effectiveness, which outperforms the state-of-the-art methods." @default.
- W3102328843 created "2020-11-23" @default.
- W3102328843 creator A5028401559 @default.
- W3102328843 creator A5049735162 @default.
- W3102328843 creator A5087241722 @default.
- W3102328843 date "2021-05-04" @default.
- W3102328843 modified "2023-09-23" @default.
- W3102328843 title "LEARNING BILATERAL CLIPPING PARAMETRIC ACTIVATION FUNCTION FOR LOW-BIT NEURAL NETWORKS" @default.
- W3102328843 hasPublicationYear "2021" @default.
- W3102328843 type Work @default.
- W3102328843 sameAs 3102328843 @default.
- W3102328843 citedByCount "0" @default.
- W3102328843 crossrefType "journal-article" @default.
- W3102328843 hasAuthorship W3102328843A5028401559 @default.
- W3102328843 hasAuthorship W3102328843A5049735162 @default.
- W3102328843 hasAuthorship W3102328843A5087241722 @default.
- W3102328843 hasConcept C105795698 @default.
- W3102328843 hasConcept C106195933 @default.
- W3102328843 hasConcept C11413529 @default.
- W3102328843 hasConcept C117251300 @default.
- W3102328843 hasConcept C119857082 @default.
- W3102328843 hasConcept C138885662 @default.
- W3102328843 hasConcept C154945302 @default.
- W3102328843 hasConcept C159985019 @default.
- W3102328843 hasConcept C162324750 @default.
- W3102328843 hasConcept C192562407 @default.
- W3102328843 hasConcept C204323151 @default.
- W3102328843 hasConcept C2776848632 @default.
- W3102328843 hasConcept C2777303404 @default.
- W3102328843 hasConcept C28855332 @default.
- W3102328843 hasConcept C33923547 @default.
- W3102328843 hasConcept C38365724 @default.
- W3102328843 hasConcept C41008148 @default.
- W3102328843 hasConcept C41895202 @default.
- W3102328843 hasConcept C50522688 @default.
- W3102328843 hasConcept C50644808 @default.
- W3102328843 hasConceptScore W3102328843C105795698 @default.
- W3102328843 hasConceptScore W3102328843C106195933 @default.
- W3102328843 hasConceptScore W3102328843C11413529 @default.
- W3102328843 hasConceptScore W3102328843C117251300 @default.
- W3102328843 hasConceptScore W3102328843C119857082 @default.
- W3102328843 hasConceptScore W3102328843C138885662 @default.
- W3102328843 hasConceptScore W3102328843C154945302 @default.
- W3102328843 hasConceptScore W3102328843C159985019 @default.
- W3102328843 hasConceptScore W3102328843C162324750 @default.
- W3102328843 hasConceptScore W3102328843C192562407 @default.
- W3102328843 hasConceptScore W3102328843C204323151 @default.
- W3102328843 hasConceptScore W3102328843C2776848632 @default.
- W3102328843 hasConceptScore W3102328843C2777303404 @default.
- W3102328843 hasConceptScore W3102328843C28855332 @default.
- W3102328843 hasConceptScore W3102328843C33923547 @default.
- W3102328843 hasConceptScore W3102328843C38365724 @default.
- W3102328843 hasConceptScore W3102328843C41008148 @default.
- W3102328843 hasConceptScore W3102328843C41895202 @default.
- W3102328843 hasConceptScore W3102328843C50522688 @default.
- W3102328843 hasConceptScore W3102328843C50644808 @default.
- W3102328843 hasLocation W31023288431 @default.
- W3102328843 hasOpenAccess W3102328843 @default.
- W3102328843 hasPrimaryLocation W31023288431 @default.
- W3102328843 hasRelatedWork W1794996182 @default.
- W3102328843 hasRelatedWork W2038570546 @default.
- W3102328843 hasRelatedWork W2059706505 @default.
- W3102328843 hasRelatedWork W2074553321 @default.
- W3102328843 hasRelatedWork W2117830586 @default.
- W3102328843 hasRelatedWork W2462262952 @default.
- W3102328843 hasRelatedWork W2512630954 @default.
- W3102328843 hasRelatedWork W2612887485 @default.
- W3102328843 hasRelatedWork W2770276918 @default.
- W3102328843 hasRelatedWork W2990707590 @default.
- W3102328843 hasRelatedWork W3008104692 @default.
- W3102328843 hasRelatedWork W3008480154 @default.
- W3102328843 hasRelatedWork W3046650080 @default.
- W3102328843 hasRelatedWork W3109377487 @default.
- W3102328843 hasRelatedWork W3118565258 @default.
- W3102328843 hasRelatedWork W3118644081 @default.
- W3102328843 hasRelatedWork W3136275618 @default.
- W3102328843 hasRelatedWork W3177987681 @default.
- W3102328843 hasRelatedWork W3203829001 @default.
- W3102328843 hasRelatedWork W2067631091 @default.
- W3102328843 isParatext "false" @default.
- W3102328843 isRetracted "false" @default.
- W3102328843 magId "3102328843" @default.
- W3102328843 workType "article" @default.