Matches in SemOpenAlex for { <https://semopenalex.org/work/W4285204619> ?p ?o ?g. }
Showing items 1 to 66 of
66
with 100 items per page.
- W4285204619 abstract "In this paper, we propose SkipBERT to accelerate BERT inference by skipping the computation of shallow layers. To achieve this, our approach encodes small text chunks into independent representations, which are then materialized to approximate the shallow representation of BERT. Since the use of such approximation is inexpensive compared with transformer calculations, we leverage it to replace the shallow layers of BERT to skip their runtime overhead. With off-the-shelf early exit mechanisms, we also skip redundant computation from the highest few layers to further improve inference efficiency. Results on GLUE show that our approach can reduce latency by 65% without sacrificing performance. By using only two-layer transformer calculations, we can still maintain 95% accuracy of BERT." @default.
- W4285204619 created "2022-07-14" @default.
- W4285204619 creator A5021827617 @default.
- W4285204619 creator A5045067652 @default.
- W4285204619 creator A5049458306 @default.
- W4285204619 creator A5076036593 @default.
- W4285204619 creator A5084188467 @default.
- W4285204619 date "2022-01-01" @default.
- W4285204619 modified "2023-09-25" @default.
- W4285204619 title "SkipBERT: Efficient Inference with Shallow Layer Skipping" @default.
- W4285204619 doi "https://doi.org/10.18653/v1/2022.acl-long.503" @default.
- W4285204619 hasPublicationYear "2022" @default.
- W4285204619 type Work @default.
- W4285204619 citedByCount "1" @default.
- W4285204619 countsByYear W42852046192023 @default.
- W4285204619 crossrefType "proceedings-article" @default.
- W4285204619 hasAuthorship W4285204619A5021827617 @default.
- W4285204619 hasAuthorship W4285204619A5045067652 @default.
- W4285204619 hasAuthorship W4285204619A5049458306 @default.
- W4285204619 hasAuthorship W4285204619A5076036593 @default.
- W4285204619 hasAuthorship W4285204619A5084188467 @default.
- W4285204619 hasBestOaLocation W42852046191 @default.
- W4285204619 hasConcept C113775141 @default.
- W4285204619 hasConcept C11413529 @default.
- W4285204619 hasConcept C119599485 @default.
- W4285204619 hasConcept C127413603 @default.
- W4285204619 hasConcept C153083717 @default.
- W4285204619 hasConcept C154945302 @default.
- W4285204619 hasConcept C165801399 @default.
- W4285204619 hasConcept C173608175 @default.
- W4285204619 hasConcept C2776214188 @default.
- W4285204619 hasConcept C41008148 @default.
- W4285204619 hasConcept C45374587 @default.
- W4285204619 hasConcept C66322947 @default.
- W4285204619 hasConcept C76155785 @default.
- W4285204619 hasConcept C82876162 @default.
- W4285204619 hasConceptScore W4285204619C113775141 @default.
- W4285204619 hasConceptScore W4285204619C11413529 @default.
- W4285204619 hasConceptScore W4285204619C119599485 @default.
- W4285204619 hasConceptScore W4285204619C127413603 @default.
- W4285204619 hasConceptScore W4285204619C153083717 @default.
- W4285204619 hasConceptScore W4285204619C154945302 @default.
- W4285204619 hasConceptScore W4285204619C165801399 @default.
- W4285204619 hasConceptScore W4285204619C173608175 @default.
- W4285204619 hasConceptScore W4285204619C2776214188 @default.
- W4285204619 hasConceptScore W4285204619C41008148 @default.
- W4285204619 hasConceptScore W4285204619C45374587 @default.
- W4285204619 hasConceptScore W4285204619C66322947 @default.
- W4285204619 hasConceptScore W4285204619C76155785 @default.
- W4285204619 hasConceptScore W4285204619C82876162 @default.
- W4285204619 hasLocation W42852046191 @default.
- W4285204619 hasOpenAccess W4285204619 @default.
- W4285204619 hasPrimaryLocation W42852046191 @default.
- W4285204619 hasRelatedWork W1996757432 @default.
- W4285204619 hasRelatedWork W2910518169 @default.
- W4285204619 hasRelatedWork W3037896803 @default.
- W4285204619 hasRelatedWork W3146091044 @default.
- W4285204619 hasRelatedWork W3203166921 @default.
- W4285204619 hasRelatedWork W4214588794 @default.
- W4285204619 hasRelatedWork W4283714288 @default.
- W4285204619 hasRelatedWork W4285327616 @default.
- W4285204619 hasRelatedWork W4287241953 @default.
- W4285204619 hasRelatedWork W4385574170 @default.
- W4285204619 isParatext "false" @default.
- W4285204619 isRetracted "false" @default.
- W4285204619 workType "article" @default.