Matches in SemOpenAlex for { <https://semopenalex.org/work/W3035030897> ?p ?o ?g. }
- W3035030897 abstract "Pre-trained language models like BERT have proven to be highly performant. However, they are often computationally expensive in many practical scenarios, for such heavy models can hardly be readily implemented with limited resources. To improve their efficiency with an assured model performance, we propose a novel speed-tunable FastBERT with adaptive inference time. The speed at inference can be flexibly adjusted under varying demands, while redundant calculation of samples is avoided. Moreover, this model adopts a unique self-distillation mechanism at fine-tuning, further enabling a greater computational efficacy with minimal loss in performance. Our model achieves promising results in twelve English and Chinese datasets. It is able to speed up by a wide range from 1 to 12 times than BERT if given different speedup thresholds to make a speed-performance tradeoff." @default.
- W3035030897 created "2020-06-19" @default.
- W3035030897 creator A5009052597 @default.
- W3035030897 creator A5015729655 @default.
- W3035030897 creator A5033908586 @default.
- W3035030897 creator A5059929869 @default.
- W3035030897 creator A5071290194 @default.
- W3035030897 creator A5080930142 @default.
- W3035030897 date "2020-01-01" @default.
- W3035030897 modified "2023-10-04" @default.
- W3035030897 title "FastBERT: a Self-distilling BERT with Adaptive Inference Time" @default.
- W3035030897 cites W1724438581 @default.
- W3035030897 cites W1821462560 @default.
- W3035030897 cites W1832693441 @default.
- W3035030897 cites W2325237720 @default.
- W3035030897 cites W2562731582 @default.
- W3035030897 cites W2798754355 @default.
- W3035030897 cites W2876111955 @default.
- W3035030897 cites W2895351178 @default.
- W3035030897 cites W2923014074 @default.
- W3035030897 cites W2938830017 @default.
- W3035030897 cites W2962677625 @default.
- W3035030897 cites W2962739339 @default.
- W3035030897 cites W2963012544 @default.
- W3035030897 cites W2963341956 @default.
- W3035030897 cites W2963403868 @default.
- W3035030897 cites W2963674932 @default.
- W3035030897 cites W2964118293 @default.
- W3035030897 cites W2965373594 @default.
- W3035030897 cites W2970120757 @default.
- W3035030897 cites W2970390493 @default.
- W3035030897 cites W2970454332 @default.
- W3035030897 cites W2970597249 @default.
- W3035030897 cites W2978017171 @default.
- W3035030897 cites W2996428491 @default.
- W3035030897 cites W2998385486 @default.
- W3035030897 cites W3082274269 @default.
- W3035030897 cites W3105966348 @default.
- W3035030897 cites W3210120707 @default.
- W3035030897 doi "https://doi.org/10.18653/v1/2020.acl-main.537" @default.
- W3035030897 hasPublicationYear "2020" @default.
- W3035030897 type Work @default.
- W3035030897 sameAs 3035030897 @default.
- W3035030897 citedByCount "87" @default.
- W3035030897 countsByYear W30350308972020 @default.
- W3035030897 countsByYear W30350308972021 @default.
- W3035030897 countsByYear W30350308972022 @default.
- W3035030897 countsByYear W30350308972023 @default.
- W3035030897 crossrefType "proceedings-article" @default.
- W3035030897 hasAuthorship W3035030897A5009052597 @default.
- W3035030897 hasAuthorship W3035030897A5015729655 @default.
- W3035030897 hasAuthorship W3035030897A5033908586 @default.
- W3035030897 hasAuthorship W3035030897A5059929869 @default.
- W3035030897 hasAuthorship W3035030897A5071290194 @default.
- W3035030897 hasAuthorship W3035030897A5080930142 @default.
- W3035030897 hasBestOaLocation W30350308971 @default.
- W3035030897 hasConcept C113775141 @default.
- W3035030897 hasConcept C11413529 @default.
- W3035030897 hasConcept C137293760 @default.
- W3035030897 hasConcept C147297375 @default.
- W3035030897 hasConcept C154945302 @default.
- W3035030897 hasConcept C159985019 @default.
- W3035030897 hasConcept C173608175 @default.
- W3035030897 hasConcept C178790620 @default.
- W3035030897 hasConcept C185592680 @default.
- W3035030897 hasConcept C192562407 @default.
- W3035030897 hasConcept C204030448 @default.
- W3035030897 hasConcept C204323151 @default.
- W3035030897 hasConcept C2776214188 @default.
- W3035030897 hasConcept C41008148 @default.
- W3035030897 hasConcept C68339613 @default.
- W3035030897 hasConceptScore W3035030897C113775141 @default.
- W3035030897 hasConceptScore W3035030897C11413529 @default.
- W3035030897 hasConceptScore W3035030897C137293760 @default.
- W3035030897 hasConceptScore W3035030897C147297375 @default.
- W3035030897 hasConceptScore W3035030897C154945302 @default.
- W3035030897 hasConceptScore W3035030897C159985019 @default.
- W3035030897 hasConceptScore W3035030897C173608175 @default.
- W3035030897 hasConceptScore W3035030897C178790620 @default.
- W3035030897 hasConceptScore W3035030897C185592680 @default.
- W3035030897 hasConceptScore W3035030897C192562407 @default.
- W3035030897 hasConceptScore W3035030897C204030448 @default.
- W3035030897 hasConceptScore W3035030897C204323151 @default.
- W3035030897 hasConceptScore W3035030897C2776214188 @default.
- W3035030897 hasConceptScore W3035030897C41008148 @default.
- W3035030897 hasConceptScore W3035030897C68339613 @default.
- W3035030897 hasLocation W30350308971 @default.
- W3035030897 hasLocation W30350308972 @default.
- W3035030897 hasOpenAccess W3035030897 @default.
- W3035030897 hasPrimaryLocation W30350308971 @default.
- W3035030897 hasRelatedWork W2752721426 @default.
- W3035030897 hasRelatedWork W2981519481 @default.
- W3035030897 hasRelatedWork W3014568172 @default.
- W3035030897 hasRelatedWork W3035030897 @default.
- W3035030897 hasRelatedWork W3104738015 @default.
- W3035030897 hasRelatedWork W4285077633 @default.
- W3035030897 hasRelatedWork W4286233754 @default.
- W3035030897 hasRelatedWork W4296563896 @default.
- W3035030897 hasRelatedWork W4307933444 @default.
- W3035030897 hasRelatedWork W4378806073 @default.