Matches in SemOpenAlex for { <https://semopenalex.org/work/W3014568172> ?p ?o ?g. }
Showing items 1 to 97 of
97
with 100 items per page.
- W3014568172 abstract "Pre-trained language models like BERT have proven to be highly performant. However, they are often computationally expensive in many practical scenarios, for such heavy models can hardly be readily implemented with limited resources. To improve their efficiency with an assured model performance, we propose a novel speed-tunable FastBERT with adaptive inference time. The speed at inference can be flexibly adjusted under varying demands, while redundant calculation of samples is avoided. Moreover, this model adopts a unique self-distillation mechanism at fine-tuning, further enabling a greater computational efficacy with minimal loss in performance. Our model achieves promising results in twelve English and Chinese datasets. It is able to speed up by a wide range from 1 to 12 times than BERT if given different speedup thresholds to make a speed-performance tradeoff." @default.
- W3014568172 created "2020-04-10" @default.
- W3014568172 creator A5009052597 @default.
- W3014568172 creator A5015729655 @default.
- W3014568172 creator A5033908586 @default.
- W3014568172 creator A5059929869 @default.
- W3014568172 creator A5071290194 @default.
- W3014568172 creator A5080930142 @default.
- W3014568172 date "2020-04-05" @default.
- W3014568172 modified "2023-10-17" @default.
- W3014568172 title "FastBERT: a Self-distilling BERT with Adaptive Inference Time" @default.
- W3014568172 cites W1690739335 @default.
- W3014568172 cites W1724438581 @default.
- W3014568172 cites W1821462560 @default.
- W3014568172 cites W1832693441 @default.
- W3014568172 cites W2325237720 @default.
- W3014568172 cites W2562731582 @default.
- W3014568172 cites W2798754355 @default.
- W3014568172 cites W2876111955 @default.
- W3014568172 cites W2895351178 @default.
- W3014568172 cites W2923014074 @default.
- W3014568172 cites W2938830017 @default.
- W3014568172 cites W2950541952 @default.
- W3014568172 cites W2950813464 @default.
- W3014568172 cites W2962677625 @default.
- W3014568172 cites W2962739339 @default.
- W3014568172 cites W2963012544 @default.
- W3014568172 cites W2963341956 @default.
- W3014568172 cites W2963403868 @default.
- W3014568172 cites W2963674932 @default.
- W3014568172 cites W2965373594 @default.
- W3014568172 cites W2970120757 @default.
- W3014568172 cites W2970390493 @default.
- W3014568172 cites W2970454332 @default.
- W3014568172 cites W2975059944 @default.
- W3014568172 cites W2978017171 @default.
- W3014568172 cites W2981852735 @default.
- W3014568172 cites W2998385486 @default.
- W3014568172 cites W3105966348 @default.
- W3014568172 cites W3210120707 @default.
- W3014568172 doi "https://doi.org/10.48550/arxiv.2004.02178" @default.
- W3014568172 hasPublicationYear "2020" @default.
- W3014568172 type Work @default.
- W3014568172 sameAs 3014568172 @default.
- W3014568172 citedByCount "28" @default.
- W3014568172 countsByYear W30145681722019 @default.
- W3014568172 countsByYear W30145681722020 @default.
- W3014568172 countsByYear W30145681722021 @default.
- W3014568172 crossrefType "posted-content" @default.
- W3014568172 hasAuthorship W3014568172A5009052597 @default.
- W3014568172 hasAuthorship W3014568172A5015729655 @default.
- W3014568172 hasAuthorship W3014568172A5033908586 @default.
- W3014568172 hasAuthorship W3014568172A5059929869 @default.
- W3014568172 hasAuthorship W3014568172A5071290194 @default.
- W3014568172 hasAuthorship W3014568172A5080930142 @default.
- W3014568172 hasBestOaLocation W30145681721 @default.
- W3014568172 hasConcept C113775141 @default.
- W3014568172 hasConcept C11413529 @default.
- W3014568172 hasConcept C137293760 @default.
- W3014568172 hasConcept C147297375 @default.
- W3014568172 hasConcept C154945302 @default.
- W3014568172 hasConcept C159985019 @default.
- W3014568172 hasConcept C173608175 @default.
- W3014568172 hasConcept C192562407 @default.
- W3014568172 hasConcept C204323151 @default.
- W3014568172 hasConcept C2776214188 @default.
- W3014568172 hasConcept C41008148 @default.
- W3014568172 hasConcept C68339613 @default.
- W3014568172 hasConceptScore W3014568172C113775141 @default.
- W3014568172 hasConceptScore W3014568172C11413529 @default.
- W3014568172 hasConceptScore W3014568172C137293760 @default.
- W3014568172 hasConceptScore W3014568172C147297375 @default.
- W3014568172 hasConceptScore W3014568172C154945302 @default.
- W3014568172 hasConceptScore W3014568172C159985019 @default.
- W3014568172 hasConceptScore W3014568172C173608175 @default.
- W3014568172 hasConceptScore W3014568172C192562407 @default.
- W3014568172 hasConceptScore W3014568172C204323151 @default.
- W3014568172 hasConceptScore W3014568172C2776214188 @default.
- W3014568172 hasConceptScore W3014568172C41008148 @default.
- W3014568172 hasConceptScore W3014568172C68339613 @default.
- W3014568172 hasLocation W30145681721 @default.
- W3014568172 hasOpenAccess W3014568172 @default.
- W3014568172 hasPrimaryLocation W30145681721 @default.
- W3014568172 hasRelatedWork W2752721426 @default.
- W3014568172 hasRelatedWork W3008756425 @default.
- W3014568172 hasRelatedWork W3014568172 @default.
- W3014568172 hasRelatedWork W3104738015 @default.
- W3014568172 hasRelatedWork W3107474891 @default.
- W3014568172 hasRelatedWork W4285077633 @default.
- W3014568172 hasRelatedWork W4285595056 @default.
- W3014568172 hasRelatedWork W4287864142 @default.
- W3014568172 hasRelatedWork W4289528260 @default.
- W3014568172 hasRelatedWork W4307933444 @default.
- W3014568172 isParatext "false" @default.
- W3014568172 isRetracted "false" @default.
- W3014568172 magId "3014568172" @default.
- W3014568172 workType "article" @default.