Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385571296> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4385571296 abstract "Pre-trained seq2seq models have achieved state-of-the-art results in the grammatical error correction task. However, these models still suffer from a prediction bias due to their unidirectional decoding. Thus, we propose a bidirectional Transformer reranker (BTR), that re-estimates the probability of each candidate sentence generated by the pre-trained seq2seq model. The BTR preserves the seq2seq-style Transformer architecture but utilizes a BERT-style self-attention mechanism in the decoder to compute the probability of each target token by using masked language modeling to capture bidirectional representations from the target context. For guiding the reranking, the BTR adopts negative sampling in the objective function to minimize the unlikelihood. During inference, the BTR gives final results after comparing the reranked top-1 results with the original ones by an acceptance threshold. Experimental results show that, in reranking candidates from a pre-trained seq2seq model, T5-base, the BTR on top of T5-base could yield 65.47 and 71.27 F0.5 scores on the CoNLL-14 and BEA test sets, respectively, and yield 59.52 GLEU score on the JFLEG corpus, with improvements of 0.36, 0.76 and 0.48 points compared with the original T5-base. Furthermore, when reranking candidates from T5-large, the BTR on top of T5-base improved the original T5-large by 0.26 points on the BEA test set." @default.
- W4385571296 created "2023-08-05" @default.
- W4385571296 creator A5016936747 @default.
- W4385571296 creator A5035876897 @default.
- W4385571296 creator A5042973046 @default.
- W4385571296 date "2023-01-01" @default.
- W4385571296 modified "2023-09-24" @default.
- W4385571296 title "Bidirectional Transformer Reranker for Grammatical Error Correction" @default.
- W4385571296 doi "https://doi.org/10.18653/v1/2023.findings-acl.234" @default.
- W4385571296 hasPublicationYear "2023" @default.
- W4385571296 type Work @default.
- W4385571296 citedByCount "0" @default.
- W4385571296 crossrefType "proceedings-article" @default.
- W4385571296 hasAuthorship W4385571296A5016936747 @default.
- W4385571296 hasAuthorship W4385571296A5035876897 @default.
- W4385571296 hasAuthorship W4385571296A5042973046 @default.
- W4385571296 hasBestOaLocation W43855712961 @default.
- W4385571296 hasConcept C11413529 @default.
- W4385571296 hasConcept C121332964 @default.
- W4385571296 hasConcept C137293760 @default.
- W4385571296 hasConcept C154945302 @default.
- W4385571296 hasConcept C165801399 @default.
- W4385571296 hasConcept C169903167 @default.
- W4385571296 hasConcept C204321447 @default.
- W4385571296 hasConcept C2776214188 @default.
- W4385571296 hasConcept C2777530160 @default.
- W4385571296 hasConcept C28490314 @default.
- W4385571296 hasConcept C38652104 @default.
- W4385571296 hasConcept C41008148 @default.
- W4385571296 hasConcept C48145219 @default.
- W4385571296 hasConcept C57273362 @default.
- W4385571296 hasConcept C62520636 @default.
- W4385571296 hasConcept C66322947 @default.
- W4385571296 hasConceptScore W4385571296C11413529 @default.
- W4385571296 hasConceptScore W4385571296C121332964 @default.
- W4385571296 hasConceptScore W4385571296C137293760 @default.
- W4385571296 hasConceptScore W4385571296C154945302 @default.
- W4385571296 hasConceptScore W4385571296C165801399 @default.
- W4385571296 hasConceptScore W4385571296C169903167 @default.
- W4385571296 hasConceptScore W4385571296C204321447 @default.
- W4385571296 hasConceptScore W4385571296C2776214188 @default.
- W4385571296 hasConceptScore W4385571296C2777530160 @default.
- W4385571296 hasConceptScore W4385571296C28490314 @default.
- W4385571296 hasConceptScore W4385571296C38652104 @default.
- W4385571296 hasConceptScore W4385571296C41008148 @default.
- W4385571296 hasConceptScore W4385571296C48145219 @default.
- W4385571296 hasConceptScore W4385571296C57273362 @default.
- W4385571296 hasConceptScore W4385571296C62520636 @default.
- W4385571296 hasConceptScore W4385571296C66322947 @default.
- W4385571296 hasLocation W43855712961 @default.
- W4385571296 hasOpenAccess W4385571296 @default.
- W4385571296 hasPrimaryLocation W43855712961 @default.
- W4385571296 hasRelatedWork W159132833 @default.
- W4385571296 hasRelatedWork W2917049097 @default.
- W4385571296 hasRelatedWork W3039805635 @default.
- W4385571296 hasRelatedWork W3138893504 @default.
- W4385571296 hasRelatedWork W3166837672 @default.
- W4385571296 hasRelatedWork W3168991979 @default.
- W4385571296 hasRelatedWork W3184217747 @default.
- W4385571296 hasRelatedWork W4229035991 @default.
- W4385571296 hasRelatedWork W4287253426 @default.
- W4385571296 hasRelatedWork W4377865045 @default.
- W4385571296 isParatext "false" @default.
- W4385571296 isRetracted "false" @default.
- W4385571296 workType "article" @default.