Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287280906> ?p ?o ?g. }
Showing items 1 to 70 of
70
with 100 items per page.
- W4287280906 abstract "Pre-trained language models like BERT achieve superior performances in various NLP tasks without explicit consideration of syntactic information. Meanwhile, syntactic information has been proved to be crucial for the success of NLP applications. However, how to incorporate the syntax trees effectively and efficiently into pre-trained Transformers is still unsettled. In this paper, we address this problem by proposing a novel framework named Syntax-BERT. This framework works in a plug-and-play mode and is applicable to an arbitrary pre-trained checkpoint based on Transformer architecture. Experiments on various datasets of natural language understanding verify the effectiveness of syntax trees and achieve consistent improvement over multiple pre-trained models, including BERT, RoBERTa, and T5." @default.
- W4287280906 created "2022-07-25" @default.
- W4287280906 creator A5018600735 @default.
- W4287280906 creator A5024097240 @default.
- W4287280906 creator A5041619025 @default.
- W4287280906 creator A5056687683 @default.
- W4287280906 creator A5061982597 @default.
- W4287280906 creator A5072548035 @default.
- W4287280906 creator A5086979603 @default.
- W4287280906 date "2021-03-07" @default.
- W4287280906 modified "2023-09-30" @default.
- W4287280906 title "Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees" @default.
- W4287280906 hasPublicationYear "2021" @default.
- W4287280906 type Work @default.
- W4287280906 citedByCount "0" @default.
- W4287280906 crossrefType "posted-content" @default.
- W4287280906 hasAuthorship W4287280906A5018600735 @default.
- W4287280906 hasAuthorship W4287280906A5024097240 @default.
- W4287280906 hasAuthorship W4287280906A5041619025 @default.
- W4287280906 hasAuthorship W4287280906A5056687683 @default.
- W4287280906 hasAuthorship W4287280906A5061982597 @default.
- W4287280906 hasAuthorship W4287280906A5072548035 @default.
- W4287280906 hasAuthorship W4287280906A5086979603 @default.
- W4287280906 hasBestOaLocation W42872809061 @default.
- W4287280906 hasConcept C114408938 @default.
- W4287280906 hasConcept C119599485 @default.
- W4287280906 hasConcept C123657996 @default.
- W4287280906 hasConcept C127413603 @default.
- W4287280906 hasConcept C137293760 @default.
- W4287280906 hasConcept C142362112 @default.
- W4287280906 hasConcept C153349607 @default.
- W4287280906 hasConcept C154945302 @default.
- W4287280906 hasConcept C165801399 @default.
- W4287280906 hasConcept C199360897 @default.
- W4287280906 hasConcept C204321447 @default.
- W4287280906 hasConcept C41008148 @default.
- W4287280906 hasConcept C58646249 @default.
- W4287280906 hasConcept C60048249 @default.
- W4287280906 hasConcept C66322947 @default.
- W4287280906 hasConceptScore W4287280906C114408938 @default.
- W4287280906 hasConceptScore W4287280906C119599485 @default.
- W4287280906 hasConceptScore W4287280906C123657996 @default.
- W4287280906 hasConceptScore W4287280906C127413603 @default.
- W4287280906 hasConceptScore W4287280906C137293760 @default.
- W4287280906 hasConceptScore W4287280906C142362112 @default.
- W4287280906 hasConceptScore W4287280906C153349607 @default.
- W4287280906 hasConceptScore W4287280906C154945302 @default.
- W4287280906 hasConceptScore W4287280906C165801399 @default.
- W4287280906 hasConceptScore W4287280906C199360897 @default.
- W4287280906 hasConceptScore W4287280906C204321447 @default.
- W4287280906 hasConceptScore W4287280906C41008148 @default.
- W4287280906 hasConceptScore W4287280906C58646249 @default.
- W4287280906 hasConceptScore W4287280906C60048249 @default.
- W4287280906 hasConceptScore W4287280906C66322947 @default.
- W4287280906 hasLocation W42872809061 @default.
- W4287280906 hasOpenAccess W4287280906 @default.
- W4287280906 hasPrimaryLocation W42872809061 @default.
- W4287280906 hasRelatedWork W10008401 @default.
- W4287280906 hasRelatedWork W10134083 @default.
- W4287280906 hasRelatedWork W10649057 @default.
- W4287280906 hasRelatedWork W11970888 @default.
- W4287280906 hasRelatedWork W12785170 @default.
- W4287280906 hasRelatedWork W4274387 @default.
- W4287280906 hasRelatedWork W5821902 @default.
- W4287280906 hasRelatedWork W7345390 @default.
- W4287280906 hasRelatedWork W9489562 @default.
- W4287280906 hasRelatedWork W9668804 @default.
- W4287280906 isParatext "false" @default.
- W4287280906 isRetracted "false" @default.
- W4287280906 workType "article" @default.