Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287630480> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W4287630480 abstract "Leveraging large amounts of unlabeled data using Transformer-like architectures, like BERT, has gained popularity in recent times owing to their effectiveness in learning general representations that can then be further fine-tuned for downstream tasks to much success. However, training these models can be costly both from an economic and environmental standpoint. In this work, we investigate how to effectively use unlabeled data: by exploring the task-specific semi-supervised approach, Cross-View Training (CVT) and comparing it with task-agnostic BERT in multiple settings that include domain and task relevant English data. CVT uses a much lighter model architecture and we show that it achieves similar performance to BERT on a set of sequence tagging tasks, with lesser financial and environmental impact." @default.
- W4287630480 created "2022-07-25" @default.
- W4287630480 creator A5009821010 @default.
- W4287630480 creator A5043262011 @default.
- W4287630480 creator A5048817662 @default.
- W4287630480 creator A5074277807 @default.
- W4287630480 creator A5079875307 @default.
- W4287630480 creator A5085329545 @default.
- W4287630480 creator A5090283553 @default.
- W4287630480 date "2020-10-27" @default.
- W4287630480 modified "2023-10-18" @default.
- W4287630480 title "To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging" @default.
- W4287630480 doi "https://doi.org/10.48550/arxiv.2010.14042" @default.
- W4287630480 hasPublicationYear "2020" @default.
- W4287630480 type Work @default.
- W4287630480 citedByCount "0" @default.
- W4287630480 crossrefType "posted-content" @default.
- W4287630480 hasAuthorship W4287630480A5009821010 @default.
- W4287630480 hasAuthorship W4287630480A5043262011 @default.
- W4287630480 hasAuthorship W4287630480A5048817662 @default.
- W4287630480 hasAuthorship W4287630480A5074277807 @default.
- W4287630480 hasAuthorship W4287630480A5079875307 @default.
- W4287630480 hasAuthorship W4287630480A5085329545 @default.
- W4287630480 hasAuthorship W4287630480A5090283553 @default.
- W4287630480 hasBestOaLocation W42876304801 @default.
- W4287630480 hasConcept C119599485 @default.
- W4287630480 hasConcept C119857082 @default.
- W4287630480 hasConcept C127413603 @default.
- W4287630480 hasConcept C154945302 @default.
- W4287630480 hasConcept C15744967 @default.
- W4287630480 hasConcept C165801399 @default.
- W4287630480 hasConcept C177264268 @default.
- W4287630480 hasConcept C199360897 @default.
- W4287630480 hasConcept C201995342 @default.
- W4287630480 hasConcept C204321447 @default.
- W4287630480 hasConcept C2776145971 @default.
- W4287630480 hasConcept C2778112365 @default.
- W4287630480 hasConcept C2780451532 @default.
- W4287630480 hasConcept C2780586970 @default.
- W4287630480 hasConcept C35639132 @default.
- W4287630480 hasConcept C41008148 @default.
- W4287630480 hasConcept C51632099 @default.
- W4287630480 hasConcept C54355233 @default.
- W4287630480 hasConcept C66322947 @default.
- W4287630480 hasConcept C77805123 @default.
- W4287630480 hasConcept C86803240 @default.
- W4287630480 hasConceptScore W4287630480C119599485 @default.
- W4287630480 hasConceptScore W4287630480C119857082 @default.
- W4287630480 hasConceptScore W4287630480C127413603 @default.
- W4287630480 hasConceptScore W4287630480C154945302 @default.
- W4287630480 hasConceptScore W4287630480C15744967 @default.
- W4287630480 hasConceptScore W4287630480C165801399 @default.
- W4287630480 hasConceptScore W4287630480C177264268 @default.
- W4287630480 hasConceptScore W4287630480C199360897 @default.
- W4287630480 hasConceptScore W4287630480C201995342 @default.
- W4287630480 hasConceptScore W4287630480C204321447 @default.
- W4287630480 hasConceptScore W4287630480C2776145971 @default.
- W4287630480 hasConceptScore W4287630480C2778112365 @default.
- W4287630480 hasConceptScore W4287630480C2780451532 @default.
- W4287630480 hasConceptScore W4287630480C2780586970 @default.
- W4287630480 hasConceptScore W4287630480C35639132 @default.
- W4287630480 hasConceptScore W4287630480C41008148 @default.
- W4287630480 hasConceptScore W4287630480C51632099 @default.
- W4287630480 hasConceptScore W4287630480C54355233 @default.
- W4287630480 hasConceptScore W4287630480C66322947 @default.
- W4287630480 hasConceptScore W4287630480C77805123 @default.
- W4287630480 hasConceptScore W4287630480C86803240 @default.
- W4287630480 hasLocation W42876304801 @default.
- W4287630480 hasOpenAccess W4287630480 @default.
- W4287630480 hasPrimaryLocation W42876304801 @default.
- W4287630480 hasRelatedWork W10719664 @default.
- W4287630480 hasRelatedWork W10961682 @default.
- W4287630480 hasRelatedWork W11584726 @default.
- W4287630480 hasRelatedWork W13607926 @default.
- W4287630480 hasRelatedWork W13978995 @default.
- W4287630480 hasRelatedWork W149980 @default.
- W4287630480 hasRelatedWork W382276 @default.
- W4287630480 hasRelatedWork W6169193 @default.
- W4287630480 hasRelatedWork W6869908 @default.
- W4287630480 hasRelatedWork W881173 @default.
- W4287630480 isParatext "false" @default.
- W4287630480 isRetracted "false" @default.
- W4287630480 workType "article" @default.