Matches in SemOpenAlex for { <https://semopenalex.org/work/W3211366969> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W3211366969 abstract "During the fine-tuning phase of transfer learning, the pretrained vocabulary remains unchanged, while model parameters are updated. The vocabulary generated based on the pretrained data is suboptimal for downstream data when domain discrepancy exists. We propose to consider the vocabulary as an optimizable parameter, allowing us to update the vocabulary by expanding it with domain-specific vocabulary based on a tokenization statistic. Furthermore, we preserve the embeddings of the added words from overfitting to downstream data by utilizing knowledge learned from a pretrained language model with a regularization term. Our method achieved consistent performance improvements on diverse domains (i.e., biomedical, computer science, news, and reviews)." @default.
- W3211366969 created "2021-11-22" @default.
- W3211366969 creator A5016582283 @default.
- W3211366969 creator A5031885225 @default.
- W3211366969 creator A5047912015 @default.
- W3211366969 creator A5058622539 @default.
- W3211366969 date "2021-10-26" @default.
- W3211366969 modified "2023-10-16" @default.
- W3211366969 title "AVocaDo: Strategy for Adapting Vocabulary to Downstream Domain" @default.
- W3211366969 cites W2027731328 @default.
- W3211366969 cites W2911489562 @default.
- W3211366969 cites W2955041501 @default.
- W3211366969 cites W2962784628 @default.
- W3211366969 cites W2963494889 @default.
- W3211366969 cites W2965373594 @default.
- W3211366969 cites W2970771982 @default.
- W3211366969 cites W2996035354 @default.
- W3211366969 cites W2998554035 @default.
- W3211366969 cites W3034978746 @default.
- W3211366969 doi "https://doi.org/10.48550/arxiv.2110.13434" @default.
- W3211366969 hasPublicationYear "2021" @default.
- W3211366969 type Work @default.
- W3211366969 sameAs 3211366969 @default.
- W3211366969 citedByCount "0" @default.
- W3211366969 crossrefType "posted-content" @default.
- W3211366969 hasAuthorship W3211366969A5016582283 @default.
- W3211366969 hasAuthorship W3211366969A5031885225 @default.
- W3211366969 hasAuthorship W3211366969A5047912015 @default.
- W3211366969 hasAuthorship W3211366969A5058622539 @default.
- W3211366969 hasBestOaLocation W32113669691 @default.
- W3211366969 hasConcept C105795698 @default.
- W3211366969 hasConcept C134306372 @default.
- W3211366969 hasConcept C138885662 @default.
- W3211366969 hasConcept C154945302 @default.
- W3211366969 hasConcept C162324750 @default.
- W3211366969 hasConcept C176982825 @default.
- W3211366969 hasConcept C204321447 @default.
- W3211366969 hasConcept C21547014 @default.
- W3211366969 hasConcept C22019652 @default.
- W3211366969 hasConcept C2776135515 @default.
- W3211366969 hasConcept C2776207758 @default.
- W3211366969 hasConcept C2777601683 @default.
- W3211366969 hasConcept C33923547 @default.
- W3211366969 hasConcept C36503486 @default.
- W3211366969 hasConcept C41008148 @default.
- W3211366969 hasConcept C41895202 @default.
- W3211366969 hasConcept C50644808 @default.
- W3211366969 hasConcept C89128539 @default.
- W3211366969 hasConceptScore W3211366969C105795698 @default.
- W3211366969 hasConceptScore W3211366969C134306372 @default.
- W3211366969 hasConceptScore W3211366969C138885662 @default.
- W3211366969 hasConceptScore W3211366969C154945302 @default.
- W3211366969 hasConceptScore W3211366969C162324750 @default.
- W3211366969 hasConceptScore W3211366969C176982825 @default.
- W3211366969 hasConceptScore W3211366969C204321447 @default.
- W3211366969 hasConceptScore W3211366969C21547014 @default.
- W3211366969 hasConceptScore W3211366969C22019652 @default.
- W3211366969 hasConceptScore W3211366969C2776135515 @default.
- W3211366969 hasConceptScore W3211366969C2776207758 @default.
- W3211366969 hasConceptScore W3211366969C2777601683 @default.
- W3211366969 hasConceptScore W3211366969C33923547 @default.
- W3211366969 hasConceptScore W3211366969C36503486 @default.
- W3211366969 hasConceptScore W3211366969C41008148 @default.
- W3211366969 hasConceptScore W3211366969C41895202 @default.
- W3211366969 hasConceptScore W3211366969C50644808 @default.
- W3211366969 hasConceptScore W3211366969C89128539 @default.
- W3211366969 hasLocation W32113669691 @default.
- W3211366969 hasOpenAccess W3211366969 @default.
- W3211366969 hasPrimaryLocation W32113669691 @default.
- W3211366969 hasRelatedWork W2094694265 @default.
- W3211366969 hasRelatedWork W2327212573 @default.
- W3211366969 hasRelatedWork W2889764925 @default.
- W3211366969 hasRelatedWork W2945392649 @default.
- W3211366969 hasRelatedWork W3035204084 @default.
- W3211366969 hasRelatedWork W3104685001 @default.
- W3211366969 hasRelatedWork W3211152275 @default.
- W3211366969 hasRelatedWork W3211366969 @default.
- W3211366969 hasRelatedWork W4214592684 @default.
- W3211366969 hasRelatedWork W4290058282 @default.
- W3211366969 isParatext "false" @default.
- W3211366969 isRetracted "false" @default.
- W3211366969 magId "3211366969" @default.
- W3211366969 workType "article" @default.