FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385479968> ?p ?o ?g. }

• W4385479968 endingPage "121054" @default.
• W4385479968 startingPage "121054" @default.
• W4385479968 abstract "Domain adaptation is a good way to boost BERT’s performance on domain-specific natural language processing (NLP) tasks. Common domain adaptation methods, however, can be deficient in capturing domain knowledge. Meanwhile, the context fragmentation inherent in Transformer-based models also hinders the acquisition of domain knowledge. Considering the semi-structural characteristics of documents and its potential for alleviating these problems, we leverage the semi-structured information of documents to supplement domain knowledge to BERT. To this end, we propose a topic-based domain adaptation method, which enhances the capture of domain knowledge at various levels of text granularity. Specifically, topic masked language modeling is designed at the paragraph level for pre-training; topic subsection matching degree dataset is automatically constructed at the subsection level for intermediate fine-tuning. Experiments are conducted over four biomedical NLP tasks across six datasets. The results show that our method benefits BERT, RoBERTa, SpanBERT, BioBERT, and PubMedBERT in nearly all cases. And we see significant gains in two question answering (QA) tasks, especially customer health QA, the topic-related one, with an average accuracy improvement of 4.8%. Thus, the semi-structured information of documents can be exploited to make BERT capture domain knowledge more effectively." @default.
• W4385479968 created "2023-08-03" @default.
• W4385479968 creator A5004301353 @default.
• W4385479968 creator A5008409894 @default.
• W4385479968 creator A5008912124 @default.
• W4385479968 creator A5024791074 @default.
• W4385479968 creator A5029762841 @default.
• W4385479968 creator A5060183803 @default.
• W4385479968 creator A5062983271 @default.
• W4385479968 date "2024-01-01" @default.
• W4385479968 modified "2023-10-14" @default.
• W4385479968 title "Supplementing domain knowledge to BERT with semi-structured information of documents" @default.
• W4385479968 cites W2009833850 @default.
• W4385479968 cites W2169099542 @default.
• W4385479968 cites W2335791510 @default.
• W4385479968 cites W2781827132 @default.
• W4385479968 cites W2911489562 @default.
• W4385479968 cites W2913352150 @default.
• W4385479968 cites W2964110616 @default.
• W4385479968 cites W2970986790 @default.
• W4385479968 cites W2997200074 @default.
• W4385479968 cites W2998385486 @default.
• W4385479968 cites W3011411500 @default.
• W4385479968 cites W3037869352 @default.
• W4385479968 cites W3099008231 @default.
• W4385479968 cites W3118485687 @default.
• W4385479968 cites W3173870405 @default.
• W4385479968 cites W3198080531 @default.
• W4385479968 cites W3211384762 @default.
• W4385479968 cites W4221153690 @default.
• W4385479968 cites W4310424784 @default.
• W4385479968 doi "https://doi.org/10.1016/j.eswa.2023.121054" @default.
• W4385479968 hasPublicationYear "2024" @default.
• W4385479968 type Work @default.
• W4385479968 citedByCount "0" @default.
• W4385479968 crossrefType "journal-article" @default.
• W4385479968 hasAuthorship W4385479968A5004301353 @default.
• W4385479968 hasAuthorship W4385479968A5008409894 @default.
• W4385479968 hasAuthorship W4385479968A5008912124 @default.
• W4385479968 hasAuthorship W4385479968A5024791074 @default.
• W4385479968 hasAuthorship W4385479968A5029762841 @default.
• W4385479968 hasAuthorship W4385479968A5060183803 @default.
• W4385479968 hasAuthorship W4385479968A5062983271 @default.
• W4385479968 hasConcept C111919701 @default.
• W4385479968 hasConcept C121332964 @default.
• W4385479968 hasConcept C134306372 @default.
• W4385479968 hasConcept C136764020 @default.
• W4385479968 hasConcept C137293760 @default.
• W4385479968 hasConcept C153083717 @default.
• W4385479968 hasConcept C154945302 @default.
• W4385479968 hasConcept C165141518 @default.
• W4385479968 hasConcept C165801399 @default.
• W4385479968 hasConcept C177774035 @default.
• W4385479968 hasConcept C204321447 @default.
• W4385479968 hasConcept C207685749 @default.
• W4385479968 hasConcept C23123220 @default.
• W4385479968 hasConcept C2776434776 @default.
• W4385479968 hasConcept C2777206241 @default.
• W4385479968 hasConcept C33923547 @default.
• W4385479968 hasConcept C36503486 @default.
• W4385479968 hasConcept C41008148 @default.
• W4385479968 hasConcept C62520636 @default.
• W4385479968 hasConcept C66322947 @default.
• W4385479968 hasConcept C71472368 @default.
• W4385479968 hasConcept C95623464 @default.
• W4385479968 hasConceptScore W4385479968C111919701 @default.
• W4385479968 hasConceptScore W4385479968C121332964 @default.
• W4385479968 hasConceptScore W4385479968C134306372 @default.
• W4385479968 hasConceptScore W4385479968C136764020 @default.
• W4385479968 hasConceptScore W4385479968C137293760 @default.
• W4385479968 hasConceptScore W4385479968C153083717 @default.
• W4385479968 hasConceptScore W4385479968C154945302 @default.
• W4385479968 hasConceptScore W4385479968C165141518 @default.
• W4385479968 hasConceptScore W4385479968C165801399 @default.
• W4385479968 hasConceptScore W4385479968C177774035 @default.
• W4385479968 hasConceptScore W4385479968C204321447 @default.
• W4385479968 hasConceptScore W4385479968C207685749 @default.
• W4385479968 hasConceptScore W4385479968C23123220 @default.
• W4385479968 hasConceptScore W4385479968C2776434776 @default.
• W4385479968 hasConceptScore W4385479968C2777206241 @default.
• W4385479968 hasConceptScore W4385479968C33923547 @default.
• W4385479968 hasConceptScore W4385479968C36503486 @default.
• W4385479968 hasConceptScore W4385479968C41008148 @default.
• W4385479968 hasConceptScore W4385479968C62520636 @default.
• W4385479968 hasConceptScore W4385479968C66322947 @default.
• W4385479968 hasConceptScore W4385479968C71472368 @default.
• W4385479968 hasConceptScore W4385479968C95623464 @default.
• W4385479968 hasLocation W43854799681 @default.
• W4385479968 hasOpenAccess W4385479968 @default.
• W4385479968 hasPrimaryLocation W43854799681 @default.
• W4385479968 hasRelatedWork W2011624601 @default.
• W4385479968 hasRelatedWork W2377919138 @default.
• W4385479968 hasRelatedWork W2378857091 @default.
• W4385479968 hasRelatedWork W2491314273 @default.
• W4385479968 hasRelatedWork W2931688134 @default.
• W4385479968 hasRelatedWork W2964094558 @default.
• W4385479968 hasRelatedWork W2999756192 @default.
• W4385479968 hasRelatedWork W4226090359 @default.

• next