FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3211384762> ?p ?o ?g. }

• W3211384762 abstract "Domain-specific pre-trained language models (PLMs) have achieved great success over various downstream tasks in different domains. However, existing domain-specific PLMs mostly rely on self-supervised learning over large amounts of domain text, without explicitly integrating domain-specific knowledge, which can be essential in many domains. Moreover, in knowledge-sensitive areas such as the biomedical domain, knowledge is stored in multiple sources and formats, and existing biomedical PLMs either neglect them or utilize them in a limited manner. In this work, we introduce an architecture to integrate domain knowledge from diverse sources into PLMs in a parameter-efficient way. More specifically, we propose to encode domain knowledge via adapters, which are small bottleneck feed-forward networks inserted between intermediate transformer layers in PLMs. These knowledge adapters are pre-trained for individual domain knowledge sources and integrated via an attention-based knowledge controller to enrich PLMs. Taking the biomedical domain as a case study, we explore three knowledge-specific adapters for PLMs based on the UMLS Metathesaurus graph, the Wikipedia articles for diseases, and the semantic grouping information for biomedical concepts. Extensive experiments on different biomedical NLP tasks and datasets demonstrate the benefits of the proposed architecture and the knowledge-specific adapters across multiple PLMs." @default.
• W3211384762 created "2021-11-22" @default.
• W3211384762 creator A5023436656 @default.
• W3211384762 creator A5061796051 @default.
• W3211384762 creator A5066063885 @default.
• W3211384762 date "2021-01-01" @default.
• W3211384762 modified "2023-10-13" @default.
• W3211384762 title "Parameter-Efficient Domain Knowledge Integration from Multiple Sources for Biomedical Pre-trained Language Models" @default.
• W3211384762 cites W2115871101 @default.
• W3211384762 cites W2169099542 @default.
• W3211384762 cites W2887528103 @default.
• W3211384762 cites W2888120268 @default.
• W3211384762 cites W2911489562 @default.
• W3211384762 cites W2937845937 @default.
• W3211384762 cites W2952867657 @default.
• W3211384762 cites W2953356739 @default.
• W3211384762 cites W2963211188 @default.
• W3211384762 cites W2963341956 @default.
• W3211384762 cites W2963403868 @default.
• W3211384762 cites W2963716420 @default.
• W3211384762 cites W2964242047 @default.
• W3211384762 cites W2964303773 @default.
• W3211384762 cites W2965373594 @default.
• W3211384762 cites W2970771982 @default.
• W3211384762 cites W2970986510 @default.
• W3211384762 cites W2970986790 @default.
• W3211384762 cites W2971258845 @default.
• W3211384762 cites W2972167903 @default.
• W3211384762 cites W2987154291 @default.
• W3211384762 cites W2996428491 @default.
• W3211384762 cites W3005441132 @default.
• W3211384762 cites W3026990524 @default.
• W3211384762 cites W3035153870 @default.
• W3211384762 cites W3037965442 @default.
• W3211384762 cites W3093553144 @default.
• W3211384762 cites W3099793224 @default.
• W3211384762 cites W3105892552 @default.
• W3211384762 cites W3113280695 @default.
• W3211384762 cites W3114916066 @default.
• W3211384762 cites W3117339789 @default.
• W3211384762 cites W3118485687 @default.
• W3211384762 cites W3151929433 @default.
• W3211384762 cites W3153675281 @default.
• W3211384762 cites W3214715529 @default.
• W3211384762 doi "https://doi.org/10.18653/v1/2021.findings-emnlp.325" @default.
• W3211384762 hasPublicationYear "2021" @default.
• W3211384762 type Work @default.
• W3211384762 sameAs 3211384762 @default.
• W3211384762 citedByCount "2" @default.
• W3211384762 countsByYear W32113847622023 @default.
• W3211384762 crossrefType "proceedings-article" @default.
• W3211384762 hasAuthorship W3211384762A5023436656 @default.
• W3211384762 hasAuthorship W3211384762A5061796051 @default.
• W3211384762 hasAuthorship W3211384762A5066063885 @default.
• W3211384762 hasBestOaLocation W32113847621 @default.
• W3211384762 hasConcept C104317684 @default.
• W3211384762 hasConcept C119857082 @default.
• W3211384762 hasConcept C121332964 @default.
• W3211384762 hasConcept C134306372 @default.
• W3211384762 hasConcept C137293760 @default.
• W3211384762 hasConcept C149635348 @default.
• W3211384762 hasConcept C154945302 @default.
• W3211384762 hasConcept C165801399 @default.
• W3211384762 hasConcept C185592680 @default.
• W3211384762 hasConcept C204321447 @default.
• W3211384762 hasConcept C207685749 @default.
• W3211384762 hasConcept C2780513914 @default.
• W3211384762 hasConcept C2987255567 @default.
• W3211384762 hasConcept C33923547 @default.
• W3211384762 hasConcept C36503486 @default.
• W3211384762 hasConcept C41008148 @default.
• W3211384762 hasConcept C55493867 @default.
• W3211384762 hasConcept C62520636 @default.
• W3211384762 hasConcept C66322947 @default.
• W3211384762 hasConcept C66746571 @default.
• W3211384762 hasConcept C69505689 @default.
• W3211384762 hasConceptScore W3211384762C104317684 @default.
• W3211384762 hasConceptScore W3211384762C119857082 @default.
• W3211384762 hasConceptScore W3211384762C121332964 @default.
• W3211384762 hasConceptScore W3211384762C134306372 @default.
• W3211384762 hasConceptScore W3211384762C137293760 @default.
• W3211384762 hasConceptScore W3211384762C149635348 @default.
• W3211384762 hasConceptScore W3211384762C154945302 @default.
• W3211384762 hasConceptScore W3211384762C165801399 @default.
• W3211384762 hasConceptScore W3211384762C185592680 @default.
• W3211384762 hasConceptScore W3211384762C204321447 @default.
• W3211384762 hasConceptScore W3211384762C207685749 @default.
• W3211384762 hasConceptScore W3211384762C2780513914 @default.
• W3211384762 hasConceptScore W3211384762C2987255567 @default.
• W3211384762 hasConceptScore W3211384762C33923547 @default.
• W3211384762 hasConceptScore W3211384762C36503486 @default.
• W3211384762 hasConceptScore W3211384762C41008148 @default.
• W3211384762 hasConceptScore W3211384762C55493867 @default.
• W3211384762 hasConceptScore W3211384762C62520636 @default.
• W3211384762 hasConceptScore W3211384762C66322947 @default.
• W3211384762 hasConceptScore W3211384762C66746571 @default.
• W3211384762 hasConceptScore W3211384762C69505689 @default.
• W3211384762 hasLocation W32113847621 @default.
• W3211384762 hasOpenAccess W3211384762 @default.
• W3211384762 hasPrimaryLocation W32113847621 @default.

• next