Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385213036> ?p ?o ?g. }
Showing items 1 to 57 of
57
with 100 items per page.
- W4385213036 abstract "Language models (LMs) like BERT and GPT have revolutionized natural language processing (NLP). However, privacy-sensitive domains, particularly the medical field, face challenges to train LMs due to limited data access and privacy constraints imposed by regulations like the Health Insurance Portability and Accountability Act (HIPPA) and the General Data Protection Regulation (GDPR). Federated learning (FL) offers a decentralized solution that enables collaborative learning while ensuring the preservation of data privacy. In this study, we systematically evaluate FL in medicine across $2$ biomedical NLP tasks using $6$ LMs encompassing $8$ corpora. Our results showed that: 1) FL models consistently outperform LMs trained on individual client's data and sometimes match the model trained with polled data; 2) With the fixed number of total data, LMs trained using FL with more clients exhibit inferior performance, but pre-trained transformer-based models exhibited greater resilience. 3) LMs trained using FL perform nearly on par with the model trained with pooled data when clients' data are IID distributed while exhibiting visible gaps with non-IID data. Our code is available at: https://github.com/PL97/FedNLP" @default.
- W4385213036 created "2023-07-25" @default.
- W4385213036 creator A5011070394 @default.
- W4385213036 creator A5014777892 @default.
- W4385213036 creator A5022245889 @default.
- W4385213036 creator A5065037360 @default.
- W4385213036 creator A5075288827 @default.
- W4385213036 creator A5085574874 @default.
- W4385213036 date "2023-07-20" @default.
- W4385213036 modified "2023-10-16" @default.
- W4385213036 title "A Systematic Evaluation of Federated Learning on Biomedical Natural Language Processing" @default.
- W4385213036 doi "https://doi.org/10.48550/arxiv.2307.11254" @default.
- W4385213036 hasPublicationYear "2023" @default.
- W4385213036 type Work @default.
- W4385213036 citedByCount "0" @default.
- W4385213036 crossrefType "posted-content" @default.
- W4385213036 hasAuthorship W4385213036A5011070394 @default.
- W4385213036 hasAuthorship W4385213036A5014777892 @default.
- W4385213036 hasAuthorship W4385213036A5022245889 @default.
- W4385213036 hasAuthorship W4385213036A5065037360 @default.
- W4385213036 hasAuthorship W4385213036A5075288827 @default.
- W4385213036 hasAuthorship W4385213036A5085574874 @default.
- W4385213036 hasBestOaLocation W43852130361 @default.
- W4385213036 hasConcept C119857082 @default.
- W4385213036 hasConcept C154945302 @default.
- W4385213036 hasConcept C199360897 @default.
- W4385213036 hasConcept C204321447 @default.
- W4385213036 hasConcept C2778306010 @default.
- W4385213036 hasConcept C38652104 @default.
- W4385213036 hasConcept C41008148 @default.
- W4385213036 hasConcept C63000827 @default.
- W4385213036 hasConcept C71745522 @default.
- W4385213036 hasConceptScore W4385213036C119857082 @default.
- W4385213036 hasConceptScore W4385213036C154945302 @default.
- W4385213036 hasConceptScore W4385213036C199360897 @default.
- W4385213036 hasConceptScore W4385213036C204321447 @default.
- W4385213036 hasConceptScore W4385213036C2778306010 @default.
- W4385213036 hasConceptScore W4385213036C38652104 @default.
- W4385213036 hasConceptScore W4385213036C41008148 @default.
- W4385213036 hasConceptScore W4385213036C63000827 @default.
- W4385213036 hasConceptScore W4385213036C71745522 @default.
- W4385213036 hasLocation W43852130361 @default.
- W4385213036 hasOpenAccess W4385213036 @default.
- W4385213036 hasPrimaryLocation W43852130361 @default.
- W4385213036 hasRelatedWork W1517479908 @default.
- W4385213036 hasRelatedWork W1552809133 @default.
- W4385213036 hasRelatedWork W2120994104 @default.
- W4385213036 hasRelatedWork W2211967836 @default.
- W4385213036 hasRelatedWork W2335422921 @default.
- W4385213036 hasRelatedWork W2377544373 @default.
- W4385213036 hasRelatedWork W2784803070 @default.
- W4385213036 hasRelatedWork W3049405423 @default.
- W4385213036 hasRelatedWork W4301229064 @default.
- W4385213036 hasRelatedWork W4380360744 @default.
- W4385213036 isParatext "false" @default.
- W4385213036 isRetracted "false" @default.
- W4385213036 workType "article" @default.