Matches in SemOpenAlex for { <https://semopenalex.org/work/W3159153780> ?p ?o ?g. }
- W3159153780 abstract "The success of pretrained word embeddings has motivated their use in the biomedical domain, with contextualized embeddings yielding remarkable results in several biomedical NLP tasks. However, there is a lack of research on quantifying their behavior under severe “stress” scenarios. In this work, we systematically evaluate three language models with adversarial examples – automatically constructed tests that allow us to examine how robust the models are. We propose two types of stress scenarios focused on the biomedical named entity recognition (NER) task, one inspired by spelling errors and another based on the use of synonyms for medical terms. Our experiments with three benchmarks show that the performance of the original models decreases considerably, in addition to revealing their weaknesses and strengths. Finally, we show that adversarial training causes the models to improve their robustness and even to exceed the original performance in some cases." @default.
- W3159153780 created "2021-05-10" @default.
- W3159153780 creator A5038755237 @default.
- W3159153780 creator A5039568711 @default.
- W3159153780 creator A5043133456 @default.
- W3159153780 creator A5058447624 @default.
- W3159153780 creator A5087152717 @default.
- W3159153780 date "2021-01-01" @default.
- W3159153780 modified "2023-10-13" @default.
- W3159153780 title "Stress Test Evaluation of Biomedical Word Embeddings" @default.
- W3159153780 cites W1623072288 @default.
- W3159153780 cites W1975084891 @default.
- W3159153780 cites W2034269086 @default.
- W3159153780 cites W2053039860 @default.
- W3159153780 cites W2121879602 @default.
- W3159153780 cites W2138275182 @default.
- W3159153780 cites W2153579005 @default.
- W3159153780 cites W2159583324 @default.
- W3159153780 cites W2169099542 @default.
- W3159153780 cites W2406264638 @default.
- W3159153780 cites W2527896214 @default.
- W3159153780 cites W2735784619 @default.
- W3159153780 cites W2787487383 @default.
- W3159153780 cites W2890430415 @default.
- W3159153780 cites W2924551358 @default.
- W3159153780 cites W2932592714 @default.
- W3159153780 cites W2940009958 @default.
- W3159153780 cites W2955676798 @default.
- W3159153780 cites W2962700793 @default.
- W3159153780 cites W2962739339 @default.
- W3159153780 cites W2963207607 @default.
- W3159153780 cites W2963341956 @default.
- W3159153780 cites W2963394326 @default.
- W3159153780 cites W2963403868 @default.
- W3159153780 cites W2963661177 @default.
- W3159153780 cites W2964153729 @default.
- W3159153780 cites W2971258845 @default.
- W3159153780 cites W3021182036 @default.
- W3159153780 cites W3083306642 @default.
- W3159153780 cites W3106224367 @default.
- W3159153780 doi "https://doi.org/10.18653/v1/2021.bionlp-1.13" @default.
- W3159153780 hasPublicationYear "2021" @default.
- W3159153780 type Work @default.
- W3159153780 sameAs 3159153780 @default.
- W3159153780 citedByCount "4" @default.
- W3159153780 countsByYear W31591537802021 @default.
- W3159153780 crossrefType "proceedings-article" @default.
- W3159153780 hasAuthorship W3159153780A5038755237 @default.
- W3159153780 hasAuthorship W3159153780A5039568711 @default.
- W3159153780 hasAuthorship W3159153780A5043133456 @default.
- W3159153780 hasAuthorship W3159153780A5058447624 @default.
- W3159153780 hasAuthorship W3159153780A5087152717 @default.
- W3159153780 hasBestOaLocation W31591537801 @default.
- W3159153780 hasConcept C10138342 @default.
- W3159153780 hasConcept C104317684 @default.
- W3159153780 hasConcept C119857082 @default.
- W3159153780 hasConcept C137293760 @default.
- W3159153780 hasConcept C138885662 @default.
- W3159153780 hasConcept C154945302 @default.
- W3159153780 hasConcept C162324750 @default.
- W3159153780 hasConcept C185592680 @default.
- W3159153780 hasConcept C187736073 @default.
- W3159153780 hasConcept C204321447 @default.
- W3159153780 hasConcept C21036866 @default.
- W3159153780 hasConcept C2777801307 @default.
- W3159153780 hasConcept C2779201015 @default.
- W3159153780 hasConcept C2780451532 @default.
- W3159153780 hasConcept C37736160 @default.
- W3159153780 hasConcept C41008148 @default.
- W3159153780 hasConcept C41895202 @default.
- W3159153780 hasConcept C55493867 @default.
- W3159153780 hasConcept C63479239 @default.
- W3159153780 hasConcept C90805587 @default.
- W3159153780 hasConceptScore W3159153780C10138342 @default.
- W3159153780 hasConceptScore W3159153780C104317684 @default.
- W3159153780 hasConceptScore W3159153780C119857082 @default.
- W3159153780 hasConceptScore W3159153780C137293760 @default.
- W3159153780 hasConceptScore W3159153780C138885662 @default.
- W3159153780 hasConceptScore W3159153780C154945302 @default.
- W3159153780 hasConceptScore W3159153780C162324750 @default.
- W3159153780 hasConceptScore W3159153780C185592680 @default.
- W3159153780 hasConceptScore W3159153780C187736073 @default.
- W3159153780 hasConceptScore W3159153780C204321447 @default.
- W3159153780 hasConceptScore W3159153780C21036866 @default.
- W3159153780 hasConceptScore W3159153780C2777801307 @default.
- W3159153780 hasConceptScore W3159153780C2779201015 @default.
- W3159153780 hasConceptScore W3159153780C2780451532 @default.
- W3159153780 hasConceptScore W3159153780C37736160 @default.
- W3159153780 hasConceptScore W3159153780C41008148 @default.
- W3159153780 hasConceptScore W3159153780C41895202 @default.
- W3159153780 hasConceptScore W3159153780C55493867 @default.
- W3159153780 hasConceptScore W3159153780C63479239 @default.
- W3159153780 hasConceptScore W3159153780C90805587 @default.
- W3159153780 hasLocation W31591537801 @default.
- W3159153780 hasLocation W31591537802 @default.
- W3159153780 hasOpenAccess W3159153780 @default.
- W3159153780 hasPrimaryLocation W31591537801 @default.
- W3159153780 hasRelatedWork W2035959783 @default.
- W3159153780 hasRelatedWork W2081647779 @default.
- W3159153780 hasRelatedWork W26478703 @default.