Matches in SemOpenAlex for { <https://semopenalex.org/work/W3046551729> ?p ?o ?g. }
- W3046551729 abstract "Clinical studies often require understanding elements of a patient's narrative that exist only in free text clinical notes. To transform notes into structured data for downstream use, these elements are commonly extracted and normalized to medical vocabularies. In this work, we audit the performance of and indicate areas of improvement for state-of-the-art systems. We find that high task accuracies for clinical entity normalization systems on the 2019 n2c2 Shared Task are misleading, and underlying performance is still brittle. Normalization accuracy is high for common concepts (95.3%), but much lower for concepts unseen in training data (69.3%). We demonstrate that current approaches are hindered in part by inconsistencies in medical vocabularies, limitations of existing labeling schemas, and narrow evaluation techniques. We reformulate the annotation framework for clinical entity extraction to factor in these issues to allow for robust end-to-end system benchmarking. We evaluate concordance of annotations from our new framework between two annotators and achieve a Jaccard similarity of 0.73 for entity recognition and an agreement of 0.83 for entity normalization. We propose a path forward to address the demonstrated need for the creation of a reference standard to spur method development in entity recognition and normalization." @default.
- W3046551729 created "2020-08-07" @default.
- W3046551729 creator A5013431623 @default.
- W3046551729 creator A5020782128 @default.
- W3046551729 creator A5039529924 @default.
- W3046551729 creator A5059288920 @default.
- W3046551729 creator A5088961661 @default.
- W3046551729 date "2020-07-31" @default.
- W3046551729 modified "2023-09-27" @default.
- W3046551729 title "Robust Benchmarking for Machine Learning of Clinical Entity Extraction" @default.
- W3046551729 cites W11298561 @default.
- W3046551729 cites W1456257443 @default.
- W3046551729 cites W1871067837 @default.
- W3046551729 cites W1934602670 @default.
- W3046551729 cites W2002514548 @default.
- W3046551729 cites W2004910511 @default.
- W3046551729 cites W2087361167 @default.
- W3046551729 cites W2096252540 @default.
- W3046551729 cites W2103765788 @default.
- W3046551729 cites W2108598243 @default.
- W3046551729 cites W2122402213 @default.
- W3046551729 cites W2143902665 @default.
- W3046551729 cites W2146089916 @default.
- W3046551729 cites W2159583324 @default.
- W3046551729 cites W2168041406 @default.
- W3046551729 cites W2169818249 @default.
- W3046551729 cites W2396881363 @default.
- W3046551729 cites W2735585131 @default.
- W3046551729 cites W2888236192 @default.
- W3046551729 cites W2891469329 @default.
- W3046551729 cites W2904730732 @default.
- W3046551729 cites W2915128229 @default.
- W3046551729 cites W2955483668 @default.
- W3046551729 cites W3011721937 @default.
- W3046551729 cites W42510333 @default.
- W3046551729 hasPublicationYear "2020" @default.
- W3046551729 type Work @default.
- W3046551729 sameAs 3046551729 @default.
- W3046551729 citedByCount "0" @default.
- W3046551729 crossrefType "posted-content" @default.
- W3046551729 hasAuthorship W3046551729A5013431623 @default.
- W3046551729 hasAuthorship W3046551729A5020782128 @default.
- W3046551729 hasAuthorship W3046551729A5039529924 @default.
- W3046551729 hasAuthorship W3046551729A5059288920 @default.
- W3046551729 hasAuthorship W3046551729A5088961661 @default.
- W3046551729 hasConcept C119857082 @default.
- W3046551729 hasConcept C124101348 @default.
- W3046551729 hasConcept C136886441 @default.
- W3046551729 hasConcept C144024400 @default.
- W3046551729 hasConcept C144133560 @default.
- W3046551729 hasConcept C153180895 @default.
- W3046551729 hasConcept C153604712 @default.
- W3046551729 hasConcept C154945302 @default.
- W3046551729 hasConcept C162324750 @default.
- W3046551729 hasConcept C162853370 @default.
- W3046551729 hasConcept C185592680 @default.
- W3046551729 hasConcept C187736073 @default.
- W3046551729 hasConcept C19165224 @default.
- W3046551729 hasConcept C195807954 @default.
- W3046551729 hasConcept C203519979 @default.
- W3046551729 hasConcept C204321447 @default.
- W3046551729 hasConcept C23123220 @default.
- W3046551729 hasConcept C2777146004 @default.
- W3046551729 hasConcept C2779135771 @default.
- W3046551729 hasConcept C2780451532 @default.
- W3046551729 hasConcept C41008148 @default.
- W3046551729 hasConcept C4554734 @default.
- W3046551729 hasConcept C55493867 @default.
- W3046551729 hasConcept C86251818 @default.
- W3046551729 hasConcept C96711827 @default.
- W3046551729 hasConceptScore W3046551729C119857082 @default.
- W3046551729 hasConceptScore W3046551729C124101348 @default.
- W3046551729 hasConceptScore W3046551729C136886441 @default.
- W3046551729 hasConceptScore W3046551729C144024400 @default.
- W3046551729 hasConceptScore W3046551729C144133560 @default.
- W3046551729 hasConceptScore W3046551729C153180895 @default.
- W3046551729 hasConceptScore W3046551729C153604712 @default.
- W3046551729 hasConceptScore W3046551729C154945302 @default.
- W3046551729 hasConceptScore W3046551729C162324750 @default.
- W3046551729 hasConceptScore W3046551729C162853370 @default.
- W3046551729 hasConceptScore W3046551729C185592680 @default.
- W3046551729 hasConceptScore W3046551729C187736073 @default.
- W3046551729 hasConceptScore W3046551729C19165224 @default.
- W3046551729 hasConceptScore W3046551729C195807954 @default.
- W3046551729 hasConceptScore W3046551729C203519979 @default.
- W3046551729 hasConceptScore W3046551729C204321447 @default.
- W3046551729 hasConceptScore W3046551729C23123220 @default.
- W3046551729 hasConceptScore W3046551729C2777146004 @default.
- W3046551729 hasConceptScore W3046551729C2779135771 @default.
- W3046551729 hasConceptScore W3046551729C2780451532 @default.
- W3046551729 hasConceptScore W3046551729C41008148 @default.
- W3046551729 hasConceptScore W3046551729C4554734 @default.
- W3046551729 hasConceptScore W3046551729C55493867 @default.
- W3046551729 hasConceptScore W3046551729C86251818 @default.
- W3046551729 hasConceptScore W3046551729C96711827 @default.
- W3046551729 hasLocation W30465517291 @default.
- W3046551729 hasOpenAccess W3046551729 @default.
- W3046551729 hasPrimaryLocation W30465517291 @default.
- W3046551729 hasRelatedWork W2046844528 @default.
- W3046551729 hasRelatedWork W2113373919 @default.