Matches in SemOpenAlex for { <https://semopenalex.org/work/W2278381402> ?p ?o ?g. }
- W2278381402 endingPage "841" @default.
- W2278381402 startingPage "833" @default.
- W2278381402 abstract "Objective To determine whether assisted annotation using interactive training can reduce the time required to annotate a clinical document corpus without introducing bias. Materials and methods A tool, RapTAT, was designed to assist annotation by iteratively pre-annotating probable phrases of interest within a document, presenting the annotations to a reviewer for correction, and then using the corrected annotations for further machine learning-based training before pre-annotating subsequent documents. Annotators reviewed 404 clinical notes either manually or using RapTAT assistance for concepts related to quality of care during heart failure treatment. Notes were divided into 20 batches of 19–21 documents for iterative annotation and training. Results The number of correct RapTAT pre-annotations increased significantly and annotation time per batch decreased by ∼50% over the course of annotation. Annotation rate increased from batch to batch for assisted but not manual reviewers. Pre-annotation F-measure increased from 0.5 to 0.6 to >0.80 (relative to both assisted reviewer and reference annotations) over the first three batches and more slowly thereafter. Overall inter-annotator agreement was significantly higher between RapTAT-assisted reviewers (0.89) than between manual reviewers (0.85). Discussion The tool reduced workload by decreasing the number of annotations needing to be added and helping reviewers to annotate at an increased rate. Agreement between the pre-annotations and reference standard, and agreement between the pre-annotations and assisted annotations, were similar throughout the annotation process, which suggests that pre-annotation did not introduce bias. Conclusions Pre-annotations generated by a tool capable of interactive training can reduce the time required to create an annotated document corpus by up to 50%." @default.
- W2278381402 created "2016-06-24" @default.
- W2278381402 creator A5001717221 @default.
- W2278381402 creator A5007080037 @default.
- W2278381402 creator A5011689338 @default.
- W2278381402 creator A5020924539 @default.
- W2278381402 creator A5035153302 @default.
- W2278381402 creator A5057054226 @default.
- W2278381402 creator A5057944407 @default.
- W2278381402 creator A5061087403 @default.
- W2278381402 creator A5069068963 @default.
- W2278381402 creator A5071482728 @default.
- W2278381402 creator A5084072550 @default.
- W2278381402 creator A5088109466 @default.
- W2278381402 creator A5090754914 @default.
- W2278381402 date "2014-09-01" @default.
- W2278381402 modified "2023-09-23" @default.
- W2278381402 title "Assisted annotation of medical free text using RapTAT" @default.
- W2278381402 cites W1573942470 @default.
- W2278381402 cites W2009790391 @default.
- W2278381402 cites W2024823706 @default.
- W2278381402 cites W2037835736 @default.
- W2278381402 cites W2047452505 @default.
- W2278381402 cites W2096252540 @default.
- W2278381402 cites W2102575587 @default.
- W2278381402 cites W2112993268 @default.
- W2278381402 cites W2119340816 @default.
- W2278381402 cites W2130451161 @default.
- W2278381402 cites W2132350545 @default.
- W2278381402 cites W2132910334 @default.
- W2278381402 cites W2136552597 @default.
- W2278381402 cites W2144245357 @default.
- W2278381402 cites W2159985898 @default.
- W2278381402 cites W2161880183 @default.
- W2278381402 cites W4211082352 @default.
- W2278381402 doi "https://doi.org/10.1136/amiajnl-2013-002255" @default.
- W2278381402 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/4147611" @default.
- W2278381402 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/24431336" @default.
- W2278381402 hasPublicationYear "2014" @default.
- W2278381402 type Work @default.
- W2278381402 sameAs 2278381402 @default.
- W2278381402 citedByCount "39" @default.
- W2278381402 countsByYear W22783814022014 @default.
- W2278381402 countsByYear W22783814022015 @default.
- W2278381402 countsByYear W22783814022016 @default.
- W2278381402 countsByYear W22783814022017 @default.
- W2278381402 countsByYear W22783814022018 @default.
- W2278381402 countsByYear W22783814022019 @default.
- W2278381402 countsByYear W22783814022020 @default.
- W2278381402 countsByYear W22783814022021 @default.
- W2278381402 countsByYear W22783814022022 @default.
- W2278381402 countsByYear W22783814022023 @default.
- W2278381402 crossrefType "journal-article" @default.
- W2278381402 hasAuthorship W2278381402A5001717221 @default.
- W2278381402 hasAuthorship W2278381402A5007080037 @default.
- W2278381402 hasAuthorship W2278381402A5011689338 @default.
- W2278381402 hasAuthorship W2278381402A5020924539 @default.
- W2278381402 hasAuthorship W2278381402A5035153302 @default.
- W2278381402 hasAuthorship W2278381402A5057054226 @default.
- W2278381402 hasAuthorship W2278381402A5057944407 @default.
- W2278381402 hasAuthorship W2278381402A5061087403 @default.
- W2278381402 hasAuthorship W2278381402A5069068963 @default.
- W2278381402 hasAuthorship W2278381402A5071482728 @default.
- W2278381402 hasAuthorship W2278381402A5084072550 @default.
- W2278381402 hasAuthorship W2278381402A5088109466 @default.
- W2278381402 hasAuthorship W2278381402A5090754914 @default.
- W2278381402 hasBestOaLocation W22783814021 @default.
- W2278381402 hasConcept C111472728 @default.
- W2278381402 hasConcept C111919701 @default.
- W2278381402 hasConcept C138885662 @default.
- W2278381402 hasConcept C154945302 @default.
- W2278381402 hasConcept C204321447 @default.
- W2278381402 hasConcept C23123220 @default.
- W2278381402 hasConcept C2776321320 @default.
- W2278381402 hasConcept C2778476105 @default.
- W2278381402 hasConcept C2779530757 @default.
- W2278381402 hasConcept C41008148 @default.
- W2278381402 hasConcept C98045186 @default.
- W2278381402 hasConceptScore W2278381402C111472728 @default.
- W2278381402 hasConceptScore W2278381402C111919701 @default.
- W2278381402 hasConceptScore W2278381402C138885662 @default.
- W2278381402 hasConceptScore W2278381402C154945302 @default.
- W2278381402 hasConceptScore W2278381402C204321447 @default.
- W2278381402 hasConceptScore W2278381402C23123220 @default.
- W2278381402 hasConceptScore W2278381402C2776321320 @default.
- W2278381402 hasConceptScore W2278381402C2778476105 @default.
- W2278381402 hasConceptScore W2278381402C2779530757 @default.
- W2278381402 hasConceptScore W2278381402C41008148 @default.
- W2278381402 hasConceptScore W2278381402C98045186 @default.
- W2278381402 hasIssue "5" @default.
- W2278381402 hasLocation W22783814021 @default.
- W2278381402 hasLocation W22783814022 @default.
- W2278381402 hasLocation W22783814023 @default.
- W2278381402 hasLocation W22783814024 @default.
- W2278381402 hasOpenAccess W2278381402 @default.
- W2278381402 hasPrimaryLocation W22783814021 @default.
- W2278381402 hasRelatedWork W1529400504 @default.
- W2278381402 hasRelatedWork W1892467659 @default.