Matches in SemOpenAlex for { <https://semopenalex.org/work/W2091950237> ?p ?o ?g. }
Showing items 1 to 98 of
98
with 100 items per page.
- W2091950237 endingPage "326" @default.
- W2091950237 startingPage "319" @default.
- W2091950237 abstract "In computational linguistics, a reliability measurement of 0.8 on some statistic such as κ is widely thought to guarantee that hand-coded data is fit for purpose, with 0.67 to 0.8 tolerable, and lower values suspect. We demonstrate that the main use of such data, machine learning, can tolerate data with low reliability as long as any disagreement among human coders looks like random noise. When the disagreement introduces patterns, however, the machine learner can pick these up just like it picks up the real patterns in the data, making the performance figures look better than they really are. For the range of reliability measures that the field currently accepts, disagreement can appreciably inflate performance figures, and even a measure of 0.8 does not guarantee that what looks like good performance really is. Although this is a commonsense result, it has implications for how we work. At the very least, computational linguists should look for any patterns in the disagreement among coders and assess what impact they will have." @default.
- W2091950237 created "2016-06-24" @default.
- W2091950237 creator A5010602808 @default.
- W2091950237 creator A5016877609 @default.
- W2091950237 date "2008-09-01" @default.
- W2091950237 modified "2023-10-16" @default.
- W2091950237 title "Reliability Measurement without Limits" @default.
- W2091950237 cites W2053154970 @default.
- W2091950237 cites W2084105614 @default.
- W2091950237 cites W2109600226 @default.
- W2091950237 cites W2112078429 @default.
- W2091950237 cites W2153072998 @default.
- W2091950237 doi "https://doi.org/10.1162/coli.2008.34.3.319" @default.
- W2091950237 hasPublicationYear "2008" @default.
- W2091950237 type Work @default.
- W2091950237 sameAs 2091950237 @default.
- W2091950237 citedByCount "81" @default.
- W2091950237 countsByYear W20919502372012 @default.
- W2091950237 countsByYear W20919502372013 @default.
- W2091950237 countsByYear W20919502372014 @default.
- W2091950237 countsByYear W20919502372015 @default.
- W2091950237 countsByYear W20919502372016 @default.
- W2091950237 countsByYear W20919502372017 @default.
- W2091950237 countsByYear W20919502372018 @default.
- W2091950237 countsByYear W20919502372019 @default.
- W2091950237 countsByYear W20919502372020 @default.
- W2091950237 countsByYear W20919502372021 @default.
- W2091950237 countsByYear W20919502372022 @default.
- W2091950237 countsByYear W20919502372023 @default.
- W2091950237 crossrefType "journal-article" @default.
- W2091950237 hasAuthorship W2091950237A5010602808 @default.
- W2091950237 hasAuthorship W2091950237A5016877609 @default.
- W2091950237 hasBestOaLocation W20919502371 @default.
- W2091950237 hasConcept C105795698 @default.
- W2091950237 hasConcept C119857082 @default.
- W2091950237 hasConcept C121332964 @default.
- W2091950237 hasConcept C124101348 @default.
- W2091950237 hasConcept C154945302 @default.
- W2091950237 hasConcept C15744967 @default.
- W2091950237 hasConcept C159985019 @default.
- W2091950237 hasConcept C163258240 @default.
- W2091950237 hasConcept C192562407 @default.
- W2091950237 hasConcept C202444582 @default.
- W2091950237 hasConcept C204321447 @default.
- W2091950237 hasConcept C204323151 @default.
- W2091950237 hasConcept C2778223634 @default.
- W2091950237 hasConcept C2780009758 @default.
- W2091950237 hasConcept C33923547 @default.
- W2091950237 hasConcept C41008148 @default.
- W2091950237 hasConcept C43214815 @default.
- W2091950237 hasConcept C62520636 @default.
- W2091950237 hasConcept C73484699 @default.
- W2091950237 hasConcept C89128539 @default.
- W2091950237 hasConcept C9652623 @default.
- W2091950237 hasConceptScore W2091950237C105795698 @default.
- W2091950237 hasConceptScore W2091950237C119857082 @default.
- W2091950237 hasConceptScore W2091950237C121332964 @default.
- W2091950237 hasConceptScore W2091950237C124101348 @default.
- W2091950237 hasConceptScore W2091950237C154945302 @default.
- W2091950237 hasConceptScore W2091950237C15744967 @default.
- W2091950237 hasConceptScore W2091950237C159985019 @default.
- W2091950237 hasConceptScore W2091950237C163258240 @default.
- W2091950237 hasConceptScore W2091950237C192562407 @default.
- W2091950237 hasConceptScore W2091950237C202444582 @default.
- W2091950237 hasConceptScore W2091950237C204321447 @default.
- W2091950237 hasConceptScore W2091950237C204323151 @default.
- W2091950237 hasConceptScore W2091950237C2778223634 @default.
- W2091950237 hasConceptScore W2091950237C2780009758 @default.
- W2091950237 hasConceptScore W2091950237C33923547 @default.
- W2091950237 hasConceptScore W2091950237C41008148 @default.
- W2091950237 hasConceptScore W2091950237C43214815 @default.
- W2091950237 hasConceptScore W2091950237C62520636 @default.
- W2091950237 hasConceptScore W2091950237C73484699 @default.
- W2091950237 hasConceptScore W2091950237C89128539 @default.
- W2091950237 hasConceptScore W2091950237C9652623 @default.
- W2091950237 hasIssue "3" @default.
- W2091950237 hasLocation W20919502371 @default.
- W2091950237 hasLocation W20919502372 @default.
- W2091950237 hasLocation W20919502373 @default.
- W2091950237 hasOpenAccess W2091950237 @default.
- W2091950237 hasPrimaryLocation W20919502371 @default.
- W2091950237 hasRelatedWork W207725243 @default.
- W2091950237 hasRelatedWork W2961085424 @default.
- W2091950237 hasRelatedWork W3046775127 @default.
- W2091950237 hasRelatedWork W3170094116 @default.
- W2091950237 hasRelatedWork W4205958290 @default.
- W2091950237 hasRelatedWork W4285260836 @default.
- W2091950237 hasRelatedWork W4286629047 @default.
- W2091950237 hasRelatedWork W4306321456 @default.
- W2091950237 hasRelatedWork W4306674287 @default.
- W2091950237 hasRelatedWork W4224009465 @default.
- W2091950237 hasVolume "34" @default.
- W2091950237 isParatext "false" @default.
- W2091950237 isRetracted "false" @default.
- W2091950237 magId "2091950237" @default.
- W2091950237 workType "article" @default.