Matches in SemOpenAlex for { <https://semopenalex.org/work/W2112796553> ?p ?o ?g. }
- W2112796553 abstract "We have recently reported on two new word-sense disambiguation systems, one trained on bilingual material (the Canadian Hansards) and the other trained on monolingual material (Roget's Thesaurus and Grolier's Encyclopedia). After using both the monolingual and bilingual classifiers for a few months, we have convinced ourselves that the performance is remarkably good. Nevertheless, we would really like to be able to make a stronger statement, and therefore, we decided to try to develop some more objective evaluation measures. Although there has been a fair amount of literature on sense-disambiguation, the literature does not offer much guidance in how we might establish the success or failure of a proposed solution such as the two systems mentioned in the previous paragraph. Many papers avoid quantitative evaluations altogether, because it is so difficult to come up with credible estimates of performance.This paper will attempt to establish upper and lower bounds on the level of performance that can be expected in an evaluation. An estimate of the lower bound of 75% (averaged over ambiguous types) is obtained by measuring the performance produced by a baseline system that ignores context and simply assigns the most likely sense in all cases. An estimate of the upper bound is obtained by assuming that our ability to measure performance is largely limited by our ability obtain reliable judgments from human informants. Not surprisingly, the upper bound is very dependent on the instructions given to the judges. Jorgensen, for example, suspected that lexicographers tend to depend too much on judgments by a single informant and found considerable variation over judgments (only 68% agreement), as she had suspected. In our own experiments, we have set out to find word-sense disambiguation tasks where the judges can agree often enough so that we could show that they were outperforming the baseline system. Under quite different conditions, we have found 96.8% agreement over judges." @default.
- W2112796553 created "2016-06-24" @default.
- W2112796553 creator A5015876016 @default.
- W2112796553 creator A5016543371 @default.
- W2112796553 creator A5068671901 @default.
- W2112796553 date "1992-01-01" @default.
- W2112796553 modified "2023-09-26" @default.
- W2112796553 title "Estimating upper and lower bounds on the performance of word-sense disambiguation programs" @default.
- W2112796553 cites W1548013757 @default.
- W2112796553 cites W1550769831 @default.
- W2112796553 cites W1570542661 @default.
- W2112796553 cites W1601817326 @default.
- W2112796553 cites W1971220772 @default.
- W2112796553 cites W1973394465 @default.
- W2112796553 cites W1977182536 @default.
- W2112796553 cites W1986347859 @default.
- W2112796553 cites W2019911971 @default.
- W2112796553 cites W2030921678 @default.
- W2112796553 cites W2035408139 @default.
- W2112796553 cites W2040004971 @default.
- W2112796553 cites W2061271742 @default.
- W2112796553 cites W2090543924 @default.
- W2112796553 cites W2106154218 @default.
- W2112796553 cites W2110529160 @default.
- W2112796553 cites W2129139611 @default.
- W2112796553 cites W2137638032 @default.
- W2112796553 cites W2148426685 @default.
- W2112796553 cites W2153890685 @default.
- W2112796553 cites W2159882563 @default.
- W2112796553 cites W2162861726 @default.
- W2112796553 doi "https://doi.org/10.3115/981967.981999" @default.
- W2112796553 hasPublicationYear "1992" @default.
- W2112796553 type Work @default.
- W2112796553 sameAs 2112796553 @default.
- W2112796553 citedByCount "156" @default.
- W2112796553 countsByYear W21127965532012 @default.
- W2112796553 countsByYear W21127965532013 @default.
- W2112796553 countsByYear W21127965532014 @default.
- W2112796553 countsByYear W21127965532015 @default.
- W2112796553 countsByYear W21127965532016 @default.
- W2112796553 countsByYear W21127965532017 @default.
- W2112796553 countsByYear W21127965532019 @default.
- W2112796553 countsByYear W21127965532020 @default.
- W2112796553 countsByYear W21127965532021 @default.
- W2112796553 countsByYear W21127965532022 @default.
- W2112796553 crossrefType "proceedings-article" @default.
- W2112796553 hasAuthorship W2112796553A5015876016 @default.
- W2112796553 hasAuthorship W2112796553A5016543371 @default.
- W2112796553 hasAuthorship W2112796553A5068671901 @default.
- W2112796553 hasBestOaLocation W21127965531 @default.
- W2112796553 hasConcept C119599485 @default.
- W2112796553 hasConcept C127413603 @default.
- W2112796553 hasConcept C134306372 @default.
- W2112796553 hasConcept C138885662 @default.
- W2112796553 hasConcept C143141573 @default.
- W2112796553 hasConcept C154945302 @default.
- W2112796553 hasConcept C157659113 @default.
- W2112796553 hasConcept C201995342 @default.
- W2112796553 hasConcept C204321447 @default.
- W2112796553 hasConcept C2780451532 @default.
- W2112796553 hasConcept C33923547 @default.
- W2112796553 hasConcept C41008148 @default.
- W2112796553 hasConcept C41895202 @default.
- W2112796553 hasConcept C44572571 @default.
- W2112796553 hasConcept C51646954 @default.
- W2112796553 hasConcept C77553402 @default.
- W2112796553 hasConcept C90805587 @default.
- W2112796553 hasConceptScore W2112796553C119599485 @default.
- W2112796553 hasConceptScore W2112796553C127413603 @default.
- W2112796553 hasConceptScore W2112796553C134306372 @default.
- W2112796553 hasConceptScore W2112796553C138885662 @default.
- W2112796553 hasConceptScore W2112796553C143141573 @default.
- W2112796553 hasConceptScore W2112796553C154945302 @default.
- W2112796553 hasConceptScore W2112796553C157659113 @default.
- W2112796553 hasConceptScore W2112796553C201995342 @default.
- W2112796553 hasConceptScore W2112796553C204321447 @default.
- W2112796553 hasConceptScore W2112796553C2780451532 @default.
- W2112796553 hasConceptScore W2112796553C33923547 @default.
- W2112796553 hasConceptScore W2112796553C41008148 @default.
- W2112796553 hasConceptScore W2112796553C41895202 @default.
- W2112796553 hasConceptScore W2112796553C44572571 @default.
- W2112796553 hasConceptScore W2112796553C51646954 @default.
- W2112796553 hasConceptScore W2112796553C77553402 @default.
- W2112796553 hasConceptScore W2112796553C90805587 @default.
- W2112796553 hasLocation W21127965531 @default.
- W2112796553 hasLocation W21127965532 @default.
- W2112796553 hasOpenAccess W2112796553 @default.
- W2112796553 hasPrimaryLocation W21127965531 @default.
- W2112796553 hasRelatedWork W2146816430 @default.
- W2112796553 hasRelatedWork W2250962194 @default.
- W2112796553 hasRelatedWork W2276331713 @default.
- W2112796553 hasRelatedWork W2287033763 @default.
- W2112796553 hasRelatedWork W2293111794 @default.
- W2112796553 hasRelatedWork W2386544544 @default.
- W2112796553 hasRelatedWork W4206945240 @default.
- W2112796553 hasRelatedWork W2183678764 @default.
- W2112796553 hasRelatedWork W2188275805 @default.
- W2112796553 hasRelatedWork W2479176469 @default.
- W2112796553 isParatext "false" @default.
- W2112796553 isRetracted "false" @default.