FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3034891697> ?p ?o ?g. }

• W3034891697 abstract "TACRED is one of the largest, most widely used crowdsourced datasets in Relation Extraction (RE). But, even with recent advances in unsupervised pre-training and knowledge enhanced neural RE, models still show a high error rate. In this paper, we investigate the questions: Have we reached a performance ceiling or is there still room for improvement? And how do crowd annotations, dataset, and models contribute to this error rate? To answer these questions, we first validate the most challenging 5K examples in the development and test sets using trained annotators. We find that label errors account for 8% absolute F1 test error, and that more than 50% of the examples need to be relabeled. On the relabeled test set the average F1 score of a large baseline model set improves from 62.1 to 70.1. After validation, we analyze misclassifications on the challenging instances, categorize them into linguistically motivated error groups, and verify the resulting error hypotheses on three state-of-the-art RE models. We show that two groups of ambiguous relations are responsible for most of the remaining errors and that models may adopt shallow heuristics on the dataset when entities are not masked." @default.
• W3034891697 created "2020-06-19" @default.
• W3034891697 creator A5070048651 @default.
• W3034891697 creator A5070094187 @default.
• W3034891697 creator A5081320436 @default.
• W3034891697 date "2020-01-01" @default.
• W3034891697 modified "2023-10-14" @default.
• W3034891697 title "TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task" @default.
• W3034891697 cites W1604644367 @default.
• W3034891697 cites W2119465010 @default.
• W3034891697 cites W2250521169 @default.
• W3034891697 cites W2250539671 @default.
• W3034891697 cites W2251622960 @default.
• W3034891697 cites W2759211898 @default.
• W3034891697 cites W2799007037 @default.
• W3034891697 cites W2892094955 @default.
• W3034891697 cites W2936215830 @default.
• W3034891697 cites W2941666437 @default.
• W3034891697 cites W2949858875 @default.
• W3034891697 cites W2950142424 @default.
• W3034891697 cites W2951286828 @default.
• W3034891697 cites W2952984539 @default.
• W3034891697 cites W2953356739 @default.
• W3034891697 cites W2962680264 @default.
• W3034891697 cites W2962809918 @default.
• W3034891697 cites W2963907426 @default.
• W3034891697 cites W2963969878 @default.
• W3034891697 cites W2964022985 @default.
• W3034891697 cites W2964204621 @default.
• W3034891697 cites W2964212344 @default.
• W3034891697 cites W2970986510 @default.
• W3034891697 cites W2972573244 @default.
• W3034891697 cites W3011411500 @default.
• W3034891697 doi "https://doi.org/10.18653/v1/2020.acl-main.142" @default.
• W3034891697 hasPublicationYear "2020" @default.
• W3034891697 type Work @default.
• W3034891697 sameAs 3034891697 @default.
• W3034891697 citedByCount "53" @default.
• W3034891697 countsByYear W30348916972020 @default.
• W3034891697 countsByYear W30348916972021 @default.
• W3034891697 countsByYear W30348916972022 @default.
• W3034891697 countsByYear W30348916972023 @default.
• W3034891697 crossrefType "proceedings-article" @default.
• W3034891697 hasAuthorship W3034891697A5070048651 @default.
• W3034891697 hasAuthorship W3034891697A5070094187 @default.
• W3034891697 hasAuthorship W3034891697A5081320436 @default.
• W3034891697 hasBestOaLocation W30348916971 @default.
• W3034891697 hasConcept C111368507 @default.
• W3034891697 hasConcept C111919701 @default.
• W3034891697 hasConcept C119857082 @default.
• W3034891697 hasConcept C121332964 @default.
• W3034891697 hasConcept C124101348 @default.
• W3034891697 hasConcept C12725497 @default.
• W3034891697 hasConcept C127313418 @default.
• W3034891697 hasConcept C127705205 @default.
• W3034891697 hasConcept C153294291 @default.
• W3034891697 hasConcept C153604712 @default.
• W3034891697 hasConcept C154945302 @default.
• W3034891697 hasConcept C162324750 @default.
• W3034891697 hasConcept C169903167 @default.
• W3034891697 hasConcept C177264268 @default.
• W3034891697 hasConcept C187736073 @default.
• W3034891697 hasConcept C199360897 @default.
• W3034891697 hasConcept C204321447 @default.
• W3034891697 hasConcept C25343380 @default.
• W3034891697 hasConcept C2777489069 @default.
• W3034891697 hasConcept C2780451532 @default.
• W3034891697 hasConcept C40969351 @default.
• W3034891697 hasConcept C41008148 @default.
• W3034891697 hasConcept C94124525 @default.
• W3034891697 hasConceptScore W3034891697C111368507 @default.
• W3034891697 hasConceptScore W3034891697C111919701 @default.
• W3034891697 hasConceptScore W3034891697C119857082 @default.
• W3034891697 hasConceptScore W3034891697C121332964 @default.
• W3034891697 hasConceptScore W3034891697C124101348 @default.
• W3034891697 hasConceptScore W3034891697C12725497 @default.
• W3034891697 hasConceptScore W3034891697C127313418 @default.
• W3034891697 hasConceptScore W3034891697C127705205 @default.
• W3034891697 hasConceptScore W3034891697C153294291 @default.
• W3034891697 hasConceptScore W3034891697C153604712 @default.
• W3034891697 hasConceptScore W3034891697C154945302 @default.
• W3034891697 hasConceptScore W3034891697C162324750 @default.
• W3034891697 hasConceptScore W3034891697C169903167 @default.
• W3034891697 hasConceptScore W3034891697C177264268 @default.
• W3034891697 hasConceptScore W3034891697C187736073 @default.
• W3034891697 hasConceptScore W3034891697C199360897 @default.
• W3034891697 hasConceptScore W3034891697C204321447 @default.
• W3034891697 hasConceptScore W3034891697C25343380 @default.
• W3034891697 hasConceptScore W3034891697C2777489069 @default.
• W3034891697 hasConceptScore W3034891697C2780451532 @default.
• W3034891697 hasConceptScore W3034891697C40969351 @default.
• W3034891697 hasConceptScore W3034891697C41008148 @default.
• W3034891697 hasConceptScore W3034891697C94124525 @default.
• W3034891697 hasLocation W30348916971 @default.
• W3034891697 hasLocation W30348916972 @default.
• W3034891697 hasOpenAccess W3034891697 @default.
• W3034891697 hasPrimaryLocation W30348916971 @default.
• W3034891697 hasRelatedWork W2605526599 @default.
• W3034891697 hasRelatedWork W2753023842 @default.
• W3034891697 hasRelatedWork W2807524541 @default.

• next