Matches in SemOpenAlex for { <https://semopenalex.org/work/W4286974872> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4286974872 abstract "Open Information Extraction (OIE) is the task of extracting facts from sentences in the form of relations and their corresponding arguments in schema-free manner. Intrinsic performance of OIE systems is difficult to measure due to the incompleteness of existing OIE benchmarks: the ground truth extractions do not group all acceptable surface realizations of the same fact that can be extracted from a sentence. To measure performance of OIE systems more realistically, it is necessary to manually annotate complete facts (i.e., clusters of all acceptable surface realizations of the same fact) from input sentences. We propose AnnIE: an interactive annotation platform that facilitates such challenging annotation tasks and supports creation of complete fact-oriented OIE evaluation benchmarks. AnnIE is modular and flexible in order to support different use case scenarios (i.e., benchmarks covering different types of facts). We use AnnIE to build two complete OIE benchmarks: one with verb-mediated facts and another with facts encompassing named entities. Finally, we evaluate several OIE systems on our complete benchmarks created with AnnIE. Our results suggest that existing incomplete benchmarks are overly lenient, and that OIE systems are not as robust as previously reported. We publicly release AnnIE under non-restrictive license." @default.
- W4286974872 created "2022-07-25" @default.
- W4286974872 creator A5031719069 @default.
- W4286974872 creator A5033913299 @default.
- W4286974872 creator A5053089446 @default.
- W4286974872 creator A5070234227 @default.
- W4286974872 creator A5070442264 @default.
- W4286974872 creator A5079336821 @default.
- W4286974872 creator A5090774104 @default.
- W4286974872 date "2021-09-15" @default.
- W4286974872 modified "2023-09-23" @default.
- W4286974872 title "AnnIE: An Annotation Platform for Constructing Complete Open Information Extraction Benchmark" @default.
- W4286974872 doi "https://doi.org/10.48550/arxiv.2109.07464" @default.
- W4286974872 hasPublicationYear "2021" @default.
- W4286974872 type Work @default.
- W4286974872 citedByCount "0" @default.
- W4286974872 crossrefType "posted-content" @default.
- W4286974872 hasAuthorship W4286974872A5031719069 @default.
- W4286974872 hasAuthorship W4286974872A5033913299 @default.
- W4286974872 hasAuthorship W4286974872A5053089446 @default.
- W4286974872 hasAuthorship W4286974872A5070234227 @default.
- W4286974872 hasAuthorship W4286974872A5070442264 @default.
- W4286974872 hasAuthorship W4286974872A5079336821 @default.
- W4286974872 hasAuthorship W4286974872A5090774104 @default.
- W4286974872 hasBestOaLocation W42869748721 @default.
- W4286974872 hasConcept C101468663 @default.
- W4286974872 hasConcept C124101348 @default.
- W4286974872 hasConcept C13280743 @default.
- W4286974872 hasConcept C146849305 @default.
- W4286974872 hasConcept C154945302 @default.
- W4286974872 hasConcept C185798385 @default.
- W4286974872 hasConcept C195807954 @default.
- W4286974872 hasConcept C199360897 @default.
- W4286974872 hasConcept C204321447 @default.
- W4286974872 hasConcept C205649164 @default.
- W4286974872 hasConcept C23123220 @default.
- W4286974872 hasConcept C2776321320 @default.
- W4286974872 hasConcept C2777530160 @default.
- W4286974872 hasConcept C41008148 @default.
- W4286974872 hasConcept C52146309 @default.
- W4286974872 hasConceptScore W4286974872C101468663 @default.
- W4286974872 hasConceptScore W4286974872C124101348 @default.
- W4286974872 hasConceptScore W4286974872C13280743 @default.
- W4286974872 hasConceptScore W4286974872C146849305 @default.
- W4286974872 hasConceptScore W4286974872C154945302 @default.
- W4286974872 hasConceptScore W4286974872C185798385 @default.
- W4286974872 hasConceptScore W4286974872C195807954 @default.
- W4286974872 hasConceptScore W4286974872C199360897 @default.
- W4286974872 hasConceptScore W4286974872C204321447 @default.
- W4286974872 hasConceptScore W4286974872C205649164 @default.
- W4286974872 hasConceptScore W4286974872C23123220 @default.
- W4286974872 hasConceptScore W4286974872C2776321320 @default.
- W4286974872 hasConceptScore W4286974872C2777530160 @default.
- W4286974872 hasConceptScore W4286974872C41008148 @default.
- W4286974872 hasConceptScore W4286974872C52146309 @default.
- W4286974872 hasLocation W42869748721 @default.
- W4286974872 hasOpenAccess W4286974872 @default.
- W4286974872 hasPrimaryLocation W42869748721 @default.
- W4286974872 hasRelatedWork W159132833 @default.
- W4286974872 hasRelatedWork W2029408038 @default.
- W4286974872 hasRelatedWork W2368651715 @default.
- W4286974872 hasRelatedWork W2793539281 @default.
- W4286974872 hasRelatedWork W2964756555 @default.
- W4286974872 hasRelatedWork W2971623275 @default.
- W4286974872 hasRelatedWork W3107474891 @default.
- W4286974872 hasRelatedWork W3108142956 @default.
- W4286974872 hasRelatedWork W3214496322 @default.
- W4286974872 hasRelatedWork W38394648 @default.
- W4286974872 isParatext "false" @default.
- W4286974872 isRetracted "false" @default.
- W4286974872 workType "article" @default.