FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2983017445> ?p ?o ?g. }

• W2983017445 abstract "In this paper, we explore strategies to evaluate models for the task research paper novelty detection: Given all papers released at a given date, which of the papers discuss new ideas and influence future research? We find the novelty is not a singular concept, and thus inherently lacks of ground truth annotations with cross-annotator agreement, which is a major obstacle in evaluating these models. Test-of-time award is closest to such annotation, which can only be made retrospectively and is extremely scarce. We thus propose to compare and evaluate models using counterfactual simulations. First, we ask models if they can differentiate papers at time t and counterfactual paper from future time t+d. Second, we ask models if they can predict test-of-time award at t+d. These are proxies that can be agreed by human annotators and easily augmented by correlated signals, using which evaluation can be done through four tasks: classification, ranking, correlation and feature selection. We show these proxy evaluation methods complement each other regarding error handling, coverage, interpretability, and scope, and thus altogether contribute to the observation of the relative strength of existing models." @default.
• W2983017445 created "2019-11-22" @default.
• W2983017445 creator A5007073696 @default.
• W2983017445 creator A5009993083 @default.
• W2983017445 creator A5070751515 @default.
• W2983017445 date "2019-01-01" @default.
• W2983017445 modified "2023-10-16" @default.
• W2983017445 title "Evaluating Research Novelty Detection: Counterfactual Approaches" @default.
• W2983017445 cites W1503432700 @default.
• W2983017445 cites W1602102908 @default.
• W2983017445 cites W1880262756 @default.
• W2983017445 cites W1966193717 @default.
• W2983017445 cites W1971226872 @default.
• W2983017445 cites W1996768744 @default.
• W2983017445 cites W2000574324 @default.
• W2983017445 cites W2039401953 @default.
• W2983017445 cites W2053403152 @default.
• W2983017445 cites W2091362531 @default.
• W2983017445 cites W2096623622 @default.
• W2983017445 cites W2105083637 @default.
• W2983017445 cites W2117473841 @default.
• W2983017445 cites W2133286915 @default.
• W2983017445 cites W2138628606 @default.
• W2983017445 cites W2146936057 @default.
• W2983017445 cites W2153579005 @default.
• W2983017445 cites W2154446588 @default.
• W2983017445 cites W2252211741 @default.
• W2983017445 cites W2596568673 @default.
• W2983017445 cites W2786305805 @default.
• W2983017445 cites W87431105 @default.
• W2983017445 doi "https://doi.org/10.18653/v1/d19-5315" @default.
• W2983017445 hasPublicationYear "2019" @default.
• W2983017445 type Work @default.
• W2983017445 sameAs 2983017445 @default.
• W2983017445 citedByCount "3" @default.
• W2983017445 countsByYear W29830174452021 @default.
• W2983017445 crossrefType "proceedings-article" @default.
• W2983017445 hasAuthorship W2983017445A5007073696 @default.
• W2983017445 hasAuthorship W2983017445A5009993083 @default.
• W2983017445 hasAuthorship W2983017445A5070751515 @default.
• W2983017445 hasBestOaLocation W29830174451 @default.
• W2983017445 hasConcept C108650721 @default.
• W2983017445 hasConcept C154945302 @default.
• W2983017445 hasConcept C15744967 @default.
• W2983017445 hasConcept C2778738651 @default.
• W2983017445 hasConcept C2778924833 @default.
• W2983017445 hasConcept C41008148 @default.
• W2983017445 hasConcept C77805123 @default.
• W2983017445 hasConceptScore W2983017445C108650721 @default.
• W2983017445 hasConceptScore W2983017445C154945302 @default.
• W2983017445 hasConceptScore W2983017445C15744967 @default.
• W2983017445 hasConceptScore W2983017445C2778738651 @default.
• W2983017445 hasConceptScore W2983017445C2778924833 @default.
• W2983017445 hasConceptScore W2983017445C41008148 @default.
• W2983017445 hasConceptScore W2983017445C77805123 @default.
• W2983017445 hasLocation W29830174451 @default.
• W2983017445 hasOpenAccess W2983017445 @default.
• W2983017445 hasPrimaryLocation W29830174451 @default.
• W2983017445 hasRelatedWork W1570269564 @default.
• W2983017445 hasRelatedWork W1939982668 @default.
• W2983017445 hasRelatedWork W2027738917 @default.
• W2983017445 hasRelatedWork W2064636555 @default.
• W2983017445 hasRelatedWork W2076090200 @default.
• W2983017445 hasRelatedWork W2092501526 @default.
• W2983017445 hasRelatedWork W2585503716 @default.
• W2983017445 hasRelatedWork W2983017445 @default.
• W2983017445 hasRelatedWork W3009062484 @default.
• W2983017445 hasRelatedWork W4213225351 @default.
• W2983017445 isParatext "false" @default.
• W2983017445 isRetracted "false" @default.
• W2983017445 magId "2983017445" @default.
• W2983017445 workType "article" @default.