Matches in SemOpenAlex for { <https://semopenalex.org/work/W4283261827> ?p ?o ?g. }
- W4283261827 endingPage "4074" @default.
- W4283261827 startingPage "4045" @default.
- W4283261827 abstract "Abstract Research on academic paper ranking has received great attention in recent years, and many algorithms have been proposed to automatically assess a large number of papers for this purpose. How to evaluate or analyse the performance of these ranking algorithms becomes an open research question. Theoretically, evaluation of an algorithm requires to compare its ranking result against a ground truth paper list. However, such ground truth does not exist in the field of scholarly ranking due to the fact that there does not and will not exist an absolutely unbiased, objective, and unified standard to formulate the impact of papers. Therefore, in practice researchers evaluate or analyse their proposed ranking algorithms by different methods, such as using domain expert decisions (test data) and comparing against predefined ranking benchmarks. The question is whether using different methods leads to different analysis results, and if so, how should we analyse the performance of the ranking algorithms? To answer these questions, this study compares among test data and different citation-based benchmarks by examining their relationships and assessing the effect of the method choices on their analysis results. The results of our experiments show that there does exist difference in analysis results when employing test data and different benchmarks, and relying exclusively on one benchmark or test data may bring inadequate analysis results. In addition, a guideline on how to conduct a comprehensive analysis using multiple benchmarks from different perspectives is summarised, which can help provide a systematic understanding and profile of the analysed algorithms." @default.
- W4283261827 created "2022-06-23" @default.
- W4283261827 creator A5013237876 @default.
- W4283261827 creator A5024383984 @default.
- W4283261827 creator A5031465905 @default.
- W4283261827 creator A5051582082 @default.
- W4283261827 date "2022-06-21" @default.
- W4283261827 modified "2023-10-16" @default.
- W4283261827 title "Analysing academic paper ranking algorithms using test data and benchmarks: an investigation" @default.
- W4283261827 cites W142875750 @default.
- W4283261827 cites W1539510218 @default.
- W4283261827 cites W1905577015 @default.
- W4283261827 cites W1907286193 @default.
- W4283261827 cites W1964104106 @default.
- W4283261827 cites W1980233487 @default.
- W4283261827 cites W1992037052 @default.
- W4283261827 cites W2000574324 @default.
- W4283261827 cites W2019753053 @default.
- W4283261827 cites W2025194265 @default.
- W4283261827 cites W2040906208 @default.
- W4283261827 cites W2058893952 @default.
- W4283261827 cites W2058933996 @default.
- W4283261827 cites W2069870183 @default.
- W4283261827 cites W2096682819 @default.
- W4283261827 cites W2099811601 @default.
- W4283261827 cites W2138621811 @default.
- W4283261827 cites W2141075029 @default.
- W4283261827 cites W2147032993 @default.
- W4283261827 cites W2151866568 @default.
- W4283261827 cites W2152407760 @default.
- W4283261827 cites W2158698691 @default.
- W4283261827 cites W2162010993 @default.
- W4283261827 cites W2178628967 @default.
- W4283261827 cites W2300984719 @default.
- W4283261827 cites W2342052599 @default.
- W4283261827 cites W2346028452 @default.
- W4283261827 cites W2410986011 @default.
- W4283261827 cites W2521492858 @default.
- W4283261827 cites W2530998006 @default.
- W4283261827 cites W2570427954 @default.
- W4283261827 cites W2604145819 @default.
- W4283261827 cites W2611627302 @default.
- W4283261827 cites W2748168069 @default.
- W4283261827 cites W2794537017 @default.
- W4283261827 cites W2809299208 @default.
- W4283261827 cites W2889465551 @default.
- W4283261827 cites W2891197287 @default.
- W4283261827 cites W2904335269 @default.
- W4283261827 cites W2908989331 @default.
- W4283261827 cites W2926059331 @default.
- W4283261827 cites W2965244786 @default.
- W4283261827 cites W2965727953 @default.
- W4283261827 cites W2986568990 @default.
- W4283261827 cites W2987501881 @default.
- W4283261827 cites W3021039303 @default.
- W4283261827 cites W3098007831 @default.
- W4283261827 cites W3102760324 @default.
- W4283261827 cites W767067438 @default.
- W4283261827 cites W95321676 @default.
- W4283261827 doi "https://doi.org/10.1007/s11192-022-04429-z" @default.
- W4283261827 hasPublicationYear "2022" @default.
- W4283261827 type Work @default.
- W4283261827 citedByCount "2" @default.
- W4283261827 countsByYear W42832618272022 @default.
- W4283261827 crossrefType "journal-article" @default.
- W4283261827 hasAuthorship W4283261827A5013237876 @default.
- W4283261827 hasAuthorship W4283261827A5024383984 @default.
- W4283261827 hasAuthorship W4283261827A5031465905 @default.
- W4283261827 hasAuthorship W4283261827A5051582082 @default.
- W4283261827 hasBestOaLocation W42832618271 @default.
- W4283261827 hasConcept C11413529 @default.
- W4283261827 hasConcept C119857082 @default.
- W4283261827 hasConcept C124101348 @default.
- W4283261827 hasConcept C124975894 @default.
- W4283261827 hasConcept C13280743 @default.
- W4283261827 hasConcept C134306372 @default.
- W4283261827 hasConcept C136764020 @default.
- W4283261827 hasConcept C151730666 @default.
- W4283261827 hasConcept C185798385 @default.
- W4283261827 hasConcept C189430467 @default.
- W4283261827 hasConcept C202444582 @default.
- W4283261827 hasConcept C205649164 @default.
- W4283261827 hasConcept C23123220 @default.
- W4283261827 hasConcept C2522767166 @default.
- W4283261827 hasConcept C2777267654 @default.
- W4283261827 hasConcept C2778805511 @default.
- W4283261827 hasConcept C33923547 @default.
- W4283261827 hasConcept C36503486 @default.
- W4283261827 hasConcept C41008148 @default.
- W4283261827 hasConcept C86803240 @default.
- W4283261827 hasConcept C9652623 @default.
- W4283261827 hasConceptScore W4283261827C11413529 @default.
- W4283261827 hasConceptScore W4283261827C119857082 @default.
- W4283261827 hasConceptScore W4283261827C124101348 @default.
- W4283261827 hasConceptScore W4283261827C124975894 @default.
- W4283261827 hasConceptScore W4283261827C13280743 @default.
- W4283261827 hasConceptScore W4283261827C134306372 @default.
- W4283261827 hasConceptScore W4283261827C136764020 @default.