Matches in SemOpenAlex for { <https://semopenalex.org/work/W797721171> ?p ?o ?g. }
- W797721171 endingPage "e0130753" @default.
- W797721171 startingPage "e0130753" @default.
- W797721171 abstract "We analysed the peer review of grant proposals under Marie Curie Actions, a major EU research funding instrument, which involves two steps: an independent assessment (Individual Evaluation Report, IER) performed remotely by 3 raters, and a consensus opinion reached during a meeting by the same raters (Consensus Report, CR). For 24,897 proposals evaluated from 2007 to 2013, the association between average IER and CR scores was very high across different panels, grant calls and years. Median average deviation (AD) index, used as a measure of inter-rater agreement, was 5.4 points on a 0-100 scale (interquartile range 3.4-8.3), overall, demonstrating a good general agreement among raters. For proposals where one rater disagreed with the other two raters (n=1424; 5.7%), or where all 3 raters disagreed (n=2075; 8.3%), the average IER and CR scores were still highly associated. Disagreement was more frequent for proposals from Economics/Social Sciences and Humanities panels. Greater disagreement was observed for proposals with lower average IER scores. CR scores for proposals with initial disagreement were also significantly lower. Proposals with a large absolute difference between the average IER and CR scores (≥10 points; n=368, 1.5%) generally had lower CR scores. An inter-correlation matrix of individual raters' scores of evaluation criteria of proposals indicated that these scores were, in general, a reflection of raters’ overall scores. Our analysis demonstrated a good internal consistency and general high agreement among raters. Consensus meetings appear to be relevant for particular panels and subsets of proposals with large differences among raters’ scores." @default.
- W797721171 created "2016-06-24" @default.
- W797721171 creator A5019328215 @default.
- W797721171 creator A5046187244 @default.
- W797721171 creator A5069046112 @default.
- W797721171 date "2015-06-30" @default.
- W797721171 modified "2023-10-18" @default.
- W797721171 title "Peer Review Evaluation Process of Marie Curie Actions under EU’s Seventh Framework Programme for Research" @default.
- W797721171 cites W1504922255 @default.
- W797721171 cites W1578561495 @default.
- W797721171 cites W1965732548 @default.
- W797721171 cites W1968157985 @default.
- W797721171 cites W1972622142 @default.
- W797721171 cites W1975626251 @default.
- W797721171 cites W1976871561 @default.
- W797721171 cites W1982340630 @default.
- W797721171 cites W1994884914 @default.
- W797721171 cites W2002502156 @default.
- W797721171 cites W2021920339 @default.
- W797721171 cites W2030360178 @default.
- W797721171 cites W2036814273 @default.
- W797721171 cites W2051213584 @default.
- W797721171 cites W2055124066 @default.
- W797721171 cites W2057029201 @default.
- W797721171 cites W2064595758 @default.
- W797721171 cites W2074978652 @default.
- W797721171 cites W2111150581 @default.
- W797721171 cites W2116171285 @default.
- W797721171 cites W2137778553 @default.
- W797721171 cites W2144772627 @default.
- W797721171 cites W2147830671 @default.
- W797721171 cites W2163445888 @default.
- W797721171 cites W2167919917 @default.
- W797721171 cites W2212838023 @default.
- W797721171 cites W2318858224 @default.
- W797721171 cites W2327638283 @default.
- W797721171 doi "https://doi.org/10.1371/journal.pone.0130753" @default.
- W797721171 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/4488366" @default.
- W797721171 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/26126111" @default.
- W797721171 hasPublicationYear "2015" @default.
- W797721171 type Work @default.
- W797721171 sameAs 797721171 @default.
- W797721171 citedByCount "18" @default.
- W797721171 countsByYear W7977211712016 @default.
- W797721171 countsByYear W7977211712017 @default.
- W797721171 countsByYear W7977211712018 @default.
- W797721171 countsByYear W7977211712019 @default.
- W797721171 countsByYear W7977211712020 @default.
- W797721171 countsByYear W7977211712021 @default.
- W797721171 countsByYear W7977211712022 @default.
- W797721171 countsByYear W7977211712023 @default.
- W797721171 crossrefType "journal-article" @default.
- W797721171 hasAuthorship W797721171A5019328215 @default.
- W797721171 hasAuthorship W797721171A5046187244 @default.
- W797721171 hasAuthorship W797721171A5069046112 @default.
- W797721171 hasBestOaLocation W7977211711 @default.
- W797721171 hasConcept C105639569 @default.
- W797721171 hasConcept C105795698 @default.
- W797721171 hasConcept C119060515 @default.
- W797721171 hasConcept C138368954 @default.
- W797721171 hasConcept C144133560 @default.
- W797721171 hasConcept C15744967 @default.
- W797721171 hasConcept C171606756 @default.
- W797721171 hasConcept C17744445 @default.
- W797721171 hasConcept C199539241 @default.
- W797721171 hasConcept C2524010 @default.
- W797721171 hasConcept C2776436953 @default.
- W797721171 hasConcept C2910001868 @default.
- W797721171 hasConcept C2993243194 @default.
- W797721171 hasConcept C3018868096 @default.
- W797721171 hasConcept C33923547 @default.
- W797721171 hasConcept C70410870 @default.
- W797721171 hasConcept C71924100 @default.
- W797721171 hasConceptScore W797721171C105639569 @default.
- W797721171 hasConceptScore W797721171C105795698 @default.
- W797721171 hasConceptScore W797721171C119060515 @default.
- W797721171 hasConceptScore W797721171C138368954 @default.
- W797721171 hasConceptScore W797721171C144133560 @default.
- W797721171 hasConceptScore W797721171C15744967 @default.
- W797721171 hasConceptScore W797721171C171606756 @default.
- W797721171 hasConceptScore W797721171C17744445 @default.
- W797721171 hasConceptScore W797721171C199539241 @default.
- W797721171 hasConceptScore W797721171C2524010 @default.
- W797721171 hasConceptScore W797721171C2776436953 @default.
- W797721171 hasConceptScore W797721171C2910001868 @default.
- W797721171 hasConceptScore W797721171C2993243194 @default.
- W797721171 hasConceptScore W797721171C3018868096 @default.
- W797721171 hasConceptScore W797721171C33923547 @default.
- W797721171 hasConceptScore W797721171C70410870 @default.
- W797721171 hasConceptScore W797721171C71924100 @default.
- W797721171 hasIssue "6" @default.
- W797721171 hasLocation W7977211711 @default.
- W797721171 hasLocation W7977211712 @default.
- W797721171 hasLocation W7977211713 @default.
- W797721171 hasLocation W7977211714 @default.
- W797721171 hasLocation W7977211715 @default.
- W797721171 hasOpenAccess W797721171 @default.
- W797721171 hasPrimaryLocation W7977211711 @default.