FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3170436849> ?p ?o ?g. }

• W3170436849 abstract "In recent years, the need for neutral benchmark studies that focus on the comparison of methods from computational sciences has been increasingly recognised by the scientific community. While general advice on the design and analysis of neutral benchmark studies can be found in recent literature, certain amounts of flexibility always exist. This includes the choice of data sets and performance measures, the handling of missing performance values and the way the performance values are aggregated over the data sets. As a consequence of this flexibility, researchers may be concerned about how their choices affect the results or, in the worst case, may be tempted to engage in questionable research practices (e.g. the selective reporting of results or the post-hoc modification of design or analysis components) to fit their expectations or hopes. To raise awareness for this issue, we use an example benchmark study to illustrate how variable benchmark results can be when all possible combinations of a range of design and analysis options are considered. We then demonstrate how the impact of each choice on the results can be assessed using multidimensional unfolding. In conclusion, based on previous literature and on our illustrative example, we claim that the multiplicity of design and analysis options combined with questionable research practices lead to biased interpretations of benchmark results and to over-optimistic conclusions. This issue should be considered by computational researchers when designing and analysing their benchmark studies and by the scientific community in general in an effort towards more reliable benchmark results." @default.
• W3170436849 created "2021-06-22" @default.
• W3170436849 creator A5010487429 @default.
• W3170436849 creator A5026492013 @default.
• W3170436849 creator A5037450272 @default.
• W3170436849 creator A5060625180 @default.
• W3170436849 creator A5091576756 @default.
• W3170436849 date "2021-06-04" @default.
• W3170436849 modified "2023-09-26" @default.
• W3170436849 title "Over-optimism in benchmark studies and the multiplicity of design and analysis options when interpreting their results" @default.
• W3170436849 cites W1510850304 @default.
• W3170436849 cites W1532821071 @default.
• W3170436849 cites W1558389304 @default.
• W3170436849 cites W1565746575 @default.
• W3170436849 cites W1576808520 @default.
• W3170436849 cites W1967004441 @default.
• W3170436849 cites W1979250836 @default.
• W3170436849 cites W2002030061 @default.
• W3170436849 cites W2005852722 @default.
• W3170436849 cites W2012594345 @default.
• W3170436849 cites W2055335745 @default.
• W3170436849 cites W2059768001 @default.
• W3170436849 cites W2067752346 @default.
• W3170436849 cites W2072371179 @default.
• W3170436849 cites W2075740080 @default.
• W3170436849 cites W2095234124 @default.
• W3170436849 cites W2097180277 @default.
• W3170436849 cites W2100267603 @default.
• W3170436849 cites W2102307317 @default.
• W3170436849 cites W2104092906 @default.
• W3170436849 cites W2106525823 @default.
• W3170436849 cites W2107230221 @default.
• W3170436849 cites W2120579447 @default.
• W3170436849 cites W2123263696 @default.
• W3170436849 cites W2127952499 @default.
• W3170436849 cites W2128246772 @default.
• W3170436849 cites W2161498332 @default.
• W3170436849 cites W2164005910 @default.
• W3170436849 cites W2167277498 @default.
• W3170436849 cites W2169065610 @default.
• W3170436849 cites W2211143780 @default.
• W3170436849 cites W2331384579 @default.
• W3170436849 cites W2386865585 @default.
• W3170436849 cites W2547157941 @default.
• W3170436849 cites W2561862420 @default.
• W3170436849 cites W2562137041 @default.
• W3170436849 cites W2581151820 @default.
• W3170436849 cites W2626372733 @default.
• W3170436849 cites W2770322578 @default.
• W3170436849 cites W2791678231 @default.
• W3170436849 cites W2908333464 @default.
• W3170436849 cites W2919176916 @default.
• W3170436849 cites W2922985761 @default.
• W3170436849 cites W2951624434 @default.
• W3170436849 cites W2964300152 @default.
• W3170436849 cites W2979600415 @default.
• W3170436849 cites W2994954405 @default.
• W3170436849 cites W3011462906 @default.
• W3170436849 cites W3090499726 @default.
• W3170436849 cites W3098038161 @default.
• W3170436849 cites W3098865414 @default.
• W3170436849 cites W3106625866 @default.
• W3170436849 cites W3113291402 @default.
• W3170436849 cites W3153302987 @default.
• W3170436849 cites W3162777509 @default.
• W3170436849 cites W75195566 @default.
• W3170436849 hasPublicationYear "2021" @default.
• W3170436849 type Work @default.
• W3170436849 sameAs 3170436849 @default.
• W3170436849 citedByCount "0" @default.
• W3170436849 crossrefType "posted-content" @default.
• W3170436849 hasAuthorship W3170436849A5010487429 @default.
• W3170436849 hasAuthorship W3170436849A5026492013 @default.
• W3170436849 hasAuthorship W3170436849A5037450272 @default.
• W3170436849 hasAuthorship W3170436849A5060625180 @default.
• W3170436849 hasAuthorship W3170436849A5091576756 @default.
• W3170436849 hasConcept C105795698 @default.
• W3170436849 hasConcept C112930515 @default.
• W3170436849 hasConcept C127413603 @default.
• W3170436849 hasConcept C13280743 @default.
• W3170436849 hasConcept C134306372 @default.
• W3170436849 hasConcept C149782125 @default.
• W3170436849 hasConcept C15744967 @default.
• W3170436849 hasConcept C182365436 @default.
• W3170436849 hasConcept C185798385 @default.
• W3170436849 hasConcept C204017024 @default.
• W3170436849 hasConcept C205649164 @default.
• W3170436849 hasConcept C2522767166 @default.
• W3170436849 hasConcept C2780598303 @default.
• W3170436849 hasConcept C33923547 @default.
• W3170436849 hasConcept C41008148 @default.
• W3170436849 hasConcept C42475967 @default.
• W3170436849 hasConcept C539667460 @default.
• W3170436849 hasConcept C71924100 @default.
• W3170436849 hasConcept C77805123 @default.
• W3170436849 hasConceptScore W3170436849C105795698 @default.
• W3170436849 hasConceptScore W3170436849C112930515 @default.
• W3170436849 hasConceptScore W3170436849C127413603 @default.
• W3170436849 hasConceptScore W3170436849C13280743 @default.
• W3170436849 hasConceptScore W3170436849C134306372 @default.

• next