Matches in SemOpenAlex for { <https://semopenalex.org/work/W4362458730> ?p ?o ?g. }
- W4362458730 abstract "Abstract The constant development of new data analysis methods in many fields of research is accompanied by an increasing awareness that these new methods often perform better in their introductory paper than in subsequent comparison studies conducted by other researchers. We attempt to explain this discrepancy by conducting a systematic experiment that we call “cross‐design validation of methods”. In the experiment, we select two methods designed for the same data analysis task, reproduce the results shown in each paper, and then reevaluate each method based on the study design (i.e., datasets, competing methods, and evaluation criteria) that was used to show the abilities of the other method. We conduct the experiment for two data analysis tasks, namely cancer subtyping using multiomic data and differential gene expression analysis. Three of the four methods included in the experiment indeed perform worse when they are evaluated on the new study design, which is mainly caused by the different datasets. Apart from illustrating the many degrees of freedom existing in the assessment of a method and their effect on its performance, our experiment suggests that the performance discrepancies between original and subsequent papers may not only be caused by the nonneutrality of the authors proposing the new method but also by differences regarding the level of expertise and field of application. Authors of new methods should thus focus not only on a transparent and extensive evaluation but also on comprehensive method documentation that enables the correct use of their methods in subsequent studies." @default.
- W4362458730 created "2023-04-05" @default.
- W4362458730 creator A5015152016 @default.
- W4362458730 creator A5026492013 @default.
- W4362458730 creator A5040820559 @default.
- W4362458730 creator A5087509441 @default.
- W4362458730 date "2023-03-31" @default.
- W4362458730 modified "2023-10-14" @default.
- W4362458730 title "Explaining the optimistic performance evaluation of newly proposed methods: A cross‐design validation experiment" @default.
- W4362458730 cites W1548779692 @default.
- W4362458730 cites W1987219048 @default.
- W4362458730 cites W2005852722 @default.
- W4362458730 cites W2038094994 @default.
- W4362458730 cites W2055335745 @default.
- W4362458730 cites W2074414424 @default.
- W4362458730 cites W2075740080 @default.
- W4362458730 cites W2107018762 @default.
- W4362458730 cites W2114104545 @default.
- W4362458730 cites W2123579165 @default.
- W4362458730 cites W2125632841 @default.
- W4362458730 cites W2127952499 @default.
- W4362458730 cites W2135256913 @default.
- W4362458730 cites W2152239989 @default.
- W4362458730 cites W2161498332 @default.
- W4362458730 cites W2179438025 @default.
- W4362458730 cites W2198613826 @default.
- W4362458730 cites W2562137041 @default.
- W4362458730 cites W2762364541 @default.
- W4362458730 cites W2765654979 @default.
- W4362458730 cites W2884724578 @default.
- W4362458730 cites W2906107882 @default.
- W4362458730 cites W2945015580 @default.
- W4362458730 cites W2950878899 @default.
- W4362458730 cites W3003192283 @default.
- W4362458730 cites W3009545736 @default.
- W4362458730 cites W3046566989 @default.
- W4362458730 cites W3098865414 @default.
- W4362458730 cites W3106625866 @default.
- W4362458730 cites W3108167468 @default.
- W4362458730 cites W3115068409 @default.
- W4362458730 cites W3162777509 @default.
- W4362458730 cites W3177188601 @default.
- W4362458730 cites W3187466590 @default.
- W4362458730 cites W4200537922 @default.
- W4362458730 cites W4220855543 @default.
- W4362458730 cites W4285077411 @default.
- W4362458730 cites W4294275276 @default.
- W4362458730 cites W4297900362 @default.
- W4362458730 cites W4323653122 @default.
- W4362458730 doi "https://doi.org/10.1002/bimj.202200238" @default.
- W4362458730 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/36999395" @default.
- W4362458730 hasPublicationYear "2023" @default.
- W4362458730 type Work @default.
- W4362458730 citedByCount "0" @default.
- W4362458730 crossrefType "journal-article" @default.
- W4362458730 hasAuthorship W4362458730A5015152016 @default.
- W4362458730 hasAuthorship W4362458730A5026492013 @default.
- W4362458730 hasAuthorship W4362458730A5040820559 @default.
- W4362458730 hasAuthorship W4362458730A5087509441 @default.
- W4362458730 hasBestOaLocation W43624587301 @default.
- W4362458730 hasConcept C105795698 @default.
- W4362458730 hasConcept C119857082 @default.
- W4362458730 hasConcept C120665830 @default.
- W4362458730 hasConcept C121332964 @default.
- W4362458730 hasConcept C124101348 @default.
- W4362458730 hasConcept C154945302 @default.
- W4362458730 hasConcept C162324750 @default.
- W4362458730 hasConcept C187736073 @default.
- W4362458730 hasConcept C192209626 @default.
- W4362458730 hasConcept C202444582 @default.
- W4362458730 hasConcept C2780451532 @default.
- W4362458730 hasConcept C33923547 @default.
- W4362458730 hasConcept C34559072 @default.
- W4362458730 hasConcept C41008148 @default.
- W4362458730 hasConcept C9652623 @default.
- W4362458730 hasConceptScore W4362458730C105795698 @default.
- W4362458730 hasConceptScore W4362458730C119857082 @default.
- W4362458730 hasConceptScore W4362458730C120665830 @default.
- W4362458730 hasConceptScore W4362458730C121332964 @default.
- W4362458730 hasConceptScore W4362458730C124101348 @default.
- W4362458730 hasConceptScore W4362458730C154945302 @default.
- W4362458730 hasConceptScore W4362458730C162324750 @default.
- W4362458730 hasConceptScore W4362458730C187736073 @default.
- W4362458730 hasConceptScore W4362458730C192209626 @default.
- W4362458730 hasConceptScore W4362458730C202444582 @default.
- W4362458730 hasConceptScore W4362458730C2780451532 @default.
- W4362458730 hasConceptScore W4362458730C33923547 @default.
- W4362458730 hasConceptScore W4362458730C34559072 @default.
- W4362458730 hasConceptScore W4362458730C41008148 @default.
- W4362458730 hasConceptScore W4362458730C9652623 @default.
- W4362458730 hasFunder F4320320879 @default.
- W4362458730 hasLocation W43624587301 @default.
- W4362458730 hasLocation W43624587302 @default.
- W4362458730 hasLocation W43624587303 @default.
- W4362458730 hasOpenAccess W4362458730 @default.
- W4362458730 hasPrimaryLocation W43624587301 @default.
- W4362458730 hasRelatedWork W2081647779 @default.
- W4362458730 hasRelatedWork W2961085424 @default.
- W4362458730 hasRelatedWork W3046775127 @default.
- W4362458730 hasRelatedWork W3170094116 @default.