Matches in SemOpenAlex for { <https://semopenalex.org/work/W4384345630> ?p ?o ?g. }
- W4384345630 abstract "Searching for clues, gathering evidence, and reviewing case files are all techniques used by criminal investigators to draw sound conclusions and avoid wrongful convictions. Medicine, too, has a long tradition of evidence-based practice, in which administering a treatment without evidence of its efficacy is considered malpractice. Similarly, in software engineering (SE) research, we can develop sound methodologies and mitigate threats to validity by basing study design decisions on evidence. Echoing a recent call for the empirical evaluation of design decisions in program comprehension experiments, we conducted a 2-phases study consisting of systematic literature searches, snowballing, and thematic synthesis. We found out (1) which validity threat categories are most often discussed in primary studies of code comprehension, and we collected evidence to build (2) the evidence profiles for the three most commonly reported threats to validity. We discovered that few mentions of validity threats in primary studies (31 of 409) included a reference to supporting evidence. For the three most commonly mentioned threats, namely the influence of programming experience, program length, and the selected comprehension measures, almost all cited studies (17 of 18) did not meet our criteria for evidence. We show that for many threats to validity that are currently assumed to be influential across all studies, their actual impact may depend on the design and context of each specific study. Researchers should discuss threats to validity within the context of their particular study and support their discussions with evidence. The present paper can be one resource for evidence, and we call for more meta-studies of this type to be conducted, which will then inform design decisions in primary studies. Further, although we have applied our methodology in the context of program comprehension, our approach can also be used in other SE research areas to enable evidence-based experiment design decisions and meaningful discussions of threats to validity." @default.
- W4384345630 created "2023-07-15" @default.
- W4384345630 creator A5008010609 @default.
- W4384345630 creator A5050191675 @default.
- W4384345630 creator A5054880551 @default.
- W4384345630 creator A5084420143 @default.
- W4384345630 date "2023-05-01" @default.
- W4384345630 modified "2023-09-27" @default.
- W4384345630 title "Evidence Profiles for Validity Threats in Program Comprehension Experiments" @default.
- W4384345630 cites W1966216063 @default.
- W4384345630 cites W1969939902 @default.
- W4384345630 cites W1971654472 @default.
- W4384345630 cites W1975675278 @default.
- W4384345630 cites W1991079201 @default.
- W4384345630 cites W2007647073 @default.
- W4384345630 cites W2008538924 @default.
- W4384345630 cites W2014079492 @default.
- W4384345630 cites W2021285462 @default.
- W4384345630 cites W2031681640 @default.
- W4384345630 cites W2031727083 @default.
- W4384345630 cites W2039840321 @default.
- W4384345630 cites W2108072832 @default.
- W4384345630 cites W2123470003 @default.
- W4384345630 cites W2127833339 @default.
- W4384345630 cites W2133764456 @default.
- W4384345630 cites W2142185437 @default.
- W4384345630 cites W2151150086 @default.
- W4384345630 cites W2162411541 @default.
- W4384345630 cites W2168130919 @default.
- W4384345630 cites W2170147406 @default.
- W4384345630 cites W2202974375 @default.
- W4384345630 cites W2380271241 @default.
- W4384345630 cites W2523427633 @default.
- W4384345630 cites W2535297765 @default.
- W4384345630 cites W2547278672 @default.
- W4384345630 cites W2566208852 @default.
- W4384345630 cites W2580685985 @default.
- W4384345630 cites W2724855087 @default.
- W4384345630 cites W2799607937 @default.
- W4384345630 cites W2808267878 @default.
- W4384345630 cites W2901317285 @default.
- W4384345630 cites W2906151105 @default.
- W4384345630 cites W2941714792 @default.
- W4384345630 cites W2962733399 @default.
- W4384345630 cites W2968611851 @default.
- W4384345630 cites W2993264455 @default.
- W4384345630 cites W31130938 @default.
- W4384345630 cites W3126162568 @default.
- W4384345630 cites W3148212941 @default.
- W4384345630 cites W4207009811 @default.
- W4384345630 cites W4239863959 @default.
- W4384345630 cites W4247781538 @default.
- W4384345630 doi "https://doi.org/10.1109/icse48619.2023.00162" @default.
- W4384345630 hasPublicationYear "2023" @default.
- W4384345630 type Work @default.
- W4384345630 citedByCount "0" @default.
- W4384345630 crossrefType "proceedings-article" @default.
- W4384345630 hasAuthorship W4384345630A5008010609 @default.
- W4384345630 hasAuthorship W4384345630A5050191675 @default.
- W4384345630 hasAuthorship W4384345630A5054880551 @default.
- W4384345630 hasAuthorship W4384345630A5084420143 @default.
- W4384345630 hasBestOaLocation W43843456302 @default.
- W4384345630 hasConcept C111472728 @default.
- W4384345630 hasConcept C120936955 @default.
- W4384345630 hasConcept C138885662 @default.
- W4384345630 hasConcept C142724271 @default.
- W4384345630 hasConcept C149091818 @default.
- W4384345630 hasConcept C151730666 @default.
- W4384345630 hasConcept C15744967 @default.
- W4384345630 hasConcept C166052673 @default.
- W4384345630 hasConcept C171606756 @default.
- W4384345630 hasConcept C174106493 @default.
- W4384345630 hasConcept C199360897 @default.
- W4384345630 hasConcept C2522767166 @default.
- W4384345630 hasConcept C2777561058 @default.
- W4384345630 hasConcept C2777904410 @default.
- W4384345630 hasConcept C2779343474 @default.
- W4384345630 hasConcept C41008148 @default.
- W4384345630 hasConcept C51082289 @default.
- W4384345630 hasConcept C511192102 @default.
- W4384345630 hasConcept C70364389 @default.
- W4384345630 hasConcept C70410870 @default.
- W4384345630 hasConcept C71924100 @default.
- W4384345630 hasConcept C75630572 @default.
- W4384345630 hasConcept C77805123 @default.
- W4384345630 hasConcept C86803240 @default.
- W4384345630 hasConceptScore W4384345630C111472728 @default.
- W4384345630 hasConceptScore W4384345630C120936955 @default.
- W4384345630 hasConceptScore W4384345630C138885662 @default.
- W4384345630 hasConceptScore W4384345630C142724271 @default.
- W4384345630 hasConceptScore W4384345630C149091818 @default.
- W4384345630 hasConceptScore W4384345630C151730666 @default.
- W4384345630 hasConceptScore W4384345630C15744967 @default.
- W4384345630 hasConceptScore W4384345630C166052673 @default.
- W4384345630 hasConceptScore W4384345630C171606756 @default.
- W4384345630 hasConceptScore W4384345630C174106493 @default.
- W4384345630 hasConceptScore W4384345630C199360897 @default.
- W4384345630 hasConceptScore W4384345630C2522767166 @default.
- W4384345630 hasConceptScore W4384345630C2777561058 @default.
- W4384345630 hasConceptScore W4384345630C2777904410 @default.