Matches in SemOpenAlex for { <https://semopenalex.org/work/W2091594042> ?p ?o ?g. }
- W2091594042 endingPage "65" @default.
- W2091594042 startingPage "55" @default.
- W2091594042 abstract "System testing and invariant detection is usually conducted from the user interface perspective when the goal is to evaluate the behavior of an application as a whole. A large number of tools and techniques have been developed to generate and automate this process, many of which have been evaluated in the literature or internally within companies. Typical metrics for determining effectiveness of these techniques include code coverage and fault detection, however, with the assumption that there is determinism in the resulting outputs. In this paper we examine the extent to which a common set of factors such as the system platform, Java version, application starting state and tool harness configurations impact these metrics. We examine three layers of testing outputs: the code layer, the behavioral (or invariant) layer and the external (or user interaction) layer. In a study using five open source applications across three operating system platforms, manipulating several factors, we observe as many as 184 lines of code coverage difference between runs using the same test cases, and up to 96 percent false positives with respect to fault detection. We also see some a small variation among the invariants inferred. Despite our best efforts, we can reduce, but not completely eliminate all possible variation in the output. We use our findings to provide a set of best practices that should lead to better consistency and smaller differences in test outcomes, allowing more repeatable and reliable testing and experimentation." @default.
- W2091594042 created "2016-06-24" @default.
- W2091594042 creator A5020147981 @default.
- W2091594042 creator A5065058975 @default.
- W2091594042 creator A5079784371 @default.
- W2091594042 creator A5086797983 @default.
- W2091594042 creator A5091857140 @default.
- W2091594042 date "2015-05-16" @default.
- W2091594042 modified "2023-10-03" @default.
- W2091594042 title "Making system user interactive tests repeatable: when and what should we control?" @default.
- W2091594042 cites W1497112919 @default.
- W2091594042 cites W1975863858 @default.
- W2091594042 cites W1977362030 @default.
- W2091594042 cites W1990414292 @default.
- W2091594042 cites W1991999918 @default.
- W2091594042 cites W2008475907 @default.
- W2091594042 cites W2008550744 @default.
- W2091594042 cites W2010666546 @default.
- W2091594042 cites W2024090064 @default.
- W2091594042 cites W2026926213 @default.
- W2091594042 cites W2043813390 @default.
- W2091594042 cites W2051485057 @default.
- W2091594042 cites W2067416361 @default.
- W2091594042 cites W2076879269 @default.
- W2091594042 cites W2097499668 @default.
- W2091594042 cites W2104959783 @default.
- W2091594042 cites W2107500604 @default.
- W2091594042 cites W2110908283 @default.
- W2091594042 cites W2111774152 @default.
- W2091594042 cites W2116682634 @default.
- W2091594042 cites W2118911653 @default.
- W2091594042 cites W2133377719 @default.
- W2091594042 cites W2133537879 @default.
- W2091594042 cites W2134072476 @default.
- W2091594042 cites W2144600533 @default.
- W2091594042 cites W2147889321 @default.
- W2091594042 cites W2156883549 @default.
- W2091594042 cites W2165956168 @default.
- W2091594042 cites W2166770977 @default.
- W2091594042 cites W2166834459 @default.
- W2091594042 cites W2170078167 @default.
- W2091594042 cites W2170806228 @default.
- W2091594042 cites W2171090019 @default.
- W2091594042 cites W2171670202 @default.
- W2091594042 cites W3150555763 @default.
- W2091594042 doi "https://doi.org/10.5555/2818754.2818764" @default.
- W2091594042 hasPublicationYear "2015" @default.
- W2091594042 type Work @default.
- W2091594042 sameAs 2091594042 @default.
- W2091594042 citedByCount "9" @default.
- W2091594042 countsByYear W20915940422016 @default.
- W2091594042 countsByYear W20915940422017 @default.
- W2091594042 countsByYear W20915940422019 @default.
- W2091594042 countsByYear W20915940422020 @default.
- W2091594042 countsByYear W20915940422021 @default.
- W2091594042 crossrefType "proceedings-article" @default.
- W2091594042 hasAuthorship W2091594042A5020147981 @default.
- W2091594042 hasAuthorship W2091594042A5065058975 @default.
- W2091594042 hasAuthorship W2091594042A5079784371 @default.
- W2091594042 hasAuthorship W2091594042A5086797983 @default.
- W2091594042 hasAuthorship W2091594042A5091857140 @default.
- W2091594042 hasConcept C112789634 @default.
- W2091594042 hasConcept C119857082 @default.
- W2091594042 hasConcept C124101348 @default.
- W2091594042 hasConcept C128942645 @default.
- W2091594042 hasConcept C152745839 @default.
- W2091594042 hasConcept C152877465 @default.
- W2091594042 hasConcept C154945302 @default.
- W2091594042 hasConcept C172707124 @default.
- W2091594042 hasConcept C177264268 @default.
- W2091594042 hasConcept C199360897 @default.
- W2091594042 hasConcept C199519371 @default.
- W2091594042 hasConcept C2776436953 @default.
- W2091594042 hasConcept C2777904410 @default.
- W2091594042 hasConcept C41008148 @default.
- W2091594042 hasConcept C43126263 @default.
- W2091594042 hasConcept C53942775 @default.
- W2091594042 hasConcept C548217200 @default.
- W2091594042 hasConcept C64869954 @default.
- W2091594042 hasConceptScore W2091594042C112789634 @default.
- W2091594042 hasConceptScore W2091594042C119857082 @default.
- W2091594042 hasConceptScore W2091594042C124101348 @default.
- W2091594042 hasConceptScore W2091594042C128942645 @default.
- W2091594042 hasConceptScore W2091594042C152745839 @default.
- W2091594042 hasConceptScore W2091594042C152877465 @default.
- W2091594042 hasConceptScore W2091594042C154945302 @default.
- W2091594042 hasConceptScore W2091594042C172707124 @default.
- W2091594042 hasConceptScore W2091594042C177264268 @default.
- W2091594042 hasConceptScore W2091594042C199360897 @default.
- W2091594042 hasConceptScore W2091594042C199519371 @default.
- W2091594042 hasConceptScore W2091594042C2776436953 @default.
- W2091594042 hasConceptScore W2091594042C2777904410 @default.
- W2091594042 hasConceptScore W2091594042C41008148 @default.
- W2091594042 hasConceptScore W2091594042C43126263 @default.
- W2091594042 hasConceptScore W2091594042C53942775 @default.
- W2091594042 hasConceptScore W2091594042C548217200 @default.
- W2091594042 hasConceptScore W2091594042C64869954 @default.
- W2091594042 hasLocation W20915940421 @default.