Matches in SemOpenAlex for { <https://semopenalex.org/work/W2956152059> ?p ?o ?g. }
- W2956152059 abstract "Tens of thousands engineers are contributing to Google's codebase that spans billions of lines of code. To ensure high code quality, tremendous amount of effort has been made with new testing techniques and frameworks. However, with increasingly complex data structures and software systems, traditional test case based testing strategies cannot scale well to achieve the desired level of test adequacy. Differential (Diff) testing is one of the new testing techniques adapted to fill this gap. It uses the same input to run two versions of a software system, namely base and test, where base is the verified/tested version of the system while test is the modified version. The output of two runs are then thoroughly compared to find abnormalities that may lead to possible bugs. Over the past few years, differential testing has been quickly adopted by hundreds of teams across all major product areas at Google. Meanwhile, many new differential testing frameworks were developed to simplify the creation, maintenance, and analysis of diff tests. Curious by this emerging popularity, we conducted the first empirical study on differential testing in practice at large scale. In this study, we investigated common practices and usage of diff tests. We further explore the features of diff tests that users value the most and the pain points of using diff tests. Through this user study, we discovered that differential testing does not replace fine-grained testing techniques such as unit tests. Instead it supplements existing testing suites. It helps users verify the impact on unmodified and unfamiliar components in the absence of a test oracle. In terms of limitations, diff tests often take long time to run and appear to generate noisy and flaky outcomes. Finally, we highlight problems (including smart data differencing, sampling, and traceability) to guide future research in differential testing." @default.
- W2956152059 created "2019-07-12" @default.
- W2956152059 creator A5003747461 @default.
- W2956152059 creator A5044611363 @default.
- W2956152059 creator A5076241682 @default.
- W2956152059 date "2019-05-01" @default.
- W2956152059 modified "2023-10-01" @default.
- W2956152059 title "Perception and Practices of Differential Testing" @default.
- W2956152059 cites W1981420413 @default.
- W2956152059 cites W2020538887 @default.
- W2956152059 cites W2026926213 @default.
- W2956152059 cites W2038899190 @default.
- W2956152059 cites W2055975932 @default.
- W2956152059 cites W2104959783 @default.
- W2956152059 cites W2107709519 @default.
- W2956152059 cites W2118542736 @default.
- W2956152059 cites W2119861793 @default.
- W2956152059 cites W2134825350 @default.
- W2956152059 cites W2140697469 @default.
- W2956152059 cites W2160829641 @default.
- W2956152059 cites W2171683519 @default.
- W2956152059 cites W2807713652 @default.
- W2956152059 cites W2809161078 @default.
- W2956152059 cites W4237774489 @default.
- W2956152059 doi "https://doi.org/10.1109/icse-seip.2019.00016" @default.
- W2956152059 hasPublicationYear "2019" @default.
- W2956152059 type Work @default.
- W2956152059 sameAs 2956152059 @default.
- W2956152059 citedByCount "19" @default.
- W2956152059 countsByYear W29561520592019 @default.
- W2956152059 countsByYear W29561520592020 @default.
- W2956152059 countsByYear W29561520592021 @default.
- W2956152059 countsByYear W29561520592022 @default.
- W2956152059 countsByYear W29561520592023 @default.
- W2956152059 crossrefType "proceedings-article" @default.
- W2956152059 hasAuthorship W2956152059A5003747461 @default.
- W2956152059 hasAuthorship W2956152059A5044611363 @default.
- W2956152059 hasAuthorship W2956152059A5076241682 @default.
- W2956152059 hasConcept C111472728 @default.
- W2956152059 hasConcept C111919701 @default.
- W2956152059 hasConcept C115903868 @default.
- W2956152059 hasConcept C117447612 @default.
- W2956152059 hasConcept C127413603 @default.
- W2956152059 hasConcept C138885662 @default.
- W2956152059 hasConcept C146978453 @default.
- W2956152059 hasConcept C148027188 @default.
- W2956152059 hasConcept C149091818 @default.
- W2956152059 hasConcept C161821725 @default.
- W2956152059 hasConcept C162443782 @default.
- W2956152059 hasConcept C178059732 @default.
- W2956152059 hasConcept C182122060 @default.
- W2956152059 hasConcept C186846655 @default.
- W2956152059 hasConcept C188598960 @default.
- W2956152059 hasConcept C200601418 @default.
- W2956152059 hasConcept C24169984 @default.
- W2956152059 hasConcept C2777904410 @default.
- W2956152059 hasConcept C2779530757 @default.
- W2956152059 hasConcept C2984328558 @default.
- W2956152059 hasConcept C41008148 @default.
- W2956152059 hasConcept C51929080 @default.
- W2956152059 hasConcept C529173508 @default.
- W2956152059 hasConcept C63406617 @default.
- W2956152059 hasConcept C86469151 @default.
- W2956152059 hasConcept C93226319 @default.
- W2956152059 hasConceptScore W2956152059C111472728 @default.
- W2956152059 hasConceptScore W2956152059C111919701 @default.
- W2956152059 hasConceptScore W2956152059C115903868 @default.
- W2956152059 hasConceptScore W2956152059C117447612 @default.
- W2956152059 hasConceptScore W2956152059C127413603 @default.
- W2956152059 hasConceptScore W2956152059C138885662 @default.
- W2956152059 hasConceptScore W2956152059C146978453 @default.
- W2956152059 hasConceptScore W2956152059C148027188 @default.
- W2956152059 hasConceptScore W2956152059C149091818 @default.
- W2956152059 hasConceptScore W2956152059C161821725 @default.
- W2956152059 hasConceptScore W2956152059C162443782 @default.
- W2956152059 hasConceptScore W2956152059C178059732 @default.
- W2956152059 hasConceptScore W2956152059C182122060 @default.
- W2956152059 hasConceptScore W2956152059C186846655 @default.
- W2956152059 hasConceptScore W2956152059C188598960 @default.
- W2956152059 hasConceptScore W2956152059C200601418 @default.
- W2956152059 hasConceptScore W2956152059C24169984 @default.
- W2956152059 hasConceptScore W2956152059C2777904410 @default.
- W2956152059 hasConceptScore W2956152059C2779530757 @default.
- W2956152059 hasConceptScore W2956152059C2984328558 @default.
- W2956152059 hasConceptScore W2956152059C41008148 @default.
- W2956152059 hasConceptScore W2956152059C51929080 @default.
- W2956152059 hasConceptScore W2956152059C529173508 @default.
- W2956152059 hasConceptScore W2956152059C63406617 @default.
- W2956152059 hasConceptScore W2956152059C86469151 @default.
- W2956152059 hasConceptScore W2956152059C93226319 @default.
- W2956152059 hasLocation W29561520591 @default.
- W2956152059 hasOpenAccess W2956152059 @default.
- W2956152059 hasPrimaryLocation W29561520591 @default.
- W2956152059 hasRelatedWork W1541981223 @default.
- W2956152059 hasRelatedWork W1608087281 @default.
- W2956152059 hasRelatedWork W2101651343 @default.
- W2956152059 hasRelatedWork W2104700244 @default.
- W2956152059 hasRelatedWork W2105063825 @default.
- W2956152059 hasRelatedWork W2111684733 @default.
- W2956152059 hasRelatedWork W2123514792 @default.