Matches in SemOpenAlex for { <https://semopenalex.org/work/W3166161509> ?p ?o ?g. }
- W3166161509 endingPage "e548" @default.
- W3166161509 startingPage "e548" @default.
- W3166161509 abstract "Performance problems in applications should ideally be detected as soon as they occur, i.e., directly when the causing code modification is added to the code repository. To this end, complex and cost-intensive application benchmarks or lightweight but less relevant microbenchmarks can be added to existing build pipelines to ensure performance goals. In this paper, we show how the practical relevance of microbenchmark suites can be improved and verified based on the application flow during an application benchmark run. We propose an approach to determine the overlap of common function calls between application and microbenchmarks, describe a method which identifies redundant microbenchmarks, and present a recommendation algorithm which reveals relevant functions that are not covered by microbenchmarks yet. A microbenchmark suite optimized in this way can easily test all functions determined to be relevant by application benchmarks after every code change, thus, significantly reducing the risk of undetected performance problems. Our evaluation using two time series databases shows that, depending on the specific application scenario, application benchmarks cover different functions of the system under test. Their respective microbenchmark suites cover between 35.62% and 66.29% of the functions called during the application benchmark, offering substantial room for improvement. Through two use cases—removing redundancies in the microbenchmark suite and recommendation of yet uncovered functions—we decrease the total number of microbenchmarks and increase the practical relevance of both suites. Removing redundancies can significantly reduce the number of microbenchmarks (and thus the execution time as well) to ~10% and ~23% of the original microbenchmark suites, whereas recommendation identifies up to 26 and 14 newly, uncovered functions to benchmark to improve the relevance. By utilizing the differences and synergies of application benchmarks and microbenchmarks, our approach potentially enables effective software performance assurance with performance tests of multiple granularities." @default.
- W3166161509 created "2021-06-22" @default.
- W3166161509 creator A5030517674 @default.
- W3166161509 creator A5031026274 @default.
- W3166161509 creator A5032206962 @default.
- W3166161509 creator A5063875577 @default.
- W3166161509 date "2021-05-28" @default.
- W3166161509 modified "2023-09-30" @default.
- W3166161509 title "Using application benchmark call graphs to quantify and improve the practical relevance of microbenchmark suites" @default.
- W3166161509 cites W137331274 @default.
- W3166161509 cites W1651603302 @default.
- W3166161509 cites W1670932443 @default.
- W3166161509 cites W1981055536 @default.
- W3166161509 cites W1985229168 @default.
- W3166161509 cites W1997726341 @default.
- W3166161509 cites W2042273123 @default.
- W3166161509 cites W2043939022 @default.
- W3166161509 cites W2051952787 @default.
- W3166161509 cites W2060328587 @default.
- W3166161509 cites W2081357937 @default.
- W3166161509 cites W2088175657 @default.
- W3166161509 cites W2091765165 @default.
- W3166161509 cites W2112582249 @default.
- W3166161509 cites W2113606713 @default.
- W3166161509 cites W2115380655 @default.
- W3166161509 cites W2118710507 @default.
- W3166161509 cites W2125364593 @default.
- W3166161509 cites W2139209962 @default.
- W3166161509 cites W2159614205 @default.
- W3166161509 cites W2163931728 @default.
- W3166161509 cites W2240667924 @default.
- W3166161509 cites W2277866467 @default.
- W3166161509 cites W2294581520 @default.
- W3166161509 cites W2316057888 @default.
- W3166161509 cites W2405628490 @default.
- W3166161509 cites W2464535078 @default.
- W3166161509 cites W2515470496 @default.
- W3166161509 cites W2529351870 @default.
- W3166161509 cites W2579246879 @default.
- W3166161509 cites W2586295755 @default.
- W3166161509 cites W2599865417 @default.
- W3166161509 cites W2605693806 @default.
- W3166161509 cites W2605807148 @default.
- W3166161509 cites W2606302229 @default.
- W3166161509 cites W2606496611 @default.
- W3166161509 cites W2614734074 @default.
- W3166161509 cites W2620898035 @default.
- W3166161509 cites W2734631700 @default.
- W3166161509 cites W2766579252 @default.
- W3166161509 cites W2767269462 @default.
- W3166161509 cites W2783317701 @default.
- W3166161509 cites W2883526741 @default.
- W3166161509 cites W2934678393 @default.
- W3166161509 cites W2936421018 @default.
- W3166161509 cites W2943483362 @default.
- W3166161509 cites W2954796040 @default.
- W3166161509 cites W2968631515 @default.
- W3166161509 cites W2968831111 @default.
- W3166161509 cites W2969777417 @default.
- W3166161509 cites W2971728030 @default.
- W3166161509 cites W2998865585 @default.
- W3166161509 cites W3004625733 @default.
- W3166161509 cites W3014951056 @default.
- W3166161509 cites W3031010723 @default.
- W3166161509 cites W3042453106 @default.
- W3166161509 cites W3088526311 @default.
- W3166161509 cites W3092173902 @default.
- W3166161509 cites W3101119896 @default.
- W3166161509 cites W3102230016 @default.
- W3166161509 cites W3103818916 @default.
- W3166161509 cites W3108371183 @default.
- W3166161509 doi "https://doi.org/10.7717/peerj-cs.548" @default.
- W3166161509 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/8176533" @default.
- W3166161509 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/34141882" @default.
- W3166161509 hasPublicationYear "2021" @default.
- W3166161509 type Work @default.
- W3166161509 sameAs 3166161509 @default.
- W3166161509 citedByCount "3" @default.
- W3166161509 countsByYear W31661615092021 @default.
- W3166161509 countsByYear W31661615092022 @default.
- W3166161509 crossrefType "journal-article" @default.
- W3166161509 hasAuthorship W3166161509A5030517674 @default.
- W3166161509 hasAuthorship W3166161509A5031026274 @default.
- W3166161509 hasAuthorship W3166161509A5032206962 @default.
- W3166161509 hasAuthorship W3166161509A5063875577 @default.
- W3166161509 hasBestOaLocation W31661615091 @default.
- W3166161509 hasConcept C119857082 @default.
- W3166161509 hasConcept C127413603 @default.
- W3166161509 hasConcept C128942645 @default.
- W3166161509 hasConcept C13280743 @default.
- W3166161509 hasConcept C14036430 @default.
- W3166161509 hasConcept C151552104 @default.
- W3166161509 hasConcept C152877465 @default.
- W3166161509 hasConcept C158154518 @default.
- W3166161509 hasConcept C166957645 @default.
- W3166161509 hasConcept C177264268 @default.
- W3166161509 hasConcept C17744445 @default.
- W3166161509 hasConcept C185798385 @default.