Matches in SemOpenAlex for { <https://semopenalex.org/work/W3147331290> ?p ?o ?g. }
- W3147331290 endingPage "3117" @default.
- W3147331290 startingPage "3117" @default.
- W3147331290 abstract "Many recent studies have shown that various multi-objective evolutionary algorithms have been widely applied in the field of search-based software engineering (SBSE) for optimal solutions. Most of them either focused on solving newly re-formulated problems or on proposing new approaches, while a number of studies performed reviews and comparative studies on the performance of proposed algorithms. To evaluate such performance, it is necessary to consider a number of performance metrics that play important roles during the evaluation and comparison of investigated algorithms based on their best-simulated results. While there are hundreds of performance metrics in the literature that can quantify in performing such tasks, there is a lack of systematic review conducted to provide evidence of using these performance metrics, particularly in the software engineering problem domain. In this paper, we aimed to review and quantify the type of performance metrics, number of objectives, and applied areas in software engineering that reported in primary studies—this will eventually lead to inspiring the SBSE community to further explore such approaches in depth. To perform this task, a formal systematic review protocol was applied for planning, searching, and extracting the desired elements from the studies. After considering all the relevant inclusion and exclusion criteria for the searching process, 105 relevant articles were identified from the targeted online databases as scientific evidence to answer the eight research questions. The preliminary results show that remarkable studies were reported without considering performance metrics for the purpose of algorithm evaluation. Based on the 27 performance metrics that were identified, hypervolume, inverted generational distance, generational distance, and hypercube-based diversity metrics appear to be widely adopted in most of the studies in software requirements engineering, software design, software project management, software testing, and software verification. Additionally, there are increasing interest in the community in re-formulating many objective problems with more than three objectives, yet, currently are dominated in re-formulating two to three objectives." @default.
- W3147331290 created "2021-04-13" @default.
- W3147331290 creator A5000454500 @default.
- W3147331290 creator A5009353020 @default.
- W3147331290 creator A5024029025 @default.
- W3147331290 creator A5038713728 @default.
- W3147331290 creator A5087099324 @default.
- W3147331290 date "2021-03-31" @default.
- W3147331290 modified "2023-10-18" @default.
- W3147331290 title "Performance Evaluation Metrics for Multi-Objective Evolutionary Algorithms in Search-Based Software Engineering: Systematic Literature Review" @default.
- W3147331290 cites W1611455054 @default.
- W3147331290 cites W1953313694 @default.
- W3147331290 cites W1962704097 @default.
- W3147331290 cites W1970205123 @default.
- W3147331290 cites W1977321274 @default.
- W3147331290 cites W1981327239 @default.
- W3147331290 cites W1984576194 @default.
- W3147331290 cites W1987846628 @default.
- W3147331290 cites W1992019261 @default.
- W3147331290 cites W2001548773 @default.
- W3147331290 cites W2013685009 @default.
- W3147331290 cites W2016004512 @default.
- W3147331290 cites W2049625105 @default.
- W3147331290 cites W2056594784 @default.
- W3147331290 cites W2058923947 @default.
- W3147331290 cites W2071336243 @default.
- W3147331290 cites W2072668705 @default.
- W3147331290 cites W2081939577 @default.
- W3147331290 cites W2085282582 @default.
- W3147331290 cites W2088598606 @default.
- W3147331290 cites W2092382400 @default.
- W3147331290 cites W2094203680 @default.
- W3147331290 cites W2097708319 @default.
- W3147331290 cites W2098907614 @default.
- W3147331290 cites W2106334424 @default.
- W3147331290 cites W2106683494 @default.
- W3147331290 cites W2106956101 @default.
- W3147331290 cites W2111540240 @default.
- W3147331290 cites W2112825198 @default.
- W3147331290 cites W2113298319 @default.
- W3147331290 cites W2133119630 @default.
- W3147331290 cites W2147826933 @default.
- W3147331290 cites W2159203651 @default.
- W3147331290 cites W2168943010 @default.
- W3147331290 cites W2172166708 @default.
- W3147331290 cites W2172293911 @default.
- W3147331290 cites W2175844808 @default.
- W3147331290 cites W2269022348 @default.
- W3147331290 cites W2291378438 @default.
- W3147331290 cites W2311532076 @default.
- W3147331290 cites W2327789292 @default.
- W3147331290 cites W2339904014 @default.
- W3147331290 cites W2342941285 @default.
- W3147331290 cites W2344388199 @default.
- W3147331290 cites W2345196092 @default.
- W3147331290 cites W2508421772 @default.
- W3147331290 cites W2509328528 @default.
- W3147331290 cites W2511336704 @default.
- W3147331290 cites W2518550796 @default.
- W3147331290 cites W2524312464 @default.
- W3147331290 cites W2529475114 @default.
- W3147331290 cites W2530083125 @default.
- W3147331290 cites W2535299462 @default.
- W3147331290 cites W2539685938 @default.
- W3147331290 cites W2558658782 @default.
- W3147331290 cites W2559566240 @default.
- W3147331290 cites W2565493441 @default.
- W3147331290 cites W2574554344 @default.
- W3147331290 cites W2577946807 @default.
- W3147331290 cites W2585224654 @default.
- W3147331290 cites W2585335632 @default.
- W3147331290 cites W2586946380 @default.
- W3147331290 cites W2596388212 @default.
- W3147331290 cites W2604256784 @default.
- W3147331290 cites W2605216647 @default.
- W3147331290 cites W2606623026 @default.
- W3147331290 cites W2611609101 @default.
- W3147331290 cites W2620902133 @default.
- W3147331290 cites W2621309054 @default.
- W3147331290 cites W264743668 @default.
- W3147331290 cites W2736565934 @default.
- W3147331290 cites W2744611928 @default.
- W3147331290 cites W2751165078 @default.
- W3147331290 cites W2751605210 @default.
- W3147331290 cites W2765787256 @default.
- W3147331290 cites W2767470376 @default.
- W3147331290 cites W2770050759 @default.
- W3147331290 cites W2775536880 @default.
- W3147331290 cites W2785772544 @default.
- W3147331290 cites W2798336324 @default.
- W3147331290 cites W2804003629 @default.
- W3147331290 cites W2804728961 @default.
- W3147331290 cites W2808276315 @default.
- W3147331290 cites W2808664504 @default.
- W3147331290 cites W2883262966 @default.
- W3147331290 cites W2883287614 @default.
- W3147331290 cites W2888468285 @default.
- W3147331290 cites W2890508658 @default.