Matches in SemOpenAlex for { <https://semopenalex.org/work/W2891285364> ?p ?o ?g. }
- W2891285364 abstract "[Context] The use of defect prediction models, such as classifiers, can support testing resource allocations by using data of the previous releases of the same project for predicting which software components are likely to be defective. A validation technique, hereinafter technique defines a specific way to split available data in training and test sets to measure a classifier accuracy. Time-series techniques have the unique ability to preserve the temporal order of data; i.e., preventing the testing set to have data antecedent to the training set. [Aim] The aim of this paper is twofold: first we check if there is a difference in the classifiers accuracy measured by time-series versus non-time-series techniques. Afterward, we check for a possible reason for this difference, i.e., if defect rates change across releases of a project. [Method] Our method consists of measuring the accuracy, i.e., AUC, of 10 classifiers on 13 open and two closed projects by using three validation techniques, namely cross validation, bootstrap, and walk-forward, where only the latter is a time-series technique. [Results] We find that the AUC of the same classifier used on the same project and measured by 10-fold varies compared to when measured by walk-forward in the range [-0.20, 0.22], and it is statistically different in 45% of the cases. Similarly, the AUC measured by bootstrap varies compared to when measured by walk-forward in the range [-0.17, 0.43], and it is statistically different in 56% of the cases. [Conclusions] We recommend choosing the technique to be used by carefully considering the conclusions to draw, the property of the available datasets, and the level of realism with the classifier usage scenario." @default.
- W2891285364 created "2018-09-27" @default.
- W2891285364 creator A5026916012 @default.
- W2891285364 creator A5044710601 @default.
- W2891285364 creator A5048245251 @default.
- W2891285364 creator A5075793467 @default.
- W2891285364 date "2018-09-05" @default.
- W2891285364 modified "2023-09-23" @default.
- W2891285364 title "Preserving Order of Data When Validating Defect Prediction Models" @default.
- W2891285364 cites W1444168786 @default.
- W2891285364 cites W1550206324 @default.
- W2891285364 cites W1554055400 @default.
- W2891285364 cites W1912151884 @default.
- W2891285364 cites W1968882522 @default.
- W2891285364 cites W1979711143 @default.
- W2891285364 cites W1980223370 @default.
- W2891285364 cites W1981109290 @default.
- W2891285364 cites W1981780459 @default.
- W2891285364 cites W1985258161 @default.
- W2891285364 cites W1992602600 @default.
- W2891285364 cites W1994493193 @default.
- W2891285364 cites W1998916198 @default.
- W2891285364 cites W2005504865 @default.
- W2891285364 cites W2025484046 @default.
- W2891285364 cites W2037668591 @default.
- W2891285364 cites W2073241381 @default.
- W2891285364 cites W2073792037 @default.
- W2891285364 cites W2080521990 @default.
- W2891285364 cites W2090653702 @default.
- W2891285364 cites W2100697007 @default.
- W2891285364 cites W2103296684 @default.
- W2891285364 cites W2107277166 @default.
- W2891285364 cites W2122702470 @default.
- W2891285364 cites W2123279272 @default.
- W2891285364 cites W2123504579 @default.
- W2891285364 cites W2146552111 @default.
- W2891285364 cites W2151666086 @default.
- W2891285364 cites W2172073485 @default.
- W2891285364 cites W2290195878 @default.
- W2891285364 cites W2344072768 @default.
- W2891285364 cites W2367798545 @default.
- W2891285364 cites W2401339491 @default.
- W2891285364 cites W2474835145 @default.
- W2891285364 cites W2514698551 @default.
- W2891285364 cites W2606150376 @default.
- W2891285364 cites W2766521509 @default.
- W2891285364 cites W2773202551 @default.
- W2891285364 cites W2784525779 @default.
- W2891285364 cites W2792770187 @default.
- W2891285364 cites W2795013017 @default.
- W2891285364 cites W2963520355 @default.
- W2891285364 cites W2963548617 @default.
- W2891285364 cites W2966207845 @default.
- W2891285364 cites W3121299688 @default.
- W2891285364 cites W570123953 @default.
- W2891285364 cites W606806371 @default.
- W2891285364 cites W1857789879 @default.
- W2891285364 hasPublicationYear "2018" @default.
- W2891285364 type Work @default.
- W2891285364 sameAs 2891285364 @default.
- W2891285364 citedByCount "1" @default.
- W2891285364 countsByYear W28912853642020 @default.
- W2891285364 crossrefType "posted-content" @default.
- W2891285364 hasAuthorship W2891285364A5026916012 @default.
- W2891285364 hasAuthorship W2891285364A5044710601 @default.
- W2891285364 hasAuthorship W2891285364A5048245251 @default.
- W2891285364 hasAuthorship W2891285364A5075793467 @default.
- W2891285364 hasConcept C105795698 @default.
- W2891285364 hasConcept C119857082 @default.
- W2891285364 hasConcept C124101348 @default.
- W2891285364 hasConcept C127413603 @default.
- W2891285364 hasConcept C143724316 @default.
- W2891285364 hasConcept C146978453 @default.
- W2891285364 hasConcept C151406439 @default.
- W2891285364 hasConcept C151730666 @default.
- W2891285364 hasConcept C154945302 @default.
- W2891285364 hasConcept C204323151 @default.
- W2891285364 hasConcept C33923547 @default.
- W2891285364 hasConcept C41008148 @default.
- W2891285364 hasConcept C51632099 @default.
- W2891285364 hasConcept C58489278 @default.
- W2891285364 hasConcept C86803240 @default.
- W2891285364 hasConcept C95623464 @default.
- W2891285364 hasConceptScore W2891285364C105795698 @default.
- W2891285364 hasConceptScore W2891285364C119857082 @default.
- W2891285364 hasConceptScore W2891285364C124101348 @default.
- W2891285364 hasConceptScore W2891285364C127413603 @default.
- W2891285364 hasConceptScore W2891285364C143724316 @default.
- W2891285364 hasConceptScore W2891285364C146978453 @default.
- W2891285364 hasConceptScore W2891285364C151406439 @default.
- W2891285364 hasConceptScore W2891285364C151730666 @default.
- W2891285364 hasConceptScore W2891285364C154945302 @default.
- W2891285364 hasConceptScore W2891285364C204323151 @default.
- W2891285364 hasConceptScore W2891285364C33923547 @default.
- W2891285364 hasConceptScore W2891285364C41008148 @default.
- W2891285364 hasConceptScore W2891285364C51632099 @default.
- W2891285364 hasConceptScore W2891285364C58489278 @default.
- W2891285364 hasConceptScore W2891285364C86803240 @default.
- W2891285364 hasConceptScore W2891285364C95623464 @default.
- W2891285364 hasLocation W28912853641 @default.