Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313530007> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W4313530007 endingPage "200172" @default.
- W4313530007 startingPage "200172" @default.
- W4313530007 abstract "Assessing the accuracy in operation of a Machine Learning (ML) system for image classification on arbitrary (unlabeled) inputs is hard. This is due to the oracle problem, which impacts the ability of automatically judging the output of the classification, thus hindering the accuracy of the assessment when unlabeled previously unseen inputs are submitted to the system. We propose the Image Classification Oracle Surrogate (ICOS), a technique to automatically evaluate the accuracy in operation of image classifiers based on Convolutional Neural Networks (CNNs). To establish whether the classification of an arbitrary image is correct or not, ICOS leverages three knowledge sources: operational input data, training data, and the ML algorithm. Knowledge is expressed through likely invariants - properties which should not be violated by correct classifications. ICOS infers and filters invariants to improve the correct detection of misclassifications, reducing the number of false positives. We evaluate ICOS experimentally on twelve CNNs – using the popular MNIST, CIFAR10, CIFAR100, and ImageNet datasets. We compare it to two alternative strategies, namely cross-referencing and self-checking. Experimental results show that ICOS exhibits performance comparable to the other strategies in terms of accuracy, showing higher stability over a variety of CNNs and datasets with different complexity and size. ICOS likely invariants are shown to be effective in automatically detecting misclassifications by CNNs used in image classification tasks when the expected output is unknown; ICOS ultimately yields faithful assessments of their accuracy in operation. Knowledge about input data can also be manually incorporated into ICOS, to increase robustness against unexpected phenomena in operation, like label shift." @default.
- W4313530007 created "2023-01-06" @default.
- W4313530007 creator A5002197803 @default.
- W4313530007 creator A5039977782 @default.
- W4313530007 creator A5054616046 @default.
- W4313530007 creator A5072680843 @default.
- W4313530007 date "2023-02-01" @default.
- W4313530007 modified "2023-10-18" @default.
- W4313530007 title "Assessing operational accuracy of CNN-based image classifiers using an oracle surrogate" @default.
- W4313530007 cites W1996517887 @default.
- W4313530007 cites W2000950277 @default.
- W4313530007 cites W2074465314 @default.
- W4313530007 cites W2112796928 @default.
- W4313530007 cites W2594788739 @default.
- W4313530007 cites W2766447205 @default.
- W4313530007 cites W2807436399 @default.
- W4313530007 cites W2982138961 @default.
- W4313530007 cites W3007157104 @default.
- W4313530007 cites W3087720408 @default.
- W4313530007 cites W3165722314 @default.
- W4313530007 cites W4281493577 @default.
- W4313530007 cites W4281707113 @default.
- W4313530007 cites W4283011843 @default.
- W4313530007 doi "https://doi.org/10.1016/j.iswa.2022.200172" @default.
- W4313530007 hasPublicationYear "2023" @default.
- W4313530007 type Work @default.
- W4313530007 citedByCount "0" @default.
- W4313530007 crossrefType "journal-article" @default.
- W4313530007 hasAuthorship W4313530007A5002197803 @default.
- W4313530007 hasAuthorship W4313530007A5039977782 @default.
- W4313530007 hasAuthorship W4313530007A5054616046 @default.
- W4313530007 hasAuthorship W4313530007A5072680843 @default.
- W4313530007 hasBestOaLocation W43135300071 @default.
- W4313530007 hasConcept C104317684 @default.
- W4313530007 hasConcept C112972136 @default.
- W4313530007 hasConcept C115903868 @default.
- W4313530007 hasConcept C115961682 @default.
- W4313530007 hasConcept C119857082 @default.
- W4313530007 hasConcept C124101348 @default.
- W4313530007 hasConcept C153180895 @default.
- W4313530007 hasConcept C154945302 @default.
- W4313530007 hasConcept C185592680 @default.
- W4313530007 hasConcept C190502265 @default.
- W4313530007 hasConcept C41008148 @default.
- W4313530007 hasConcept C50644808 @default.
- W4313530007 hasConcept C55166926 @default.
- W4313530007 hasConcept C55493867 @default.
- W4313530007 hasConcept C63479239 @default.
- W4313530007 hasConcept C64869954 @default.
- W4313530007 hasConcept C75294576 @default.
- W4313530007 hasConcept C81363708 @default.
- W4313530007 hasConceptScore W4313530007C104317684 @default.
- W4313530007 hasConceptScore W4313530007C112972136 @default.
- W4313530007 hasConceptScore W4313530007C115903868 @default.
- W4313530007 hasConceptScore W4313530007C115961682 @default.
- W4313530007 hasConceptScore W4313530007C119857082 @default.
- W4313530007 hasConceptScore W4313530007C124101348 @default.
- W4313530007 hasConceptScore W4313530007C153180895 @default.
- W4313530007 hasConceptScore W4313530007C154945302 @default.
- W4313530007 hasConceptScore W4313530007C185592680 @default.
- W4313530007 hasConceptScore W4313530007C190502265 @default.
- W4313530007 hasConceptScore W4313530007C41008148 @default.
- W4313530007 hasConceptScore W4313530007C50644808 @default.
- W4313530007 hasConceptScore W4313530007C55166926 @default.
- W4313530007 hasConceptScore W4313530007C55493867 @default.
- W4313530007 hasConceptScore W4313530007C63479239 @default.
- W4313530007 hasConceptScore W4313530007C64869954 @default.
- W4313530007 hasConceptScore W4313530007C75294576 @default.
- W4313530007 hasConceptScore W4313530007C81363708 @default.
- W4313530007 hasFunder F4320320300 @default.
- W4313530007 hasFunder F4320335254 @default.
- W4313530007 hasFunder F4320338337 @default.
- W4313530007 hasLocation W43135300071 @default.
- W4313530007 hasOpenAccess W4313530007 @default.
- W4313530007 hasPrimaryLocation W43135300071 @default.
- W4313530007 hasRelatedWork W2742991909 @default.
- W4313530007 hasRelatedWork W2767651786 @default.
- W4313530007 hasRelatedWork W2810865670 @default.
- W4313530007 hasRelatedWork W2911373680 @default.
- W4313530007 hasRelatedWork W2912288872 @default.
- W4313530007 hasRelatedWork W2913749182 @default.
- W4313530007 hasRelatedWork W3156786002 @default.
- W4313530007 hasRelatedWork W3208266890 @default.
- W4313530007 hasRelatedWork W4313530007 @default.
- W4313530007 hasRelatedWork W4385415357 @default.
- W4313530007 hasVolume "17" @default.
- W4313530007 isParatext "false" @default.
- W4313530007 isRetracted "false" @default.
- W4313530007 workType "article" @default.