Matches in SemOpenAlex for { <https://semopenalex.org/work/W2895864717> ?p ?o ?g. }
Showing items 1 to 79 of
79
with 100 items per page.
- W2895864717 abstract "We characterize a prevalent weakness of deep neural networks (DNNs)---overthinking---which occurs when a DNN can reach correct predictions before its final layer. Overthinking is computationally wasteful, and it can also be destructive when, by the final layer, a correct prediction changes into a misclassification. Understanding overthinking requires studying how each prediction evolves during a DNN's forward pass, which conventionally is opaque. For prediction transparency, we propose the Shallow-Deep Network (SDN), a generic modification to off-the-shelf DNNs that introduces internal classifiers. We apply SDN to four modern architectures, trained on three image classification tasks, to characterize the overthinking problem. We show that SDNs can mitigate the wasteful effect of overthinking with confidence-based early exits, which reduce the average inference cost by more than 50% and preserve the accuracy. We also find that the destructive effect occurs for 50% of misclassifications on natural inputs and that it can be induced, adversarially, with a recent backdooring attack. To mitigate this effect, we propose a new confusion metric to quantify the internal disagreements that will likely lead to misclassifications." @default.
- W2895864717 created "2018-10-26" @default.
- W2895864717 creator A5033409139 @default.
- W2895864717 creator A5037829512 @default.
- W2895864717 date "2018-10-16" @default.
- W2895864717 modified "2023-10-18" @default.
- W2895864717 title "How to Stop Off-the-Shelf Deep Neural Networks from Overthinking." @default.
- W2895864717 hasPublicationYear "2018" @default.
- W2895864717 type Work @default.
- W2895864717 sameAs 2895864717 @default.
- W2895864717 citedByCount "0" @default.
- W2895864717 crossrefType "posted-content" @default.
- W2895864717 hasAuthorship W2895864717A5033409139 @default.
- W2895864717 hasAuthorship W2895864717A5037829512 @default.
- W2895864717 hasConcept C11171543 @default.
- W2895864717 hasConcept C119857082 @default.
- W2895864717 hasConcept C154945302 @default.
- W2895864717 hasConcept C15744967 @default.
- W2895864717 hasConcept C162324750 @default.
- W2895864717 hasConcept C176217482 @default.
- W2895864717 hasConcept C178790620 @default.
- W2895864717 hasConcept C185592680 @default.
- W2895864717 hasConcept C187736073 @default.
- W2895864717 hasConcept C21547014 @default.
- W2895864717 hasConcept C2776214188 @default.
- W2895864717 hasConcept C2779227376 @default.
- W2895864717 hasConcept C2780233690 @default.
- W2895864717 hasConcept C2780898871 @default.
- W2895864717 hasConcept C2781140086 @default.
- W2895864717 hasConcept C2984842247 @default.
- W2895864717 hasConcept C38652104 @default.
- W2895864717 hasConcept C41008148 @default.
- W2895864717 hasConcept C50644808 @default.
- W2895864717 hasConceptScore W2895864717C11171543 @default.
- W2895864717 hasConceptScore W2895864717C119857082 @default.
- W2895864717 hasConceptScore W2895864717C154945302 @default.
- W2895864717 hasConceptScore W2895864717C15744967 @default.
- W2895864717 hasConceptScore W2895864717C162324750 @default.
- W2895864717 hasConceptScore W2895864717C176217482 @default.
- W2895864717 hasConceptScore W2895864717C178790620 @default.
- W2895864717 hasConceptScore W2895864717C185592680 @default.
- W2895864717 hasConceptScore W2895864717C187736073 @default.
- W2895864717 hasConceptScore W2895864717C21547014 @default.
- W2895864717 hasConceptScore W2895864717C2776214188 @default.
- W2895864717 hasConceptScore W2895864717C2779227376 @default.
- W2895864717 hasConceptScore W2895864717C2780233690 @default.
- W2895864717 hasConceptScore W2895864717C2780898871 @default.
- W2895864717 hasConceptScore W2895864717C2781140086 @default.
- W2895864717 hasConceptScore W2895864717C2984842247 @default.
- W2895864717 hasConceptScore W2895864717C38652104 @default.
- W2895864717 hasConceptScore W2895864717C41008148 @default.
- W2895864717 hasConceptScore W2895864717C50644808 @default.
- W2895864717 hasLocation W28958647171 @default.
- W2895864717 hasOpenAccess W2895864717 @default.
- W2895864717 hasPrimaryLocation W28958647171 @default.
- W2895864717 hasRelatedWork W2554000980 @default.
- W2895864717 hasRelatedWork W2593807705 @default.
- W2895864717 hasRelatedWork W2785321380 @default.
- W2895864717 hasRelatedWork W2809182263 @default.
- W2895864717 hasRelatedWork W2892430965 @default.
- W2895864717 hasRelatedWork W2901197893 @default.
- W2895864717 hasRelatedWork W2944897350 @default.
- W2895864717 hasRelatedWork W2947947498 @default.
- W2895864717 hasRelatedWork W2951244744 @default.
- W2895864717 hasRelatedWork W2952183644 @default.
- W2895864717 hasRelatedWork W2953054173 @default.
- W2895864717 hasRelatedWork W2970500560 @default.
- W2895864717 hasRelatedWork W3024979215 @default.
- W2895864717 hasRelatedWork W3034745658 @default.
- W2895864717 hasRelatedWork W3034750315 @default.
- W2895864717 hasRelatedWork W3042547080 @default.
- W2895864717 hasRelatedWork W3096951942 @default.
- W2895864717 hasRelatedWork W3100726446 @default.
- W2895864717 hasRelatedWork W3195221712 @default.
- W2895864717 hasRelatedWork W3212111403 @default.
- W2895864717 isParatext "false" @default.
- W2895864717 isRetracted "false" @default.
- W2895864717 magId "2895864717" @default.
- W2895864717 workType "article" @default.