Matches in SemOpenAlex for { <https://semopenalex.org/work/W2903886228> ?p ?o ?g. }
- W2903886228 abstract "We derive the fast convergence rates of a deep neural network (DNN) classifier with the rectified linear unit (ReLU) activation function learned using the hinge loss. We consider three cases for a true model: (1) a smooth decision boundary, (2) smooth conditional class probability, and (3) the margin condition (i.e., the probability of inputs near the decision boundary is small). We show that the DNN classifier learned using the hinge loss achieves fast rate convergences for all three cases provided that the architecture (i.e., the number of layers, number of nodes and sparsity). is carefully selected. An important implication is that DNN architectures are very flexible for use in various cases without much modification. In addition, we consider a DNN classifier learned by minimizing the cross-entropy, and show that the DNN classifier achieves a fast convergence rate under the condition that the conditional class probabilities of most data are sufficiently close to either 1 or zero. This assumption is not unusual for image recognition because human beings are extremely good at recognizing most images. To confirm our theoretical explanation, we present the results of a small numerical study conducted to compare the hinge loss and cross-entropy." @default.
- W2903886228 created "2018-12-22" @default.
- W2903886228 creator A5011264910 @default.
- W2903886228 creator A5022240133 @default.
- W2903886228 creator A5039296329 @default.
- W2903886228 date "2018-12-10" @default.
- W2903886228 modified "2023-09-27" @default.
- W2903886228 title "Fast convergence rates of deep neural networks for classification" @default.
- W2903886228 cites W1585021961 @default.
- W2903886228 cites W1698155719 @default.
- W2903886228 cites W1935978687 @default.
- W2903886228 cites W1982032418 @default.
- W2903886228 cites W1994197834 @default.
- W2903886228 cites W2015052585 @default.
- W2903886228 cites W2022465039 @default.
- W2903886228 cites W2024046085 @default.
- W2903886228 cites W2029115180 @default.
- W2903886228 cites W2030843733 @default.
- W2903886228 cites W2043919728 @default.
- W2903886228 cites W2049393399 @default.
- W2903886228 cites W2100495367 @default.
- W2903886228 cites W2136922672 @default.
- W2903886228 cites W2142114717 @default.
- W2903886228 cites W2161388792 @default.
- W2903886228 cites W2528305538 @default.
- W2903886228 cites W2557283755 @default.
- W2903886228 cites W2949117887 @default.
- W2903886228 cites W2952226704 @default.
- W2903886228 cites W2962742960 @default.
- W2903886228 cites W2963000224 @default.
- W2903886228 cites W2963146412 @default.
- W2903886228 cites W2963264710 @default.
- W2903886228 cites W2963674932 @default.
- W2903886228 cites W2963982496 @default.
- W2903886228 cites W3099719085 @default.
- W2903886228 cites W3102511045 @default.
- W2903886228 hasPublicationYear "2018" @default.
- W2903886228 type Work @default.
- W2903886228 sameAs 2903886228 @default.
- W2903886228 citedByCount "1" @default.
- W2903886228 countsByYear W29038862282020 @default.
- W2903886228 crossrefType "posted-content" @default.
- W2903886228 hasAuthorship W2903886228A5011264910 @default.
- W2903886228 hasAuthorship W2903886228A5022240133 @default.
- W2903886228 hasAuthorship W2903886228A5039296329 @default.
- W2903886228 hasConcept C106301342 @default.
- W2903886228 hasConcept C11413529 @default.
- W2903886228 hasConcept C115961682 @default.
- W2903886228 hasConcept C119857082 @default.
- W2903886228 hasConcept C121332964 @default.
- W2903886228 hasConcept C12267149 @default.
- W2903886228 hasConcept C127162648 @default.
- W2903886228 hasConcept C139532973 @default.
- W2903886228 hasConcept C153180895 @default.
- W2903886228 hasConcept C154945302 @default.
- W2903886228 hasConcept C167981619 @default.
- W2903886228 hasConcept C2984842247 @default.
- W2903886228 hasConcept C31258907 @default.
- W2903886228 hasConcept C38365724 @default.
- W2903886228 hasConcept C39891107 @default.
- W2903886228 hasConcept C41008148 @default.
- W2903886228 hasConcept C42023084 @default.
- W2903886228 hasConcept C50644808 @default.
- W2903886228 hasConcept C57869625 @default.
- W2903886228 hasConcept C62520636 @default.
- W2903886228 hasConcept C75294576 @default.
- W2903886228 hasConcept C95623464 @default.
- W2903886228 hasConceptScore W2903886228C106301342 @default.
- W2903886228 hasConceptScore W2903886228C11413529 @default.
- W2903886228 hasConceptScore W2903886228C115961682 @default.
- W2903886228 hasConceptScore W2903886228C119857082 @default.
- W2903886228 hasConceptScore W2903886228C121332964 @default.
- W2903886228 hasConceptScore W2903886228C12267149 @default.
- W2903886228 hasConceptScore W2903886228C127162648 @default.
- W2903886228 hasConceptScore W2903886228C139532973 @default.
- W2903886228 hasConceptScore W2903886228C153180895 @default.
- W2903886228 hasConceptScore W2903886228C154945302 @default.
- W2903886228 hasConceptScore W2903886228C167981619 @default.
- W2903886228 hasConceptScore W2903886228C2984842247 @default.
- W2903886228 hasConceptScore W2903886228C31258907 @default.
- W2903886228 hasConceptScore W2903886228C38365724 @default.
- W2903886228 hasConceptScore W2903886228C39891107 @default.
- W2903886228 hasConceptScore W2903886228C41008148 @default.
- W2903886228 hasConceptScore W2903886228C42023084 @default.
- W2903886228 hasConceptScore W2903886228C50644808 @default.
- W2903886228 hasConceptScore W2903886228C57869625 @default.
- W2903886228 hasConceptScore W2903886228C62520636 @default.
- W2903886228 hasConceptScore W2903886228C75294576 @default.
- W2903886228 hasConceptScore W2903886228C95623464 @default.
- W2903886228 hasLocation W29038862281 @default.
- W2903886228 hasOpenAccess W2903886228 @default.
- W2903886228 hasPrimaryLocation W29038862281 @default.
- W2903886228 hasRelatedWork W1569549387 @default.
- W2903886228 hasRelatedWork W2295405790 @default.
- W2903886228 hasRelatedWork W232973997 @default.
- W2903886228 hasRelatedWork W2483754710 @default.
- W2903886228 hasRelatedWork W2786098160 @default.
- W2903886228 hasRelatedWork W2791139006 @default.
- W2903886228 hasRelatedWork W2798027793 @default.
- W2903886228 hasRelatedWork W2799238091 @default.