Matches in SemOpenAlex for { <https://semopenalex.org/work/W2967330081> ?p ?o ?g. }
Showing items 1 to 97 of
97
with 100 items per page.
- W2967330081 abstract "Preactivation ResNets consistently outperforms the original postactivation ResNets on the CIFAR10/100 classification benchmark. However, these results surprisingly do not carry over to the standard ImageNet benchmark. First, we theoretically analyze this incongruity in terms of how the two variants differ in handling the propagation of gradients. Although identity shortcuts are critical in both variants for improving optimization and performance, we show that postactivation variants enable early layers to receive a diverse dynamic composition of gradients from effectively deeper paths in comparison to preactivation variants, enabling the network to make maximal use of its representational capacity. Second, we show that downsampling projections (while only a few in number) have a significantly detrimental effect on performance. We show that by simply replacing downsampling projections with identitylike dense-reshape shortcuts, the classification results of standard residual architectures such as ResNets, ResNeXts, and SE-Nets improve by up to 1.2% on ImageNet, without any increase in computational complexity (FLOPs)." @default.
- W2967330081 created "2019-08-22" @default.
- W2967330081 creator A5029980724 @default.
- W2967330081 creator A5055264952 @default.
- W2967330081 date "2020-01-01" @default.
- W2967330081 modified "2023-09-25" @default.
- W2967330081 title "A Generic Improvement to Deep Residual Networks Based on Gradient Flow" @default.
- W2967330081 cites W1530262073 @default.
- W2967330081 cites W1686810756 @default.
- W2967330081 cites W2097117768 @default.
- W2967330081 cites W2108598243 @default.
- W2967330081 cites W2161388792 @default.
- W2967330081 cites W2163605009 @default.
- W2967330081 cites W2194775991 @default.
- W2967330081 cites W2302255633 @default.
- W2967330081 cites W2331143823 @default.
- W2967330081 cites W2402144811 @default.
- W2967330081 cites W2476548250 @default.
- W2967330081 cites W2535388113 @default.
- W2967330081 cites W2549139847 @default.
- W2967330081 cites W2560215812 @default.
- W2967330081 cites W2565827560 @default.
- W2967330081 cites W2570467259 @default.
- W2967330081 cites W2604414494 @default.
- W2967330081 cites W2613718673 @default.
- W2967330081 cites W2623790698 @default.
- W2967330081 cites W2900590034 @default.
- W2967330081 cites W2949242443 @default.
- W2967330081 cites W2952626150 @default.
- W2967330081 cites W2962990163 @default.
- W2967330081 cites W2963372104 @default.
- W2967330081 cites W2963410064 @default.
- W2967330081 cites W2963446712 @default.
- W2967330081 cites W2963975324 @default.
- W2967330081 cites W2964166828 @default.
- W2967330081 cites W2964350391 @default.
- W2967330081 cites W3018960895 @default.
- W2967330081 doi "https://doi.org/10.1109/tnnls.2019.2929198" @default.
- W2967330081 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/31425125" @default.
- W2967330081 hasPublicationYear "2020" @default.
- W2967330081 type Work @default.
- W2967330081 sameAs 2967330081 @default.
- W2967330081 citedByCount "4" @default.
- W2967330081 countsByYear W29673300812020 @default.
- W2967330081 countsByYear W29673300812021 @default.
- W2967330081 countsByYear W29673300812022 @default.
- W2967330081 crossrefType "journal-article" @default.
- W2967330081 hasAuthorship W2967330081A5029980724 @default.
- W2967330081 hasAuthorship W2967330081A5055264952 @default.
- W2967330081 hasConcept C110384440 @default.
- W2967330081 hasConcept C11413529 @default.
- W2967330081 hasConcept C115961682 @default.
- W2967330081 hasConcept C119857082 @default.
- W2967330081 hasConcept C127313418 @default.
- W2967330081 hasConcept C13280743 @default.
- W2967330081 hasConcept C134306372 @default.
- W2967330081 hasConcept C154945302 @default.
- W2967330081 hasConcept C155512373 @default.
- W2967330081 hasConcept C173608175 @default.
- W2967330081 hasConcept C185798385 @default.
- W2967330081 hasConcept C33923547 @default.
- W2967330081 hasConcept C3826847 @default.
- W2967330081 hasConcept C41008148 @default.
- W2967330081 hasConcept C73000952 @default.
- W2967330081 hasConceptScore W2967330081C110384440 @default.
- W2967330081 hasConceptScore W2967330081C11413529 @default.
- W2967330081 hasConceptScore W2967330081C115961682 @default.
- W2967330081 hasConceptScore W2967330081C119857082 @default.
- W2967330081 hasConceptScore W2967330081C127313418 @default.
- W2967330081 hasConceptScore W2967330081C13280743 @default.
- W2967330081 hasConceptScore W2967330081C134306372 @default.
- W2967330081 hasConceptScore W2967330081C154945302 @default.
- W2967330081 hasConceptScore W2967330081C155512373 @default.
- W2967330081 hasConceptScore W2967330081C173608175 @default.
- W2967330081 hasConceptScore W2967330081C185798385 @default.
- W2967330081 hasConceptScore W2967330081C33923547 @default.
- W2967330081 hasConceptScore W2967330081C3826847 @default.
- W2967330081 hasConceptScore W2967330081C41008148 @default.
- W2967330081 hasConceptScore W2967330081C73000952 @default.
- W2967330081 hasLocation W29673300811 @default.
- W2967330081 hasLocation W29673300812 @default.
- W2967330081 hasOpenAccess W2967330081 @default.
- W2967330081 hasPrimaryLocation W29673300811 @default.
- W2967330081 hasRelatedWork W112744582 @default.
- W2967330081 hasRelatedWork W1485630101 @default.
- W2967330081 hasRelatedWork W172869079 @default.
- W2967330081 hasRelatedWork W2085153158 @default.
- W2967330081 hasRelatedWork W2498017833 @default.
- W2967330081 hasRelatedWork W280889461 @default.
- W2967330081 hasRelatedWork W2961085424 @default.
- W2967330081 hasRelatedWork W3095334494 @default.
- W2967330081 hasRelatedWork W3170181770 @default.
- W2967330081 hasRelatedWork W4200446208 @default.
- W2967330081 isParatext "false" @default.
- W2967330081 isRetracted "false" @default.
- W2967330081 magId "2967330081" @default.
- W2967330081 workType "article" @default.