Matches in SemOpenAlex for { <https://semopenalex.org/work/W2947556543> ?p ?o ?g. }
- W2947556543 abstract "Convolution is a central operation in Convolutional Neural Networks (CNNs),which applies a kernel to overlapping regions shifted across the image.However, because of the strong correlations in real-world image data,convolutional kernels are in effect re-learning redundant data. In this work,we show that this redundancy has made neural network training challenging, andpropose network deconvolution, a procedure which optimally removes pixel-wiseand channel-wise correlations before the data is fed into each layer. Networkdeconvolution can be efficiently calculated at a fraction of the computationalcost of a convolution layer. We also show that the deconvolution filters in thefirst layer of the network resemble the center-surround structure found inbiological neurons in the visual regions of the brain. Filtering with suchkernels results in a sparse representation, a desired property that has beenmissing in the training of neural networks. Learning from the sparserepresentation promotes faster convergence and superior results without the useof batch normalization. We apply our network deconvolution operation to 10modern neural network models by replacing batch normalization within each.Extensive experiments show that the network deconvolution operation is able todeliver performance improvement in all cases on the CIFAR-10, CIFAR-100, MNIST,Fashion-MNIST, Cityscapes, and ImageNet datasets." @default.
- W2947556543 created "2019-06-07" @default.
- W2947556543 creator A5022360238 @default.
- W2947556543 creator A5023301667 @default.
- W2947556543 creator A5036912867 @default.
- W2947556543 creator A5067533973 @default.
- W2947556543 creator A5072804127 @default.
- W2947556543 creator A5075000826 @default.
- W2947556543 creator A5083553427 @default.
- W2947556543 creator A5084386258 @default.
- W2947556543 date "2019-05-28" @default.
- W2947556543 modified "2023-09-22" @default.
- W2947556543 title "Network Deconvolution" @default.
- W2947556543 cites W1483804921 @default.
- W2947556543 cites W1533072162 @default.
- W2947556543 cites W1665214252 @default.
- W2947556543 cites W1976730913 @default.
- W2947556543 cites W1980266375 @default.
- W2947556543 cites W1985242550 @default.
- W2947556543 cites W2001515960 @default.
- W2947556543 cites W2015208937 @default.
- W2947556543 cites W2116360511 @default.
- W2947556543 cites W2135980043 @default.
- W2947556543 cites W2136325353 @default.
- W2947556543 cites W2145889472 @default.
- W2947556543 cites W2798909945 @default.
- W2947556543 cites W2890113354 @default.
- W2947556543 cites W2963743626 @default.
- W2947556543 cites W2963857170 @default.
- W2947556543 hasPublicationYear "2019" @default.
- W2947556543 type Work @default.
- W2947556543 sameAs 2947556543 @default.
- W2947556543 citedByCount "1" @default.
- W2947556543 countsByYear W29475565432020 @default.
- W2947556543 crossrefType "posted-content" @default.
- W2947556543 hasAuthorship W2947556543A5022360238 @default.
- W2947556543 hasAuthorship W2947556543A5023301667 @default.
- W2947556543 hasAuthorship W2947556543A5036912867 @default.
- W2947556543 hasAuthorship W2947556543A5067533973 @default.
- W2947556543 hasAuthorship W2947556543A5072804127 @default.
- W2947556543 hasAuthorship W2947556543A5075000826 @default.
- W2947556543 hasAuthorship W2947556543A5083553427 @default.
- W2947556543 hasAuthorship W2947556543A5084386258 @default.
- W2947556543 hasConcept C111919701 @default.
- W2947556543 hasConcept C11413529 @default.
- W2947556543 hasConcept C114614502 @default.
- W2947556543 hasConcept C136886441 @default.
- W2947556543 hasConcept C144024400 @default.
- W2947556543 hasConcept C152124472 @default.
- W2947556543 hasConcept C153180895 @default.
- W2947556543 hasConcept C154945302 @default.
- W2947556543 hasConcept C174576160 @default.
- W2947556543 hasConcept C190502265 @default.
- W2947556543 hasConcept C19165224 @default.
- W2947556543 hasConcept C33923547 @default.
- W2947556543 hasConcept C41008148 @default.
- W2947556543 hasConcept C45347329 @default.
- W2947556543 hasConcept C50644808 @default.
- W2947556543 hasConcept C60908668 @default.
- W2947556543 hasConcept C74193536 @default.
- W2947556543 hasConcept C81363708 @default.
- W2947556543 hasConceptScore W2947556543C111919701 @default.
- W2947556543 hasConceptScore W2947556543C11413529 @default.
- W2947556543 hasConceptScore W2947556543C114614502 @default.
- W2947556543 hasConceptScore W2947556543C136886441 @default.
- W2947556543 hasConceptScore W2947556543C144024400 @default.
- W2947556543 hasConceptScore W2947556543C152124472 @default.
- W2947556543 hasConceptScore W2947556543C153180895 @default.
- W2947556543 hasConceptScore W2947556543C154945302 @default.
- W2947556543 hasConceptScore W2947556543C174576160 @default.
- W2947556543 hasConceptScore W2947556543C190502265 @default.
- W2947556543 hasConceptScore W2947556543C19165224 @default.
- W2947556543 hasConceptScore W2947556543C33923547 @default.
- W2947556543 hasConceptScore W2947556543C41008148 @default.
- W2947556543 hasConceptScore W2947556543C45347329 @default.
- W2947556543 hasConceptScore W2947556543C50644808 @default.
- W2947556543 hasConceptScore W2947556543C60908668 @default.
- W2947556543 hasConceptScore W2947556543C74193536 @default.
- W2947556543 hasConceptScore W2947556543C81363708 @default.
- W2947556543 hasLocation W29475565431 @default.
- W2947556543 hasOpenAccess W2947556543 @default.
- W2947556543 hasPrimaryLocation W29475565431 @default.
- W2947556543 hasRelatedWork W2362164969 @default.
- W2947556543 hasRelatedWork W2766854072 @default.
- W2947556543 hasRelatedWork W2787640691 @default.
- W2947556543 hasRelatedWork W2826389836 @default.
- W2947556543 hasRelatedWork W2947516189 @default.
- W2947556543 hasRelatedWork W2963316641 @default.
- W2947556543 hasRelatedWork W2963699903 @default.
- W2947556543 hasRelatedWork W2971503239 @default.
- W2947556543 hasRelatedWork W2980907007 @default.
- W2947556543 hasRelatedWork W2984005812 @default.
- W2947556543 hasRelatedWork W3012359162 @default.
- W2947556543 hasRelatedWork W3037315397 @default.
- W2947556543 hasRelatedWork W3037420336 @default.
- W2947556543 hasRelatedWork W3048092834 @default.
- W2947556543 hasRelatedWork W3088389255 @default.
- W2947556543 hasRelatedWork W3121227506 @default.
- W2947556543 hasRelatedWork W3124138214 @default.
- W2947556543 hasRelatedWork W3126412799 @default.