Matches in SemOpenAlex for { <https://semopenalex.org/work/W2949560654> ?p ?o ?g. }
- W2949560654 abstract "We explore the redundancy of parameters in deep neural networks by replacing the conventional linear projection in fully-connected layers with the circulant projection. The circulant structure substantially reduces memory footprint and enables the use of the Fast Fourier Transform to speed up the computation. Considering a fully-connected neural network layer with d input nodes, and d output nodes, this method improves the time complexity from O(d^2) to O(dlogd) and space complexity from O(d^2) to O(d). The space savings are particularly important for modern deep convolutional neural network architectures, where fully-connected layers typically contain more than 90% of the network parameters. We further show that the gradient computation and optimization of the circulant projections can be performed very efficiently. Our experiments on three standard datasets show that the proposed approach achieves this significant gain in storage and efficiency with minimal increase in error rate compared to neural networks with unstructured projections." @default.
- W2949560654 created "2019-06-27" @default.
- W2949560654 creator A5018301052 @default.
- W2949560654 creator A5026746295 @default.
- W2949560654 creator A5037340457 @default.
- W2949560654 creator A5052325109 @default.
- W2949560654 creator A5065795593 @default.
- W2949560654 creator A5074976770 @default.
- W2949560654 date "2015-02-11" @default.
- W2949560654 modified "2023-10-18" @default.
- W2949560654 title "An exploration of parameter redundancy in deep networks with circulant projections" @default.
- W2949560654 cites W1535629693 @default.
- W2949560654 cites W1542981317 @default.
- W2949560654 cites W1570197553 @default.
- W2949560654 cites W161114242 @default.
- W2949560654 cites W1737787488 @default.
- W2949560654 cites W1814624729 @default.
- W2949560654 cites W1849277567 @default.
- W2949560654 cites W1904365287 @default.
- W2949560654 cites W1922123711 @default.
- W2949560654 cites W1950843348 @default.
- W2949560654 cites W1968422655 @default.
- W2949560654 cites W1990470142 @default.
- W2949560654 cites W1998808035 @default.
- W2949560654 cites W2058641082 @default.
- W2949560654 cites W2068730032 @default.
- W2949560654 cites W2090836891 @default.
- W2949560654 cites W2102605133 @default.
- W2949560654 cites W2112796928 @default.
- W2949560654 cites W2122221966 @default.
- W2949560654 cites W2129305389 @default.
- W2949560654 cites W2145287260 @default.
- W2949560654 cites W2152402969 @default.
- W2949560654 cites W2155541015 @default.
- W2949560654 cites W2157452486 @default.
- W2949560654 cites W2167215970 @default.
- W2949560654 cites W2168231600 @default.
- W2949560654 cites W2949825606 @default.
- W2949560654 cites W2950094539 @default.
- W2949560654 cites W2950179405 @default.
- W2949560654 cites W2950967261 @default.
- W2949560654 cites W2951472764 @default.
- W2949560654 cites W2951592057 @default.
- W2949560654 cites W2962683872 @default.
- W2949560654 cites W2963542991 @default.
- W2949560654 cites W2963911037 @default.
- W2949560654 cites W2964118293 @default.
- W2949560654 cites W587794757 @default.
- W2949560654 cites W70975097 @default.
- W2949560654 doi "https://doi.org/10.48550/arxiv.1502.03436" @default.
- W2949560654 hasPublicationYear "2015" @default.
- W2949560654 type Work @default.
- W2949560654 sameAs 2949560654 @default.
- W2949560654 citedByCount "41" @default.
- W2949560654 countsByYear W29495606542015 @default.
- W2949560654 countsByYear W29495606542016 @default.
- W2949560654 countsByYear W29495606542017 @default.
- W2949560654 countsByYear W29495606542018 @default.
- W2949560654 countsByYear W29495606542019 @default.
- W2949560654 countsByYear W29495606542020 @default.
- W2949560654 countsByYear W29495606542022 @default.
- W2949560654 crossrefType "posted-content" @default.
- W2949560654 hasAuthorship W2949560654A5018301052 @default.
- W2949560654 hasAuthorship W2949560654A5026746295 @default.
- W2949560654 hasAuthorship W2949560654A5037340457 @default.
- W2949560654 hasAuthorship W2949560654A5052325109 @default.
- W2949560654 hasAuthorship W2949560654A5065795593 @default.
- W2949560654 hasAuthorship W2949560654A5074976770 @default.
- W2949560654 hasBestOaLocation W29495606541 @default.
- W2949560654 hasConcept C111919701 @default.
- W2949560654 hasConcept C11413529 @default.
- W2949560654 hasConcept C115973184 @default.
- W2949560654 hasConcept C152124472 @default.
- W2949560654 hasConcept C154945302 @default.
- W2949560654 hasConcept C179799912 @default.
- W2949560654 hasConcept C41008148 @default.
- W2949560654 hasConcept C45374587 @default.
- W2949560654 hasConcept C50644808 @default.
- W2949560654 hasConcept C57493831 @default.
- W2949560654 hasConcept C74912251 @default.
- W2949560654 hasConcept C81363708 @default.
- W2949560654 hasConceptScore W2949560654C111919701 @default.
- W2949560654 hasConceptScore W2949560654C11413529 @default.
- W2949560654 hasConceptScore W2949560654C115973184 @default.
- W2949560654 hasConceptScore W2949560654C152124472 @default.
- W2949560654 hasConceptScore W2949560654C154945302 @default.
- W2949560654 hasConceptScore W2949560654C179799912 @default.
- W2949560654 hasConceptScore W2949560654C41008148 @default.
- W2949560654 hasConceptScore W2949560654C45374587 @default.
- W2949560654 hasConceptScore W2949560654C50644808 @default.
- W2949560654 hasConceptScore W2949560654C57493831 @default.
- W2949560654 hasConceptScore W2949560654C74912251 @default.
- W2949560654 hasConceptScore W2949560654C81363708 @default.
- W2949560654 hasLocation W29495606541 @default.
- W2949560654 hasOpenAccess W2949560654 @default.
- W2949560654 hasPrimaryLocation W29495606541 @default.
- W2949560654 hasRelatedWork W1877508920 @default.
- W2949560654 hasRelatedWork W1919191429 @default.
- W2949560654 hasRelatedWork W2074705589 @default.
- W2949560654 hasRelatedWork W2322750154 @default.