Matches in SemOpenAlex for { <https://semopenalex.org/work/W2623572502> ?p ?o ?g. }
- W2623572502 abstract "ABSTRACT Convolutional neural networks are rapidly gaining popularity in regulatory genomics. Typically, these networks have a stack of convolutional and pooling layers, followed by one or more fully connected layers. In genomics, the same positional patterns are often present across multiple convolutional channels. Therefore, in current state-of-the-art networks, there exists significant redundancy in the representations learned by standard fully connected layers. We present a new separable fully connected layer that learns a weights tensor that is the outer product of positional weights and cross-channel weights, thereby allowing the same positional patterns to be applied across multiple convolutional channels. Decomposing positional and cross-channel weights further enables us to readily impose biologically-inspired constraints on positional weights, such as symmetry. We also propose a novel regularizer and constraint that act on curvature in the positional weights. Using experiments on simulated and in vivo datasets, we show that networks that incorporate our separable fully connected layer outperform conventional models with analogous architectures and the same number of parameters. Additionally, our networks are more robust to hyperparameter tuning, have more informative gradients, and produce importance scores that are more consistent with known biology than conventional deep neural networks. Availability Implementation: https://github.com/kundajelab/keras/tree/keras_1 A gist illustrating model setup is at: goo.gl/gYooaa" @default.
- W2623572502 created "2017-06-15" @default.
- W2623572502 creator A5053034507 @default.
- W2623572502 creator A5075894968 @default.
- W2623572502 creator A5083952534 @default.
- W2623572502 date "2017-06-05" @default.
- W2623572502 modified "2023-09-26" @default.
- W2623572502 title "Separable Fully Connected Layers Improve Deep Learning Models For Genomics" @default.
- W2623572502 cites W1019830208 @default.
- W2623572502 cites W2514448720 @default.
- W2623572502 cites W2584834072 @default.
- W2623572502 cites W2950988695 @default.
- W2623572502 doi "https://doi.org/10.1101/146431" @default.
- W2623572502 hasPublicationYear "2017" @default.
- W2623572502 type Work @default.
- W2623572502 sameAs 2623572502 @default.
- W2623572502 citedByCount "7" @default.
- W2623572502 countsByYear W26235725022017 @default.
- W2623572502 countsByYear W26235725022018 @default.
- W2623572502 countsByYear W26235725022019 @default.
- W2623572502 countsByYear W26235725022020 @default.
- W2623572502 crossrefType "posted-content" @default.
- W2623572502 hasAuthorship W2623572502A5053034507 @default.
- W2623572502 hasAuthorship W2623572502A5075894968 @default.
- W2623572502 hasAuthorship W2623572502A5083952534 @default.
- W2623572502 hasBestOaLocation W26235725021 @default.
- W2623572502 hasConcept C108583219 @default.
- W2623572502 hasConcept C111919701 @default.
- W2623572502 hasConcept C119857082 @default.
- W2623572502 hasConcept C127162648 @default.
- W2623572502 hasConcept C13280743 @default.
- W2623572502 hasConcept C134306372 @default.
- W2623572502 hasConcept C152124472 @default.
- W2623572502 hasConcept C153180895 @default.
- W2623572502 hasConcept C154945302 @default.
- W2623572502 hasConcept C178790620 @default.
- W2623572502 hasConcept C180623205 @default.
- W2623572502 hasConcept C185592680 @default.
- W2623572502 hasConcept C185798385 @default.
- W2623572502 hasConcept C202444582 @default.
- W2623572502 hasConcept C205649164 @default.
- W2623572502 hasConcept C2779227376 @default.
- W2623572502 hasConcept C2780186347 @default.
- W2623572502 hasConcept C31258907 @default.
- W2623572502 hasConcept C33923547 @default.
- W2623572502 hasConcept C38652104 @default.
- W2623572502 hasConcept C41008148 @default.
- W2623572502 hasConcept C51255310 @default.
- W2623572502 hasConcept C70437156 @default.
- W2623572502 hasConcept C70710897 @default.
- W2623572502 hasConcept C81363708 @default.
- W2623572502 hasConcept C8642999 @default.
- W2623572502 hasConceptScore W2623572502C108583219 @default.
- W2623572502 hasConceptScore W2623572502C111919701 @default.
- W2623572502 hasConceptScore W2623572502C119857082 @default.
- W2623572502 hasConceptScore W2623572502C127162648 @default.
- W2623572502 hasConceptScore W2623572502C13280743 @default.
- W2623572502 hasConceptScore W2623572502C134306372 @default.
- W2623572502 hasConceptScore W2623572502C152124472 @default.
- W2623572502 hasConceptScore W2623572502C153180895 @default.
- W2623572502 hasConceptScore W2623572502C154945302 @default.
- W2623572502 hasConceptScore W2623572502C178790620 @default.
- W2623572502 hasConceptScore W2623572502C180623205 @default.
- W2623572502 hasConceptScore W2623572502C185592680 @default.
- W2623572502 hasConceptScore W2623572502C185798385 @default.
- W2623572502 hasConceptScore W2623572502C202444582 @default.
- W2623572502 hasConceptScore W2623572502C205649164 @default.
- W2623572502 hasConceptScore W2623572502C2779227376 @default.
- W2623572502 hasConceptScore W2623572502C2780186347 @default.
- W2623572502 hasConceptScore W2623572502C31258907 @default.
- W2623572502 hasConceptScore W2623572502C33923547 @default.
- W2623572502 hasConceptScore W2623572502C38652104 @default.
- W2623572502 hasConceptScore W2623572502C41008148 @default.
- W2623572502 hasConceptScore W2623572502C51255310 @default.
- W2623572502 hasConceptScore W2623572502C70437156 @default.
- W2623572502 hasConceptScore W2623572502C70710897 @default.
- W2623572502 hasConceptScore W2623572502C81363708 @default.
- W2623572502 hasConceptScore W2623572502C8642999 @default.
- W2623572502 hasLocation W26235725021 @default.
- W2623572502 hasOpenAccess W2623572502 @default.
- W2623572502 hasPrimaryLocation W26235725021 @default.
- W2623572502 hasRelatedWork W1019830208 @default.
- W2623572502 hasRelatedWork W2198606573 @default.
- W2623572502 hasRelatedWork W2345512687 @default.
- W2623572502 hasRelatedWork W2402213890 @default.
- W2623572502 hasRelatedWork W2408279554 @default.
- W2623572502 hasRelatedWork W2519028049 @default.
- W2623572502 hasRelatedWork W2535446807 @default.
- W2623572502 hasRelatedWork W2584834072 @default.
- W2623572502 hasRelatedWork W2796970379 @default.
- W2623572502 hasRelatedWork W2949966083 @default.
- W2623572502 hasRelatedWork W2953136705 @default.
- W2623572502 hasRelatedWork W2963025229 @default.
- W2623572502 hasRelatedWork W3033693697 @default.
- W2623572502 hasRelatedWork W3102905059 @default.
- W2623572502 hasRelatedWork W3120960909 @default.
- W2623572502 hasRelatedWork W3156692528 @default.
- W2623572502 hasRelatedWork W3165774164 @default.
- W2623572502 hasRelatedWork W3183134174 @default.
- W2623572502 hasRelatedWork W3207139774 @default.