Matches in SemOpenAlex for { <https://semopenalex.org/work/W3016591907> ?p ?o ?g. }
- W3016591907 abstract "Neural networks are the pinnacle of Artificial Intelligence, as in recent years we witnessed many novel architectures, learning and optimization techniques for deep learning. Capitalizing on the fact that neural networks inherently constitute multipartite graphs among neuron layers, we aim to analyze directly their structure to extract meaningful information that can improve the learning process. To our knowledge graph mining techniques for enhancing learning in neural networks have not been thoroughly investigated. In this paper we propose an adapted version of the k-core structure for the complete weighted multipartite graph extracted from a deep learning architecture. As a multipartite graph is a combination of bipartite graphs, that are in turn the incidence graphs of hypergraphs, we design k-hypercore decomposition, the hypergraph analogue of k-core degeneracy. We applied k-hypercore to several neural network architectures, more specifically to convolutional neural networks and multilayer perceptrons for image recognition tasks after a very short pretraining. Then we used the information provided by the hypercore numbers of the neurons to re-initialize the weights of the neural network, thus biasing the gradient optimization scheme. Extensive experiments proved that k-hypercore outperforms the state-of-the-art initialization methods." @default.
- W3016591907 created "2020-04-24" @default.
- W3016591907 creator A5057695979 @default.
- W3016591907 creator A5058510425 @default.
- W3016591907 creator A5060660251 @default.
- W3016591907 creator A5085447779 @default.
- W3016591907 date "2020-04-16" @default.
- W3016591907 modified "2023-09-25" @default.
- W3016591907 title "Hcore-Init: Neural Network Initialization based on Graph Degeneracy" @default.
- W3016591907 cites W1533861849 @default.
- W3016591907 cites W1676999057 @default.
- W3016591907 cites W1677182931 @default.
- W3016591907 cites W1934481708 @default.
- W3016591907 cites W2009797711 @default.
- W3016591907 cites W2058803838 @default.
- W3016591907 cites W2095705004 @default.
- W3016591907 cites W2148606255 @default.
- W3016591907 cites W2178237821 @default.
- W3016591907 cites W2546574318 @default.
- W3016591907 cites W2808551187 @default.
- W3016591907 cites W2935576361 @default.
- W3016591907 cites W2962810718 @default.
- W3016591907 cites W3118608800 @default.
- W3016591907 hasPublicationYear "2020" @default.
- W3016591907 type Work @default.
- W3016591907 sameAs 3016591907 @default.
- W3016591907 citedByCount "0" @default.
- W3016591907 crossrefType "posted-content" @default.
- W3016591907 hasAuthorship W3016591907A5057695979 @default.
- W3016591907 hasAuthorship W3016591907A5058510425 @default.
- W3016591907 hasAuthorship W3016591907A5060660251 @default.
- W3016591907 hasAuthorship W3016591907A5085447779 @default.
- W3016591907 hasConcept C108583219 @default.
- W3016591907 hasConcept C11413529 @default.
- W3016591907 hasConcept C114466953 @default.
- W3016591907 hasConcept C118615104 @default.
- W3016591907 hasConcept C119857082 @default.
- W3016591907 hasConcept C121040770 @default.
- W3016591907 hasConcept C121332964 @default.
- W3016591907 hasConcept C132525143 @default.
- W3016591907 hasConcept C153180895 @default.
- W3016591907 hasConcept C154945302 @default.
- W3016591907 hasConcept C166733315 @default.
- W3016591907 hasConcept C197657726 @default.
- W3016591907 hasConcept C199360897 @default.
- W3016591907 hasConcept C2777727622 @default.
- W3016591907 hasConcept C2781221856 @default.
- W3016591907 hasConcept C33923547 @default.
- W3016591907 hasConcept C41008148 @default.
- W3016591907 hasConcept C50644808 @default.
- W3016591907 hasConcept C60644358 @default.
- W3016591907 hasConcept C60908668 @default.
- W3016591907 hasConcept C62520636 @default.
- W3016591907 hasConcept C80444323 @default.
- W3016591907 hasConcept C81363708 @default.
- W3016591907 hasConcept C84114770 @default.
- W3016591907 hasConcept C86803240 @default.
- W3016591907 hasConceptScore W3016591907C108583219 @default.
- W3016591907 hasConceptScore W3016591907C11413529 @default.
- W3016591907 hasConceptScore W3016591907C114466953 @default.
- W3016591907 hasConceptScore W3016591907C118615104 @default.
- W3016591907 hasConceptScore W3016591907C119857082 @default.
- W3016591907 hasConceptScore W3016591907C121040770 @default.
- W3016591907 hasConceptScore W3016591907C121332964 @default.
- W3016591907 hasConceptScore W3016591907C132525143 @default.
- W3016591907 hasConceptScore W3016591907C153180895 @default.
- W3016591907 hasConceptScore W3016591907C154945302 @default.
- W3016591907 hasConceptScore W3016591907C166733315 @default.
- W3016591907 hasConceptScore W3016591907C197657726 @default.
- W3016591907 hasConceptScore W3016591907C199360897 @default.
- W3016591907 hasConceptScore W3016591907C2777727622 @default.
- W3016591907 hasConceptScore W3016591907C2781221856 @default.
- W3016591907 hasConceptScore W3016591907C33923547 @default.
- W3016591907 hasConceptScore W3016591907C41008148 @default.
- W3016591907 hasConceptScore W3016591907C50644808 @default.
- W3016591907 hasConceptScore W3016591907C60644358 @default.
- W3016591907 hasConceptScore W3016591907C60908668 @default.
- W3016591907 hasConceptScore W3016591907C62520636 @default.
- W3016591907 hasConceptScore W3016591907C80444323 @default.
- W3016591907 hasConceptScore W3016591907C81363708 @default.
- W3016591907 hasConceptScore W3016591907C84114770 @default.
- W3016591907 hasConceptScore W3016591907C86803240 @default.
- W3016591907 hasOpenAccess W3016591907 @default.
- W3016591907 hasRelatedWork W1557057374 @default.
- W3016591907 hasRelatedWork W1580754821 @default.
- W3016591907 hasRelatedWork W2081863214 @default.
- W3016591907 hasRelatedWork W2122564745 @default.
- W3016591907 hasRelatedWork W2125607078 @default.
- W3016591907 hasRelatedWork W2163438556 @default.
- W3016591907 hasRelatedWork W2248681278 @default.
- W3016591907 hasRelatedWork W2461532701 @default.
- W3016591907 hasRelatedWork W2539886340 @default.
- W3016591907 hasRelatedWork W2784070433 @default.
- W3016591907 hasRelatedWork W3115556650 @default.
- W3016591907 hasRelatedWork W3139306118 @default.
- W3016591907 hasRelatedWork W3158297005 @default.
- W3016591907 hasRelatedWork W3161893952 @default.
- W3016591907 hasRelatedWork W3162006846 @default.
- W3016591907 hasRelatedWork W3173608637 @default.
- W3016591907 hasRelatedWork W3174222962 @default.