Matches in SemOpenAlex for { <https://semopenalex.org/work/W4312922768> ?p ?o ?g. }
- W4312922768 abstract "Finding the best architectures for learning machines, such as deep neural networks, is a well-known technical and theoretical challenge. Recent work by Mellor et al [1] showed that there may exist correlations between the accuracies of trained networks and the values of some easily computable measures defined on randomly initialised networks which may enable the search of tens of thousands of neural architectures without training. Mellor et al [1] used the Hamming distance evaluated over all the ReLU neurons as such a measure. Motivated by these findings, in our work, we ask the question of the existence of other and perhaps more principled measures which could be used as determinants of the potential success of a given neural architecture. In particular, we examine if the dimensionality and quasi-orthogonality of neural networks' feature space could be correlated with the network's performance after training. We showed, using the setup as in Mellor et al [1], that dimensionality and quasi-orthogonality may jointly serve as networks' performance discriminants. In addition to offering new opportunities to accelerate neural architecture search, our findings suggest important relationships between the networks' final performance and properties of their randomly initialised feature spaces: data dimension and quasi-orthogonality." @default.
- W4312922768 created "2023-01-05" @default.
- W4312922768 creator A5024753869 @default.
- W4312922768 creator A5025746657 @default.
- W4312922768 creator A5052143104 @default.
- W4312922768 creator A5058069510 @default.
- W4312922768 creator A5069472885 @default.
- W4312922768 creator A5077253721 @default.
- W4312922768 date "2022-07-18" @default.
- W4312922768 modified "2023-09-25" @default.
- W4312922768 title "Quasi-orthogonality and intrinsic dimensions as measures of learning and generalisation" @default.
- W4312922768 cites W1786513448 @default.
- W4312922768 cites W2022845879 @default.
- W4312922768 cites W2028569884 @default.
- W4312922768 cites W2030499717 @default.
- W4312922768 cites W2040549971 @default.
- W4312922768 cites W2124477890 @default.
- W4312922768 cites W2754478492 @default.
- W4312922768 cites W2884063665 @default.
- W4312922768 cites W2884716758 @default.
- W4312922768 cites W2892053535 @default.
- W4312922768 cites W2977886961 @default.
- W4312922768 cites W2981563141 @default.
- W4312922768 cites W3018252856 @default.
- W4312922768 cites W3099661174 @default.
- W4312922768 cites W3204954825 @default.
- W4312922768 cites W3206571981 @default.
- W4312922768 cites W4234345389 @default.
- W4312922768 doi "https://doi.org/10.1109/ijcnn55064.2022.9892337" @default.
- W4312922768 hasPublicationYear "2022" @default.
- W4312922768 type Work @default.
- W4312922768 citedByCount "1" @default.
- W4312922768 countsByYear W43129227682023 @default.
- W4312922768 crossrefType "proceedings-article" @default.
- W4312922768 hasAuthorship W4312922768A5024753869 @default.
- W4312922768 hasAuthorship W4312922768A5025746657 @default.
- W4312922768 hasAuthorship W4312922768A5052143104 @default.
- W4312922768 hasAuthorship W4312922768A5058069510 @default.
- W4312922768 hasAuthorship W4312922768A5069472885 @default.
- W4312922768 hasAuthorship W4312922768A5077253721 @default.
- W4312922768 hasBestOaLocation W43129227682 @default.
- W4312922768 hasConcept C111030470 @default.
- W4312922768 hasConcept C111919701 @default.
- W4312922768 hasConcept C11413529 @default.
- W4312922768 hasConcept C119857082 @default.
- W4312922768 hasConcept C120314980 @default.
- W4312922768 hasConcept C124101348 @default.
- W4312922768 hasConcept C138885662 @default.
- W4312922768 hasConcept C154945302 @default.
- W4312922768 hasConcept C17137986 @default.
- W4312922768 hasConcept C193319292 @default.
- W4312922768 hasConcept C202444582 @default.
- W4312922768 hasConcept C2524010 @default.
- W4312922768 hasConcept C2776401178 @default.
- W4312922768 hasConcept C2778572836 @default.
- W4312922768 hasConcept C2778814252 @default.
- W4312922768 hasConcept C2780009758 @default.
- W4312922768 hasConcept C30732413 @default.
- W4312922768 hasConcept C33676613 @default.
- W4312922768 hasConcept C33923547 @default.
- W4312922768 hasConcept C41008148 @default.
- W4312922768 hasConcept C41895202 @default.
- W4312922768 hasConcept C50644808 @default.
- W4312922768 hasConcept C80444323 @default.
- W4312922768 hasConcept C83665646 @default.
- W4312922768 hasConceptScore W4312922768C111030470 @default.
- W4312922768 hasConceptScore W4312922768C111919701 @default.
- W4312922768 hasConceptScore W4312922768C11413529 @default.
- W4312922768 hasConceptScore W4312922768C119857082 @default.
- W4312922768 hasConceptScore W4312922768C120314980 @default.
- W4312922768 hasConceptScore W4312922768C124101348 @default.
- W4312922768 hasConceptScore W4312922768C138885662 @default.
- W4312922768 hasConceptScore W4312922768C154945302 @default.
- W4312922768 hasConceptScore W4312922768C17137986 @default.
- W4312922768 hasConceptScore W4312922768C193319292 @default.
- W4312922768 hasConceptScore W4312922768C202444582 @default.
- W4312922768 hasConceptScore W4312922768C2524010 @default.
- W4312922768 hasConceptScore W4312922768C2776401178 @default.
- W4312922768 hasConceptScore W4312922768C2778572836 @default.
- W4312922768 hasConceptScore W4312922768C2778814252 @default.
- W4312922768 hasConceptScore W4312922768C2780009758 @default.
- W4312922768 hasConceptScore W4312922768C30732413 @default.
- W4312922768 hasConceptScore W4312922768C33676613 @default.
- W4312922768 hasConceptScore W4312922768C33923547 @default.
- W4312922768 hasConceptScore W4312922768C41008148 @default.
- W4312922768 hasConceptScore W4312922768C41895202 @default.
- W4312922768 hasConceptScore W4312922768C50644808 @default.
- W4312922768 hasConceptScore W4312922768C80444323 @default.
- W4312922768 hasConceptScore W4312922768C83665646 @default.
- W4312922768 hasLocation W43129227681 @default.
- W4312922768 hasLocation W43129227682 @default.
- W4312922768 hasOpenAccess W4312922768 @default.
- W4312922768 hasPrimaryLocation W43129227681 @default.
- W4312922768 hasRelatedWork W1489992831 @default.
- W4312922768 hasRelatedWork W2079201387 @default.
- W4312922768 hasRelatedWork W2095834362 @default.
- W4312922768 hasRelatedWork W2140061864 @default.
- W4312922768 hasRelatedWork W2319450352 @default.
- W4312922768 hasRelatedWork W2949892466 @default.
- W4312922768 hasRelatedWork W3174860214 @default.