Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287685082> ?p ?o ?g. }
Showing items 1 to 55 of
55
with 100 items per page.
- W4287685082 abstract "Numerous researchers recently applied empirical spectral analysis to the study of modern deep learning classifiers. We identify and discuss an important formal class/cross-class structure and show how it lies at the origin of the many visually striking features observed in deepnet spectra, some of which were reported in recent articles, others are unveiled here for the first time. These include spectral outliers, spikes, and small but distinct continuous distributions, bumps, often seen beyond the edge of a main bulk. The significance of the cross-class structure is illustrated in three ways: (i) we prove the ratio of outliers to bulk in the spectrum of the Fisher information matrix is predictive of misclassification, in the context of multinomial logistic regression; (ii) we demonstrate how, gradually with depth, a network is able to separate class-distinctive information from class variability, all while orthogonalizing the class-distinctive information; and (iii) we propose a correction to KFAC, a well-known second-order optimization algorithm for training deepnets." @default.
- W4287685082 created "2022-07-26" @default.
- W4287685082 creator A5018100130 @default.
- W4287685082 date "2020-08-26" @default.
- W4287685082 modified "2023-10-14" @default.
- W4287685082 title "Traces of Class/Cross-Class Structure Pervade Deep Learning Spectra" @default.
- W4287685082 doi "https://doi.org/10.48550/arxiv.2008.11865" @default.
- W4287685082 hasPublicationYear "2020" @default.
- W4287685082 type Work @default.
- W4287685082 citedByCount "0" @default.
- W4287685082 crossrefType "posted-content" @default.
- W4287685082 hasAuthorship W4287685082A5018100130 @default.
- W4287685082 hasBestOaLocation W42876850821 @default.
- W4287685082 hasConcept C117568660 @default.
- W4287685082 hasConcept C119857082 @default.
- W4287685082 hasConcept C127313418 @default.
- W4287685082 hasConcept C149782125 @default.
- W4287685082 hasConcept C151730666 @default.
- W4287685082 hasConcept C153180895 @default.
- W4287685082 hasConcept C154945302 @default.
- W4287685082 hasConcept C192065140 @default.
- W4287685082 hasConcept C2777212361 @default.
- W4287685082 hasConcept C2779343474 @default.
- W4287685082 hasConcept C33923547 @default.
- W4287685082 hasConcept C41008148 @default.
- W4287685082 hasConcept C79337645 @default.
- W4287685082 hasConceptScore W4287685082C117568660 @default.
- W4287685082 hasConceptScore W4287685082C119857082 @default.
- W4287685082 hasConceptScore W4287685082C127313418 @default.
- W4287685082 hasConceptScore W4287685082C149782125 @default.
- W4287685082 hasConceptScore W4287685082C151730666 @default.
- W4287685082 hasConceptScore W4287685082C153180895 @default.
- W4287685082 hasConceptScore W4287685082C154945302 @default.
- W4287685082 hasConceptScore W4287685082C192065140 @default.
- W4287685082 hasConceptScore W4287685082C2777212361 @default.
- W4287685082 hasConceptScore W4287685082C2779343474 @default.
- W4287685082 hasConceptScore W4287685082C33923547 @default.
- W4287685082 hasConceptScore W4287685082C41008148 @default.
- W4287685082 hasConceptScore W4287685082C79337645 @default.
- W4287685082 hasLocation W42876850821 @default.
- W4287685082 hasOpenAccess W4287685082 @default.
- W4287685082 hasPrimaryLocation W42876850821 @default.
- W4287685082 hasRelatedWork W2155125785 @default.
- W4287685082 hasRelatedWork W2314217709 @default.
- W4287685082 hasRelatedWork W2774493118 @default.
- W4287685082 hasRelatedWork W2807534916 @default.
- W4287685082 hasRelatedWork W2886315566 @default.
- W4287685082 hasRelatedWork W3080428960 @default.
- W4287685082 hasRelatedWork W3105243393 @default.
- W4287685082 hasRelatedWork W3136715846 @default.
- W4287685082 hasRelatedWork W4205555581 @default.
- W4287685082 hasRelatedWork W868043366 @default.
- W4287685082 isParatext "false" @default.
- W4287685082 isRetracted "false" @default.
- W4287685082 workType "article" @default.