Matches in SemOpenAlex for { <https://semopenalex.org/work/W3103668067> ?p ?o ?g. }
- W3103668067 abstract "Contemporary machine learning applications often involve classification tasks with many classes. Despite their extensive use, a precise understanding of the statistical properties and behavior of classification algorithms is still missing, especially in modern regimes where the number of classes is rather large. In this paper, we take a step in this direction by providing the first asymptotically precise analysis of linear multiclass classification. Our theoretical analysis allows us to precisely characterize how the test error varies over different training algorithms, data distributions, problem dimensions as well as number of classes, inter/intra class correlations and class priors. Specifically, our analysis reveals that the classification accuracy is highly distribution-dependent with different algorithms achieving optimal performance for different data distributions and/or training/features sizes. Unlike linear regression/binary classification, the test error in multiclass classification relies on intricate functions of the trained model (e.g., correlation between some of the trained weights) whose asymptotic behavior is difficult to characterize. This challenge is already present in simple classifiers, such as those minimizing a square loss. Our novel theoretical techniques allow us to overcome some of these challenges. The insights gained may pave the way for a precise understanding of other classification algorithms beyond those studied in this paper." @default.
- W3103668067 created "2020-11-23" @default.
- W3103668067 creator A5024812488 @default.
- W3103668067 creator A5046962187 @default.
- W3103668067 creator A5050547472 @default.
- W3103668067 date "2020-11-16" @default.
- W3103668067 modified "2023-09-27" @default.
- W3103668067 title "Theoretical Insights Into Multiclass Classification: A High-dimensional Asymptotic View" @default.
- W3103668067 cites W1480538416 @default.
- W3103668067 cites W1485629353 @default.
- W3103668067 cites W1494922272 @default.
- W3103668067 cites W1573195610 @default.
- W3103668067 cites W1608733719 @default.
- W3103668067 cites W1676820704 @default.
- W3103668067 cites W1689484996 @default.
- W3103668067 cites W1800334520 @default.
- W3103668067 cites W1986705681 @default.
- W3103668067 cites W2000655290 @default.
- W3103668067 cites W2006715322 @default.
- W3103668067 cites W2021624181 @default.
- W3103668067 cites W2065800647 @default.
- W3103668067 cites W2077306951 @default.
- W3103668067 cites W2096520669 @default.
- W3103668067 cites W2101276256 @default.
- W3103668067 cites W2108394050 @default.
- W3103668067 cites W2116444583 @default.
- W3103668067 cites W2123202508 @default.
- W3103668067 cites W2130942839 @default.
- W3103668067 cites W2133864802 @default.
- W3103668067 cites W2141062690 @default.
- W3103668067 cites W2157791002 @default.
- W3103668067 cites W2164595191 @default.
- W3103668067 cites W2282078507 @default.
- W3103668067 cites W2296616510 @default.
- W3103668067 cites W2405602819 @default.
- W3103668067 cites W2461743311 @default.
- W3103668067 cites W2512971201 @default.
- W3103668067 cites W2523051598 @default.
- W3103668067 cites W2547875792 @default.
- W3103668067 cites W2553576544 @default.
- W3103668067 cites W2581138301 @default.
- W3103668067 cites W2614751510 @default.
- W3103668067 cites W2765329844 @default.
- W3103668067 cites W2891124631 @default.
- W3103668067 cites W2899436891 @default.
- W3103668067 cites W2905371339 @default.
- W3103668067 cites W2909326933 @default.
- W3103668067 cites W2922934758 @default.
- W3103668067 cites W2939822721 @default.
- W3103668067 cites W2962708723 @default.
- W3103668067 cites W2962785246 @default.
- W3103668067 cites W2963017107 @default.
- W3103668067 cites W2963060833 @default.
- W3103668067 cites W2963203807 @default.
- W3103668067 cites W2964309963 @default.
- W3103668067 cites W2970316015 @default.
- W3103668067 cites W2970423380 @default.
- W3103668067 cites W2970806297 @default.
- W3103668067 cites W2974475894 @default.
- W3103668067 cites W2989169642 @default.
- W3103668067 cites W3004510491 @default.
- W3103668067 cites W3007237875 @default.
- W3103668067 cites W3011054152 @default.
- W3103668067 cites W3011980396 @default.
- W3103668067 cites W3014636164 @default.
- W3103668067 cites W3022893496 @default.
- W3103668067 cites W3034426742 @default.
- W3103668067 cites W3035703482 @default.
- W3103668067 cites W3037659592 @default.
- W3103668067 cites W3046374342 @default.
- W3103668067 cites W3080936353 @default.
- W3103668067 cites W3121235106 @default.
- W3103668067 cites W3151137625 @default.
- W3103668067 cites W583140124 @default.
- W3103668067 cites W590507843 @default.
- W3103668067 cites W74946117 @default.
- W3103668067 cites W835905657 @default.
- W3103668067 hasPublicationYear "2020" @default.
- W3103668067 type Work @default.
- W3103668067 sameAs 3103668067 @default.
- W3103668067 citedByCount "0" @default.
- W3103668067 crossrefType "posted-content" @default.
- W3103668067 hasAuthorship W3103668067A5024812488 @default.
- W3103668067 hasAuthorship W3103668067A5046962187 @default.
- W3103668067 hasAuthorship W3103668067A5050547472 @default.
- W3103668067 hasConcept C105795698 @default.
- W3103668067 hasConcept C107673813 @default.
- W3103668067 hasConcept C111472728 @default.
- W3103668067 hasConcept C11413529 @default.
- W3103668067 hasConcept C119857082 @default.
- W3103668067 hasConcept C12267149 @default.
- W3103668067 hasConcept C123860398 @default.
- W3103668067 hasConcept C138885662 @default.
- W3103668067 hasConcept C153180895 @default.
- W3103668067 hasConcept C154945302 @default.
- W3103668067 hasConcept C177769412 @default.
- W3103668067 hasConcept C2777212361 @default.
- W3103668067 hasConcept C2780586882 @default.
- W3103668067 hasConcept C33923547 @default.
- W3103668067 hasConcept C41008148 @default.