Matches in SemOpenAlex for { <https://semopenalex.org/work/W3005732517> ?p ?o ?g. }
- W3005732517 abstract "$k$-means clustering is a fundamental problem in unsupervised learning. The problem concerns finding a partition of the data points into $k$ clusters such that the within-cluster variation is minimized. Despite its importance and wide applicability, a theoretical understanding of the $k$-means problem has not been completely satisfactory. Existing algorithms with theoretical performance guarantees often rely on sophisticated (sometimes artificial) algorithmic techniques and restricted assumptions on the data. The main challenge lies in the non-convex nature of the problem; in particular, there exist additional local solutions other than the global optimum. Moreover, the simplest and most popular algorithm for $k$-means, namely Lloyd's algorithm, generally converges to such spurious local solutions both in theory and in practice. In this paper, we approach the $k$-means problem from a new perspective, by investigating the structures of these spurious local solutions under a probabilistic generative model with $k$ ground truth clusters. As soon as $k=3$, spurious local minima provably exist, even for well-separated and balanced clusters. One such local minimum puts two centers at one true cluster, and the third center in the middle of the other two true clusters. For general $k$, one local minimum puts multiple centers at a true cluster, and one center in the middle of multiple true clusters. Perhaps surprisingly, we prove that this is essentially the only type of spurious local minima under a separation condition. Our results pertain to the $k$-means formulation for mixtures of Gaussians or bounded distributions. Our theoretical results corroborate existing empirical observations and provide justification for several improved algorithms for $k$-means clustering." @default.
- W3005732517 created "2020-02-24" @default.
- W3005732517 creator A5033145861 @default.
- W3005732517 creator A5041110468 @default.
- W3005732517 creator A5060774236 @default.
- W3005732517 date "2020-02-16" @default.
- W3005732517 modified "2023-10-03" @default.
- W3005732517 title "Structures of Spurious Local Minima in $k$-means" @default.
- W3005732517 cites W1535281955 @default.
- W3005732517 cites W159029274 @default.
- W3005732517 cites W1865173371 @default.
- W3005732517 cites W1977556410 @default.
- W3005732517 cites W1986219860 @default.
- W3005732517 cites W1986790896 @default.
- W3005732517 cites W1987019005 @default.
- W3005732517 cites W1998739300 @default.
- W3005732517 cites W2011430131 @default.
- W3005732517 cites W2029069446 @default.
- W3005732517 cites W2029698681 @default.
- W3005732517 cites W2049633694 @default.
- W3005732517 cites W2059971059 @default.
- W3005732517 cites W2073459066 @default.
- W3005732517 cites W2088879945 @default.
- W3005732517 cites W2103718624 @default.
- W3005732517 cites W2109224747 @default.
- W3005732517 cites W2115665694 @default.
- W3005732517 cites W2127218421 @default.
- W3005732517 cites W2138002832 @default.
- W3005732517 cites W2146758737 @default.
- W3005732517 cites W2150593711 @default.
- W3005732517 cites W2160197181 @default.
- W3005732517 cites W2167930540 @default.
- W3005732517 cites W2187617524 @default.
- W3005732517 cites W2199495299 @default.
- W3005732517 cites W2506488269 @default.
- W3005732517 cites W2560270297 @default.
- W3005732517 cites W2599272755 @default.
- W3005732517 cites W2884586244 @default.
- W3005732517 cites W2954474386 @default.
- W3005732517 cites W2962737134 @default.
- W3005732517 cites W2963164444 @default.
- W3005732517 cites W2963411648 @default.
- W3005732517 cites W2963455969 @default.
- W3005732517 cites W2963626260 @default.
- W3005732517 cites W2963814147 @default.
- W3005732517 cites W2964073168 @default.
- W3005732517 cites W2965628250 @default.
- W3005732517 cites W2970485282 @default.
- W3005732517 cites W3035495594 @default.
- W3005732517 cites W2185776155 @default.
- W3005732517 doi "https://doi.org/10.48550/arxiv.2002.06694" @default.
- W3005732517 hasPublicationYear "2020" @default.
- W3005732517 type Work @default.
- W3005732517 sameAs 3005732517 @default.
- W3005732517 citedByCount "2" @default.
- W3005732517 countsByYear W30057325172020 @default.
- W3005732517 crossrefType "posted-content" @default.
- W3005732517 hasAuthorship W3005732517A5033145861 @default.
- W3005732517 hasAuthorship W3005732517A5041110468 @default.
- W3005732517 hasAuthorship W3005732517A5060774236 @default.
- W3005732517 hasBestOaLocation W30057325171 @default.
- W3005732517 hasConcept C11413529 @default.
- W3005732517 hasConcept C114614502 @default.
- W3005732517 hasConcept C119857082 @default.
- W3005732517 hasConcept C126255220 @default.
- W3005732517 hasConcept C134306372 @default.
- W3005732517 hasConcept C154945302 @default.
- W3005732517 hasConcept C164866538 @default.
- W3005732517 hasConcept C186633575 @default.
- W3005732517 hasConcept C199360897 @default.
- W3005732517 hasConcept C33923547 @default.
- W3005732517 hasConcept C34388435 @default.
- W3005732517 hasConcept C41008148 @default.
- W3005732517 hasConcept C42812 @default.
- W3005732517 hasConcept C49937458 @default.
- W3005732517 hasConcept C73555534 @default.
- W3005732517 hasConcept C97256817 @default.
- W3005732517 hasConceptScore W3005732517C11413529 @default.
- W3005732517 hasConceptScore W3005732517C114614502 @default.
- W3005732517 hasConceptScore W3005732517C119857082 @default.
- W3005732517 hasConceptScore W3005732517C126255220 @default.
- W3005732517 hasConceptScore W3005732517C134306372 @default.
- W3005732517 hasConceptScore W3005732517C154945302 @default.
- W3005732517 hasConceptScore W3005732517C164866538 @default.
- W3005732517 hasConceptScore W3005732517C186633575 @default.
- W3005732517 hasConceptScore W3005732517C199360897 @default.
- W3005732517 hasConceptScore W3005732517C33923547 @default.
- W3005732517 hasConceptScore W3005732517C34388435 @default.
- W3005732517 hasConceptScore W3005732517C41008148 @default.
- W3005732517 hasConceptScore W3005732517C42812 @default.
- W3005732517 hasConceptScore W3005732517C49937458 @default.
- W3005732517 hasConceptScore W3005732517C73555534 @default.
- W3005732517 hasConceptScore W3005732517C97256817 @default.
- W3005732517 hasLocation W30057325171 @default.
- W3005732517 hasOpenAccess W3005732517 @default.
- W3005732517 hasPrimaryLocation W30057325171 @default.
- W3005732517 hasRelatedWork W1523179148 @default.
- W3005732517 hasRelatedWork W1969261868 @default.
- W3005732517 hasRelatedWork W2007193508 @default.
- W3005732517 hasRelatedWork W2021599769 @default.