Matches in SemOpenAlex for { <https://semopenalex.org/work/W3209102090> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W3209102090 endingPage "422" @default.
- W3209102090 startingPage "395" @default.
- W3209102090 abstract "The <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink> <tex-math notation=LaTeX>$ktext {-means}$ </tex-math></inline-formula> clustering problem concerns finding a partition of the data points into <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink> <tex-math notation=LaTeX>$k$ </tex-math></inline-formula> clusters such that the total within-cluster squared distance is minimized. This optimization objective is non-convex, and not everywhere differentiable. In general, there exist spurious local solutions other than the global optimum. Moreover, the simplest and most popular algorithm for <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink> <tex-math notation=LaTeX>$ktext {-means}$ </tex-math></inline-formula> , namely Lloyd’s algorithm, generally converges to such spurious local solutions both in theory and in practice. In this paper, we investigate the <italic xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>structures</i> of these spurious local solutions under a probabilistic generative model with <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink> <tex-math notation=LaTeX>$k$ </tex-math></inline-formula> ground truth clusters. As soon as <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink> <tex-math notation=LaTeX>$k=3$ </tex-math></inline-formula> , spurious local minima provably exist, even for well-separated clusters. One such local minimum puts two centers at one true cluster, and the third center in the middle of the other two true clusters. We prove that this is essentially the <italic xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>only</i> type of spurious local minima under a separation condition. In particular, any local minimum solution only involves a configuration that puts multiple centers at a true cluster, and one center in the middle of multiple true clusters. Our results pertain to the <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink> <tex-math notation=LaTeX>$ktext {-means}$ </tex-math></inline-formula> formulation for mixtures of Gaussians or bounded distributions, and hold in the over- and under-parametrization regimes where the number of centers in <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink> <tex-math notation=LaTeX>$ktext {-means}$ </tex-math></inline-formula> may not equal to the number of true clusters. Our theoretical results corroborate existing empirical observations and provide justification for popular heuristics for <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink> <tex-math notation=LaTeX>$ktext {-means}$ </tex-math></inline-formula> clustering." @default.
- W3209102090 created "2021-11-08" @default.
- W3209102090 creator A5033145861 @default.
- W3209102090 creator A5041110468 @default.
- W3209102090 creator A5060774236 @default.
- W3209102090 date "2022-01-01" @default.
- W3209102090 modified "2023-10-17" @default.
- W3209102090 title "Structures of Spurious Local Minima in <i>k</i>-Means" @default.
- W3209102090 cites W1865173371 @default.
- W3209102090 cites W1977556410 @default.
- W3209102090 cites W1986219860 @default.
- W3209102090 cites W1986790896 @default.
- W3209102090 cites W1987019005 @default.
- W3209102090 cites W1998739300 @default.
- W3209102090 cites W2011430131 @default.
- W3209102090 cites W2029069446 @default.
- W3209102090 cites W2029698681 @default.
- W3209102090 cites W2059971059 @default.
- W3209102090 cites W2088879945 @default.
- W3209102090 cites W2103718624 @default.
- W3209102090 cites W2109224747 @default.
- W3209102090 cites W2110105238 @default.
- W3209102090 cites W2150593711 @default.
- W3209102090 cites W2160197181 @default.
- W3209102090 cites W2167930540 @default.
- W3209102090 cites W2506488269 @default.
- W3209102090 cites W2599272755 @default.
- W3209102090 cites W2884586244 @default.
- W3209102090 cites W2962737134 @default.
- W3209102090 cites W2963122491 @default.
- W3209102090 cites W2963814147 @default.
- W3209102090 cites W2964256738 @default.
- W3209102090 cites W305865050 @default.
- W3209102090 cites W3138330851 @default.
- W3209102090 cites W4211030719 @default.
- W3209102090 cites W4236385439 @default.
- W3209102090 doi "https://doi.org/10.1109/tit.2021.3122465" @default.
- W3209102090 hasPublicationYear "2022" @default.
- W3209102090 type Work @default.
- W3209102090 sameAs 3209102090 @default.
- W3209102090 citedByCount "3" @default.
- W3209102090 countsByYear W32091020902022 @default.
- W3209102090 countsByYear W32091020902023 @default.
- W3209102090 crossrefType "journal-article" @default.
- W3209102090 hasAuthorship W3209102090A5033145861 @default.
- W3209102090 hasAuthorship W3209102090A5041110468 @default.
- W3209102090 hasAuthorship W3209102090A5060774236 @default.
- W3209102090 hasBestOaLocation W32091020902 @default.
- W3209102090 hasConcept C105795698 @default.
- W3209102090 hasConcept C11413529 @default.
- W3209102090 hasConcept C114614502 @default.
- W3209102090 hasConcept C118615104 @default.
- W3209102090 hasConcept C33923547 @default.
- W3209102090 hasConcept C41008148 @default.
- W3209102090 hasConcept C45357846 @default.
- W3209102090 hasConcept C73555534 @default.
- W3209102090 hasConcept C94375191 @default.
- W3209102090 hasConcept C97256817 @default.
- W3209102090 hasConceptScore W3209102090C105795698 @default.
- W3209102090 hasConceptScore W3209102090C11413529 @default.
- W3209102090 hasConceptScore W3209102090C114614502 @default.
- W3209102090 hasConceptScore W3209102090C118615104 @default.
- W3209102090 hasConceptScore W3209102090C33923547 @default.
- W3209102090 hasConceptScore W3209102090C41008148 @default.
- W3209102090 hasConceptScore W3209102090C45357846 @default.
- W3209102090 hasConceptScore W3209102090C73555534 @default.
- W3209102090 hasConceptScore W3209102090C94375191 @default.
- W3209102090 hasConceptScore W3209102090C97256817 @default.
- W3209102090 hasFunder F4320306076 @default.
- W3209102090 hasIssue "1" @default.
- W3209102090 hasLocation W32091020901 @default.
- W3209102090 hasLocation W32091020902 @default.
- W3209102090 hasOpenAccess W3209102090 @default.
- W3209102090 hasPrimaryLocation W32091020901 @default.
- W3209102090 hasRelatedWork W1890613635 @default.
- W3209102090 hasRelatedWork W1978042415 @default.
- W3209102090 hasRelatedWork W2338700700 @default.
- W3209102090 hasRelatedWork W2361460797 @default.
- W3209102090 hasRelatedWork W2386767533 @default.
- W3209102090 hasRelatedWork W2386949455 @default.
- W3209102090 hasRelatedWork W2573131093 @default.
- W3209102090 hasRelatedWork W2770289473 @default.
- W3209102090 hasRelatedWork W3137732947 @default.
- W3209102090 hasRelatedWork W4386766411 @default.
- W3209102090 hasVolume "68" @default.
- W3209102090 isParatext "false" @default.
- W3209102090 isRetracted "false" @default.
- W3209102090 magId "3209102090" @default.
- W3209102090 workType "article" @default.