Matches in SemOpenAlex for { <https://semopenalex.org/work/W2395756713> ?p ?o ?g. }
- W2395756713 abstract "The problem of least squares regression of a $d$-dimensional unknown parameter is considered. A stochastic gradient descent based algorithm with weighted iterate-averaging that uses a single pass over the data is studied and its convergence rate is analyzed. We first consider a bounded constraint set of the unknown parameter. Under some standard regularity assumptions, we provide an explicit $O(1/k)$ upper bound on the convergence rate, depending on the variance (due to the additive noise in the measurements) and the size of the constraint set. We show that the variance term dominates the error and decreases with rate $1/k$, while the term which is related to the size of the constraint set decreases with rate $log k/k^2$. We then compare the asymptotic ratio $rho$ between the convergence rate of the proposed scheme and the empirical risk minimizer (ERM) as the number of iterations approaches infinity. We show that $rholeq 4$ under some mild conditions for all $dgeq 1$. We further improve the upper bound by showing that $rholeq 4/3$ for the case of $d=1$ and unbounded parameter set. Simulation results demonstrate strong performance of the algorithm as compared to existing methods, and coincide with $rholeq 4/3$ even for large $d$ in practice." @default.
- W2395756713 created "2016-06-24" @default.
- W2395756713 creator A5052663817 @default.
- W2395756713 creator A5066085947 @default.
- W2395756713 creator A5078518595 @default.
- W2395756713 date "2016-06-09" @default.
- W2395756713 modified "2023-09-23" @default.
- W2395756713 title "On Projected Stochastic Gradient Descent Algorithm with Weighted Averaging for Least Squares Regression" @default.
- W2395756713 cites W1556219185 @default.
- W2395756713 cites W1791038712 @default.
- W2395756713 cites W1957482736 @default.
- W2395756713 cites W1988795359 @default.
- W2395756713 cites W1992208280 @default.
- W2395756713 cites W1998880679 @default.
- W2395756713 cites W2024484010 @default.
- W2395756713 cites W2045744861 @default.
- W2395756713 cites W2061863621 @default.
- W2395756713 cites W2086161653 @default.
- W2395756713 cites W2096199223 @default.
- W2395756713 cites W2103971893 @default.
- W2395756713 cites W2105875671 @default.
- W2395756713 cites W2107438106 @default.
- W2395756713 cites W2112269233 @default.
- W2395756713 cites W2118545728 @default.
- W2395756713 cites W2138507770 @default.
- W2395756713 cites W2151695970 @default.
- W2395756713 cites W2157187092 @default.
- W2395756713 cites W2169713291 @default.
- W2395756713 cites W2950967979 @default.
- W2395756713 cites W3102317997 @default.
- W2395756713 cites W3141595720 @default.
- W2395756713 cites W92732855 @default.
- W2395756713 cites W2098605271 @default.
- W2395756713 doi "https://doi.org/10.48550/arxiv.1606.03000" @default.
- W2395756713 hasPublicationYear "2016" @default.
- W2395756713 type Work @default.
- W2395756713 sameAs 2395756713 @default.
- W2395756713 citedByCount "2" @default.
- W2395756713 countsByYear W23957567132016 @default.
- W2395756713 countsByYear W23957567132022 @default.
- W2395756713 crossrefType "posted-content" @default.
- W2395756713 hasAuthorship W2395756713A5052663817 @default.
- W2395756713 hasAuthorship W2395756713A5066085947 @default.
- W2395756713 hasAuthorship W2395756713A5078518595 @default.
- W2395756713 hasBestOaLocation W23957567131 @default.
- W2395756713 hasConcept C105795698 @default.
- W2395756713 hasConcept C114614502 @default.
- W2395756713 hasConcept C119857082 @default.
- W2395756713 hasConcept C134306372 @default.
- W2395756713 hasConcept C162324750 @default.
- W2395756713 hasConcept C185429906 @default.
- W2395756713 hasConcept C206688291 @default.
- W2395756713 hasConcept C2524010 @default.
- W2395756713 hasConcept C26517878 @default.
- W2395756713 hasConcept C2776036281 @default.
- W2395756713 hasConcept C2777303404 @default.
- W2395756713 hasConcept C28826006 @default.
- W2395756713 hasConcept C33923547 @default.
- W2395756713 hasConcept C34388435 @default.
- W2395756713 hasConcept C38652104 @default.
- W2395756713 hasConcept C41008148 @default.
- W2395756713 hasConcept C50522688 @default.
- W2395756713 hasConcept C50644808 @default.
- W2395756713 hasConcept C57869625 @default.
- W2395756713 hasConcept C77553402 @default.
- W2395756713 hasConcept C9936470 @default.
- W2395756713 hasConceptScore W2395756713C105795698 @default.
- W2395756713 hasConceptScore W2395756713C114614502 @default.
- W2395756713 hasConceptScore W2395756713C119857082 @default.
- W2395756713 hasConceptScore W2395756713C134306372 @default.
- W2395756713 hasConceptScore W2395756713C162324750 @default.
- W2395756713 hasConceptScore W2395756713C185429906 @default.
- W2395756713 hasConceptScore W2395756713C206688291 @default.
- W2395756713 hasConceptScore W2395756713C2524010 @default.
- W2395756713 hasConceptScore W2395756713C26517878 @default.
- W2395756713 hasConceptScore W2395756713C2776036281 @default.
- W2395756713 hasConceptScore W2395756713C2777303404 @default.
- W2395756713 hasConceptScore W2395756713C28826006 @default.
- W2395756713 hasConceptScore W2395756713C33923547 @default.
- W2395756713 hasConceptScore W2395756713C34388435 @default.
- W2395756713 hasConceptScore W2395756713C38652104 @default.
- W2395756713 hasConceptScore W2395756713C41008148 @default.
- W2395756713 hasConceptScore W2395756713C50522688 @default.
- W2395756713 hasConceptScore W2395756713C50644808 @default.
- W2395756713 hasConceptScore W2395756713C57869625 @default.
- W2395756713 hasConceptScore W2395756713C77553402 @default.
- W2395756713 hasConceptScore W2395756713C9936470 @default.
- W2395756713 hasLocation W23957567131 @default.
- W2395756713 hasLocation W23957567132 @default.
- W2395756713 hasOpenAccess W2395756713 @default.
- W2395756713 hasPrimaryLocation W23957567131 @default.
- W2395756713 hasRelatedWork W112932971 @default.
- W2395756713 hasRelatedWork W130791004 @default.
- W2395756713 hasRelatedWork W1815537186 @default.
- W2395756713 hasRelatedWork W2050961887 @default.
- W2395756713 hasRelatedWork W2152241334 @default.
- W2395756713 hasRelatedWork W2511372611 @default.
- W2395756713 hasRelatedWork W2615709397 @default.
- W2395756713 hasRelatedWork W2896572968 @default.
- W2395756713 hasRelatedWork W2970894719 @default.