Matches in SemOpenAlex for { <https://semopenalex.org/work/W2952676558> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W2952676558 abstract "We address the statistical and optimization impacts of the classical sketch and Hessian sketch used to approximately solve the Matrix Ridge Regression (MRR) problem. Prior research has quantified the effects of classical sketch on the strictly simpler least squares regression (LSR) problem. We establish that classical sketch has a similar effect upon the optimization properties of MRR as it does on those of LSR: namely, it recovers nearly optimal solutions. By contrast, Hessian sketch does not have this guarantee, instead, the approximation error is governed by a subtle interplay between the mass in the responses and the optimal objective value. For both types of approximation, the regularization in the sketched MRR problem results in significantly different statistical properties from those of the sketched LSR problem. In particular, there is a bias-variance trade-off in sketched MRR that is not present in sketched LSR. We provide upper and lower bounds on the bias and variance of sketched MRR, these bounds show that classical sketch significantly increases the variance, while Hessian sketch significantly increases the bias. Empirically, sketched MRR solutions can have risks that are higher by an order-of-magnitude than those of the optimal MRR solutions. We establish theoretically and empirically that model averaging greatly decreases the gap between the risks of the true and sketched solutions to the MRR problem. Thus, in parallel or distributed settings, sketching combined with model averaging is a powerful technique that quickly obtains near-optimal solutions to the MRR problem while greatly mitigating the increased statistical risk incurred by sketching." @default.
- W2952676558 created "2019-06-27" @default.
- W2952676558 creator A5030507461 @default.
- W2952676558 creator A5033006662 @default.
- W2952676558 creator A5038646656 @default.
- W2952676558 date "2017-02-16" @default.
- W2952676558 modified "2023-09-27" @default.
- W2952676558 title "Sketched Ridge Regression: Optimization Perspective, Statistical Perspective, and Model Averaging" @default.
- W2952676558 cites W1493892051 @default.
- W2952676558 cites W1788183014 @default.
- W2952676558 cites W2070996757 @default.
- W2952676558 cites W2278578264 @default.
- W2952676558 cites W2468624009 @default.
- W2952676558 cites W2530525251 @default.
- W2952676558 cites W2721907797 @default.
- W2952676558 cites W2755278809 @default.
- W2952676558 cites W2766036709 @default.
- W2952676558 cites W2954857526 @default.
- W2952676558 cites W2965497096 @default.
- W2952676558 cites W3097609957 @default.
- W2952676558 cites W2950579266 @default.
- W2952676558 hasPublicationYear "2017" @default.
- W2952676558 type Work @default.
- W2952676558 sameAs 2952676558 @default.
- W2952676558 citedByCount "5" @default.
- W2952676558 countsByYear W29526765582017 @default.
- W2952676558 countsByYear W29526765582018 @default.
- W2952676558 countsByYear W29526765582019 @default.
- W2952676558 crossrefType "posted-content" @default.
- W2952676558 hasAuthorship W2952676558A5030507461 @default.
- W2952676558 hasAuthorship W2952676558A5033006662 @default.
- W2952676558 hasAuthorship W2952676558A5038646656 @default.
- W2952676558 hasConcept C105795698 @default.
- W2952676558 hasConcept C11413529 @default.
- W2952676558 hasConcept C121955636 @default.
- W2952676558 hasConcept C126255220 @default.
- W2952676558 hasConcept C12713177 @default.
- W2952676558 hasConcept C149782125 @default.
- W2952676558 hasConcept C154945302 @default.
- W2952676558 hasConcept C162324750 @default.
- W2952676558 hasConcept C196083921 @default.
- W2952676558 hasConcept C203616005 @default.
- W2952676558 hasConcept C2776135515 @default.
- W2952676558 hasConcept C2779231336 @default.
- W2952676558 hasConcept C28826006 @default.
- W2952676558 hasConcept C33923547 @default.
- W2952676558 hasConcept C41008148 @default.
- W2952676558 hasConcept C83546350 @default.
- W2952676558 hasConceptScore W2952676558C105795698 @default.
- W2952676558 hasConceptScore W2952676558C11413529 @default.
- W2952676558 hasConceptScore W2952676558C121955636 @default.
- W2952676558 hasConceptScore W2952676558C126255220 @default.
- W2952676558 hasConceptScore W2952676558C12713177 @default.
- W2952676558 hasConceptScore W2952676558C149782125 @default.
- W2952676558 hasConceptScore W2952676558C154945302 @default.
- W2952676558 hasConceptScore W2952676558C162324750 @default.
- W2952676558 hasConceptScore W2952676558C196083921 @default.
- W2952676558 hasConceptScore W2952676558C203616005 @default.
- W2952676558 hasConceptScore W2952676558C2776135515 @default.
- W2952676558 hasConceptScore W2952676558C2779231336 @default.
- W2952676558 hasConceptScore W2952676558C28826006 @default.
- W2952676558 hasConceptScore W2952676558C33923547 @default.
- W2952676558 hasConceptScore W2952676558C41008148 @default.
- W2952676558 hasConceptScore W2952676558C83546350 @default.
- W2952676558 hasLocation W29526765581 @default.
- W2952676558 hasOpenAccess W2952676558 @default.
- W2952676558 hasPrimaryLocation W29526765581 @default.
- W2952676558 hasRelatedWork W1806401590 @default.
- W2952676558 hasRelatedWork W2000375126 @default.
- W2952676558 hasRelatedWork W2131742377 @default.
- W2952676558 hasRelatedWork W2522507952 @default.
- W2952676558 hasRelatedWork W2531031089 @default.
- W2952676558 hasRelatedWork W2547442375 @default.
- W2952676558 hasRelatedWork W2610042689 @default.
- W2952676558 hasRelatedWork W2788937988 @default.
- W2952676558 hasRelatedWork W2805886869 @default.
- W2952676558 hasRelatedWork W2890118063 @default.
- W2952676558 hasRelatedWork W2909543128 @default.
- W2952676558 hasRelatedWork W2912009252 @default.
- W2952676558 hasRelatedWork W2918899818 @default.
- W2952676558 hasRelatedWork W2948501930 @default.
- W2952676558 hasRelatedWork W3034340526 @default.
- W2952676558 hasRelatedWork W3035079661 @default.
- W2952676558 hasRelatedWork W3105392875 @default.
- W2952676558 hasRelatedWork W3175350478 @default.
- W2952676558 hasRelatedWork W3204783299 @default.
- W2952676558 hasRelatedWork W2275336286 @default.
- W2952676558 isParatext "false" @default.
- W2952676558 isRetracted "false" @default.
- W2952676558 magId "2952676558" @default.
- W2952676558 workType "article" @default.