Matches in SemOpenAlex for { <https://semopenalex.org/work/W2568703777> ?p ?o ?g. }
- W2568703777 endingPage "712" @default.
- W2568703777 startingPage "697" @default.
- W2568703777 abstract "Nearly all estimators in statistical prediction come with an associated tuning parameter, in one way or another. Common practice, given data, is to choose the tuning parameter value that minimizes a constructed estimate of the prediction error of the estimator; we focus on Stein’s unbiased risk estimator, or SURE, which forms an unbiased estimate of the prediction error by augmenting the observed training error with an estimate of the degrees of freedom of the estimator. Parameter tuning via SURE minimization has been advocated by many authors, in a wide variety of problem settings, and in general, it is natural to ask: what is the prediction error of the SURE-tuned estimator? An obvious strategy would be simply use the apparent error estimate as reported by SURE, that is, the value of the SURE criterion at its minimum, to estimate the prediction error of the SURE-tuned estimator. But this is no longer unbiased; in fact, we would expect that the minimum of the SURE criterion is systematically biased downwards for the true prediction error. In this work, we define the excess optimism of the SURE-tuned estimator to be the amount of this downward bias in the SURE minimum. We argue that the following two properties motivate the study of excess optimism: (i) an unbiased estimate of excess optimism, added to the SURE criterion at its minimum, gives an unbiased estimate of the prediction error of the SURE-tuned estimator; (ii) excess optimism serves as an upper bound on the excess risk, that is, the difference between the risk of the SURE-tuned estimator and the oracle risk (where the oracle uses the best fixed tuning parameter choice). We study excess optimism in two common settings: shrinkage estimators and subset regression estimators. Our main results include a James–Stein-like property of the SURE-tuned shrinkage estimator, which is shown to dominate the MLE; and both upper and lower bounds on excess optimism for SURE-tuned subset regression. In the latter setting, when the collection of subsets is nested, our bounds are particularly tight, and reveal that in the case of no signal, the excess optimism is always in between 0 and 10 degrees of freedom, regardless of how many models are being selected from. Supplementary materials for this article are available online." @default.
- W2568703777 created "2017-01-13" @default.
- W2568703777 creator A5039021124 @default.
- W2568703777 creator A5076708141 @default.
- W2568703777 date "2018-08-06" @default.
- W2568703777 modified "2023-09-27" @default.
- W2568703777 title "Excess Optimism: How Biased is the Apparent Error of an Estimator Tuned by SURE?" @default.
- W2568703777 cites W1502338185 @default.
- W2568703777 cites W1792568252 @default.
- W2568703777 cites W1942197703 @default.
- W2568703777 cites W1995691260 @default.
- W2568703777 cites W2004330830 @default.
- W2568703777 cites W2005530382 @default.
- W2568703777 cites W2009462809 @default.
- W2568703777 cites W2012224392 @default.
- W2568703777 cites W2033484654 @default.
- W2568703777 cites W2033914841 @default.
- W2568703777 cites W2052418342 @default.
- W2568703777 cites W2054640142 @default.
- W2568703777 cites W2056481711 @default.
- W2568703777 cites W2063942101 @default.
- W2568703777 cites W2064674496 @default.
- W2568703777 cites W2079724595 @default.
- W2568703777 cites W2088349114 @default.
- W2568703777 cites W2100471135 @default.
- W2568703777 cites W2103299849 @default.
- W2568703777 cites W2141007997 @default.
- W2568703777 cites W2144461674 @default.
- W2568703777 cites W2154290668 @default.
- W2568703777 cites W2158940042 @default.
- W2568703777 cites W2165161097 @default.
- W2568703777 cites W2172185584 @default.
- W2568703777 cites W2204774351 @default.
- W2568703777 cites W2259472751 @default.
- W2568703777 cites W2546934947 @default.
- W2568703777 cites W3098272239 @default.
- W2568703777 cites W3099470970 @default.
- W2568703777 cites W3100970744 @default.
- W2568703777 cites W3106348863 @default.
- W2568703777 cites W4234698323 @default.
- W2568703777 cites W4235051201 @default.
- W2568703777 cites W4237415315 @default.
- W2568703777 cites W4249991467 @default.
- W2568703777 doi "https://doi.org/10.1080/01621459.2018.1429276" @default.
- W2568703777 hasPublicationYear "2018" @default.
- W2568703777 type Work @default.
- W2568703777 sameAs 2568703777 @default.
- W2568703777 citedByCount "12" @default.
- W2568703777 countsByYear W25687037772018 @default.
- W2568703777 countsByYear W25687037772019 @default.
- W2568703777 countsByYear W25687037772020 @default.
- W2568703777 countsByYear W25687037772021 @default.
- W2568703777 countsByYear W25687037772022 @default.
- W2568703777 countsByYear W25687037772023 @default.
- W2568703777 crossrefType "journal-article" @default.
- W2568703777 hasAuthorship W2568703777A5039021124 @default.
- W2568703777 hasAuthorship W2568703777A5076708141 @default.
- W2568703777 hasBestOaLocation W25687037772 @default.
- W2568703777 hasConcept C105795698 @default.
- W2568703777 hasConcept C134962040 @default.
- W2568703777 hasConcept C139945424 @default.
- W2568703777 hasConcept C149782125 @default.
- W2568703777 hasConcept C15744967 @default.
- W2568703777 hasConcept C164172150 @default.
- W2568703777 hasConcept C165646398 @default.
- W2568703777 hasConcept C185429906 @default.
- W2568703777 hasConcept C191393472 @default.
- W2568703777 hasConcept C204017024 @default.
- W2568703777 hasConcept C33923547 @default.
- W2568703777 hasConcept C35594927 @default.
- W2568703777 hasConcept C77805123 @default.
- W2568703777 hasConceptScore W2568703777C105795698 @default.
- W2568703777 hasConceptScore W2568703777C134962040 @default.
- W2568703777 hasConceptScore W2568703777C139945424 @default.
- W2568703777 hasConceptScore W2568703777C149782125 @default.
- W2568703777 hasConceptScore W2568703777C15744967 @default.
- W2568703777 hasConceptScore W2568703777C164172150 @default.
- W2568703777 hasConceptScore W2568703777C165646398 @default.
- W2568703777 hasConceptScore W2568703777C185429906 @default.
- W2568703777 hasConceptScore W2568703777C191393472 @default.
- W2568703777 hasConceptScore W2568703777C204017024 @default.
- W2568703777 hasConceptScore W2568703777C33923547 @default.
- W2568703777 hasConceptScore W2568703777C35594927 @default.
- W2568703777 hasConceptScore W2568703777C77805123 @default.
- W2568703777 hasIssue "526" @default.
- W2568703777 hasLocation W25687037771 @default.
- W2568703777 hasLocation W25687037772 @default.
- W2568703777 hasLocation W25687037773 @default.
- W2568703777 hasOpenAccess W2568703777 @default.
- W2568703777 hasPrimaryLocation W25687037771 @default.
- W2568703777 hasRelatedWork W1513121561 @default.
- W2568703777 hasRelatedWork W1967656023 @default.
- W2568703777 hasRelatedWork W1981044177 @default.
- W2568703777 hasRelatedWork W2030240339 @default.
- W2568703777 hasRelatedWork W2065670139 @default.
- W2568703777 hasRelatedWork W2416077154 @default.
- W2568703777 hasRelatedWork W2801374849 @default.
- W2568703777 hasRelatedWork W4230988377 @default.