Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287723728> ?p ?o ?g. }
Showing items 1 to 57 of
57
with 100 items per page.
- W4287723728 abstract "We consider prediction with expert advice when data are generated from distributions varying arbitrarily within an unknown constraint set. This semi-adversarial setting includes (at the extremes) the classical i.i.d. setting, when the unknown constraint set is restricted to be a singleton, and the unconstrained adversarial setting, when the constraint set is the set of all distributions. The Hedge algorithm -- long known to be minimax (rate) optimal in the adversarial regime -- was recently shown to be simultaneously minimax optimal for i.i.d. data. In this work, we propose to relax the i.i.d. assumption by seeking adaptivity at all levels of a natural ordering on constraint sets. We provide matching upper and lower bounds on the minimax regret at all levels, show that Hedge with deterministic learning rates is suboptimal outside of the extremes, and prove that one can adaptively obtain minimax regret at all levels. We achieve this optimal adaptivity using the follow-the-regularized-leader (FTRL) framework, with a novel adaptive regularization scheme that implicitly scales as the square root of the entropy of the current predictive distribution, rather than the entropy of the initial predictive distribution. Finally, we provide novel technical tools to study the statistical performance of FTRL along the semi-adversarial spectrum." @default.
- W4287723728 created "2022-07-26" @default.
- W4287723728 creator A5019870310 @default.
- W4287723728 creator A5040655665 @default.
- W4287723728 creator A5042384857 @default.
- W4287723728 date "2020-07-13" @default.
- W4287723728 modified "2023-09-24" @default.
- W4287723728 title "Relaxing the I.I.D. Assumption: Adaptively Minimax Optimal Regret via Root-Entropic Regularization" @default.
- W4287723728 doi "https://doi.org/10.48550/arxiv.2007.06552" @default.
- W4287723728 hasPublicationYear "2020" @default.
- W4287723728 type Work @default.
- W4287723728 citedByCount "0" @default.
- W4287723728 crossrefType "posted-content" @default.
- W4287723728 hasAuthorship W4287723728A5019870310 @default.
- W4287723728 hasAuthorship W4287723728A5040655665 @default.
- W4287723728 hasAuthorship W4287723728A5042384857 @default.
- W4287723728 hasBestOaLocation W42877237281 @default.
- W4287723728 hasConcept C105795698 @default.
- W4287723728 hasConcept C106301342 @default.
- W4287723728 hasConcept C121332964 @default.
- W4287723728 hasConcept C126255220 @default.
- W4287723728 hasConcept C149728462 @default.
- W4287723728 hasConcept C154945302 @default.
- W4287723728 hasConcept C2776135515 @default.
- W4287723728 hasConcept C33923547 @default.
- W4287723728 hasConcept C37736160 @default.
- W4287723728 hasConcept C41008148 @default.
- W4287723728 hasConcept C50817715 @default.
- W4287723728 hasConcept C62520636 @default.
- W4287723728 hasConceptScore W4287723728C105795698 @default.
- W4287723728 hasConceptScore W4287723728C106301342 @default.
- W4287723728 hasConceptScore W4287723728C121332964 @default.
- W4287723728 hasConceptScore W4287723728C126255220 @default.
- W4287723728 hasConceptScore W4287723728C149728462 @default.
- W4287723728 hasConceptScore W4287723728C154945302 @default.
- W4287723728 hasConceptScore W4287723728C2776135515 @default.
- W4287723728 hasConceptScore W4287723728C33923547 @default.
- W4287723728 hasConceptScore W4287723728C37736160 @default.
- W4287723728 hasConceptScore W4287723728C41008148 @default.
- W4287723728 hasConceptScore W4287723728C50817715 @default.
- W4287723728 hasConceptScore W4287723728C62520636 @default.
- W4287723728 hasLocation W42877237281 @default.
- W4287723728 hasOpenAccess W4287723728 @default.
- W4287723728 hasPrimaryLocation W42877237281 @default.
- W4287723728 hasRelatedWork W2025490963 @default.
- W4287723728 hasRelatedWork W2106842346 @default.
- W4287723728 hasRelatedWork W3111617249 @default.
- W4287723728 hasRelatedWork W3127666205 @default.
- W4287723728 hasRelatedWork W3149052698 @default.
- W4287723728 hasRelatedWork W3176362036 @default.
- W4287723728 hasRelatedWork W3202508532 @default.
- W4287723728 hasRelatedWork W3209936076 @default.
- W4287723728 hasRelatedWork W4287555357 @default.
- W4287723728 hasRelatedWork W4286892142 @default.
- W4287723728 isParatext "false" @default.
- W4287723728 isRetracted "false" @default.
- W4287723728 workType "article" @default.