Matches in SemOpenAlex for { <https://semopenalex.org/work/W4301355915> ?p ?o ?g. }
Showing items 1 to 67 of
67
with 100 items per page.
- W4301355915 abstract "We study the intrinsic limitations of sequential convex optimization through the lens of feedback information theory. In the oracle model of optimization, an algorithm queries an {em oracle} for noisy information about the unknown objective function, and the goal is to (approximately) minimize every function in a given class using as few queries as possible. We show that, in order for a function to be optimized, the algorithm must be able to accumulate enough information about the objective. This, in turn, puts limits on the speed of optimization under specific assumptions on the oracle and the type of feedback. Our techniques are akin to the ones used in statistical literature to obtain minimax lower bounds on the risks of estimation procedures; the notable difference is that, unlike in the case of i.i.d. data, a sequential optimization algorithm can gather observations in a {em controlled} manner, so that the amount of information at each step is allowed to change in time. In particular, we show that optimization algorithms often obey the law of diminishing returns: the signal-to-noise ratio drops as the optimization algorithm approaches the optimum. To underscore the generality of the tools, we use our approach to derive fundamental lower bounds for a certain active learning problem. Overall, the present work connects the intuitive notions of information in optimization, experimental design, estimation, and active learning to the quantitative notion of Shannon information." @default.
- W4301355915 created "2022-10-05" @default.
- W4301355915 creator A5044844161 @default.
- W4301355915 creator A5076656836 @default.
- W4301355915 date "2010-10-11" @default.
- W4301355915 modified "2023-09-23" @default.
- W4301355915 title "Information-based complexity, feedback and dynamics in convex programming" @default.
- W4301355915 doi "https://doi.org/10.48550/arxiv.1010.2285" @default.
- W4301355915 hasPublicationYear "2010" @default.
- W4301355915 type Work @default.
- W4301355915 citedByCount "0" @default.
- W4301355915 crossrefType "posted-content" @default.
- W4301355915 hasAuthorship W4301355915A5044844161 @default.
- W4301355915 hasAuthorship W4301355915A5076656836 @default.
- W4301355915 hasBestOaLocation W43013559151 @default.
- W4301355915 hasConcept C112680207 @default.
- W4301355915 hasConcept C11413529 @default.
- W4301355915 hasConcept C115903868 @default.
- W4301355915 hasConcept C126255220 @default.
- W4301355915 hasConcept C137836250 @default.
- W4301355915 hasConcept C14036430 @default.
- W4301355915 hasConcept C149728462 @default.
- W4301355915 hasConcept C15744967 @default.
- W4301355915 hasConcept C157972887 @default.
- W4301355915 hasConcept C2524010 @default.
- W4301355915 hasConcept C2780767217 @default.
- W4301355915 hasConcept C33923547 @default.
- W4301355915 hasConcept C41008148 @default.
- W4301355915 hasConcept C542102704 @default.
- W4301355915 hasConcept C55166926 @default.
- W4301355915 hasConcept C78458016 @default.
- W4301355915 hasConcept C86803240 @default.
- W4301355915 hasConceptScore W4301355915C112680207 @default.
- W4301355915 hasConceptScore W4301355915C11413529 @default.
- W4301355915 hasConceptScore W4301355915C115903868 @default.
- W4301355915 hasConceptScore W4301355915C126255220 @default.
- W4301355915 hasConceptScore W4301355915C137836250 @default.
- W4301355915 hasConceptScore W4301355915C14036430 @default.
- W4301355915 hasConceptScore W4301355915C149728462 @default.
- W4301355915 hasConceptScore W4301355915C15744967 @default.
- W4301355915 hasConceptScore W4301355915C157972887 @default.
- W4301355915 hasConceptScore W4301355915C2524010 @default.
- W4301355915 hasConceptScore W4301355915C2780767217 @default.
- W4301355915 hasConceptScore W4301355915C33923547 @default.
- W4301355915 hasConceptScore W4301355915C41008148 @default.
- W4301355915 hasConceptScore W4301355915C542102704 @default.
- W4301355915 hasConceptScore W4301355915C55166926 @default.
- W4301355915 hasConceptScore W4301355915C78458016 @default.
- W4301355915 hasConceptScore W4301355915C86803240 @default.
- W4301355915 hasLocation W43013559151 @default.
- W4301355915 hasLocation W43013559152 @default.
- W4301355915 hasLocation W43013559153 @default.
- W4301355915 hasOpenAccess W4301355915 @default.
- W4301355915 hasPrimaryLocation W43013559151 @default.
- W4301355915 hasRelatedWork W115839209 @default.
- W4301355915 hasRelatedWork W1491460447 @default.
- W4301355915 hasRelatedWork W2155192981 @default.
- W4301355915 hasRelatedWork W2227983344 @default.
- W4301355915 hasRelatedWork W2562747313 @default.
- W4301355915 hasRelatedWork W2942851704 @default.
- W4301355915 hasRelatedWork W2952173607 @default.
- W4301355915 hasRelatedWork W4301355915 @default.
- W4301355915 hasRelatedWork W4312894828 @default.
- W4301355915 hasRelatedWork W4320167325 @default.
- W4301355915 isParatext "false" @default.
- W4301355915 isRetracted "false" @default.
- W4301355915 workType "article" @default.