FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2488183544> ?p ?o ?g. }

• W2488183544 abstract "What role does metareasoning play in models of bounded rationality? We examine the various existing computational approaches to bounded rationality and divide them into three classes. Only one of these classes significantly relies on a metareasoning component. We explore the characteristics of this class of models and argue that it offers desirable properties. In fact, many of the effective approaches to bounded rationality that have been developed since the early 1980’s match this particular paradigm. We conclude with some open research problems and challenges. Computational models of bounded rationality In the pursuit of building decision-making machines, artificial intelligence researchers often turn to theories of “rationality” in decision theory and economics. Rationality is a desired property of intelligent agents since it provides well-defined normative evaluation criteria and since it establishes formal frameworks to analyze agents (Doyle 1990; Russell and Wefald 1991). But in general, rationality requires making optimal choices with respect to one’s desires and goals. As early as 1947, Herbert Simon observed that optimal decision making is impractical in complex domains since it requires one to perform intractable computations within a limited amount of time (Simon 1947; 1982). Moreover, the vast computational resources required to select optimal actions often reduce the utility of the result. Simon suggested that some criterion must be used to determine that an adequate, or satisfactory, decision has been found. He used the Scottish word “satisficing,” which means satisfying, to denote decision making that searches until an alternative is found that is satisfactory by the agent’s aspiration level criterion. Simon’s notion of satisficing has inspired much work within the social sciences and within artificial intelligence in the areas of problem solving, planning and search. In the social sciences, much of the work has focused on developing descriptive theories of human decision making (Gigerenzer 2000). These theories attempt to explain how people make decisions in the real-world, coping with complex situations, uncertainty, and limited amount of time. The answer is often based on a variety of heuristic methods that Copyright c © 2008, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved. are used by people to operate effectively in these situations. Work within the AI community–which is the focus of this paper–has produced a variety of computational models that can take into account the computational cost of decision making (Dean and Boddy 1988; Horvitz 1987; Russell et al. 1993; Wellman 1990; Zilberstein 1993). The idea that the cost of decision making must be taken into account was introduced by Simon and later by the statistician Irving Good who used the term Type II Rationality to describe it (Good 1971). Good said that “when the expected time and effort taken to think and do calculations is allowed for in the costs, then one is using the principle of rationality of type II.” But neither Simon nor Good presented any effective computational framework to implement “satisficing” or “type II rationality”. It is by now widely accepted that in most cases the ideal decision-theoretic notion of rationality is beyond our reach. However, the concept of satisficing offers only a vague design principle that needs a good deal of formalization before it can be used in practice. In particular, one must define the required properties of a satisficing criterion and the quality of behavior that is expected when these properties are achieved. AI researchers have introduced over the years a variety of computational models that can be seen as forms of bounded rationality. We start by dividing these models into three broad classes. We are particularly interested in the role that metareasoning plays in these theories. Approximate reasoning One of the early computational approaches to bounded rationality has been based on heuristic search. In fact, Simon has initially identified satisficing with heuristic search. In this context, heuristic search represents a form of approximate reasoning. It uses some domain knowledge to guide the search process, which continues until a satisfactory solution is found. This should be distinguished from admissible heuristic techniques such as A∗ that are designed to always return the optimal answer. Admissible heuristic search is an important part of AI, but it has little to do with bounded rationality. The focus on optimal, rather than satisfying, solutions makes this type of heuristic search simply a more efficient way to find exact answers. Simon refers to another type of heuristic functions in which heuristics are used to select “adequate” solutions. Such heuristic functions are rarely admissible and the corresponding search processes are not optimal in any formal sense. Systems based on non-admissible heuristic functions are often harder to evaluate, especially when optimal decisions are not available. Although it is often assumed that approximate reasoning is aimed at finding approximate answers to a given problem, it can take different forms. For example, the initial problem can be reformulated in such a way that reduces its complexity. The reformulation process could be approximate, yielding a new problem that is easier to solve because it does not retain all the details of the original problem. The resulting problem could then be solved efficiently and perhaps optimally and the obtained solution can then be used as an approximate solution for the original problem. One example of such a process–also referred to as approximate modeling–is when deterministic action models are used in planning, ignoring the uncertainty about action failures. Combined with suitable runtime execution monitoring, such an approach could be beneficial. In fact, the winner of a recent probabilistic planning competition was a planner based on these principles. Regardless of the form of approximation, approximate reasoning techniques can be complemented by some form of explicit or implicit metareasoning. Metareasoning in this context is a mechanism to make certain runtime decisions by reasoning about the problem solving–or object-level–reasoning process. This can be done either explicitly, by introducing another level of reasoning as shown in Figure 1, or implicitly, by pre-compiling metareasoning decisions into the object-level reasoning process at design time. For example, metareasoning has been used to develop search control strategies–both explicitly and implicitly. In some cases, the goal is specifically to optimize the tradeoff between search effort and quality of results (Russell and Wefald 1991). Thus, metareasoning could play a useful role in certain forms of approximate reasoning, but it is not–by definition–a required component. While it is clear that any form of bounded rationality essentially implies that the agent performs approximate reasoning, the opposite is not necessarily true. Generally, frameworks for approximate reasoning do not provide any formal guarantees about the overall performance of the agent. Such guarantees are necessary to offer a satisfactory definition of bounded rationality and thus restore some sort of qualified optimality. So, we do not view a heuristic rule that proves useful in practice to be in itself a framework for bounded rationality if it does not have additional formal properties. The rest of this section describes two additional approaches that offer such precise properties. Optimal metaraesoning Since metareasoning is a component that monitors and controls object-level deliberation, one could pose the question of whether the metareasoning process itself is optimal. Optimality here is with respect to the overall agent performance, given its fixed object-level deliberation capabilities. This is a well-defined question that sometimes has a simple answer. For example, metareasoning may focus on the single question of when to stop deliberation and take action. Depending on how the base-level component is structured, the answer may or may not be straightforward. Optimal metareasoning has been also referred to as rational metareasoning (Horvitz 1989) and metalevel rationality (Russell 1995) to distinguish it from perfect rationality. This offers one precise form of bounded rationality that we will examine in further details in the next section. It should be noted that optimal metareasoning can result in arbitrary poor agent performance. This is true because we do not impose upfront any constraints on the object-level deliberation process, in terms of either efficiency or correctness. Nevertheless, we will see later that this presents an attractive framework for bounded rationality and that performance guarantees can be established once additional constraints are imposed on the overall architecture." @default.
• W2488183544 created "2016-08-23" @default.
• W2488183544 creator A5027224308 @default.
• W2488183544 date "2011-01-01" @default.
• W2488183544 modified "2023-09-23" @default.
• W2488183544 title "Metareasoning and Bounded Rationality" @default.
• W2488183544 cites W128729319 @default.
• W2488183544 cites W147827576 @default.
• W2488183544 cites W1485548214 @default.
• W2488183544 cites W1497803288 @default.
• W2488183544 cites W1510672157 @default.
• W2488183544 cites W1519698894 @default.
• W2488183544 cites W1525110644 @default.
• W2488183544 cites W1582772526 @default.
• W2488183544 cites W1588509063 @default.
• W2488183544 cites W1591263692 @default.
• W2488183544 cites W1976129448 @default.
• W2488183544 cites W2040827706 @default.
• W2488183544 cites W2048923623 @default.
• W2488183544 cites W2156452244 @default.
• W2488183544 cites W2162412417 @default.
• W2488183544 cites W2163316275 @default.
• W2488183544 cites W2164448820 @default.
• W2488183544 cites W2166996723 @default.
• W2488183544 doi "https://doi.org/10.7551/mitpress/8069.003.0005" @default.
• W2488183544 hasPublicationYear "2011" @default.
• W2488183544 type Work @default.
• W2488183544 sameAs 2488183544 @default.
• W2488183544 citedByCount "13" @default.
• W2488183544 countsByYear W24881835442013 @default.
• W2488183544 countsByYear W24881835442015 @default.
• W2488183544 countsByYear W24881835442016 @default.
• W2488183544 countsByYear W24881835442020 @default.
• W2488183544 countsByYear W24881835442021 @default.
• W2488183544 crossrefType "book-chapter" @default.
• W2488183544 hasAuthorship W2488183544A5027224308 @default.
• W2488183544 hasBestOaLocation W24881835442 @default.
• W2488183544 hasConcept C111472728 @default.
• W2488183544 hasConcept C134306372 @default.
• W2488183544 hasConcept C138885662 @default.
• W2488183544 hasConcept C144237770 @default.
• W2488183544 hasConcept C154945302 @default.
• W2488183544 hasConcept C201717286 @default.
• W2488183544 hasConcept C33923547 @default.
• W2488183544 hasConcept C34388435 @default.
• W2488183544 hasConcept C41008148 @default.
• W2488183544 hasConcept C58694771 @default.
• W2488183544 hasConceptScore W2488183544C111472728 @default.
• W2488183544 hasConceptScore W2488183544C134306372 @default.
• W2488183544 hasConceptScore W2488183544C138885662 @default.
• W2488183544 hasConceptScore W2488183544C144237770 @default.
• W2488183544 hasConceptScore W2488183544C154945302 @default.
• W2488183544 hasConceptScore W2488183544C201717286 @default.
• W2488183544 hasConceptScore W2488183544C33923547 @default.
• W2488183544 hasConceptScore W2488183544C34388435 @default.
• W2488183544 hasConceptScore W2488183544C41008148 @default.
• W2488183544 hasConceptScore W2488183544C58694771 @default.
• W2488183544 hasLocation W24881835441 @default.
• W2488183544 hasLocation W24881835442 @default.
• W2488183544 hasOpenAccess W2488183544 @default.
• W2488183544 hasPrimaryLocation W24881835441 @default.
• W2488183544 hasRelatedWork W103772952 @default.
• W2488183544 hasRelatedWork W157091445 @default.
• W2488183544 hasRelatedWork W1575020259 @default.
• W2488183544 hasRelatedWork W1592614963 @default.
• W2488183544 hasRelatedWork W1608894218 @default.
• W2488183544 hasRelatedWork W1739018506 @default.
• W2488183544 hasRelatedWork W2043987150 @default.
• W2488183544 hasRelatedWork W2088956500 @default.
• W2488183544 hasRelatedWork W2119567691 @default.
• W2488183544 hasRelatedWork W2121863487 @default.
• W2488183544 hasRelatedWork W2134802714 @default.
• W2488183544 hasRelatedWork W2148218781 @default.
• W2488183544 hasRelatedWork W2148962857 @default.
• W2488183544 hasRelatedWork W2479602717 @default.
• W2488183544 hasRelatedWork W2772627893 @default.
• W2488183544 hasRelatedWork W2945132723 @default.
• W2488183544 hasRelatedWork W3198336215 @default.
• W2488183544 hasRelatedWork W36193500 @default.
• W2488183544 hasRelatedWork W602493290 @default.
• W2488183544 hasRelatedWork W72885726 @default.
• W2488183544 isParatext "false" @default.
• W2488183544 isRetracted "false" @default.
• W2488183544 magId "2488183544" @default.
• W2488183544 workType "book-chapter" @default.