Matches in SemOpenAlex for { <https://semopenalex.org/work/W1969783622> ?p ?o ?g. }
- W1969783622 endingPage "36" @default.
- W1969783622 startingPage "1" @default.
- W1969783622 abstract "High cognitive load arises from complex time and safety-critical tasks, for example, mapping out flight paths, monitoring traffic, or even managing nuclear reactors, causing stress, errors, and lowered performance. Over the last five years, our research has focused on using the multimodal interaction paradigm to detect fluctuations in cognitive load in user behavior during system interaction. Cognitive load variations have been found to impact interactive behavior: by monitoring variations in specific modal input features executed in tasks of varying complexity, we gain an understanding of the communicative changes that occur when cognitive load is high. So far, we have identified specific changes in: speech, namely acoustic, prosodic, and linguistic changes; interactive gesture; and digital pen input, both interactive and freeform. As ground-truth measurements, galvanic skin response, subjective, and performance ratings have been used to verify task complexity. The data suggest that it is feasible to use features extracted from behavioral changes in multiple modal inputs as indices of cognitive load. The speech-based indicators of load, based on data collected from user studies in a variety of domains, have shown considerable promise. Scenarios include single-user and team-based tasks; think-aloud and interactive speech; and single-word, reading, and conversational speech, among others. Pen-based cognitive load indices have also been tested with some success, specifically with pen-gesture, handwriting, and freeform pen input, including diagraming. After examining some of the properties of these measurements, we present a multimodal fusion model, which is illustrated with quantitative examples from a case study. The feasibility of employing user input and behavior patterns as indices of cognitive load is supported by experimental evidence. Moreover, symptomatic cues of cognitive load derived from user behavior such as acoustic speech signals, transcribed text, digital pen trajectories of handwriting, and shapes pen, can be supported by well-established theoretical frameworks, including O'Donnell and Eggemeier's workload measurement [1986] Sweller's Cognitive Load Theory [Chandler and Sweller 1991], and Baddeley's model of modal working memory [1992] as well as McKinstry et al.'s [2008] and Rosenbaum's [2005] action dynamics work. The benefit of using this approach to determine the user's cognitive load in real time is that the data can be collected implicitly that is, during day-to-day use of intelligent interactive systems, thus overcomes problems of intrusiveness and increases applicability in real-world environments, while adapting information selection and presentation in a dynamic computer interface with reference to load." @default.
- W1969783622 created "2016-06-24" @default.
- W1969783622 creator A5015420352 @default.
- W1969783622 creator A5019161835 @default.
- W1969783622 creator A5040959660 @default.
- W1969783622 creator A5051364953 @default.
- W1969783622 creator A5056429995 @default.
- W1969783622 creator A5056957877 @default.
- W1969783622 creator A5062522073 @default.
- W1969783622 creator A5079060805 @default.
- W1969783622 date "2012-12-01" @default.
- W1969783622 modified "2023-10-02" @default.
- W1969783622 title "Multimodal behavior and interaction as indicators of cognitive load" @default.
- W1969783622 cites W1486865977 @default.
- W1969783622 cites W1545407019 @default.
- W1969783622 cites W1566850435 @default.
- W1969783622 cites W1583053084 @default.
- W1969783622 cites W1774048885 @default.
- W1969783622 cites W1888386172 @default.
- W1969783622 cites W1908224838 @default.
- W1969783622 cites W1965453174 @default.
- W1969783622 cites W1967259204 @default.
- W1969783622 cites W1967390364 @default.
- W1969783622 cites W1967395107 @default.
- W1969783622 cites W1970783852 @default.
- W1969783622 cites W1975846642 @default.
- W1969783622 cites W1978941942 @default.
- W1969783622 cites W1979497730 @default.
- W1969783622 cites W1980848027 @default.
- W1969783622 cites W1980877068 @default.
- W1969783622 cites W1988573256 @default.
- W1969783622 cites W1988790447 @default.
- W1969783622 cites W1989590930 @default.
- W1969783622 cites W2002894033 @default.
- W1969783622 cites W2002913375 @default.
- W1969783622 cites W2004599511 @default.
- W1969783622 cites W2007062046 @default.
- W1969783622 cites W2015161350 @default.
- W1969783622 cites W2017617574 @default.
- W1969783622 cites W2025197360 @default.
- W1969783622 cites W2025791332 @default.
- W1969783622 cites W2026292399 @default.
- W1969783622 cites W2026618543 @default.
- W1969783622 cites W2033584730 @default.
- W1969783622 cites W2034355442 @default.
- W1969783622 cites W2040646018 @default.
- W1969783622 cites W2043745365 @default.
- W1969783622 cites W2056294943 @default.
- W1969783622 cites W2057837267 @default.
- W1969783622 cites W2061696236 @default.
- W1969783622 cites W2065342345 @default.
- W1969783622 cites W2067983645 @default.
- W1969783622 cites W2070534370 @default.
- W1969783622 cites W2072328708 @default.
- W1969783622 cites W2072612968 @default.
- W1969783622 cites W2073447756 @default.
- W1969783622 cites W2077512056 @default.
- W1969783622 cites W2088486584 @default.
- W1969783622 cites W2093531204 @default.
- W1969783622 cites W2093717447 @default.
- W1969783622 cites W2096036274 @default.
- W1969783622 cites W2106128184 @default.
- W1969783622 cites W2111517084 @default.
- W1969783622 cites W2120357670 @default.
- W1969783622 cites W2132477475 @default.
- W1969783622 cites W2135070170 @default.
- W1969783622 cites W2137243825 @default.
- W1969783622 cites W2139006235 @default.
- W1969783622 cites W2140591843 @default.
- W1969783622 cites W2143594821 @default.
- W1969783622 cites W2146719356 @default.
- W1969783622 cites W2153360297 @default.
- W1969783622 cites W2161662762 @default.
- W1969783622 cites W2166667242 @default.
- W1969783622 cites W2911336608 @default.
- W1969783622 cites W4205104973 @default.
- W1969783622 cites W4213346165 @default.
- W1969783622 cites W4214825932 @default.
- W1969783622 cites W4301801366 @default.
- W1969783622 cites W2031195320 @default.
- W1969783622 doi "https://doi.org/10.1145/2395123.2395127" @default.
- W1969783622 hasPublicationYear "2012" @default.
- W1969783622 type Work @default.
- W1969783622 sameAs 1969783622 @default.
- W1969783622 citedByCount "75" @default.
- W1969783622 countsByYear W19697836222013 @default.
- W1969783622 countsByYear W19697836222014 @default.
- W1969783622 countsByYear W19697836222015 @default.
- W1969783622 countsByYear W19697836222016 @default.
- W1969783622 countsByYear W19697836222017 @default.
- W1969783622 countsByYear W19697836222018 @default.
- W1969783622 countsByYear W19697836222019 @default.
- W1969783622 countsByYear W19697836222020 @default.
- W1969783622 countsByYear W19697836222021 @default.
- W1969783622 countsByYear W19697836222022 @default.
- W1969783622 countsByYear W19697836222023 @default.
- W1969783622 crossrefType "journal-article" @default.
- W1969783622 hasAuthorship W1969783622A5015420352 @default.