FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2772857319> ?p ?o ?g. }

• W2772857319 abstract "When Input and Output Diverge: Mismatches in Gesture, Speech, and Image Alissa Melinger (melinger@coli.uni-sb.de) Department of Computational Psycholinguistics, Saarland University, Saarbrucken, 66041, Germany Sotaro Kita (sotaro.kita@bristol.ac.uk) Department of Experimental Psychology, 8 Woodland Road University of Bristol, Bristol BS8 1TN, United Kingdom representation, but they can also be influenced by ‘thinking for speaking’ operations on this representation. Discriminating between these theoretical alternatives is difficult because there is usually a close isomorphism between the semantic content of speech and the imagistic content of the representation speech is describing. Bearing on this discussion are recent studies demonstrating that gestures can convey complementary information to what is expressed in speech. For example, when describing their solutions to the Tower of Hanoi problem, speakers’ gestures sometimes corresponded to possible strategies that were not mentioned in the concurrent speech rather than to the strategy that was mentioned in speech. (Garber & Goldin-Meadow, 2002). The non- isomorphism between the content of speech and gesture has been referred to as speech-gesture mismatches. High rates of speech-gesture mismatches have also been reported for children who are in the transitional stage of acquiring the ability to correctly respond to the Piagetian conservation task (Church & Goldin-Meadow, 1986). Speech-gesture mismatches appear to contradict the claims of the Lexical Semantic Hypothesis in that they express information not included in speech. However, the information expressed by gesture in the speech-gesture mismatches does not actually conflict with either the linguistic or the imagistic representation; instead they provide complementary information. Thus, they do not provide a strong test of the competing theories. In this paper we employed perspective taking to create situations in which what was said conflicted with what was seen. Examining the behavior of gesture in these cases should discriminate between the competing hypotheses regarding gesture generation. The Lexical Semantics Hypothesis predicts that gestures will always align with the speech. The Free Imagery Hypothesis predicts that the gestures will always align with the image. The Interface Hypothesis predicts that gesture alignment will be influenced by ‘thinking for speaking’ processes and therefore the alignment of gesture could be to either or both representations, depending on the specific situation. Abstract The goal of the current paper is to investigate the behavior of gesture when the information conveyed by speech and the information conveyed by the image being described conflict as a result of perspective taking. To construct a corpus of speech-image mismatches, we designed a picture description elicitation procedure using path-like networks of colored circles. The results of our analysis demonstrate that gestures can be mismatched to both speech, as has been previously observed, and to the image, which has not been previously reported. The results provide insights into the nature of the representations that give rise to gestures. The Origin of Gesture This paper investigates the underlying cognitive processes involved in relating spatial information from a visual input to two separate output modalities, namely speech and gesture. Three theoretical possibilities have been proposed for how these three modalities of representation, visual- spatial, verbal and gestural, are related: The Lexical Semantic Hypothesis (Butterworth & Hadar, 1989; Schegloff, 1984), the Free Imagery Hypothesis (Krauss, Chen, & Chawla, 1996; Krauss, Chen, & Gottesman, 2000; but see de Ruiter, 1998, 2000 for another version of this hypothesis), and the Interface Hypothesis (Kita & Ozyurek, The Lexical Semantic Hypothesis (Butterworth & Hadar, 1989; Schegloff, 1984) proposes that gestures are generated from the semantics of the lexical items chosen to express the desired message. It predicts that gestures should always correspond to the meaning expressed by specific lexical items. In contrast, the Free Imagery Hypothesis (Krauss et al., 1996, 2000) claims that gestures are generated on the basis of pre-linguistic non-propositional representations; the strong reading of this proposal implies that the information conveyed by gesture should be unaffected by the specific lexical items selected during formulation and by the ‘thinking for speaking’ (Slobin, 1987, 1996) processes that convert the imagistic representation into propositional content (however, see below for alternative readings of this proposal). The Interface Hypothesis (Kita & Ozyurek, 2003) claims that gestures originate from a mediating representation connecting spatio-motoric representations in memory and linguistic representations. According to this view, gestures are generated from the imagistic Perspective Taking Perspective taking is a critical step required to express spatial relations in speech (cf. Miller & Johnson-Laird," @default.
• W2772857319 created "2017-12-22" @default.
• W2772857319 creator A5024764242 @default.
• W2772857319 creator A5054897487 @default.
• W2772857319 date "2004-01-01" @default.
• W2772857319 modified "2023-09-28" @default.
• W2772857319 title "When Input and Output Diverge: Mismatches in Gesture, Speech, and Image" @default.
• W2772857319 cites W111787296 @default.
• W2772857319 cites W1493636870 @default.
• W2772857319 cites W1513874694 @default.
• W2772857319 cites W153699105 @default.
• W2772857319 cites W1584697775 @default.
• W2772857319 cites W1598586539 @default.
• W2772857319 cites W1634667895 @default.
• W2772857319 cites W175626799 @default.
• W2772857319 cites W1974604838 @default.
• W2772857319 cites W1989590930 @default.
• W2772857319 cites W1991568221 @default.
• W2772857319 cites W2008496867 @default.
• W2772857319 cites W2023464717 @default.
• W2772857319 cites W2062645196 @default.
• W2772857319 cites W2127508752 @default.
• W2772857319 cites W2128092632 @default.
• W2772857319 cites W2165209568 @default.
• W2772857319 cites W2232925767 @default.
• W2772857319 cites W2264155890 @default.
• W2772857319 cites W2334905547 @default.
• W2772857319 cites W2974832207 @default.
• W2772857319 cites W51494718 @default.
• W2772857319 cites W587016256 @default.
• W2772857319 cites W840597016 @default.
• W2772857319 cites W976506165 @default.
• W2772857319 hasPublicationYear "2004" @default.
• W2772857319 type Work @default.
• W2772857319 sameAs 2772857319 @default.
• W2772857319 citedByCount "0" @default.
• W2772857319 crossrefType "journal-article" @default.
• W2772857319 hasAuthorship W2772857319A5024764242 @default.
• W2772857319 hasAuthorship W2772857319A5054897487 @default.
• W2772857319 hasConcept C138885662 @default.
• W2772857319 hasConcept C154945302 @default.
• W2772857319 hasConcept C15744967 @default.
• W2772857319 hasConcept C17744445 @default.
• W2772857319 hasConcept C199539241 @default.
• W2772857319 hasConcept C204321447 @default.
• W2772857319 hasConcept C207347870 @default.
• W2772857319 hasConcept C2776359362 @default.
• W2772857319 hasConcept C28490314 @default.
• W2772857319 hasConcept C41008148 @default.
• W2772857319 hasConcept C41895202 @default.
• W2772857319 hasConcept C94625758 @default.
• W2772857319 hasConceptScore W2772857319C138885662 @default.
• W2772857319 hasConceptScore W2772857319C154945302 @default.
• W2772857319 hasConceptScore W2772857319C15744967 @default.
• W2772857319 hasConceptScore W2772857319C17744445 @default.
• W2772857319 hasConceptScore W2772857319C199539241 @default.
• W2772857319 hasConceptScore W2772857319C204321447 @default.
• W2772857319 hasConceptScore W2772857319C207347870 @default.
• W2772857319 hasConceptScore W2772857319C2776359362 @default.
• W2772857319 hasConceptScore W2772857319C28490314 @default.
• W2772857319 hasConceptScore W2772857319C41008148 @default.
• W2772857319 hasConceptScore W2772857319C41895202 @default.
• W2772857319 hasConceptScore W2772857319C94625758 @default.
• W2772857319 hasIssue "26" @default.
• W2772857319 hasLocation W27728573191 @default.
• W2772857319 hasOpenAccess W2772857319 @default.
• W2772857319 hasPrimaryLocation W27728573191 @default.
• W2772857319 hasRelatedWork W130413587 @default.
• W2772857319 hasRelatedWork W2085214686 @default.
• W2772857319 hasRelatedWork W2094592934 @default.
• W2772857319 hasRelatedWork W2139454104 @default.
• W2772857319 hasRelatedWork W2250652494 @default.
• W2772857319 hasRelatedWork W2288247670 @default.
• W2772857319 hasRelatedWork W2292441393 @default.
• W2772857319 hasRelatedWork W2547744351 @default.
• W2772857319 hasRelatedWork W2774282548 @default.
• W2772857319 hasRelatedWork W2801562116 @default.
• W2772857319 hasRelatedWork W2888140820 @default.
• W2772857319 hasRelatedWork W2895974687 @default.
• W2772857319 hasRelatedWork W2981040192 @default.
• W2772857319 hasRelatedWork W3009943497 @default.
• W2772857319 hasRelatedWork W3161216209 @default.
• W2772857319 hasRelatedWork W3186156286 @default.
• W2772857319 hasRelatedWork W3193768936 @default.
• W2772857319 hasRelatedWork W395442513 @default.
• W2772857319 hasRelatedWork W401403315 @default.
• W2772857319 hasRelatedWork W2220580718 @default.
• W2772857319 hasVolume "26" @default.
• W2772857319 isParatext "false" @default.
• W2772857319 isRetracted "false" @default.
• W2772857319 magId "2772857319" @default.
• W2772857319 workType "article" @default.