Search

This chapter provides an introductory overview of some of the basic experimental paradigms traditionally employed in the field of gesture studies to investigate both comprehension and production in adult and child populations. With respect to gesture production, the chapter taps into paradigms used for exploring both intra-psychological and inter-psychological functions of co-speech gestures. At the same time, the present chapter aims to shed light on some of the core questions researchers have been addressing in using the described paradigms, concluding with a reflection on some of the methodological shortcomings and limitations of the respective paradigms and methods used.

This chapter argues for a composite utterances approach to research on body, language, and communication. It argues that to understand meaning we need to begin with the utterance or speech act as the unit of analysis. From this perspective, the primary task in interpreting others’ behaviour in communication is to infer what a person wants to say. In order to solve this task, an interpreter is free to consult any and all available information, regardless of the sensory modality in which that information is gathered (e.g., vision versus hearing), and regardless of the semiotic function of that information (e.g., iconic/indexical, symbolic/conventional, or some combination of these). Having recognized that another person has an intention to communicate, an interpreter takes the available relevant information (e.g., vocalizations, facial expressions, hand movements, all in the context of synchronic knowledge of linguistic and cultural systems, and other aspects of common ground) and looks for a way in which those cooccuring signs may simultaneously point to a single overall message of the move that a person is making. This is helped by the binding power of social cognition in an enchronic context (that is, the sequential context of turn-by-turn conversation), in particular the assumption that people are not merely saying things but making moves. The chapter focuses on co-speech hand gestures, and also discusses implications of the composite utterances approach to research on syntax, and on sign language.

This chapter gives a brief and selective overview of how to approach research on bodilyand linguistic aspects of communication by doing fieldwork. Here I do not address tech-nological issues such as specific choices of video recording equipment or computerprograms for processing and analysis. Any such discussion would either be too pur-pose-specific or would quickly become obsolete due to the fast-moving nature of thetechnology. Our interest here is the general approach.

Multimodal Communication; Embodiment