Search

Speech disfluency refers to the errors, pauses, or repetitions in speech production. Co-speech gestures are known to help resolve disfluency, suggesting a metacognitive involvement.Here we ask whether (1) disfluencies and gestures act as metacognitive cues in speech, and (2) they have different functions in conversational vs. non-conversational settings. Fifty participants responded to trivia questions, and rated their confidence in their answers (i.e. metacognitive judgement), either with a visible or a non-visible listener. They audibly elaborated on their answers during which we measured the frequency and type of disfluencies and co-speech gestures. We predict confidence ratings to change as a function of the rate of disfluency and the gestures produced by the participants. We also expect the rate of disfluencies and gestures change depending on the conversational setting. Our findings will contribute to understanding the multimodal nature of language and the role of metacognition in speech and gesture production.

Gesturing helps cognitive load (Kita et al., 2017) and access to details in autobiographical memories (Aydin et al., 2023). We examined gestures' roles in narrating emotional autobiographical events in first (L1) and second language (L2), expecting (1) gesture use to increase phenomenological ratings (reliving, visual imagery, auditory imagery, and importance) of the events and emotional intensity in both languages and (2) the effect to be more prominent in L2 than L1, where cognitive load increases. Twenty-nine participants (Mage=21.24) narrated positive and negative events in L1-Turkish and L2-English. No difference between L1 and L2 was found in phenomenological and emotional intensity ratings controlling for English proficiency and current mood. Representational gestures predicted imagery for negative events in L1, and non-representational gestures predicted emotional intensity and reliving for negative events in L2. Representational gestures' recollecting and non-representational gestures' fluency-resolving functions might have increased phenomenological ratings, particularly for negative events.

Metaphor comprehension studies have investigated how we process metaphors by pitting conventional metaphors against novel ones. Although these studies have yielded much data on how we comprehend metaphors, no research has examined how we process novel spatial metaphors of time.We constructed a stimuli pool of 80 spatial metaphors of time, 40 were conventional time metaphors, whereas the other 40 were novel spatial metaphors of time evenly distributed among Moving-Ego or Moving-Time perspectives and Path or Manner metaphorical motion in the main verb. Ratings by 40 participants showed that the novel metaphors had more possible interpretations, were more ambiguous, difficult to interpret, less apt, and less conventional. A pilot study with 10 participants showed that these properties of metaphors were linked to metaphor interpretation and temporal gesture production in various ways. This study will continue to investigate how we process and represent novel spatial metaphors of time with more participants.

Hand gestures have been shown to enhance overall verbal divergent and convergent creative thinking, especially for people with high imagery. In the present study, we tested whether gestures can also boost creative imagery, or creative visual imagination, as both creativity and gestures might rely on visuospatial skills. Participants first generated ideas regarding a simple unfinished figure and then completed the figure with their favorite idea. Spontaneous and encouraged gesture frequencies during idea generation and verbal descriptions of the idea before drawing it were calculated. We found that iconic gestures produced when generating ideas could lead to more vivid and original creative imagery. However, gesturing during idea description could result in reduced transformativeness (i.e., reduced modification and flexibility when drawing). These findings suggest that iconic gestures can be beneficial for visual creative imagery when generating ideas. However, once we settle on a particular idea, gesturing about it might hinder creative flexibility.

Filled pauses (e.g., um) help speakers to maintain a conversational floor with their listener(s). Considered an advanced form of disfluency; they emerge when children obtain some language competency. Bilinguals might frequently produce filled pauses as they are sensitive to communication. This longitudinal study examined Turkish-English bilingual (N=50) and Turkish monolingual (N=48) children's production of filled pauses in L1-Turkish and L2-English narratives. Children in three age groups were recruited in Time1 (5-,7- and 9-year-olds) and Time2 (6-,8- and 10-year-olds) and were asked to narrate a story from a picture book. Results showed that controlling for L1-Turkish proficiency scores, the filled pause frequency in L1-Turkish narratives increased from Time1 to Time2, both for bilinguals and monolinguals for all age groups. We obtained the same findings for bilingual children's English narratives, controlling for English proficiency. We suggest that filled pauses might stem from metacognitive processes, which become more prominent with age.

People rely on communicative cues when assessing others' knowledge levels about a topic. Speech fluency has been shown to inform these assessments (Brennan & Williams, 1995), however little is known whether co-speech gestures also impact how we judge others' level of expertise. To address this, we showed 42 participants (Mage=21.05) short videos of speakers in four conditions (fluent or disfluent speech with gestures, fluent or disfluent speech without gestures). Participants then provided FOAK (feelings of another's knowing) judgements of the speaker. A mixed effects regression analysis, with conditions as fixed and trial and subjects as random effects, revealed that fluent speech elicited higher FOAK ratings than disfluent speech, p

Preschoolers have difficulties in relational reasoning tasks, which are usually attributed to their object focus. Object focus can be reduced by using basic shapes familiar to children and could differ across children. Therefore, in Experiment 1, we investigated 25 4-year-olds' performance in the relational match-to-sample task (RMTS), using basic shapes with training, and testing sameness and difference. In Experiment 2, 41 4- to 5-year-olds were tested in the RMTS, using basic shapes, manipulating familiarity, without training, and testing only sameness. We also investigated whether children's use of object property words (e.g., color, shape) was directly associated with their performance. Our results showed that children performed above the chance level when tested on sameness but not on difference (Experiment 1). Furthermore, basic shapes but not familiar shapes enhanced preschoolers' performance in the RMTS (Experiment 2). Children's use of object property words dampened their performance. These findings underline the importance of task- and child-related factors when investigating children's relational reasoning in particular and cognitive performance in general.

Temporal perspectives have been studied as a part of spatial thinking of time. They allow us to place ourselves and temporal events on a timeline, making it easier to spatialize time. This study investigates how we adopt temporal perspectives in temporal gestures. We asked participants to retell temporal scenarios written in the Moving-Ego (ME), Moving-Time (MT), and Time-Reference-Point (Time-RP) perspectives in spontaneous and elicited gesture conditions. Participants adopted temporal perspectives similarly regardless of the gesture condition, with few differences. Our results showed that participants’ temporal gestures resonated better with the Ego-Reference-Point versus Time-Reference-Point distinction. Participants produced more ME and Time-RP gestures for the corresponding scenarios and speech, however the MT perspective was not adopted more than the others in any condition. Our findings show that we incorporate temporal perspectives into our temporal gestures to a considerable extent, however, the classical ME and MT classification may not hold for temporal gestures.

We investigated the influence of the COVID-19 pandemic on young people’s value temporal focus, religiosity, and time spatialization. Samples of young participants from eight cultures (Americans, Spaniards, Serbs, Bosniaks, Croats, Moroccans, Turks, and Chinese) collected before the pandemic (N = 497, mean age = 21.09) were matched with samples collected during the first confinement period (N = 497, mean age = 20.96). Our results in study 1 showed that during the pandemic, young adults were less religious, more future-focused, and placed the future in front to of them in a greater extent. In study 2, using the whole sample collected during the pandemic (N = 893, mean age = 21.94), we observed that the more affected the participants were by the pandemic, the greater their future focus, the lower their religiosity, and the greater their tendency to locate the future in front. These pattern of results held in most cultures.

Contrary to the classic idea of arbitrariness in mappings between words and meanings, many languages have words that mimic the sounds of their referents (onomatopoeia) and other subtler sound symbolic associations. However, our knowledge concerning the characteristics of sound-meaning links is still limited. Previous research mostly focused on languages with a large (e.g., Japanese) or limited (e.g., English) inventory of sound symbolic words. We conducted a word-production study with native speakers of Turkish, a language with a moderate amount of sound symbolic words, and examined links between sound properties (e.g., voiced vs. voiceless) and semantic dimensions (e.g., size, speed) in describing motions. Some of the sound-meaning links identified were the links found in Japanese and English samples in previous studies (Saji et al., 2019), whereas many seem to be specific to Turkish. This study provides initial evidence for language-specific sound symbolism in Turkish and links that are consistent across languages.

We investigated recency bias (i.e., choosing the second option among two) of 3- to 5-year-old preschoolers (n=59) in a free order language, Turkish, regarding individual differences in working memory and verbal skills. Children were presented with a decision-making task in which they responded to questions about an imaginary character’s decisions with familiar and unfamiliar objects in 3 word orders (both options at the beginning, both at the end, or first option at the beginning while the second at the end). Children exhibited bias in all word orders. WM skills, not language skills, predicted bias, even after controlling for age. As children aged, their bias decreased for unfamiliar options when both were at the beginning. Recency bias also decreased as children’s WM skills improved when both options were at the beginning. Children are not mindful decision-makers and their WM skills interact with the way questions are asked.

Gestures facilitate speech production by helping speakers reduce cognitive load. Studies on gesture-speech interaction mostly examined the effect of representational gestures on spatial contexts. However, abstract deictics (e.g., pointing at objects that are not visually present) might also have a role in facilitating cognitive processes. The present study investigated the effect of gestures on disfluency rates by presenting a narrative task in three conditions: spontaneous, restricted, and encouraged gesture use. We found that disfluency rates across three conditions did not significantly differ. The use of abstract deictics in the spontaneous gesture use condition was a significant predictor of disfluency rates in the gesture restricted condition. Results indicate that gestures’ facilitative roles might be manifested differently depending on the context. Abstract deictics might also benefit speakers, especially in a narrative context. Studying abstract deictics can provide new insights on gesture and speech production interaction.

Online data collection has become a prominent option due to the COVID-19 pandemic. It is crucial to understand to what extent online studies can be compared with face-to-face studies, particularly in multimodal language research on which the modes of communication have a crucial effect. This study investigated multimodal communication across face-to-face and videoconferencing settings, focusing on gesture production and speech disfluency in a daily routine description task (N=64). Results suggested that overall disfluency rate was higher for those who communicated via videoconferencing than those who communicated face-to-face. The use of specific disfluency types also differed across the two settings, signaling an interplay between cognitive and communicative strategies. Overall gesture frequency and iconic gesture use were comparable across the two settings. Iconic gesture use negatively predicted the overall disfluency rate, regardless of the setting. Using different contexts is required to understand whether multimodal language differs between face-to-face and online communication.

Temporal gestures reveal our metaphorical thinking of time. Less is known about how speakers of different languages encode temporal gestures. We asked 19 adults to explain the meanings of 12 spatial metaphors of time in Turkish sentences. We coded gestures according to the coding scheme of Cooperrider and Nuñez (2009). Individuals produced 237 temporal gestures. There were 162 placing (68.35%), 10 pointing (4.22%), 13 duration-marking (5.49%), 12 bridging (5.06%), 40 animating (16.88%) gestures. We also identified 61 temporal gestures that did not fall into any category in their classification. These gestures depicted the change of the time of an event caused by humans (e.g., to postpone a meeting) with an open hand moving the events along an axis. We termed these as “moving” gestures and suggest that speakers of different languages may vary in their representations of temporal gestures.

Language guides how we conceptualize the level of detail in categorical spatial relations (Bowerman, 1996; Choi, 2006). This study examined whether details in different dimensions (i.e., distance and direction) given in spatial descriptions vary as a function of spatial categories. We asked Turkish speaking participants (N=40) to describe the spatial relation between two geometric objects aligned either on the horizontal or the vertical axis. There were three relations (on/above, under/below, next to/near) of which the direction (left, right) and the distance (adjacent, 5 mm, 10 mm, 15 mm) varied equally. More detailed descriptions in terms of direction and distance were provided for ‘next to/near’ compared to ‘on/above’ and ‘under/below’ relations. These results suggest an asymmetry between vertical and horizontal axes. Sensitivity for detailed descriptions along the horizontal axis may relate to language-specific spatial categorization.

A widely shared view on temporal representation suggests that people conceptualize time metaphorically as a spatial journey from a back (past) location to a front (future) location. This view predicts 1) shorter estimated distances to and better evaluations of front/future than back/past events (an asymmetry); 2) positive correlations between space, time, and evaluation; 3) negative correlations between responses to the front/future and the back/past. In the present study, participants performed a temporal distance task, a time discounting task, and a spatial distance task, all with back/past and front/future versions. Results showed that 1) there was not asymmetry between back/past and front/future in any task; 2) spatial and temporal tasks correlated positively, but they did not correlate with time discounting; and 3) responses toward the front/future and back/past correlated positively (and not negatively) in all three tasks. The results suggest the need to revise the "moving forward view of time".

Human memory retains information related to survival more effectively, termed survival processing effect (SPE). Adaptive memory should also more effectively store reliable information than unreliable information. In an experiment (n=107) we asked whether the SPE depends on the reliability of information encoded by linguistic markers. In Turkish, evidentiality markers encode whether information is gathered firsthand (-miş) or not (-di), and provide cues on source reliability. We found that sentences processed for their relevance to survival were better recalled than those processed for their relevance to moving. This survival processing effect was significant for both direct and indirect evidentiality markers, although it was stronger for direct evidentiality. That SPE persisted in the indirect evidentiality condition suggests survival related information is privileged in encoding even when potentially marked as unreliable by linguistic markers. Thus, the effect of language on memory is not profound but rather computed online.

Previous research has shown that gestures help people think and solve problems more successfully. Recent studies have also found that encouraging gesture use helps generating new creative ideas and enhances verbal improvisation. Moreover, fluid arm movements have been associated with improving the ability to connect remote associates. Research is still limited with emphasis on divergent thinking and the mechanisms behind the gesture-creativity interplay are not clear. This study examined whether encouraging gesture use could enhance the ability to connect both verbal and visual remote associates of young adults (N = 90) and hypothesised that mental imagery skills could facilitate that relationship. Our preliminary results showed that encouraging gestures did not improve remote association scores, however, mental imagery ability was a significant predictor of verbal remote associates’ scores when gestures were encouraged. We suggest that individuals who have higher mental imagery skills might benefit more from gestures for visualising verbal information.

Previous research suggests that humans use multimodal information during emotional communication. Only a few studies have investigated how emotional information is presented in non-verbal channels. We examined the role of hand gestures in communicating emotions. In a between-subject design, we analyzed the size, frequency, and type of gestures under encouraged and spontaneous gesturing conditions. Participants (N=36) were asked to describe narratives with emotional content. Preliminary analyses with 18 individuals show that, interestingly, gesture frequencies and gesture use with specific emotional phrases did not differ between groups. Also, there was not a significant difference between the two groups in the types of gestures they produced. However, the gestures in the encouraged condition were significantly bigger in size compared to gestures in the spontaneous condition. These diverse preliminary results suggest that people’s hand gestures during emotional communication should be investigated with all their dimensions instead of focusing on one aspect.

Observing gestures facilitate listeners’ comprehension, especially for visual-spatial information. However, people differ in how and to what extent they benefit from gestures depending on their visual-spatial abilities. This study examined whether and how spatial skills (i.e., mental rotation) relate to how much listeners benefit from observing gestures. We tested 51 Turkish-speaking adults’ comprehension of spatial relations when the critical spatial information was provided in three different conditions: (1) only in speech (e.g., saying “right” without making any gesture), (2) both in speech and in gesture (saying “right” and gesturing to the right), and (3) only in gesture (saying “here” and gesturing to the right). We found that mental rotation scores were associated with increased accuracy only for speech + gesture (z = 2.37, p = .02) and the gesture-only conditions (z = 2.13, p = .03). These results suggest that visual-spatial cognitive resources might be important for gesture processing.

Inference-making is a complex mental process as it involves retrieving prior knowledge and active meaning-making, appropriate for exploring processing automaticity vs. difficulty in different languages. People are prone to falsely recognizing sentences that represent the inferences they made due to gist encoding. To examine whether this process differs for L1 and L2, we presented forty-eight Turkish-English bilingual participants in Turkish, English, and dual-language sentence groups that allowed them to configure objects mentally and draw spatial inferences. Inferred sentences were recognized significantly more than new sentences. We observed this in L1 and L2, but not the dual-language condition. Higher L2 proficiency and lower executive functioning abilities were related to higher false recognition. These results are aligned with the bilingual memory organization, suggesting L2 approaches L1 automaticity with increased proficiency. Lower EF participants might prefer less effortful strategies to process information, such as averaging, abstracting, inferring, and gist extracting.

There is contradictory evidence on whether speech productiongets impaired or enhanced when people are restrained fromgesturing. There is also very little research on how this effectcan change with aging. The present study sought evidence forthese by asking young and elderly adults to describe twodifferent routes on a map in spontaneous speech and whengestures were prohibited. We found that elderly adultsproduced more spatial language when they were restricted touse gestures compared to their spontaneous speech, whereasyoung adults produced comparable levels of spatial languagein both conditions. Young and elderly adults used comparablelevels of gestures in their spontaneous route descriptions. Yet,only young adults’ gesture use correlated positively with theirspatial language production. Thus, the results of gestureprohibition on speech production are different for young andelderly adults.

Subjective duration estimates are positively related to themagnitude of various non-temporal stimuli (e.g. Xuan et al.,2007). Our study investigated whether temporal and spatialmagnitude information conveyed by linguistic stimuli wouldaffect perceived duration in a temporal reproduction task. Weused time-related words referring to different exact durations(e.g. second; Experiment 1), and spatial-temporal metaphors(e.g. long), referring to indistinct temporal as well as spatialmagnitudes (Experiment 2). In both experiments, participantsover-reproduced the shorter target duration (2.4 s) and under-reproduced the longer target duration (4.8 s). In Experiment1, participants under-reproduced the longer target durationmore when they saw “week” in the training and “year” in thereproduction. Yet, we did not observe the same semanticmagnitude effect in other word pairs either in Experiment 1 or2. Overall, we did not find supporting evidence for magnitudeinformation conveyed by language affecting subjective timeestimates.

The cognitive architecture and function of co-speech gesturehas been the subject of a large body of research. We investigatetwo main questions in this field, namely, whether language andgesture are the same or two inter-related systems, and whethergestures help resolve speech problems, by examining therelationship between gesture and disfluency in neurotypicalspeakers. Our results support the view of separate, but inter-related systems by showing that speech problems do notnecessarily cause gesture problems, and on many occasions,gestures signal an upcoming speech problem even before itsurfaces in overt speech. We also show that while gestures aremore common on fluent trials, speakers use both iconic andbeat gestures on disfluent trials to facilitate communication,although the two gesture types support communication indifferent ways.

People use spatial metaphors to talk about temporal concepts.They also gesture frequently during speech. Thecharacteristics of these gestures give information regardingthe mental timelines people form to experience time. Thepresent study investigates the expression of temporal conceptson a natural setting with Turkish speakers. We found thatTurkish speakers used more metaphoric temporal phrases(e.g., short period, time flies quickly) than words referring totime without spatial content (e.g., today, nowadays) in asession where they talked about people’s fortune.Spontaneous gestures were mainly classified as metaphoricand beat gestures and were mostly produced on the sagittalaxis, which contradicts with the previous findings. Yet, wealso found that people used vertical axis to represent currentand future events. These findings suggest that lateral axis maynot always be the most common direction for co-speechtemporal gesture use, and the pragmatic constraints of theenvironment may influence the spatial conceptualization oftime.