Search

Background: This study was motivated by the need to enhance Mandarin learning through embodied interactions and physical engagement methods. While most studies confirm the positive effects of touchscreen devices on learning, mixed findings suggest a need for more engaging methods. This research addresses these gaps by exploring the benefits of embodied interaction through the Shaking‐On game app, an embodied question‐response platform, in comparison to Kahoot. Objectives: To compare the learning effectiveness of the Shaking‐On app, which incorporates physical shaking interactions, with the conventional quiz platform Kahoot in promoting Mandarin learning and positive emotional experiences. Methods: A total of 158 junior high school students participated in the study, engaging in 15‐minute sessions once a week for 3 weeks in a formal classroom setting. Participants were divided into two groups: one using the Shaking‐On app and the other using Kahoot. The study employed a comparative analysis framework based on achievement emotion theory to evaluate learning outcomes and emotional responses. Furthermore, the classroom response system (CRS) analysis was used to assess the cognitive and affective parameters of the learning tasks in the Shaking‐On app and Kahoot, providing detailed insight into how different interactive tasks contributed to learning. Results and Conclusions: The results indicated that the Shaking‐On app significantly enhanced Mandarin learning and engagement compared with Kahoot. Participants using Shaking‐On experienced higher levels of interactive situational interest and flow, while test anxiety remained consistent across both groups. These findings suggest that incorporating embodied interactions into digital learning tools can substantially benefit student engagement and learning outcomes. The study indicated that such apps could be effectively integrated into classroom settings to enhance student learning. Educators and game developers are encouraged to integrate such interactive elements to improve the efficacy and appeal of educational applications. Lay Description: What Is currently known about this topic?: Digital game‐based learning enhances motivation, critical thinking and retention.Embodied cognition links bodily experiences to improved learning outcomes.Physical activities in learning can boost motivation, interest and performance.Engagement through physical interaction may help reduce test anxiety. What does this paper add?: Shaking‐On is more effective in Mandarin learning than Kahoot as classroom response system.Bodily engagement in Shaking‐On enhances situational interest and flow.No significant difference in test anxiety between Shaking‐On and Kahoot users.Embodied interactions provide substantial benefits in digital learning tools. Implications for practice: Educators should integrate embodied interactions to enhance student engagement.Game developers can design more effective learning apps with embodied elements.Future research should explore Shaking‐On's impact on other subjects.Policies should support the development of interactive digital learning tools. [ABSTRACT FROM AUTHOR]

Computational wearables are redefining our presence in the world and transforming our lifestyles by engendering a seamless connection between the wearer and the worn. Despite numerous original studies on the development as well as the current advances of wearables, a systematic review from the standpoint of fashion seems to be lacking. Thus, this systematic review aimed to explore the current state of research on computational fashion in wearables' literature in terms of the key domains, theoretical models, materials, interaction modalities, and existing gaps. To this aim, the authors built a search string based on the keywords in related topics and conducted the research using Scopus databases. As a result, a total of 4777 papers between January 1990 to August 2021 were screened and 82 research study papers finally passed the inclusion-exclusion criteria for the purpose of the review. The results display: first, computational wearables' studies are becoming more inclined towards the aesthetic aspects of fashion wearables; second, although the functional aspects of the design processes received more attention, embodiment was the most discussed theory in the included studies; third, the extensive application of fabric implied the need for new fabrics with both smart quality and flexibility to afford aesthetic aspects; fourth, ambient data as input modalities received extensive attention in fashion wearables; fifth, kinetic output modalities as novel modes of fashion expression are becoming as prevalent as visual modalities. Finally, our findings provide a detailed overview of distinct facets of studies on computational fashion and a future research agenda for researchers and designers working on fashion and wearables. [ABSTRACT FROM AUTHOR]

AbstractMost research about augmentative and alternative communication (AAC) has focused on improving use of and access to speech generating devices (SGDs). However, many adults with significant physical and developmental disabilities express a preference for unaided, embodied forms of communication. This study used conversation analysis (CA) techniques to analyze the forms and functions of embodied communication that occurred during interactions between a young man who used unaided, embodied communication and an SGD to communicate with a familiar communication partner. Close analysis revealed that embodied resources were required for both unaided and aided forms of communication. Furthermore, both participants used their bodies to establish interactional spaces with different focal points during interaction, which placed different demands on the aided speaker. Unfortunately, when the SGD was the focal point, problematic demands were placed on the aided speaker, which in turn resulted in increased embodied effort on his part. The forms and functions of the body, differences in the participants’ interactions when communication did and did not involve the SGD, and implications for research and practice are all reported and discussed. [ABSTRACT FROM AUTHOR]

While previous research studies have focused on either caregivers' or residents' perception and use of social robots, this article offers an empirical and theoretical examination of joint activities in triadic human–robot interaction. The symptomatology of dementia creates an asymmetrical relation wherein the impetus to employ a robot often originates from the caregiver. Drawing on field work and video recorded interactions in dementia care homes, the article investigates how caregivers draw on embodied resources to involve residents and robot animals in interaction. The analysis demonstrates how caregivers promote commitment and encounter resistance with residents. We draw on the theory of sociomaterial interactionism to study situated interaction between bodies in a meaning‐generating process. By re‐conceptualising the theoretical notions of manipulation and recruitment, the article offers an approach for studying orientations that distinguish between reciprocity of agential objects. We show that caregivers usually distinguish between interactions with people and machines by anticipating a specific response from the robots (manipulation), while they invite participation in a broader sense from residents (recruitment). Social friction arises, however, if caregivers act upon the residents as embodied objects in manipulative ways. [ABSTRACT FROM AUTHOR]

Repetition has often been argued to be a semiotic device that iconically signifies 'more content', such as intensity and plurality. However, through multimodal interaction analysis of materials in English, Estonian, and Swedish, this paper demonstrates how self-repetition is used to coordinate actions across participants and temporally organize the ongoing activity. The data are taken from infant mealtimes, pilates classes, dance training, boardgames, rock climbing, and opera rehearsals. Repetition of both lexical and non-lexical tokens can prolong, postpone, and generally organize segments of action as well as co-create rhythms and moves in a moment-by-moment reflexive relationship with other (non-vocalizing) participants. A crucial feature of repetitions is that they can be flexibly extended to fit the other's public performance, its launching, continuation, and projectable completion. We argue that the iconicity of repetition emerges through its indexical relationship to other bodies, as a real-time jointly achieved phenomenon. [ABSTRACT FROM AUTHOR]

In-lab elicitation studies inform the design of gestures by having the participants suggest actions to activate the system functions. Conversely, crowd-sourced identification studies follow the opposite path, asking the users to associate the control actions with functions. Identification studies have been used to validate the gestures produced by elicitation studies, but not to design interactive systems. In this paper, we show that identification studies can be combined with in situ observations to design the gestures for data exploration with public displays. To illustrate this method, we developed two versions of a gesture-controlled system for data exploration with 368 users: one designed through an elicitation study, and one designed through in situ observations followed by an identification study. Our results show that the users discovered the majority of the gestures with similar accuracy across the two prototypes. Additionally, the in situ approach enabled the direct recruitment of target users, and the crowd-sourced approach typical of identification studies expedited the design process. [ABSTRACT FROM AUTHOR]

Researchers are increasingly calling for more computational thinking (CT) teaching tools and activities designed for young children. Considering young children's need to draw on their bodily experiences to learn abstract concepts, this study applied the embodied cognition perspective to design an unplugged (non-computer-based) toolkit with activities that foster CT. This study aimed to explore young children's experiences in unplugged activities. Specifically, children's perceptions about the activities were investigated, and their embodied interactions during the activities were analyzed to reveal how CT emerges as an embodied phenomenon. Results indicate that children had positive perceptions about the activities. In addition, young children's algorithmic thinking and debugging emerged most frequently. Furthermore, this study found that CT extended to both the unplugged toolkit and children's bodies and emerged in perception-action loops. This research provides insight into the instructional design of young children's CT and helps researchers understand how young children develop CT from an embodied cognition perspective. [ABSTRACT FROM AUTHOR]

Copyright of Teacher Education Research is the property of Teacher Education Research Editorial Office and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

This special issue explores interaction and language use in situations involving human and non-human participants. Bringing together methodologies and theoretical approaches in linguistics and interactional studies, namely Conversation Analysis, the volume focuses on the social actions accomplished in interspecies interaction and the linguistic construction of non-human perception and meaning-making. The studies of the volume deal with cat's bodily and vocal cues used for coordinating human participant's attention to a shared object, animal actions as conditionally relevant to human utterances within sequence organization, dogs' embodied responses to playing partners' verbal turns within a ball game, and expressions of non-human sensory perception through reported animal thoughts. The special issue introduces Interspecies Pragmatics as an approach used for studying human-animal interactions and relationships, with a particular focus on building multimodal understanding in these specific environments. Interspecies Pragmatics aligns with various interdisciplinary approaches in the Humanities and Social Sciences (Human-Animal Studies, Posthumanism, Ecocriticism, Ecolinguistics, Biosemiotics). By undoing conceptual hierarchies and boundaries between humans and other living beings, we can gain insights into shared interests and meanings across species boundaries. • Animals' first and second actions are conditionally relevant to human utterances. • Cats use bodily cues to direct humans' attention to a shared object. • Dogs distinguish addressed recipient from the unaddressed recipient. • By reporting animal thoughts humans share awareness of non-human perceptual worlds. • Interspecies Pragmatics explores the Human-Animal bond in language and interaction. [ABSTRACT FROM AUTHOR]

This paper discusses the critical role of art therapy in solving various psychological problems, and introduces an innovative immersive and interactive art therapy mechanism based on artificial intelligence (AI), which combines machine learning and AI algorithms to realize embodied interactions between the learner, the machine, and the environment.The study analyzes the changes of students’ status before and after receiving art therapy in terms of various dimensions, including students’ social avoidance, general well-being, and self-emotions. Using regression modeling, the study validated the positive effects of art therapy on students’ mental health, cognitive abilities, and depression levels. It showed that art therapy had a statistically significant impact on improving students’ mental health, cognition, and reducing depressive symptoms at the 1% level of significance. Students who participated in art therapy had a 0.329 unit increase in mental health scores compared to non-participants, and this study provides a valuable reference and idea for the application of expressive art therapy in mental health education.

By analysing the movements through space of a famous conversation analyst delivering a well-known lecture, this paper reveals the creative construction of space within the social and physical constraints of the lecture hall, and in so doing contributes to the embodied analysis of humans in material environments. While founded in a multimodal or embodied conversation analysis, it uses terminology and insights from dance to help ‘see’ and analyse the movements as ‘footwork’ and ‘figures’.

The emerging field of human-building interaction (HBI) has its roots in the historical trends of the development of architecture and human-computer interaction (HCI). Advancements in building information modelling (BIM), sensing, and actuation technologies as well as the commodification and miniaturisation of microprocessors over the past two decades are transforming what once were quixotic visions of a cybernetic architecture into reality. This new reality which integrates computation with architecture opens up different kinds of engagements in the ways we design, use, and inhabit our built environments. A question that follows this new reality is: how can we conceptualise human experience in such environments? Thus far, the lived human experience of such interactions has been an overlooked aspect in HBI-related research. In this article, we provide an initial experience framework for HBI underpinned by existing literature from the HCI and architecture domains on the subjective, lived-in experience of architecture and findings derived from a case study of a field-deployed HBI interface. The research objective of our framework is to outline aspects of HBI lived experiences that can be used as guiding lenses for HBI designers and practitioners who wish to design for and assess such experiences.

In this article we report on the work being carried out in the archival and presentation in mixed reality (MR) of materials pertaining to interactive artworks, in the context of a state-funded partnership project. We describe our approach in scanning and organizing materials as a contribution to an existing online archive of digital art (ADA); and in the design and implementation of an MR application for interacting with archive contents. Digital archives offer expanded possibilities for experiencing the content, which can be tailored to different use-cases and types of content. As frameworks for MR become more common and accessible to a wider audience, an archive can more readily combine characteristics of both the physical and digital worlds to empower the activities of visitors and scholars alike. For this, it is necessary to experiment with newer forms of presentation and interaction, as well as types of content, such as three-dimensional (3D) models. We offer details and insights about the processes used and decisions taken in both the archival and experimental aspects of our contribution and conclude with directions for further work. [ABSTRACT FROM AUTHOR]

Copyright of Journal of Ordnance Equipment Engineering is the property of Chongqing University of Technology and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

The present paper contributes to the emerging field of embodied interaction. It reports on research into deictic interactions between a human and a non-human, specifically a cat, interlocutor, applying a pragmatic framework developed for human–human communicative interactions. We analyse video recordings of interactions where a cat is a deictic agent pointing the human interlocutor either to the door or the food bowl. We show that these interactions show triadic pointing, hence, focusing joint attention on a common object as a proxy for the event i.e., providing food in the bowl and opening the door. We show that the cat also checks whether the human understands her intentions and that she confirms the human's interpretation. We do not restrict ourselves to vocal communication - as is often done in human language studies -, but we examine how in cat-human communication the cat and human bodies are used to express deixis. Thus, we conceptualize deixis as an embodied interpersonal i.e., interspecies phenomenon. We show that the cat interlocutor uses her body, e.g. eyes/body/tail/ears, as well as her voice, meowing/purring, within this complex deictic interaction. • The present paper investigates the contribution of the non-human feline interlocutor as a deictic agent in interspecies human/non-human interaction. • Our analysis successfully applies a pragmatic framework developed for human–human communicative interactions, to intraspecies instances of human-non-human interaction. • We show that the body emerges as the crucial locus of deixis, which in turn entails that one (and perhaps the only) prerequisite to. • The specific expression of deixis depends on the kind of body possessed by the deictic agent: There are aspects of "human deixis" that cats cannot express, and vice versa. • Deictic communication of cats includes eye gaze, and possibly positioning of the ears and the instrumental use of the paw. [ABSTRACT FROM AUTHOR]

In-lab elicitation studies inform the design of gestures by having the participants suggest actions to activate the system functions. Conversely, crowd-sourced identification studies follow the opposite path, asking the users to associate the control actions with functions. Identification studies have been used to validate the gestures produced by elicitation studies, but not to design interactive systems. In this paper, we show that identification studies can be combined with in situ observations to design the gestures for data exploration with public displays. To illustrate this method, we developed two versions of a gesture-controlled system for data exploration with 368 users: one designed through an elicitation study, and one designed through in situ observations followed by an identification study. Our results show that the users discovered the majority of the gestures with similar accuracy across the two prototypes. Additionally, the in situ approach enabled the direct recruitment of target users, and the crowd-sourced approach typical of identification studies expedited the design process.

This ongoing PhD study aims to explore the potential of shape-changing fashion and textiles for aesthetic haptic interaction and affective soma experiences using Research through Design methodology. The research has progressed through multiple workshops and design projects, with each one building upon the previous findings and contributing to the ongoing work. Design strategies and toolkits are developed to accommodate various interaction modalities, soma experiences, haptic patterns, and use contexts. Preliminary results show the potential of translating affective haptic experiences into fashion and textile design languages. It also contributes to the development of textile-craft-based shape-changing methods for hand-held tactile textile installation and body-worn haptic wearables design to generate engaging experiences. In the future study, I will verify the effectiveness of the developed design toolkits through workshops by engaging design students, thus preparing the study's outcomes for broader dissemination. [ABSTRACT FROM AUTHOR]

Visual and text-based art plays a role in constituting and sustaining international harm reduction social movements based on drug user rights. The digital arts of harm reduction examined in this article counter sociological discomfort with pleasure by performing the artisanal pleasures of craft, context, and practice. Through close examination of the Instagram hashtag #celestialheartbreak, the article centers work by artist Jamie Harary, whose queer feminist harm reduction art places women and gender-nonconforming people at the center of harm reduction in life-affirming ways. The work expands the visual repertoire for speculative narcofeminist imaginaries, moving beyond rights-based formations to consider the play of emotional intensity. This article meditates upon the movement of affective neuroscience as supplement to feminist and queer drug research, as well as harm reduction practice, in offering socially situated accounts for getting at the lived dimensions of affective lives and claims to making sense of social worlds by living well with drugs. [ABSTRACT FROM AUTHOR]

Physical manipulatives, such as rods or tiles, are widely used for mathematics learning, as they support embodied cognition, enable the execution of epistemic actions, and foster conceptual metaphors. Counting them, children explore, rearrange, and reinterpret the environment through the haptic channel. Vision generally complements physical actions, which makes using traditional manipulatives limited for children with visual impairments (VIs). Digitally augmenting manipulatives with feedback through alternative modalities might improve them. We specifically discuss conveying number representations to children with VIs using haptic and auditory channels within an environment encouraging exploration and supporting active touch counting strategies while promoting reflection. This paper presents LETSMath, a tangible system for training basic mathematical skills of children with VIs, developed through Design-Based Research with three iterations in which we involved 19 children with VIs and their educators. We discuss how the system may support training skills in the composition of numbers and the impact that the different system features have on slowing down the interaction pace to trigger reflection, on understanding, and on incorporation. [ABSTRACT FROM AUTHOR]

Embodied interaction (EI) is a body-based interactive paradigm that has the potential to enhance the flow experience in virtual reality (VR). To examine this hypothesis, this paper distinguishes three common types of EI in VR, namely body-based, tangible, and avatar-based EI. In empirical studies 1–3, three comparative experiments were carried out to examine the respective effects of these EI modes on flow experience. Subjective and physiological data (e.g., electrodermal activity, etc.) from studies 1–2 show that the use of body-based and tangible EI leads to the enhancement of physiological arousal (an important indicator of concentration) and flow experience. Study 3 reveals the effect of avatar-based EI on flow experience. Using a high-ownership avatar is found to enhance the sense of presence and involvement, which then improves flow. This effect is only for experienced users, showing a moderating effect. The mechanism of these positive effects requires further clarification. [ABSTRACT FROM AUTHOR]

Coupling is a key concept in the field of embodied interaction with digital products and systems, describing how digital phenomena relate to the physical world. In this paper, we present a Research through Design process in which the concept of coupling is explored and deepened. The use case that we employed to conduct our research is an industrial workplace proposed by Audi Brussels and Kuka. Our aim was to enrich this workplace with projection, or Spatial Augmented Reality, while focusing on operator interaction. We went through three successive design iterations, each of which resulted in a demonstrator. We present each of the three demonstrators, focusing on how they propelled our understanding of coupling. We establish a framework in which coupling between different events, be they physical or digital, emerges on four different aspects: time, location, direction, and expression. We bring the first three aspects together under one heading—coupling of meaning—and relate it to ease of use and pragmatic usability. We uncover the characteristics of the fourth aspect—coupling of expression—and link it to the psychological wellbeing of the operator in the workplace. We conclude this paper by highlighting its contribution to the embodied interaction research agenda. [ABSTRACT FROM AUTHOR]

In this paper, the researchers report an experimental study on conceptual knowledge learning and application through embodied interactions, expecting that bodily movements would facilitate learning in a positive manner. The intervention was enabled by Unity3D and Kinect V2, and taught novice adult learners the concepts of and conversions between binary and decimal numbers. Fifty-three adult participants were recruited, and randomly assigned into the experimental and control groups. During the intervention, participants in the experimental group manipulated and interacted with the learning materials through their body movements enabled by Kinect; while those in the control group learned the same content but interacted using conventional mouse and keyboard. Pre- and posttests results indicated that embodied interactions facilitated conceptual learning for the participating adult learners. However, compared with the mouse interaction, the embodied interactions did not lead to significantly better knowledge retention and application results. The study outcome implies that embodied interactions do not necessarily lead to better learning performances over traditional mouse-based interactions, and the 'how' and 'how much' may play critical roles for such interventions. Suggestions and challenges in designing learning systems utilizing embodied interactions enabled by novel technologies are provided. [ABSTRACT FROM AUTHOR]

Coaching has expanded as a method of facilitating individual change, performance, and learning. It is generally described in terms of its functions, referring to cognitive and organisational psychology as well as theories of change, theoretical stances, and methodologies from psychotherapy. Theoretical concern for the body as part of the meaning-making process has been piecemeal in coaching, despite growing interest in embodiment in psychology and learning. There are widespread calls in relevant disciplines for stronger theorisation of embodiment. The Merleau-Pontian concept of "intervolvement" is adopted as a frame, which is tentatively operationalised and illustrated using an example study observing the interactions of a coaching dyad. The case study demonstrates how the coaching practice can be understood from an embodied perspective. A model is proposed, which conceptualises specific ways in which the interaction can be described. [ABSTRACT FROM AUTHOR]

Guitarists struggle to play their instruments while simultaneously using additional computing devices (i.e., encumbered interaction). We explored designs with guitarists through co-design and somaesthetic design workshops, learning that they (unsurprisingly) preferred to focus on playing their guitars and keeping their instruments' material integrity intact. Subsequently, we devised an interactive guitar strap controller, which guitarists found promising for tackling encumbered interaction during instrumental transcription, learning and practice. Our design process highlights three strategies: considering postural interaction, applying somaesthetic design to interactive music technology development, and augmenting guitar accessories. [ABSTRACT FROM AUTHOR]

Background: This study aims to further the understanding of communication involving people with late-stage dementia by highlighting assisted eating as an interactive joint activity. Assisted eating is, on the surface, primarily a care activity with the purpose of feeding the assisted person and thereby facilitating nutritional uptake. Helping someone to eat requires, nevertheless, fine-grained communication and coordination of both attention and embodied actions. Method: Using video recordings where a person with late-stage dementia is provided with assistance to eat, we show how assisted eating is sequentially organized into smaller, local communicative projects, and how each project's completion is contingent upon the temporal co-ordination of the participants' attention and embodied actions. Results: The analysis shows how actions necessary to carry out the eating (e.g., manipulating the food, bringing the food to the mouth) are also inherently communicative and achieved through an embodied participation framework. Discussion/conclusion: Our findings show that while the caregiving staff perform most of the actions required in the assisted eating, the person with dementia is a central agent whose actions - displays of engagement and disengagement - are decisive for the progression of the eating activity and play central roles in the interactive achievement of the activity. [ABSTRACT FROM AUTHOR]