Search

In a meeting, two or more individuals come together to verbally share information. However, discrepancies in perceptions often occur in complicated discussions. Therefore, whether the information transfer succeeded must be reconfirmed. This problem is typically resolved through ex-post measures such as meeting minutes. Our previous results indicated that the degree of information transfer can be predicted using head movement synchrony. In this study, we propose an information transfer estimation method based on head movement synchrony during a conversation evaluated by an omnidirectional camera that can easily obtain body movements. These body movements were quantified using Motion Energy Analysis, which is commonly used in clinical psychology, with additional processes used to reduce noise caused by lighting in the room and resulting from large accidental movements. By these processes, body movement synchrony was quantified. We confirmed that this synchrony occurred between actually interacting pairs and tested whether it was related to the degree of information transfer. In the experimental evaluation, body movement synchrony was found to be high for interacting pairs, and a positive correlation was observed between synchrony and degree of information transfer. Therefore, our proposed method may detect the synchrony and estimate the degree of information transfer using an omnidirectional camera.

Human interaction has two principle functions: building and maintaining relationships with others and exchanging information. The function of building and maintaining relationships with others relates to interpersonal coordination; this behavior pattern is expected to predict the outcome of social relationships, such as between therapists and patients. It is unclear, however, whether the exchange of information is associated with interpersonal coordination. In the present study, we tested a hypothesis of whether body movement synchrony occurs in a natural conversation and whether this synchrony has a positive correlation with the degree of information exchange. Fifty participants were engaged in a conversation task; each had different roles in the conversation. We measured their body movements during this conversation using an optical motion capture system. Similar to methods that can be found in previous research, we calculated body movements and quantified their synchrony applying the methods previously reported that automatically quantified their body movements. Moreover, we determined the participants' degree of information exchange concerning the conversation using a questionnaire. We observed that the body movement synchrony of pairs who talked with each other was significantly higher than that of pairs who did not talk with each other, and that this synchrony was positively associated with the degree of information exchange. These results suggest that body movement synchrony predicted information exchange.

The self is built as an entity independent from the external world using the human ability to experience the senses of agency and ownership. Humans usually experience these senses during movement. Nevertheless, researchers recently reported that another person’s synchronous mirror-symmetrical movements elicited both agency and ownership in research participants. However, it is unclear whether this elicitation was caused by the synchronicity or the mirror symmetry of the movements. To address this question, we investigated the effect of interpersonal synchronization on the self-reported sense of agency and ownership in two conditions, using movements with and without mirror symmetry. Participants performed rhythmic hand movements while viewing the experimenter’s synchronous or random hand movements, and then reported their perceptions of agency and ownership in a questionnaire. We observed that agency and ownership were significantly elicited by the experimenter’s synchronous hand movements in both conditions. The results suggested that the synchronous movements of another person—rather than mirror- or non-mirror-symmetrical movements—appear to elicit the experience of a sense of agency and ownership. The results also suggested that people could experience these senses not only from their own movements but also from another person’s synchronous movements.

Gaze-independent brain computer interfaces (BCIs) are a potential communication tool for persons with paralysis. This study applies affective auditory stimuli to investigate their effects using a P300 BCI. Fifteen able-bodied participants operated the P300 BCI, with positive and negative affective sounds (PA: a meowing cat sound, NA: a screaming cat sound). Permuted stimuli of the positive and negative affective sounds (permuted-PA, permuted-NA) were also used for comparison. Electroencephalography data was collected, and offline classification accuracies were compared. We used a visual analog scale (VAS) to measure positive and negative affective feelings in the participants. The mean classification accuracies were 84.7% for PA and 67.3% for permuted-PA, while the VAS scores were 58.5 for PA and −12.1 for permuted-PA. The positive affective stimulus showed significantly higher accuracy and VAS scores than the negative affective stimulus. In contrast, mean classification accuracies were 77.3% for NA and 76.0% for permuted-NA, while the VAS scores were −50.0 for NA and −39.2 for permuted NA, which are not significantly different. We determined that a positive affective stimulus with accompanying positive affective feelings significantly improved BCI accuracy. Additionally, an ALS patient achieved 90% online classification accuracy. These results suggest that affective stimuli may be useful for preparing a practical auditory BCI system for patients with disabilities.

The simultaneous perception of multimodal sensory information has a crucial role for effective reactions to the external environment. Voluntary movements are known to occasionally affect simultaneous perception of auditory and tactile stimuli presented to the moving body part. However, little is known about spatial limits on the effect of voluntary movements on simultaneous perception, especially when tactile stimuli are presented to a non-moving body part. We examined the effect of voluntary movement on the simultaneous perception of auditory and tactile stimuli presented to the non-moving body part. We considered the possible mechanism using a temporal order judgement task under three experimental conditions: voluntary movement, where participants voluntarily moved their right index finger and judged the temporal order of auditory and tactile stimuli presented to their non-moving left index finger; passive movement; and no movement. During voluntary movement, the auditory stimulus needed to be presented before the tactile stimulus so that they were perceived as occurring simultaneously. This subjective simultaneity differed significantly from the passive movement and no movement conditions. This finding indicates that the effect of voluntary movement on simultaneous perception of auditory and tactile stimuli extends to the non-moving body part.

Gaze-independent brain-computer interfaces (BCIs) are a possible communication channel for persons with paralysis. We investigated if it is possible to use auditory stimuli to create a BCI for the Japanese Hiragana syllabary, which has 46 Hiragana characters. Additionally, we investigated if training has an effect on accuracy despite the high amount of different stimuli involved. Able-bodied participants (N=6) were asked to select 25 syllables (out of fifty possible choices) using a two step procedure: first the consonant (ten choices) and then the vowel (five choices). This was repeated on three separate days. Additionally, a person with spinal cord injury (SCI) participated in the experiment. Four out of six healthy participants reached Hiragana syllable accuracies above 70% and the information transfer rate increased from 1.7 bits/min in the first session to 3.2 bits/min in the third session. The accuracy of the participant with SCI increased from 12% (0.2 bits/min) to 56% (2 bits/min) in session three. Reliable selections from a 10×5 matrix using auditory stimuli were possible and performance is increased by training. We were able to show that auditory P300 BCIs can be used for communication with up to fifty symbols. This enables the use of the technology of auditory P300 BCIs with a variety of applications.

The ownership of one's body parts represents a fundamental aspect of self-consciousness. Accumulating empirical evidence supports the existence of this concept in humans and nonhuman primates, but it is unclear whether nonprimate mammals experience similar feelings. Therefore, the present study used rubber tails to investigate body ownership in rodents. When the real tails and rubber tails were synchronously stroked, the mice responded as if their own tails were touched when the rubber tails were grasped. In contrast, when the stimuli were delivered asynchronously, there was a significantly lower mean response rate when the rubber tail was grasped. These findings suggest that mice may experience body ownership of their tails, suggestive of the rubber hand illusion in humans.SIGNIFICANCE STATEMENTTo explore the manner in which the ownership of body parts is experienced, this study specifically used the rubber hand illusion (RHI), in which self-consciousness can be extended out of one's own body. Accumulating empirical evidence supports the existence of this concept in humans and nonhuman primates, but it remains unclear whether nonprimate mammals experience similar feelings. This study demonstrated for the first time that mice may experience body ownership of their tails, which is suggestive of the RHI in humans and provides evidence that may highlight how humans experience the ownership of body parts.