Search

Social distancing is an effective strategy to mitigate the impact of infectious diseases. If sick or healthy, or both, predominantly socially distance, the epidemic curve flattens. Contact reductions may occur for different reasons during a pandemic including health-related mobility loss (severity of symptoms), duty of care for a member of a high-risk group, and forced quarantine. Other decisions to reduce contacts are of a more voluntary nature. In particular, sick people reduce contacts consciously to avoid infecting others, and healthy individuals reduce contacts in order to stay healthy. We use game theory to formalize the interaction of voluntary social distancing in a partially infected population. This improves the behavioral micro-foundations of epidemiological models, and predicts differential social distancing rates dependent on health status. The model’s key predictions in terms of comparative statics are derived, which concern changes and interactions between social distancing behaviors of sick and healthy. We fit the relevant parameters for endogenous social distancing to an epidemiological model with evidence from influenza waves to provide a benchmark for an epidemic curve with endogenous social distancing. Our results suggest that spreading similar in peak and case numbers to what partial immobilization of the population produces, yet quicker to pass, could occur endogenously. Going forward, eventual social distancing orders and lockdown policies should be benchmarked against more realistic epidemic models that take endogenous social distancing into account, rather than be driven by static, and therefore unrealistic, estimates for social mixing that intrinsically overestimate spreading., Scientific Reports, 11 (1), ISSN:2045-2322

Games, 12 (4), ISSN:2073-4336

Objects learned within single enclosed spaces (e.g., rooms) can be represented within a single reference frame. Contrarily, the representation of navigable spaces (multiple interconnected enclosed spaces) is less well understood. In this study we examined different levels of integration within memory (local, regional, global), when learning object locations in navigable space. Participants consecutively learned two distinctive regions of a virtual environment that eventually converged at a common transition point and subsequently solved a pointing task. In Experiment 1 pointing latency increased with increasing corridor distance to the target and additionally when pointing into the other region. Further, when pointing within a region alignment with local and regional reference frames, when pointing across regional boundaries alignment with a global reference frame was found to accelerate pointing. Thus, participants memorized local corridors, clustered corridors into regions, and integrated globally across the entire environment. Introducing the transition point at the beginning of learning each region in Experiment 2 caused previous region effects to vanish. Our findings emphasize the importance of locally confined spaces for structuring spatial memory and suggest that the opportunity to integrate novel into existing spatial information early during learning may influence unit formation on the regional level. Further, global representations seem to be consulted only when accessing spatial information beyond regional borders. Our results are inconsistent with conceptions of spatial memory for large scale environments based either exclusively on local reference frames or upon a single reference frame encompassing the whole environment, but rather support hierarchical representation of space. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Illusory self-motion often provokes motion sickness, which is commonly explained in terms of an inter-sensory conflict that is not in accordance with previous experience. Here we address the influence of cognition in motion sickness and show that such a conflict isnotprovocative when the observer believes that the motion illusion is indeed actually occurring. Illusory self-motion and motion sickness were elicited in healthy human participants who were seated on a stationary rotary chair inside a rotating optokinetic drum. Participants knew that both chair and drum could rotate but were unaware of the actual motion stimulus. Results showed that motion sickness was correlated with the discrepancy between participants’perceivedself-motion and participants’beliefsabout the actual motion. Together with the general motion sickness susceptibility, this discrepancy accounted for 51% of the variance in motion sickness intensity. This finding sheds a new light on the causes of visually induced motion sickness and suggests that it is not governed by an inter-sensory conflict per se, but by beliefs concerning the actual self-motion. This cognitive influence provides a promising tool for the development of new countermeasures.

Percepts of verticality are thought to be constructed as a weighted average of multisensory inputs, but the observed weights differ considerably between studies. In the present study, we evaluate whether this can be explained by differences in how visual, somatosensory and proprioceptive cues contribute to representations of the Head In Space (HIS) and Body In Space (BIS). Participants (10) were standing on a force plate on top of a motion platform while wearing a visualization device that allowed us to artificially tilt their visual surroundings. They were presented with (in)congruent combinations of visual, platform, and head tilt, and performed Rod & Frame Test (RFT) and Subjective Postural Vertical (SPV) tasks. We also recorded postural responses to evaluate the relation between perception and balance. The perception data shows that body tilt, head tilt, and visual tilt affect the HIS and BIS in both experimental tasks. For the RFT task, visual tilt induced considerable biases (≈ 10° for 36° visual tilt) in the direction of the vertical expressed in the visual scene; for the SPV task, participants also adjusted platform tilt to correct for illusory body tilt induced by the visual stimuli, but effects were much smaller (≈ 0.25°). Likewise, postural data from the SPV task indicate participants slightly shifted their weight to counteract visual tilt (0.3° for 36° visual tilt). The data reveal a striking dissociation of visual effects between the two tasks. We find that the data can be explained well using a model where percepts of the HIS and BIS are constructed from direct signals from head and body sensors, respectively, and indirect signals based on body and head signals but corrected for perceived neck tilt. These findings show that perception of the HIS and BIS derive from the same sensory signals, but see profoundly different weighting factors. We conclude that observations of different weightings between studies likely result from querying of distinct latent constructs referenced to the body or head in space.

In dynamic driving simulators, the experience of operating a vehicle is reproduced by combining visual stimuli generated by graphical rendering with inertial stimuli generated by platform motion. Due to inherent limitations of the platform workspace, inertial stimulation is subject to shortcomings in the form of missing cues, false cues, and/or scaling errors, which negatively affect simulation fidelity. In the present study, we aim at quantifying the relative contribution of an active somatosensory stimulation to the perceived intensity of self-motion, relative to other sensory systems. Participants judged the intensity of longitudinal and lateral driving maneuvers in a dynamic driving simulator in passive driving conditions, with and without additional active somatosensory stimulation, as provided by an Active Seat (AS) and Active Belts (AB) integrated system (ASB). The results show that ASB enhances the perceived intensity of sustained decelerations, and increases the precision of acceleration perception overall. Our findings are consistent with models of perception, and indicate that active somatosensory stimulation can indeed be used to improve simulation fidelity.

Even when we are wearing gloves, we can easily detect whether a surface that we are touching is sticky or not. However, we know little about the similarities between brain activations elicited by this glove contact and by direct contact with our bare skin. In this functional magnetic resonance imaging (fMRI) study, we investigated which brain regions represent stickiness intensity information obtained in both touch conditions, i.e., skin contact and glove contact. First, we searched for neural representations mediating stickiness for each touch condition separately and found regions responding to both mainly in the supramarginal gyrus and the secondary somatosensory cortex. Second, we explored whether surface stickiness is encoded in common neural patterns irrespective of how participants touched the sticky stimuli. Using a cross-condition decoding method, we tested whether the stickiness intensities could be decoded from fMRI signals evoked by skin contact using a classifier trained on the responses elicited by glove contact, and vice versa. Our results found shared neural encoding patterns in the bilateral angular gyri and the inferior frontal gyrus (IFG) and suggest that these areas represent stickiness intensity information regardless of how participants touched the sticky stimuli. Interestingly, we observed that neural encoding patterns of these areas were reflected in participants' intensity ratings. This study revealed common and distinct brain activation patterns of tactile stickiness using two different touch conditions, which may broaden the understanding of neural mechanisms related to surface texture perception.

We present clean experimental evidence that a methodological confound was introduced by Andreoni and Miller (2002) that leads to diametrically opposed conclusions regarding comparisons of preferences between categories of fellow human beings distinguished by gender or age. Our study is a warning not to run the Andreoni-Miller tests of the consistency of altruistic preferences on the basis of their ‘interactive’ experimental protocol, and in particular not to perform preference estimations with the purpose of said comparisons. It is more interpretable and controllable to run the traditional, standard dictator game.

Objective This study investigates the neural basis of inattentional deafness, which could result from task irrelevance in the auditory modality. Background Humans can fail to respond to auditory alarms under high workload situations. This failure, termed inattentional deafness, is often attributed to high workload in the visual modality, which reduces one's capacity for information processing. Besides this, our capacity for processing auditory information could also be selectively diminished if there is no obvious task relevance in the auditory channel. This could be another contributing factor given the rarity of auditory warnings. Method Forty-eight participants performed a visuomotor tracking task while auditory stimuli were presented: a frequent pure tone, an infrequent pure tone, and infrequent environmental sounds. Participants were required either to respond to the presentation of the infrequent pure tone (auditory task-relevant) or not (auditory task-irrelevant). We recorded and compared the event-related potentials (ERPs) that were generated by environmental sounds, which were always task-irrelevant for both groups. These ERPs served as an index for our participants' awareness of the task-irrelevant auditory scene. Results Manipulation of auditory task relevance influenced the brain's response to task-irrelevant environmental sounds. Specifically, the late novelty-P3 to irrelevant environmental sounds, which underlies working memory updating, was found to be selectively enhanced by auditory task relevance independent of visuomotor workload. Conclusion Task irrelevance in the auditory modality selectively reduces our brain's responses to unexpected and irrelevant sounds regardless of visuomotor workload. Application Presenting relevant auditory information more often could mitigate the risk of inattentional deafness.

Previous behavioral and neurophysiological research has shown better memory for horizontal than for vertical locations. In these studies, participants navigated toward these locations. In the present study we investigated whether the orientation of the spatial plane per se was responsible for this difference. We thus had participants learn locations visually from a single perspective and retrieve them from multiple viewpoints. In three experiments, participants studied colored tags on a horizontally or vertically oriented board within a virtual room and recalled these locations with different layout orientations (Exp. 1) or from different room-based perspectives (Exps. 2 and 3). All experiments revealed evidence for equal recall performance in horizontal and vertical memory. In addition, the patterns for recall from different test orientations were rather similar. Consequently, our results suggest that memory is qualitatively similar for both vertical and horizontal two-dimensional locations, given that these locations are learned from a single viewpoint. Thus, prior differences in spatial memory may have originated from the structure of the space or the fact that participants navigated through it. Additionally, the strong performance advantages for perspective shifts (Exps. 2 and 3) relative to layout rotations (Exp. 1) suggest that configurational judgments are not only based on memory of the relations between target objects, but also encompass the relations between target objects and the surrounding room—for example, in the form of a memorized view. Electronic supplementary material The online version of this article (10.3758/s13421-017-0753-9) contains supplementary material, which is available to authorized users.

Recognizing who is carrying out an action is essential for successful human interaction. The cognitive mechanisms underlying this ability are little understood and have been subject of discussions in embodied approaches to action recognition. Here we examine one solution, that visual action recognition processes are at least partly sensitive to the actor’s identity. We investigated the dependency between identity information and action related processes by testing the sensitivity of neural action recognition processes to clothing and facial identity information with a behavioral adaptation paradigm. Our results show that action adaptation effects are in fact modulated by both clothing information and the actor’s facial identity. The finding demonstrates that neural processes underlying action recognition are sensitive to identity information (including facial identity) and thereby not exclusively tuned to actions. We suggest that such response properties are useful to help humans in knowing who carried out an action.

Distinguishing animate from inanimate objects is fundamental for social perception in humans and animals. Visual motion cues indicative of self-propelled object motion are useful for animacy perception: they can be detected over a wide expanse of visual field, at distance and in low visibility conditions, can attract attention and provide clues about object behaviour. However, the neural correlates of animacy perception evoked exclusively by visual motion cues, i.e. not relying on form, background or visual context, are unclear. We aimed to address this question in four psychophysical experiments in humans, two of which performed during neuroimaging. The stimulus was a single dot with constant form that moved on a blank background and evoked controlled degrees of perceived animacy through parametric variations of self-propelled motion cues. BOLD signals reflecting perceived animacy in a graded manner irrespective of eye movements were found in one intraparietal region. Additional whole-brain and region-of-interest analyses revealed no comparable effects in brain regions associated with social processing or other areas. Our study shows that animacy perception evoked solely by visual motion cues, a basic perceptual process in social cognition, engages brain regions not primarily associated with social cognition.

Previous research on risk-glorifying media has provided encompassing evidence for a positive connection between risk-glorifying contents and (a) risk-positive emotions, (b) risk-positive cognitions and attitudes, and (c) risk-positive behavioral inclinations. Nevertheless, little evidence shows whether risk-glorifying content increases actual risk behavior. We conducted three experimental studies to assess whether risk-glorifying commercials increase risk behavior. In all studies, participants were randomly assigned to a risk-glorifying or a neutral commercial. Additionally, in Study 2 participants were randomly assigned to an additional arousal or a non-arousal condition to test the mediating effect of arousal. In Study 3, we tested the mediating effect of the accessibility to risk-positive cognitions. We measured participants’ risk behavior via the risk assessment ramp. Our results revealed that participants who watched the risk-glorifying commercial walked faster to the jumping-off point (Study 1, 2, & 3) and jumped from a higher level (Study 2 & 3), thus, indicating the exposure to risk-glorifying media content increases people’s risk behavior. Neither arousal, nor the accessibility to risk-positive cognition mediated the effect of risk-glorifying media content. Beyond our findings, we offer a new tool to assess risk behavior that is effective and easy to apply.

Previous human fMRI studies have reported activation of somatosensory areas not only during actual touch, but also during touch observation. However, it has remained unclear how the brain encodes visually evoked tactile intensities. Using an associative learning method, we investigated neural representations of roughness intensities evoked by (a) tactile explorations and (b) visual observation of tactile explorations. Moreover, we explored (c) modality-independent neural representations of roughness intensities using a cross-modal classification method. Case (a) showed significant decoding performance in the anterior cingulate cortex (ACC) and the supramarginal gyrus (SMG), while in the case (b), the bilateral posterior parietal cortices, the inferior occipital gyrus, and the primary motor cortex were identified. Case (c) observed shared neural activity patterns in the bilateral insula, the SMG, and the ACC. Interestingly, the insular cortices were identified only from the cross-modal classification, suggesting their potential role in modality-independent tactile processing. We further examined correlations of confusion patterns between behavioral and neural similarity matrices for each region. Significant correlations were found solely in the SMG, reflecting a close relationship between neural activities of SMG and roughness intensity perception. The present findings may deepen our understanding of the brain mechanisms underlying intensity perception of tactile roughness.

The neural substrates of tactile roughness perception have been investigated by many neuroimaging studies, while relatively little effort has been devoted to the investigation of neural representations of visually perceived roughness. In this human fMRI study, we looked for neural activity patterns that could be attributed to five different roughness intensity levels when the stimuli were perceived visually, i.e., in absence of any tactile sensation. During functional image acquisition, participants viewed video clips displaying a right index fingertip actively exploring the sandpapers that had been used for the behavioural experiment. A whole brain multivariate pattern analysis found four brain regions in which visual roughness intensities could be decoded: the bilateral posterior parietal cortex (PPC), the primary somatosensory cortex (S1) extending to the primary motor cortex (M1) in the right hemisphere, and the inferior occipital gyrus (IOG). In a follow-up analysis, we tested for correlations between the decoding accuracies and the tactile roughness discriminability obtained from a preceding behavioural experiment. We could not find any correlation between both although, during scanning, participants were asked to recall the tactilely perceived roughness of the sandpapers. We presume that a better paradigm is needed to reveal any potential visuo-tactile convergence. However, the present study identified brain regions that may subserve the discrimination of different intensities of visual roughness. This finding may contribute to elucidate the neural mechanisms related to the visual roughness perception in the human brain.

Social norms interventions are increasingly used in applied policy-making such as to end female genital mutilation or open defecation. Amongst the reasons for why policy-makers rely on social norms intervention tools is that the relevant underlying theory, which is concerned with dynamic-stochastic deviations processes, has matured substantially over the past three decades. In this article, turning to behavioral evidence, we investigate which of the models proposed in this strand of theory are supported regarding individual human behavior. Specifically, we identify which assumptions regarding individual-level adjustment behavior in terms of optimal play (‘best response’) and deviations thereof (‘noise’) are supported. In doing so, we move the focus of research from the theoretical and modeling question ‘How Noise Matters?’ (Blume, 2003) to the behavioral and empirical question ‘What Noise Matters?’.

Several studies have shown that the perception of one's own hand size is distorted in proprioceptive localization tasks. It has been suggested that those distortions mirror somatosensory anisotropies. Recent research suggests that non-corporeal items also show some spatial distortions. In order to investigate the psychological processes underlying the localization task, we investigated the influences of visual similarity and memory on distortions observed on corporeal and non-corporeal items. In experiment 1, participants indicated the location of landmarks on: their own hand, a rubber hand (rated as most similar to the real hand), and a rake (rated as least similar to the real hand). Results show no significant differences between rake and rubber hand distortions but both items were significantly less distorted than the hand. Experiments 2 and 3 explored the role of memory in spatial distance judgments of the hand, the rake and the rubber hand. Spatial representations of items measured in experiments 2 and 3 were also distorted but showed the tendency to be smaller than in localization tasks. While memory and visual similarity seem to contribute to explain qualitative similarities in distortions between the hand and non-corporeal items, those factors cannot explain the larger magnitude observed in hand distortions.

The object orientation effect describes shorter perceived distances to the front than to the back of oriented objects. The present work extends previous studies in showing that the object orientation effect occurs not only for egocentric distances between an observer and an object, but also for exocentric distances, that are between two oriented objects. Participants watched animated virtual humans (avatars) which were either facing each other or looking away, and afterward adjusted a bar to estimate the perceived length. In two experiments, participants judged avatars facing each other as closer than avatars facing away from each other. As the judged distance was between two objects and did not involve the observer, results rule out an explanation that observers perceive object fronts as closer to prepare for future interaction with them. The second experiment tested an explanation by predictive coding, this is the extrapolation of the current state of affairs to likely future states here that avatars move forward. We used avatars standing on bridges either connecting them or running orthogonal to the inter-avatar line thus preventing forward movement. This variation of walkability did not influence participants’ judgments. We conclude that if predictive coding was used by participants, they did not consider the whole scene layout for prediction, but concentrated on avatars. Another potential explanation of the effect assumes a general asymmetrical distribution of inter-person distances: people facing each other might typically be closer to each other than when facing away and that this asymmetry is reflected as a bias in perception.

Most studies on spatial memory refer to the horizontal plane, leaving an open question as to whether findings generalize to vertical spaces where gravity and the visual upright of our surrounding space are salient orientation cues. In three experiments, we examined which reference frame is used to organize memory for vertical locations: the one based on the body vertical, the visual-room vertical, or the direction of gravity. Participants judged interobject spatial relationships learned from a vertical layout in a virtual room. During learning and testing, we varied the orientation of the participant's body (upright vs. lying sideways) and the visually presented room relative to gravity (e.g., rotated by 90° along the frontal plane). Across all experiments, participants made quicker or more accurate judgments when the room was oriented in the same way as during learning with respect to their body, irrespective of their orientations relative to gravity. This suggests that participants employed an egocentric body-based reference frame for representing vertical object locations. Our study also revealed an effect of body-gravity alignment during testing. Participants recalled spatial relations more accurately when upright, regardless of the body and visual-room orientation during learning. This finding is consistent with a hypothesis of selection conflict between different reference frames. Overall, our results suggest that a body-based reference frame is preferred over salient allocentric reference frames in memory for vertical locations perceived from a single view. Further, memory of vertical space seems to be tuned to work best in the default upright body orientation. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Cooperation among unrelated individuals in social-dilemma-type situations is a key topic in social and biological sciences. It has been shown that, without suitable mechanisms, high levels of cooperation/contributions in repeated public goods games are not stable in the long run. Reputation, as a driver of indirect reciprocity, is often proposed as a mechanism that leads to cooperation. A simple and prominent reputation dynamic function through scoring: contributing behaviour increases one's score, non-contributing reduces it. Indeed, many experiments have established that scoring can sustain cooperation in two-player prisoner's dilemmas and donation games. However, these prior studies focused on pairwise interactions, with no experiment studying reputation mechanisms in more general group interactions. In this paper, we focus on groups and scores, proposing and testing several scoring rules that could apply to multi-player prisoners' dilemmas played in groups, which we test in a laboratory experiment. Results are unambiguously negative: we observe a steady decline of cooperation for every tested scoring mechanism. All scoring systems suffer from it in much the same way. We conclude that the positive results obtained by scoring in pairwise interactions do not apply to multi-player prisoner's dilemmas, and that alternative mechanisms are needed., Journal of the Royal Society. Interface, 15 (144), ISSN:1742-5689, ISSN:1742-5662

Motor-based theories of facial expression recognition propose that the visual perception of facial expression is aided by sensorimotor processes that are also used for the production of the same expression. Accordingly, sensorimotor and visual processes should provide congruent emotional information about a facial expression. Here, we report evidence that challenges this view. Specifically, the repeated execution of facial expressions has the opposite effect on the recognition of a subsequent facial expression than the repeated viewing of facial expressions. Moreover, the findings of the motor condition, but not of the visual condition, were correlated with a nonsensory condition in which participants imagined an emotional situation. These results can be well accounted for by the idea that facial expression recognition is not always mediated by motor processes but can also be recognized on visual information alone.

Significance Why is it so easy for humans to interact with each other? In social interactions, humans coordinate their actions with each other nonverbally. For example, dance partners need to relate their actions to each other to coordinate their movements. The underlying neurocognitive mechanisms supporting this ability are surprisingly poorly understood. We show that human brain processes are sensitive to pairs of matching actions that make up a social interaction. These findings provide insights into the perceptual architecture that helps humans to relate actions to each other. This capability is essential for social interactions, and its understanding will aid future development of therapies to treat social cognitive disorders., A hallmark of human social behavior is the effortless ability to relate one’s own actions to that of the interaction partner, e.g., when stretching out one’s arms to catch a tripping child. What are the behavioral properties of the neural substrates that support this indispensable human skill? Here we examined the processes underlying the ability to relate actions to each other, namely the recognition of spatiotemporal contingencies between actions (e.g., a “giving” that is followed by a “taking”). We used a behavioral adaptation paradigm to examine the response properties of perceptual mechanisms at a behavioral level. In contrast to the common view that action-sensitive units are primarily selective for one action (i.e., primary action, e.g., ‘throwing”), we demonstrate that these processes also exhibit sensitivity to a matching contingent action (e.g., “catching”). Control experiments demonstrate that the sensitivity of action recognition processes to contingent actions cannot be explained by lower-level visual features or amodal semantic adaptation. Moreover, we show that action recognition processes are sensitive only to contingent actions, but not to noncontingent actions, demonstrating their selective sensitivity to contingent actions. Our findings show the selective coding mechanism for action contingencies by action-sensitive processes and demonstrate how the representations of individual actions in social interactions can be linked in a unified representation.

Early studies suggested that auditory stimuli are only (cognitively) processed if they are relevant for the task. However, studies that are more recent show that this is not necessarily true. Rather, it depends on the nature of the auditory stimuli. Environmental sounds are processed even when they are irrelevant for the task and even when participants are engaged in demanding visual tasks. These latter results can be interpreted within the framework of situational awareness. To maintain situational awareness, it is essential to continuously scan the environment for unexpected sounds that might not be of immediate task relevance but could inform us about important changes in the environment. In the current study, we investigate whether and how the scanning for, and processing of, environmental sounds—in other words, situational awareness of the auditory scene—is influenced by auditory attention manipulations. Here, auditory attention was manipulated by requiring participants to perform an auditory oddball-detection task or not, while task-irrelevant environmental sounds were occasionally presented in the background. The current study answers the following questions: (1) Is the processing of environmental sounds influenced by manipulations of auditory attention or is it an automatic process? (2) Is the processing of irrelevant environmental sounds attenuated or enhanced by auditory attention? On the one hand, the processing of the irrelevant environmental sounds could be attenuated, because the additional task increases the demand for auditory attentional resources. On the other hand, the processing of the environmental sounds could be enhanced because more attention is directed toward the auditory channel to optimize performance in the auditory oddball-detection task.

Experimental implementations of dictator games are found to differ in terms of their underlying strategic incentives. We explore this discovery in two separate directions. Theoretically, assuming identical other-regarding preferences, we show that the two most widely used protocols can generate strongly contrasting rational-choice predictions, from which different interpretations of dictator giving arise. Experimentally, a tailor-made experiment reveals signiffcant differences between the two protocols but rejects full rationality as a satisfactory explanatory theory. Our findings indicate that several previously drawn conclusions regarding other-regarding preferences among humans distinguished by social class, gender, generation, nationality, etc. may be more ambiguous than hitherto believed.

In this study, we demonstrate the effects of anxiety and cognitive load on eye movement planning in an instrument flight task adhering to a single-sensor-single-indicator data visualisation design philosophy. The task was performed in neutral and anxiety conditions, while a low or high cognitive load, auditory n-back task was also performed. Cognitive load led to a reduction in the number of transitions between instruments, and impaired task performance. Changes in self-reported anxiety between the neutral and anxiety conditions positively correlated with changes in the randomness of eye movements between instruments, but only when cognitive load was high. Taken together, the results suggest that both cognitive load and anxiety impact gaze behavior, and that these effects should be explored when designing data visualization displays.

The cognitive workload of a steering task could reflect its demand on attentional as well as working memory resources under different conditions. These respective demands could be differentiated by evaluating components of the event-related potential (ERP) response to different types of stimulus probes, which are claimed to reflect the availability of either attention (i.e., novelty-P3) or working memory (i.e., target-P3) resources. Here, a within-subject analysis is employed to evaluate the robustness of ERP measurements in discriminating the cognitive demands of different steering conditions. We find that the amplitude of novelty-P3 ERPs to task-irrelevant environmental sounds is diminished when participants are required to perform a steering task. This indicates that steering places a demand on attentional resources. In addition, target-P3 ERPs to a secondary auditory detection task vary when the controller dynamics in the steering task are manipulated. This indicates that differences in controller dynamics vary in their working memory demands.

While moving through the environment, humans use vision to discriminate different self-motion intensities and to control their actions (e.g. maintaining balance or controlling a vehicle). How the intensity of visual stimuli affects self-motion perception is an open, yet important, question. In this study, we investigate the human ability to discriminate perceived velocities of visually induced illusory self-motion (vection) around the vertical (yaw) axis. Stimuli, generated using a projection screen (70 × 90 deg field of view), consist of a natural virtual environment (360 deg panoramic colour picture of a forest) rotating at constant velocity. Participants control stimulus duration to allow for a complete vection illusion to occur in every single trial. In a two-interval forced-choice task, participants discriminate a reference motion from a comparison motion, adjusted after every presentation, by indicating which rotation feels stronger. Motion sensitivity is measured as the smallest perceivable change in stimulus intensity (differential threshold) for eight participants at five rotation velocities (5, 15, 30, 45 and 60 deg/s). Differential thresholds for circular vection increase with stimulus velocity, following a trend well described by a power law with an exponent of 0.64. The time necessary for complete vection to arise is slightly but significantly longer for the first stimulus presentation (average 11.56 s) than for the second (9.13 s) and does not depend on stimulus velocity. Results suggest that lower differential thresholds (higher sensitivity) are associated with smaller rotations, because they occur more frequently during everyday experience. Moreover, results also suggest that vection is facilitated by a recent exposure, possibly related to visual motion after-effect.

Prominent accounts of decision making state that decisions are made on the basis of an accumulation of sensory evidence, orchestrated by networks of prefrontal and parietal neural populations. Here we assess whether these findings generalize to decisions on self-motion. Participants were presented with whole body yaw rotations of different durations in a 2-Interval-Forced-Choice paradigm, and tasked to discriminate motions on the basis of their amplitude. The cortical hemodynamic response was recorded using functional near-infrared spectroscopy (fNIRS) while participants were performing the task. The imaging data was used to predict the specific response on individual experimental trials, and to predict whether the comparison stimulus would be judged larger than the reference. Classifier performance on the former variable was negligible. However, considerable performance was achieved for the latter variable, specifically using parietal imaging data. The findings provide support for the notion that activity in the parietal cortex reflects modality independent decision variables that represent the strength of the neural evidence in favor of a decision. The results are encouraging for the use of fNIRS as a method to perform neuroimaging in moving individuals.

This study investigated the role of vection (i.e., a visually induced sense of self-motion), optokinetic nystagmus (OKN), and inadvertent head movements in visually induced motion sickness (VIMS), evoked by yaw rotation of the visual surround. These three elements have all been proposed as contributing factors in VIMS, as they can be linked to different motion sickness theories. However, a full understanding of the role of each factor is still lacking because independent manipulation has proven difficult in the past. We adopted an integrative approach to the problem by obtaining measures of potentially relevant parameters in four experimental conditions and subsequently combining them in a linear mixed regression model. To that end, participants were exposed to visual yaw rotation in four separate sessions. Using a full factorial design, the OKN was manipulated by a fixation target (present/absent), and vection strength by introducing a conflict in the motion direction of the central and peripheral field of view (present/absent). In all conditions, head movements were minimized as much as possible. Measured parameters included vection strength, vection variability, OKN slow phase velocity, OKN frequency, the number of inadvertent head movements, and inadvertent head tilt. Results show that VIMS increases with vection strength, but that this relation varies among participants (R2 = 0.48). Regression parameters for vection variability, head and eye movement parameters were not significant. These results may seem to be in line with the Sensory Conflict theory on motion sickness, but we argue that a more detailed definition of the exact nature of the conflict is required to fully appreciate the relationship between vection and VIMS.

Previous research has rarely examined the combined influence of anxiety and cognitive load on gaze behavior and performance whilst undertaking complex perceptual-motor tasks. In the current study, participants performed an aviation instrument landing task in neutral and anxiety conditions, while performing a low or high cognitive load auditory n-back task. Both self-reported anxiety and heart rate increased from neutral conditions indicating that anxiety was successfully manipulated. Response accuracy and reaction time for the auditory task indicated that cognitive load was also successfully manipulated. Cognitive load negatively impacted flight performance and the frequency of gaze transitions between areas of interest. Performance was maintained in anxious conditions, with a concomitant decrease in n-back reaction time suggesting that this was due to an increase in mental effort. Analyses of individual responses to the anxiety manipulation revealed that changes in anxiety levels from neutral to anxiety conditions were positively correlated with changes in visual scanning entropy, which is a measure of the randomness of gaze behavior, but only when cognitive load was high. This finding lends support for an interactive effect of cognitive anxiety and cognitive load on attentional control.

A large body of research shows that the Central Nervous System (CNS) integrates multisensory information. However, this strategy should only apply to multisensory signals that have a common cause; independent signals should be segregated. Causal Inference (CI) models account for this notion. Surprisingly, previous findings suggested that visual and inertial cues on heading of self-motion are integrated regardless of discrepancy. We hypothesized that CI does occur, but that characteristics of the motion profiles affect multisensory processing. Participants estimated heading of visual-inertial motion stimuli with several different motion profiles and a range of intersensory discrepancies. The results support the hypothesis that judgments of signal causality are included in the heading estimation process. Moreover, the data suggest a decreasing tolerance for discrepancies and an increasing reliance on visual cues for longer duration motions.

Categorization of seen objects is often determined by the shapes of objects. However, shape is not exclusive to the visual modality: The haptic system also is expert at identifying shapes. Hence, an important question for understanding shape processing is whether humans store separate modality-dependent shape representations, or whether information is integrated into one multisensory representation. To answer this question, we created a metric space of computer-generated novel objects varying in shape. These objects were then printed using a 3-D printer, to generate tangible stimuli. In a categorization experiment, participants first explored the objects visually and haptically. We found that both modalities led to highly similar categorization behavior. Next, participants were trained either visually or haptically on shape categories within the metric space. As expected, visual training increased visual performance, and haptic training increased haptic performance. Importantly, however, we found that visual training also improved haptic performance, and vice versa. Two additional experiments showed that the location of the categorical boundary in the metric space also transferred across modalities, as did heightened discriminability of objects adjacent to the boundary. This observed transfer of metric category knowledge across modalities indicates that visual and haptic forms of shape information are integrated into a shared multisensory representation.

Current neuroscientific models of bodily self-consciousness (BSC) argue that inaccurate integration of sensory signals leads to altered states of BSC. Indeed, using virtual reality technology, observers viewing a fake or virtual body while being exposed to tactile stimulation of the real body, can experience illusory ownership over–and mislocalization towards—the virtual body (Full-Body Illusion, FBI). Among the sensory inputs contributing to BSC, the vestibular system is believed to play a central role due to its importance in estimating self-motion and orientation. This theory is supported by clinical evidence that vestibular loss patients are more prone to altered BSC states, and by recent experimental evidence that visuo-vestibular conflicts can disrupt BSC in healthy individuals. Nevertheless, the contribution of vestibular information and self-motion perception to BSC remains largely unexplored. Here, we investigate the relationship between alterations of BSC and self-motion sensitivity in healthy individuals. Fifteen participants were exposed to visuo-vibrotactile conflicts designed to induce an FBI, and subsequently to visual rotations that evoked illusory self-motion (vection). We found that synchronous visuo-vibrotactile stimulation successfully induced the FBI, and further observed a relationship between the strength of the FBI and the time necessary for complete vection to arise. Specifically, higher self-reported FBI scores across synchronous and asynchronous conditions were associated to shorter vection latencies. Our findings are in agreement with clinical observations that vestibular loss patients have higher FBI susceptibility and lower vection latencies, and argue for increased visual over vestibular dependency during altered states of BSC.

People use “route knowledge” to navigate to targets along familiar routes and “survey knowledge” to determine (by pointing, for example) a target’s metric location. We show that both root in separate memories of the same environment: participants navigating through their home city relied on representations and reference frames different from those they used when doing a matched survey task. Tubingen residents recalled their way along a familiar route to a distant target while located in a photorealistic virtual 3D model of Tubingen, indicating their route decisions on a keyboard. Participants had previously done a survey task (pointing) using the same start points and targets. Errors and response latencies observed in route recall were completely unrelated to errors and latencies in pointing. This suggests participants employed different and independent representations for each task. Further, participants made fewer routing errors when asked to respond from a horizontal walking perspective rather than a constant aerial perspective. This suggests that instead of the single reference, north-up frame (similar to a conventional map) they used in the survey task, participants employed different, and most probably multiple, reference frames learned from “on the ground” navigating experience. The implication is that, within their everyday environment, people use map or navigation-based knowledge according to which best suits the task.

In this paper, we show that differences in reaction times (RT) to self-motion depend not only on the duration of the profile, but also on the actual time course of the acceleration. We previously proposed models that described direction discrimination thresholds for rotational and translational motions based on the dynamics of the vestibular sensory organs (otoliths and semi-circular canals). As these models have the potential to describe RT for different motion profiles (e.g., trapezoidal versus triangular acceleration profiles or varying profile durations), we validated these models by measuring RTs in human observers for a direction discrimination task using both translational and rotational motions varying in amplitude, duration and acceleration profile shape in a within-subjects design. In agreement with previous studies, amplitude and duration were found to affect RT, and importantly, we found an influence of the profile shape on RT. The models are able to fit the measured RTs with an accuracy of around 5 ms, and the best-fitting parameters are similar to those found from identifying the models based on threshold measurements. This confirms the validity of the modeling approach and links perceptual thresholds to RT. By establishing a link between vestibular thresholds for self-motion and RT, we show for the first time that RTs to purely inertial motion stimuli can be used as an alternative to threshold measurements for identifying self-motion perception models. This is advantageous, since RT tasks are less challenging for participants and make assessment of vestibular function less fatiguing. Further, our results provide strong evidence that the perceived timing of self-motion stimulation is largely influenced by the response dynamics of the vestibular sensory organs.