Search

Multisensory integration (MSI) is the integration by the brain of environmental information acquired through more than one sense. Accurate MSI has been shown to be a key component of successful aging and to be crucial for processes underlying activities of daily living (ADLs). Problems in MSI could prevent older adults (OA) to age in place and live independently. However, there is a need to know how to assess changes in MSI in individuals. This systematic review provides an overview of tests assessing the effect of age on MSI in the healthy elderly population (aged 60 years and older). A literature search was done in Scopus. Articles from the earliest records available to January 20, 2016, were eligible for inclusion if assessing effects of aging on MSI in the healthy elderly population compared to younger adults (YA). These articles were rated for risk of bias with the Newcastle-Ottawa quality assessment. Out of 307 identified research articles, 49 articles were included for final review, describing 69 tests. The review indicated that OA maximize the use of multiple sources of information in comparison to YA (20 studies). In tasks that require more cognitive function, or when participants need to adapt rapidly to a situation, or when a dual task is added to the experiment, OA have problems selecting and integrating information properly as compared to YA (19 studies). Additionally, irrelevant or wrong information (i.e., distractors) has a greater impact on OA than on YA (21 studies). OA failing to weigh sensory information properly, has not been described in previous reviews. Anatomical changes (i.e., reduction of brain volume and differences of brain areas' recruitment) and information processing changes (i.e., general cognitive slowing, inverse effectiveness, larger time window of integration, deficits in attentional control and increased noise at baseline) can only partly explain the differences between OA and YA regarding MSI. Since we have an interest in successful aging and early detection of MSI issues in the elderly population, the identified tests form a good starting point to develop a clinically useful toolkit to assess MSI in healthy OA.

This study investigated whether communication via mediated hand pressure during a remotely shared experience (watching an amusing video) can (1) enhance recovery from sadness, (2) enhance the affective quality of the experience, and (3) increase trust towards the communication partner. Thereto participants first watched a sad movie clip to elicit sadness, followed by a funny one to stimulate recovery from sadness. While watching the funny clip they signaled a hypothetical fellow participant every time they felt amused. In the experimental condition the participants responded by pressing a hand-held two-way mediated touch device (a Frebble), which also provided haptic feedback via simulated hand squeezes. In the control condition they responded by pressing a button and they received abstract visual feedback. Objective (heart rate, galvanic skin conductance, number and duration of joystick or Frebble presses) and subjective (questionnaires) data were collected to assess the emotional reactions of the participants. The subjective measurements confirmed that the sad movie successfully induced sadness while the funny movie indeed evoked more positive feelings. Although their ranking agreed with the subjective measurements, the physiological measurements confirmed this conclusion only for the funny movie. The results show that recovery from movie induced sadness, the affective experience of the amusing movie, and trust towards the communication partner did not differ between both experimental conditions. Hence, feedback via mediated hand touching did not enhance either of these factors compared to visual feedback. Further analysis of the data showed that participants scoring low on Extraversion (i.e., persons that are more introvert) or low on Touch Receptivity (i.e., persons who do not like to be touched by others) felt better understood by their communication partner when receiving mediated touch feedback instead of visual feedback, while the opposite was found for participants scoring high on these factors. The implications of these results for further research are discussed, and some suggestions for follow-up experiments are presented.

Previous research has shown that odorants consistently evoke associations with textures and their tactile properties like smoothness and roughness. Also, it has been observed that olfaction can modulate tactile perception. We therefore hypothesized that tactile roughness perception may be biased towards the somatosensory connotation of an ambient odorant. We performed two experiments to test this hypothesis. In the first experiment, we investigated the influence of ambient chemosensory stimuli with different roughness connotations on tactile roughness perception. In addition to a pleasant odor with a connotation of softness (PEA), we also included a trigeminal stimulant with a rough, sharp or prickly connotation (Ethanol). We expected that-compared to a No-odorant control condition-tactile texture perception would be biased towards smoothness in the presence of PEA and towards roughness in the presence of Ethanol. However, our results show no significant interaction between chemosensory stimulation and perceived tactile surface roughness. It could be argued that ambient odors may be less effective in stimulating crossmodal associations, since they are by definition extraneous to the tactile stimuli. In an attempt to optimize the conditions for sensory integration, we therefore performed a second experiment in which the olfactory and tactile stimuli were presented in synchrony and in close spatial proximity. In addition, we included pleasant (Lemon) and unpleasant (Indole) odorants that are known to have the ability to affect tactile perception. We expected that tactile stimuli would be perceived as less rough when simultaneously presented with Lemon or PEA (both associated with softness) than when presented with Ethanol or Indole (odors that can be associated with roughness). Again, we found no significant main effect of chemosensory condition on perceived tactile roughness. We discuss the limitations of this study and we present suggestions for future research.

Estimating cognitive or affective state from neurophysiological signals and designing applications that make use of this information requires expertise in many disciplines such as neurophysiology, machine learning, experimental psychology, and human factors. This makes it difficult to perform research that is strong in all its aspects as well as to judge a study or application on its merits. On the occasion of the special topic "Using neurophysiological signals that reflect cognitive or affective state" we here summarize often occurring pitfalls and recommendations on how to avoid them, both for authors (researchers) and readers. They relate to defining the state of interest, the neurophysiological processes that are expected to be involved in the state of interest, confounding factors, inadvertently "cheating" with classification analyses, insight on what underlies successful state estimation, and finally, the added value of neurophysiological measures in the context of an application. We hope that this paper will support the community in producing high quality studies and well-validated, useful applications.

While studies exist that compare different physiological variables with respect to their association with mental workload, it is still largely unclear which variables supply the best information about momentary workload of an individual and what is the benefit of combining them. We investigated workload using the n-back task, controlling for body movements and visual input. We recorded EEG, skin conductance, respiration, ECG, pupil size and eye blinks of 14 subjects. Various variables were extracted from these recordings and used as features in individually tuned classification models. Online classification was simulated by using the first part of the data as training set and the last part of the data for testing the models. The results indicate that EEG performs best, followed by eye related measures and peripheral physiology. Combining variables from different sensors did not significantly improve workload assessment over the best performing sensor alone. Best classification accuracy, a little over 90%, was reached for distinguishing between high and low workload on the basis of 2 min segments of EEG and eye related variables. A similar and not significantly different performance of 86% was reached using only EEG from single electrode location Pz.

Gaze-independent event-related potential (ERP) based brain-computer interfaces (BCIs) yield relatively low BCI performance and traditionally employ unimodal stimuli. Bimodal ERP-BCIs may increase BCI performance due to multisensory integration or summation in the brain. An additional advantage of bimodal BCIs may be that the user can choose which modality or modalities to attend to. We studied bimodal, visual-tactile, gaze-independent BCIs and investigated whether or not ERP components' tAUCs and subsequent classification accuracies are increased for (1) bimodal vs. unimodal stimuli; (2) location-congruent vs. location-incongruent bimodal stimuli; and (3) attending to both modalities vs. to either one modality. We observed an enhanced bimodal (compared to unimodal) P300 tAUC, which appeared to be positively affected by location-congruency (p = 0.056) and resulted in higher classification accuracies. Attending either to one or to both modalities of the bimodal location-congruent stimuli resulted in differences between ERP components, but not in classification performance. We conclude that location-congruent bimodal stimuli improve ERP-BCIs, and offer the user the possibility to switch the attended modality without losing performance.

Learning to master a task is expected to be accompanied by a decrease in effort during task execution. We examine the possibility to monitor learning using physiological measures that have been reported to reflect effort or workload. Thirty-five participants performed different difficulty levels of the n-back task while a range of physiological and performance measurements were recorded. In order to dissociate non-specific time-related effects from effects of learning, we used the easiest level as a baseline condition. This condition is expected to only reflect non-specific effects of time. Performance and subjective measures confirmed more learning for the difficult level than for the easy level. The difficulty levels affected physiological variables in the way as expected, therewith showing their sensitivity. However, while most of the physiological variables were also affected by time, time-related effects were generally the same for the easy and the difficult level. Thus, in a well-controlled experiment that enabled the dissociation of general time effects from learning we did not find physiological variables to indicate decreasing effort associated with learning. Theoretical and practical implications are discussed., (Copyright © 2014 Elsevier B.V. All rights reserved.)

Pairing two brief auditory beeps with a single flash can evoke the percept of a second, illusory, flash. Investigations of the underlying neural mechanisms are limited to post-stimulus effects of this sound-induced illusory flash. We investigated whether touch modulates the visual evoked potential in a similar vein, and also looked at pre-stimulus activity. Electroencephalogram (EEG) was recorded over occipital and parieto-occipital areas of 12 observers. We compared bimodal EEG to its unimodal constituents (i.e., the difference waves) and found significant positive deflections around 110 ms and 200 ms and negative deflections around 330 ms and 390 ms from stimulus onset. These results are similar to those reported for the sound-induced illusion, albeit somewhat later. Furthermore, comparison of the EEG activity between those trials in which the illusion was perceived and those in which it was absent revealed that the phase of pre-stimulus alpha was linked to perceiving the illusion or not. We conclude that touch can modulate activity in the visual cortex and that similar neural mechanisms underlie perception of the sound- and touch-induced illusory flash and that the phase of the alpha wave at the moment of presentation that affects perception., (Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.)

The P300 event-related potential (ERP) can be used to infer whether an observer is looking at a target or not. Common practice in P300 experiments and applications is that observers are asked to fixate their eyes while stimuli are presented. We investigated the possibility to differentiate between single target and nontarget fixations in a target search task involving eye movements by using EEG epochs synchronized to fixation onset (fixation-related potentials: FRPs). Participants systematically scanned search displays consisting of six small Landolt Cs in search of Cs with a particular orientation. After each search display, they indicated whether and where target Cs had been presented. As expected, an FRP component consistent with the P300 reliably distinguished between target and nontarget fixations. It was possible to classify single FRPs into target and nontarget FRPs above chance (on average 62% correct, where 50% would be chance). These results are the first step to practical applications such as covertly monitoring observers' interests and supporting search tasks.

In the illusory flash paradigm, a single flash may be experienced as two flashes when accompanied by two beeps or taps, and two flashes may be experienced as a single flash when accompanied by one beep or tap. The classic paradigm restricts responses to '1' and '2' (2-AFC), ignoring possible qualitative differences between real and illusory flashes and implicitly assuming that illusory flashes are indistinguishable from real flashes. We added a third response category 'different from that of either 1 or 2 flashes' (3-AFC). Eight naïve and 6 experienced observers responded to 160 real and 160 illusory flash trials. Experienced observers were exposed to 1,200 trials before the experiment but without receiving feedback on their performance. The third response category was used for only 4 % of the real flash trials and for 44 % of the illusory flash trials. Experienced observers did so more often (78 %) than naïve observers (18 %). This shows that observers can reliably identify illusory flashes and indicates that mere exposure to illusory flash trials (without feedback) is enough to detect and classify potential qualitative differences between real and illusory flashes.

The present experiment tested 60 individuals on a multiple screen, visual target detection task. Using a within-participant design, individuals received no-cue augmentation, an augmenting tactile cue alone, an augmenting auditory cue alone or both of the latter augmentations in combination. Results showed significant and substantive improvements in performance such that successful search speed was facilitated by more than 43%, errors of omission were reduced by 86% and errors of commission were reduced by more than 77% in the combinatorial cueing condition compared with the non-cued control. These outcomes were not a trade of performance efficiency for associated mental effort because recorded levels of cognitive workload were also reduced by more than 30% in the multi-cued circumstance compared with the control condition. When the tactile modality was incorporated it led to the highest gain in performance speed, when the auditory modality was incorporated, it led to the best levels of performance accuracy. The combined condition rendered the best of each from of performance increment. Reasons for this outcome pattern are discussed alongside their manifest practical benefits., Practitioner Summary: This experiment tested 60 individuals on a multiple screen, visual target detection task. Individuals received no-cue augmentation, tactile cue alone, an augmenting auditory cue alone or both of the latter augmentations in combination. Results showed significant and substantive improvements in the combinatorial cueing condition compared with the non-cued control.

Event-related potential (ERP)-based brain-computer interfaces (BCIs) employ differences in brain responses to attended and ignored stimuli. Typically, visual stimuli are used. Tactile stimuli have recently been suggested as a gaze-independent alternative. Bimodal stimuli could evoke additional brain activity due to multisensory integration which may be of use in BCIs. We investigated the effect of visual-tactile stimulus presentation on the chain of ERP components, BCI performance (classification accuracies and bitrates) and participants' task performance (counting of targets). Ten participants were instructed to navigate a visual display by attending (spatially) to targets in sequences of either visual, tactile or visual-tactile stimuli. We observe that attending to visual-tactile (compared to either visual or tactile) stimuli results in an enhanced early ERP component (N1). This bimodal N1 may enhance BCI performance, as suggested by a nonsignificant positive trend in offline classification accuracies. A late ERP component (P300) is reduced when attending to visual-tactile compared to visual stimuli, which is consistent with the nonsignificant negative trend of participants' task performance. We discuss these findings in the light of affected spatial attention at high-level compared to low-level stimulus processing. Furthermore, we evaluate bimodal BCIs from a practical perspective and for future applications.

Previous studies indicate that both electroencephalogram (EEG) spectral power (in particular the alpha and theta band) and event-related potentials (ERPs) (in particular the P300) can be used as a measure of mental work or memory load. We compare their ability to estimate workload level in a well-controlled task. In addition, we combine both types of measures in a single classification model to examine whether this results in higher classification accuracy than either one alone. Participants watched a sequence of visually presented letters and indicated whether or not the current letter was the same as the one (n instances) before. Workload was varied by varying n. We developed different classification models using ERP features, frequency power features or a combination (fusion). Training and testing of the models simulated an online workload estimation situation. All our ERP, power and fusion models provide classification accuracies between 80% and 90% when distinguishing between the highest and the lowest workload condition after 2 min. For 32 out of 35 participants, classification was significantly higher than chance level after 2.5 s (or one letter) as estimated by the fusion model. Differences between the models are rather small, though the fusion model performs better than the other models when only short data segments are available for estimating workload.

In this study, the determinants of head motions (rotations) when driving around bends were investigated when drivers viewed the scene through a head-mounted display. The scene camera was either fixed or coupled to head motions along 2 or 3 axes of rotation. Eight participants drove around a triangular circuit and the range and speed of head rotations, the correlations between head rotations and lateral acceleration, and the coupling between the different axes of head rotation were calculated. Results showed that substantial head rotations were made even when head rotations had no influence on the direction of the camera, suggesting a strong motor coupling between steering actions and head motion. Head roll was determined, at least in part, by the gravito-inertial force, contradicting earlier results reported in the literature.

Event-related potential (ERP) based brain-computer interfaces (BCIs) employ differences in brain responses to attended and ignored stimuli. When using a tactile ERP-BCI for navigation, mapping is required between navigation directions on a visual display and unambiguously corresponding tactile stimuli (tactors) from a tactile control device: control-display mapping (CDM). We investigated the effect of congruent (both display and control horizontal or both vertical) and incongruent (vertical display, horizontal control) CDMs on task performance, the ERP and potential BCI performance. Ten participants attended to a target (determined via CDM), in a stream of sequentially vibrating tactors. We show that congruent CDM yields best task performance, enhanced the P300 and results in increased estimated BCI performance. This suggests a reduced availability of attentional resources when operating an ERP-BCI with incongruent CDM. Additionally, we found an enhanced N2 for incongruent CDM, which indicates a conflict between visual display and tactile control orientations., Practitioner Summary: Incongruency in control-display mapping reduces task performance. In this study, brain responses, task and system performance are related to (in)congruent mapping of command options and the corresponding stimuli in a brain-computer interface (BCI). Directional congruency reduces task errors, increases available attentional resources, improves BCI performance and thus facilitates human-computer interaction.

Giving direct, continuous feedback on a brain state is common practice in motor imagery based brain-computer interfaces (BCI), but has not been reported for BCIs based on event-related potentials (ERP), where feedback is only given once after a sequence of stimuli. Potentially, direct feedback could allow the user to adjust his strategy during a running trial to obtain the required response. In order to test the usefulness of such feedback, directionally congruent vibrotactile feedback was given during an online auditory BCI experiment. Users received either no feedback, short feedback pulses or continuous feedback. The feedback conditions showed reduced performance both on a behavioral task and in terms of classification accuracy. Several explanations are discussed that give interesting starting points for further research on this topic.

In Illusory Flash (IF) experiments, congruent multisensory presentation has no effect on the mean estimate of the number of events, but decreases the variance in comparison with unisensory presentation. In contrast, congruent multisensory presentation in other Temporal Numerosity Judgement (TNJ) tasks affects the mean estimate (i.e., it often results in a reduction in underestimation) and increases the variance. In three experiments, we investigated the differences between both paradigms as possible causes of this discrepancy: the presence or absence of incongruent stimuli (Experiment 1), the instruction to the observer to either count flashes, beeps or multisensory events (Experiment 2), and the range of pulses presented (Experiment 3). We found significant differences between the mean numerosity estimate of multisensory and unisensory series in Experiment 3, but not in 1 and 2. This suggests that the difference in the range of pulses presented in IF (1-3 pulses) and TNJ (1-10 pulses) is the primary cause of the discrepancy. In the discussion we propose that this result may be explained by the use of two different strategies and their susceptibility to multisensory presentation. For small pulse numbers, observers can accurately count both unisensory and multisensory pulses. For larger numbers, observers can no longer count but will estimate the number based on the pulse series duration which is improved for multisensory stimuli.

In this study, we investigated a Brain-Computer Interface (BCI) based on EEG responses to vibro-tactile stimuli around the waist. P300 BCIs based on tactile stimuli have the advantage of not taxing the visual or auditory system and of being potentially unnoticeable to other people. A tactile BCI could be especially suitable for patients whose vision or eye movements are impaired. In Experiment 1, we investigated its feasibility and the effect of the number of equally spaced tactors. Whereas a large number of tactors is expected to enhance the P300 amplitude since the target will be less frequent, it could also negatively affect the P300 since it will be difficult to identify the target when tactor density increases. Participants were asked to attend to the vibrations of a target tactor, embedded within a stream of distracters. The number of tactors was two, four or six. We demonstrated the feasibility of a tactile P300 BCI. We did not find a difference in SWLDA classification performance between the different numbers of tactors. In a second set of experiments we reduced the stimulus onset asynchrony (SOA) by shortening the on- and/or off-time of the tactors. The SOA for an optimum performance as measured in our experiments turned out to be close to conventional SOAs of visual P300 BCIs.

In this paper, we present three field-based evaluations of a tactile land navigation system. In Experiment 1, we transition from a laboratory setting to rugged terrain used to train US Army soldier land navigation. Navigation in this challenging terrain requires careful attention to one's surroundings. Participants navigated 3 waypoints along 600 meters through heavily wooded terrain, using 1) map and compass, 2) standard alpha-numeric handheld GPS device, and 3) the tactile GPS system, while also responding to radio requests for information. Experiment 2 used the same challenging terrain during night operations, where participants must also search for live and silhouette targets, using 1) handheld GPS device, 2) head-mounted map-based GPS, and 3) the tactile GPS system. In addition to navigating, participants searched for silhouette and live (human) targets. Experiment 3 had participants navigate with 1) a commercial GPS arrow display, 2) the tactile GPS system, and 3) both together. We conclude that tactile navigation displays can be used in strenuous outdoor environments and can outperform visual displays under conditions of high cognitive and visual workload.

Irrelevant events in one sensory modality can influence the number of events that are perceived in another modality. Previously, the underlying process of sensory integration was studied in conditions in which participants knew a priori which sensory modality was relevant and which was not. Consequently, (bottom-up) sensory interference and (top-down) selective attention were confounded. We disentangled these effects by measuring the influence of visual flashes on the number of tactile taps that were perceived, and vice versa, in two conditions. In the cue condition, participants were instructed on which modality to report before the bimodal stimulus was presented. In the no-cue condition, they were instructed after stimulus presentation. Participants reported the number of events that they perceived for bimodal combinations of one, two, or three flashes and one, two, or three taps. Our main findings were that (1) in no-cue conditions, the influence of vision on touch was stronger than was the influence of touch on vision; (2) in cue conditions, the integration effects were smaller than those in no-cue conditions; and (3) irrelevant taps were less easily ignored than were irrelevant flashes. This study disentangled previously confounded bottom-up and top-down effects: The bottom-up influence of vision on touch was stronger, but vision was also more easily suppressed by top-down selective attention. We have compared our results qualitatively and quantitatively with recently proposed sensory-integration models.

This in-traffic, field study examined the merit of using a car seat instrumented with tactile stimulation elements (tactors) to communicate directional information to a driver. A car seat fitted with an 8 times 8 matrix of tactors embedded in the seat pan was used to code eight different directions (the four cardinal and four oblique directions). With this seat mounted in a car, a field study was conducted under both smooth road and brick road vibratory conditions. The primary performance measures were directional accuracy and reaction time, measured under both alerted and simulated surprise conditions. Overall, the results show that the tactile chair seat provides a promising and robust method of providing directional information. The percentage of correct directional responses was very high (92 percent of all trials), and incorrect responses were typically just one location segment (45 degrees) off.

This laboratory study examined the possibility of using a car seat instrumented with a tactile display to communicate directional information to a driver. A car seat fitted with an 8 x 8 matrix of vibrators embedded in the seat pan was used to code eight different directions. Localization response time and angular accuracy were examined as a function of stimulus direction, presence of a tactile attention cue, temporal pattern, stimulus layout, age, and gender. The mean absolute angular error was 23 degrees, and both localization accuracy and response times were superior for the back left, backward, and back right directions. Of the various temporal pattern/attention cue combinations examined, results favored the relatively fast patterns consisting of vibration bursts of 125 or 250 ms without a centrally located attention cue over 500 ms bursts that were preceded by an attention cue. Observed age and gender effects were relatively modest, suggesting that using tactile cueing to communicate direction is effective across a wide range of users. In addition, the tactile stimulus was detected by more than 90% of the participants under surprise trial conditions. Overall, these results indicate that the tactile chair provides a promising and robust method of providing directional information.

In temporal numerosity judgment, observers systematically underestimate the number of pulses. The strongest underestimations occur when stimuli are presented with a short interstimulus interval (ISI) and are stronger for vision than for audition and touch. We investigated if multisensory presentation leads to a reduction of underestimation. Participants were presented with 2 to 10 (combinations of) auditory beeps, tactile taps to the index finger and visual flashes at different ISIs (20 to 320 ms). For all presentation modes, we found underestimation, except for small number of pulses. A control experiment showed that the latter is due to a (cognitive) range effect. Averaged over conditions, the order of performance of sensory modalities is touch, audition and last vision. Generally, multisensory presentation improves performance over the unisensory presentations. For larger ISIs (160 and 320 ms), we found a tendency toward a reduction in variance for the multisensory presentation modes. For smaller ISIs (20 and 40 ms), we found a reduction in underestimation, but an increase in variance for the multisensory presentation modes. In the discussion, we relate these two findings to Maximum Likelihood Estimation (MLE) models predicting that multisensory integration reduces variance.

Vibrotactile mobility systems present spatial information such as the direction of a waypoint through a localized vibration on the torso. Using these systems requires the ability to determine the absolute location of the stimulus. Because data are available only on the ability to determine the relative location of stimuli on the torso, we developed a novel method for measuring absolute localization on the basis of triangulation. For 15 observers, we calculated the subjective location of visual and tactile stimuli on the frontal half of the torso. The size of the 95% confidence intervals around the subjective tactile locations is about the size of the stimuli (1.66 cm) and is slightly larger than that around the subjective visual locations (mean difference, 0.17 cm). The error in tactile judgments over and above that in the visual judgments is present only for locations near the body midline. When the subjective visual and tactile locations are not co-located, the difference can best be described by a shift along the radius from the body midaxis. The same holds for the differences between the veridical and the subjective locations. Therefore, the difference between the veridical and the subjective directions of a stimulus is small. The results make us believe that stimulus locations on the torso are coded in polar coordinates of which the angle is perceptual invariant and the distance is less important, probably because it varies with changes in, among other things, posture and breathing.

Introduction: Recent evidence indicates that vibrotactile displays can potentially reduce the risk of sensory and cognitive overload. Before these displays can be introduced in super agile aircraft, it must be ascertained that vibratory stimuli can be sensed and interpreted by pilots subjected to high G loads., Methods: Each of 9 pilots intercepted 32 targets in the Swedish Dynamic Flight Simulator. Targets were indicated on simulated standard Gripen visual displays. In addition, in half of the trials target direction was also displayed on a 60-element tactile torso display. Performance measures and subjective ratings were recorded., Results: Each pilot pulled G peaks above +8 Gz. With tactile cueing present, mean reaction time was reduced from 1458 ms (SE = 54) to 1245 ms (SE = 88). Mean total chase time for targets that popped up behind the pilot's aircraft was reduced from 13 s (SE = 0.45) to 12 s (SE = 0.41). Pilots rated the tactile display favorably over the visual displays at target pop-up on the easiness of detecting a threat presence and on the clarity of initial position of the threats., Discussion: This study is the first to show that tactile display information is perceivable and useful in hypergravity (up to +9 Gz). The results show that the tactile display can capture attention at threat pop-up and improve threat awareness for threats in the back, even in the presence of high-end visual displays. It is expected that the added value of tactile displays may further increase after formal training and in situations of unexpected target pop-up.

Orienting oneself in space is not an easy task. On Earth, we combine visual, vestibular and pressure cues into a coherent concept of up and down. Since there are no cues from gravity in space, astronauts have to adjust the way they determine up from down, with the possible risk of space motion sickness. In three tasks performed by one astronaut in the International Space Station (ISS), we examined the effect of artificial touch cues presented to the torso. The role of "natural" touch cues on spatial orientation in microgravity, such as pressure presented to the sole of the feet, has already been shown, but it is not trivial whether the brain can also integrate artificial orientation information that has no real life equivalent. We find that artificial touch information in the form of a localised vibration on the torso that indicates down can make orienting in microgravity faster, better and easier. The importance of the artificial touch information seems to increase over the initial 7 days of staying in microgravity while the weight of visual information decreases over the same period. The results underline the capacity of the brain to adapt to unusual environments and to use and integrate artificial cues. Besides astronauts, pilots, divers and people with a vestibular dysfunction may benefit from this technology.

Objective: We investigated the effectiveness of a tactile torso display as a countermeasure to spatial disorientation (SD) and compared inside-out and outside-in codings., Background: SD is a serious threat to military as well as civilian pilots and aircraft. Considerable effort has been put into SD countermeasures such as training programs and advanced cockpit displays. Tactile displays have been considered a promising technology., Method: Twenty-four participants were assigned to the two coding groups (12 per group and matched for age and gender). We used a rotating chair to build up a state of SD by rotating participants around their yaw axis followed by a sudden stop. During the following recovery phase a random disturbance signal was added to the chair's orientation. Participants actively controlled their orientation and were instructed to maintain a stable orientation., Results: Statistical analyses revealed that recovery from SD was improved with support of the tactile instrument, but tracking performance was reduced. The effects were the same whether the instrument was available full time or during the recovery phase only. There were no differences between outside-in and inside-out coding., Conclusion: The present study demonstrates the potential of tactile cockpit instruments in controlling SD, even in the presence of strong but misleading self-motion information from the vestibular sense., Application: Actual or potential applications of this research include spatial disorientation countermeasures for pilots, divers, and astronauts.

The present study investigates tracking performance with tactile and/or visual presentation of target and cursor. The tactile display consisted of vibrators in a horizontal linear array on the torso, the visual display consisted of dots projected on a horizontal plane surrounding the observer. Both displays presented qualitatively identical information: direction in a horizontal plane. Participants performed two different tracking tasks with target and cursor presented to the same modality (either visual or tactile) or to different modalities (a visual target and a tactile cursor or vice versa). The errors in both cross-modal settings were well predicted by the uni-modal errors. This indicates that no additional costs are involved in cross-modal visual-vibrotactile tracking. Closer inspection of the data reveals that the tactile modality is less suited for processing external disturbances. These results give directions on how to allocate information to the visual and tactile modalities in a multi-modal tracking interface, such as those applied in military cockpits.

We investigated the consistency between tactually and visually designated empty time intervals. In a forced-choice discrimination task, participants judged whether the second of two intervals was shorter or longer than the first interval. Two pulses defined the intervals. The pulse was either a vibro-tactile burst presented to the fingertip, or a foveally presented white square. The comparisons were made for uni-modal and cross-modal intervals. We used four levels of standard interval durations in the range of 100- 800 ms. The results showed that tactile empty intervals must be 8.5% shorter to be perceived as long as visual intervals. This cross-modal bias is larger for small intervals and decreases with increasing standard intervals. The Weber fractions (the threshold divided by the standard interval) are 20% and are constant over the standard intervals. This indicates that the Weber law holds for the range of interval lengths tested. Furthermore, the Weber fractions are consistent over uni-modal and cross-modal comparisons, which indicates that there is no additional noise involved in the cross-modal comparisons.

Indirect viewing systems such as tv cameras can potentially support drivers under low visibility conditions or when the driver's field of view (FOV) is restricted. In three experiments, we identified the critical image parameters of such systems on vehicle control. We used a taskbattery that measured lateral and longitudinal vehicle control in both simulated and real world driving. Important parameters are magnification factor (compared to unity, a magnification of 0.5 leads to a lower course stability and overestimation of speed and distance) and FOV (increasing the FOV from 50 degrees to 100 degrees improves performance in lateral control tasks). However, the positive effects of a doubled FOV cannot outweigh the negative effects of magnification 0.5, when both factors are confounded. Less critical is the image resolution (lowering the image resolution leads to distance overestimation and degraded longitudinal control) and image update rate (rates below 5 - 10 Hz decrease lateral control). Camera viewpoint (i.e., the location of the camera) is not critical for vehicle control. Overall, we can conclude that vehicle control with an indirect viewing system is proficient when the image parameters are adequately chosen. This supports the further development of these kind of driver support systems.

For multiple degree-of-freedom (DOF) systems, it is important to determine how accurately operators can control each DOF and what influence perceptual, information processing, and psychomotor components have on performance. Sixteen right-handed male students participated in 2 experiments: 1 involving positioning and 1 involving tracking with 3 translational DOFs. To separate perceptual and psychomotor effects, we used 2 control-display mappings that differed in the coupling of vertical and depth dimensions to the up-down and fore-aft control axes. We observed information processing effects in the positioning task: Initial error correction on the vertical dimension lagged in time behind the horizontal dimension. The depth dimension error correction lagged behind both, which was ascribed to the poorer perceptual information. We observed this perceptual effect also in the tracking experiment: Tracking error along the depth dimension was 3.8 times larger than along the other dimensions. Motor effects were also present, with tracking errors along the up-down axis of the hand controller being 1.1 times larger than along the fore-aft axis. These results indicate that all 3 components contribute to control performance. Actual applications of this research include interface design for remote control and virtual reality.