Search

Urban Air Mobility (UAM) vehicles will need to meet the safety and comfort expectations of passengers and crews. However, existing Federal Aviation Administration airworthiness standards for airplanes and rotorcraft are unlikely to adequately address these needs. Some insight into this issue may be gained from research into NASA's approach to human-systems integration standards and guidelines that promote astronaut health, safety, and performance, since both space and UAM vehicles must consider factors such as occupant motion sickness, vibration, and sound levels. Building upon knowledge garnered from the experience of NASA, the U.S. Department of Defense, and other international organizations, this presentation will elucidate: 1) how UAM-induced flight factors can impact occupant comfort, productivity, as well as safety; and 2) how government and industry standards could be developed or revised to help assure passenger acceptance of revolutionary Vertical Take Off and Landing aircraft technologies.

NASA's Human Research Program (HRP) funds research efforts aimed at mitigating various human health and performance risks, including the Risk of Inadequate Design of Human and Automation/Robotic Integration (HARI). As such, within HRP, the Human Factors and Behavioral Performance (HFBP) Element tasked an evaluation of future HARI needs in order to scope and focus the HARI risk research plan. The objective was to provide a systematic understanding of the critical factors associated with effective HARI that will be necessary to achieve the future mission goals for near- and deep-space exploration. Future mission goals are specified by NASA Design Reference Missions (DRMs) that are pertinent to the HRP. The outcome of this evaluation is a set of NASA-relevant HARI tasks, factors, and interactions required for exploration-class missions.

NASA employs Design Reference Missions (DRMs) to define potential architectures for future human exploration missions to deep space, the Moon, and Mars. While DRMs to these destinations share some components, each mission has different needs. This paper focuses on the human and automation/robotic integration needs for these future missions, evaluating them with respect to NASA research gaps in the area of space human factors engineering. The outcomes of our assessment is a human and automation/robotic (HAR) task list for each of the four DRMs that we reviewed (i.e., Deep Space Sortie, Lunar Visit/Habitation, Deep Space Habitation, and Planetary), a list of common critical HAR factors that drive HAR design.

Humans show increased systematic and random errors when reaching for targets at 3.8Gx with or without added vibration.

Virtual Environments (aka Virtual Reality) is again catching the public imagination and a number of startups (e.g. Oculus) and even not-so-startup companies (e.g. Microsoft) are trying to develop display systems to capitalize on this renewed interest. All acknowledge that this time they will get it right by providing the required dynamic fidelity, visual quality, and interesting content for the concept of VR to take off and change the world in ways it failed to do so in past incarnations. Some of the surprisingly long historical background of the technology that the form of direct simulation that underlies virtual environment and augmented reality displays will be briefly reviewed. An example of a mid 1990's augmented reality display system with good dynamic performance from our lab will be used to illustrate some of the underlying phenomena and technology concerning visual stability of virtual environments and objects during movement. In conclusion some idealized performance characteristics for a reference system will be proposed. Interestingly, many systems more or less on the market now may actually meet many of these proposed technical requirements. This observation leads to the conclusion that the current success of the IT firms trying to commercialize the technology will depend on the hidden costs of using the systems as well as the development of interesting and compelling content.

A method and apparatus for reducing the visual blur of an object being viewed by an observer experiencing vibration. In various embodiments of the present invention, the visual blur is reduced through stroboscopic image modulation (SIM). A SIM device is operated in an alternating "on/off" temporal pattern according to a SIM drive signal (SDS) derived from the vibration being experienced by the observer. A SIM device (controlled by a SIM control system) operates according to the SDS serves to reduce visual blur by "freezing" (or reducing an image's motion to a slow drift) the visual image of the viewed object. In various embodiments, the SIM device is selected from the group consisting of illuminator(s), shutter(s), display control system(s), and combinations of the foregoing (including the use of multiple illuminators, shutters, and display control systems).

System response latency is a prominent characteristic of human-computer interaction. Laggy systems are; however, not simply annoying but substantially reduce user productivity. The impact of latency on head referenced display systems, particularly head-mounted systems, is especially disturbing since not only can it interfere with dynamic registration in augmented reality displays but it also can in some cases indirectly contribute to motion sickness. We will summarize several experiments using standard psychophysical discrimination techniques that suggest what system latencies will be required to achieve perceptual stability for spatially referenced computer-generated imagery. In conclusion I will speculate about other system performance characteristics that I would hope to have for a dream augmented reality system.

The Misalignment Effect Function (MEF) describes the decrement in manual performance associated with a rotation between operators' visual display frame of reference and that of their manual control. It now has been empirically determined for rotation axes oblique to canonical body axes and is compared with the MEF previously measured for rotations about canonical axes. A targeting rule, called the Secant Rule, based on these earlier measurements is derived from a hypothetical process and shown to describe some of the data from three previous experiments. It explains the motion trajectories determined for rotations less than 65deg in purely kinematic terms without the need to appeal to a mental rotation process. Further analysis of this rule in three dimensions applied to oblique rotation axes leads to a somewhat surprising expectation that the difficulty posed by rotational misalignment should get harder as the required movement is shorter. This prediction is confirmed. Geometry underlying this rule also suggests analytic extensions for predicting more generally the difficulty of making movements in arbitrary directions subject to arbitrary misalignments.

We plan to study the invariance in the shift in control strategy from continuous control to move-and-wait as a function of latency and control difficulty. To do so we have developed a theoretically understood way of introducing measurable levels of control difficulty using misalignment between display and control axes . We now use this understanding to study the interaction of control difficulty and system latency. We have conducted an experiment to calibrate our imposition of control difficulty using more representative control rotations. We use these levels of difficulty to directly study the interaction of control difficulty with latency. Results suggest a way to generalize latency requirements across control difficulties that should aid establishment of standards for managing latency in teleoperation.

To identify spatial and temporal discontinuities in telerobot movement in order to describe the shift in operators control and error correction strategies from continuous control to move-and-wait strategies. This shift was studied under conditions of simulated increasingly time-delayed teleoperation. The ultimate goal is to determine if the time delay associated with the shift is invariant with independently imposed control difficulty. We expect this shift to manifest itself as changes in the number of discontinuity of movement path. We proposed an approach to spatial and temporal discontinuity detection algorithm for analysis of teleoperated trajectory in three dimensional space. The algorithm provides a simple and potentially objective method for detecting the discontinuity during telerobot operation and evaluating the difficulty of rotational coordinate condition in teleoperation.

A method and apparatus were developed to minimize latency (time delay ) in virtual environment (VE) and other discrete- time computer-base d systems that require real-time display in response to sensor input s. Latency in such systems is due to the sum of the finite time requi red for information processing and communication within and between sensors, software, and displays.

We measured the impacts on human visual function of a range of vibration levels (0.15, 0.3, 0.5, and 0.7 g) at the frequency and along the axis of the anticipated Ares thrust oscillation. We found statistically significant and equivalent decrements in performance on a reading and a numeric processing task at tested vibration levels above 0.3 g (0-to-peak), but no evidence of after-effects. At the smallest font and highest vibration level tested, the average effect was a 50 percent increase in response time and six-fold increase in errors. Our findings support a preliminary trade space in which currently planned Orion font sizes and text spacing appear to be too small to support accurate and efficient reading at the tested vibration levels above 0.3 g, but not too small to support reading at 0.3 g. This study does not address potential impacts on crew cognitive decision-making or motor control and does not test either the full induced Orion-Ares environment with its sustained Gx-loading or the full complexity of the final Orion seat-helmet-suit interface. A final determination of the Orion-Ares program limit on vibration must take these additional factors into consideration and, thus, may need to be lower than that needed to support effective reading at 1-Gx bias.

Recent engineering analyses of the integrated Ares-Orion stack show that vibration levels for Orion crews have the potential to be much higher than those experienced in Gemini, Apollo, and Shuttle vehicles. Of particular concern to the Constellation Program (CxP) is the 12 Hz thrust oscillation (TO) that the Ares-I rocket develops during the final ~20 seconds preceding first-stage separation, at maximum G-loading. While the structural-dynamic mitigations being considered can assure that vibration due to TO is reduced to below the CxP crew health limit, it remains to be determined how far below this limit vibration must be reduced to enable effective crew performance during launch. Moreover, this "performance" vibration limit will inform the operations concepts (and crew-system interface designs) for this critical phase of flight. While Gemini and Apollo studies provide preliminary guidance, the data supporting the historical limits were obtained using less advanced interface technologies and very different operations concepts. In this study, supported by the Exploration Systems Mission Directorate (ESMD) Human Research Program, we investigated display readability-a fundamental prerequisite for any interaction with electronic crew-vehicle interfaces-while observers were subjected to 12 Hz vibration superimposed on the 3.8 G loading expected for the TO period of ascent. Two age-matched groups of participants (16 general population and 13 Crew Office) performed a numerical display reading task while undergoing sustained 3.8 G loading and whole-body vibration at 0, 0.15, 0.3, 0.5, and 0.7 g in the eyeballs in/out (x-axis) direction. The time-constrained reading task used an Orion-like display with 10- and 14-pt non-proportional sans-serif fonts, and was designed to emulate the visual acquisition and processing essential for crew system monitoring. Compared to the no-vibration baseline, we found no significant effect of vibration at 0.15 and 0.3 g on task error rates (ER) or response times (RT). Significant degradations in both ER and RT, however, were observed at 0.5 and 0.7 g for 10-pt, and at 0.7 g for 14-pt font displays. These objective performance measures were mirrored by participants' subjective ratings. Interestingly, we found that the impact of vibration on ER increased with distance from the center of the display, but only for vertical displacements. Furthermore, no significant ER or RT aftereffects were detected immediately following vibration, regardless of amplitude. Lastly, given that our reading task required no specialized spaceflight expertise, our finding that effects were not statistically distinct between our two groups is not surprising. The results from this empirical study provide initial guidance for evaluating the display readability trade-space between text-font size and vibration amplitude. However, the outcome of this work should be considered preliminary in nature for a number of reasons: 1. The single 12 Hz x-axis vibration employed was based on earlier load-cycle models of the induced TO environment at the end of Ares-I first stage flight. Recent analyses of TO mitigation designs suggest that significant concurrent off-axis vibration may also occur. 2. The shirtsleeve environment in which we tested fails to capture the full kinematic and dynamic complexity of the physical interface between crewmember and the still-to-bematured helmet-suit-seat designs, and the impact these will have for vibration transmission and consequent performance. 3. By examining performance in this reading and number processing task, we are only assessing readability, a first and necessary step that in itself does not directly address the performance of more sophisticated operational tasks such as vehicle-health monitoring or manual control of the vehicle.

An optical see-through, augmented reality display was used to study subjects' ability to detect aircraft maneuvering and landing at the Dallas Ft. Worth International airport in an ATC Tower simulation. Subjects monitored the traffic patterns as if from the airport's western control tower. Three binocular fields of view (14 deg, 28 deg and 47 deg) were studied in an independent groups' design to measure the degradation in detection performance associated with the visual field restrictions. In a second experiment the 14 deg and 28 deg fields were presented either with 46% binocular overlap or 100% overlap for separate groups. The near asymptotic results of the first experiment suggest that binocular fields of view much greater than 47% are unlikely to dramatically improve performance; and those of the second experiment suggest that partial binocular overlap is feasible for augmented reality displays such as may be used for ATC tower applications.

Overall latency remains an impediment to perceived image stability and consequently to human performance in virtual environment (VE) systems. Predictive compensators have been proposed as a means to mitigate these shortcomings, but they introduce rendering errors because of induced motion overshoot and heightened noise. Discriminability of these compensator artifacts was investigated by a protocol in which head tracked image stability for 35 ms baseline VE system latency was compared against artificially added (16.7 to 100 ms) latency compensated by a previously studied Kalman Filter (K-F) predictor. A control study in which uncompensated 16.7 to 100 ms latencies were compared against the baseline was also performed. Results from 10 subjects in the main study and 8 in the control group indicate that predictive compensation artifacts are less discernible than the disruptions of uncompensated time delay for the shorter but not the longer added latencies. We propose that noise magnification and overshoot are contributory cues to the presence of predictive compensation.

A three degree of freedom parallel mechanism or linkage that couples three degree of freedom translational displacements at an endpoint, such as a handle, a hand grip, or a robot tool, to link rotations about three axes that are fixed with respect to a common base or ground link. The mechanism includes a three degree of freedom spherical linkage formed of two closed loops, and a planar linkage connected to the endpoint. The closed loops are rotatably interconnected, and made of eight rigid links connected by a plurality of single degree of freedom revolute joints. Three of these revolute joints are base joints and are connected to a common ground. such that the axis lines passing through the revolute joints intersect at a common fixed center point K forming the center of a spherical work volume in which the endpoint is capable of moving. 'Me three degrees of freedom correspond to the spatial displacement of the endpoint, for instance. The mechanism provides a new overall spatial kinematic linkage composed of a minimal number of rigid links and rotary joints. The mechanism has improved mechanical stiffness, and conveys mechanical power bidirectionally between the human operator and the electromechanical actuators. It does not require gears, belts. cable, screw or other types of transmission elements, and is useful in applications requiring full backdrivability. Thus, this invention can serve as the mechanical linkage for actively powered devices such as compliant robotic manipulators and force-reflecting hand controllers, and passive devices such as manual input devices for computers and other systems.

This summary focuses on the kinesthetic interface of a virtual environment system that was developed at the Newman Laboratory for Biomechanics and Human Rehabilitation at M.I.T. for the study of manual control in both motorically impaired and able-bodied individuals.