Search

Eye/brain/task (EBT) testbed records electroencephalograms, movements of eyes, and structures of tasks to provide comprehensive data on neurophysiological experiments. Intended to serve continuing effort to develop means for interactions between human brain waves and computers. Software library associated with testbed provides capabilities to recall collected data, to process data on movements of eyes, to correlate eye-movement data with electroencephalographic data, and to present data graphically. Cognitive processes investigated in ways not previously possible.

The issues are described which are associated with using a laser scanner for visual sensing and the methods developed by the author to address them. A laser scanner is a device that controls the direction of a laser beam by deflecting it through a pair of orthogonal mirrors, the orientations of which are specified by a computer. If a calibrated laser scanner is combined with a calibrated camera, it is possible to perform three dimensional sensing by directing the laser at objects within the field of view of the camera. There are several issues associated with using a laser scanner for three dimensional visual sensing that must be addressed in order to use the laser scanner effectively. First, methods are needed to calibrate the laser scanner and estimate three dimensional points. Second, methods to estimate three dimensional points using a calibrated camera and laser scanner are required. Third, methods are required for locating the laser spot in a cluttered image. Fourth, mathematical models that predict the laser scanner's performance and provide structure for three dimensional data points are necessary. Several methods were developed to address each of these and has evaluated them to determine how and when they should be applied. The theoretical development, implementation, and results when used in a dual arm eighteen degree of freedom robotic system for space assembly is described.

The ongoing vision research at the Center for Intelligent Robotic Systems for Space Exploration (CIRSSE) is directed toward identifying and addressing the relevant issues involved in applying visual sensing to space assembly tasks. A considerable amount of effort has been devoted to passive sensing techniques such as using multiple cameras to identify objects in a scene. To compliment the capabilities of the passive visual system in the CIRSSE robotics testbed, research is being conducted in active sensing techniques. This report is description of the research associated with the testbed's laser scanner and its application as an active sensing device. The report is comprised of five major topics. First is a brief description of the CIRSSE visual system and a summary of the active sensing research that has been conducted up to this point. Second, some of the methods currently used to calibrate CIRSSE's laser scanner are described as well as an appraisal of the effectiveness of these methods. Third, is a discussion of how the laser scanner can be employed in concert with a camera to provide a three dimensional point estimation capability. Fourth, there is a description of methods that can be used to detect the presence of the laser beam in a cluttered camera image. Finally, there is a summary of the current state of this research and a description of research planned for the future.