Search

An assembly planning system that operates based on a recursive decomposition of assembly into subassemblies, and analyzes assembly cost in terms of stability, directionality, and manipulability to guide the generation of preferred assembly plans is presented. The planning in this system incorporates the special processes, such as cleaning, testing, labeling, etc. that must occur during the assembly, and handles nonreversible as well as reversible assembly tasks through backward assembly planning. In order to increase the planning efficiency, the system avoids the analysis of decompositions that do not correspond to feasible assembly tasks. This is achieved by grouping and merging those parts that can not be decomposable at the current stage of backward assembly planning due to the requirement of special processes and the constraint of interconnection feasibility. The invention includes methods of evaluating assembly cost in terms of the number of fixtures (or holding devices) and reorientations required for assembly, through the analysis of stability, directionality, and manipulability. All these factors are used in defining cost and heuristic functions for an AO* search for an optimal plan.

Optoelectronic proximity sensor comprises seven identical units functioning together to provide partially redundant data on spatial relationship between sensor and nearby diffusely reflecting surface. Provides data on distance, relative orientation, and curvature of surface. Sensor called "Hexeye" because its units exhibit hexagonal symmetry when viewed along optical axes and mounted together in hexagonal close packing. Because all six arrays of photodetectors in unit measure essentially identical distributions of light in operating mode, each provides redundant information averaged to increase accuracy or used to verify operation of others. Malfunctioning photodector identified, and output ignored or replaced by interpolated value. Developed for use in such robotic applications as noncontact probing or scanning of surfaces, localization and recognition of objects, and guiding "smart" robot hands in grasping objects.

Proposed teleoperator control system incorporates several advanced features to improve coordination between remote robotic manipulator (slave arm) and human operator at control manipulator (master arm). Provides superior performance in terms of error profiles and task-completion time in presence of human control errors varying over wide range and maintains stability under large signal-propagation delays. System highly robust in presence of nonlinearities and incorrect human commands in both position and rate modes of control.

Proposed two-arm robotic manipulator capable of changing its mechanical structure to fit given task. No reassembly or replacement in conventional sense: instead, arms commanded during operation to assume any of number of alternative configurations, described briefly in "Dynamic Coordination of a Two-Arm Robotic Manipulator" (NPO-18816), NASA Tech Briefs.

Report presents study of dynamical and kinematical considerations guiding selection of configuration of self-reconfigurable, two-arm robotic manipulator. Two multiple-link arms cooperate in manipulating single object, reconfiguring their mutual, cooperative structure according to changing task requirements.

System of algorithms developed to automate planning of sequences of manufacturing or field operations in which components are put together into assemblies. Results of DFA analysis also used to modify designs to optimize them with respect to assembly considerations.

A theoretical framework is presented for a 'sensing-knowledge command-fusion' paradigm of interactive and cooperative sensing and control in advanced teleoperators, which takes advantage of both current and projected robotic dexterousness and sensor-based autonomy capabilities. Attention is given to (1) a method for the achievement of a sensing-knowledge-command computational mechanism that implements the intended cooperative/interactive system, and (2) the system architecture and man/machine-interface protocols entailed by this implementation.

Teleoperation experiments at JPL have shown that advanced features in a telerobotic system are a necessary condition for good results, but that they are not sufficient to assure consistently good performance by the operators. Two or three operators are normally used during training and experiments to maintain the desired performance. An alternative to this multi-operator control station is a man-machine interface embedding computer programs that can perform some of the operator's functions. In this paper we present our first experiments with these concepts, in which we focused on the areas of real-time task monitoring and interactive path planning. In the first case, when performing a known task, the operator has an automatic aid for setting control parameters and camera views. In the second case, an interactive path planner will rank different path alternatives so that the operator will make the correct control decision. The monitoring function has been implemented with a neural network doing the real-time task segmentation. The interactive path planner was implemented for redundant manipulators to specify arm configurations across the desired path and satisfy geometric, task, and performance constraints.

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decisionmaking between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. The Sensing-Knowledge-Command (SKC) fusion network is proposed as a fundamental architecture for implementing cooperative and interactive sensing and control. Simulation results are shown.

An assembly planning system that operates based on a recursive decomposition of assembly into subassemblies is presented. The planning system analyzes assembly cost in terms of stability, directionality, and manipulability to guide the generation of preferred assembly plans. The planning in this system incorporates the special processes, such as cleaning, testing, labeling, etc., that must occur during the assembly. Additionally, the planning handles nonreversible, as well as reversible, assembly tasks through backward assembly planning. In order to decrease the planning efficiency, the system avoids the analysis of decompositions that do not correspond to feasible assembly tasks. This is achieved by grouping and merging those parts that can not be decomposable at the current stage of backward assembly planning due to the requirement of special processes and the constraint of interconnection feasibility. The invention includes methods of evaluating assembly cost in terms of the number of fixtures (or holding devices) and reorientations required for assembly, through the analysis of stability, directionality, and manipulability. All these factors are used in defining cost and heuristic functions for an AO* search for an optimal plan.

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decision-making between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. A case study is performed to demonstrate the feasibility of implementing the fundamental theory and system architecture of interactive and cooperative sensing and control, proposed for the new generation of teleoperation.

A novel optical proximity sensor system, capable of measuring the distance to the orientation and the discontinuity at a local area of an object surface, was designed and evaluated for robotic applications. The sensor system gets its name, Hexagonal Eye, (HexEYE) from its shape where seven identical hexagonal sensing units were configured hexagonally into a compact geometric structure. The seven sensing units were grouped into multiple combinations of three sensing units to measure the surface orientation as well as surface discontinuity. The distinctive features of HexEYE are an order of magnitude increased in distance sensitivity by optimizing the curvature of a conical mirror, the enhanced measurement accuracy based on multiple levels of sensor fusion, and the compactness in size due to a sensing mechanism based on the Gaussian lens law. A prototype of single sensing unit has been built and was evaluated experimentally.

An approach to robust recognition of handwritten numerals using two operating parallel networks is presented. The first network uses inputs in Cartesian coordinates, and the second network uses the same inputs transformed into polar coordinates. How the proposed approach realizes the robustness to local and global variations of input numerals by handling inputs both in Cartesian coordinates and in its transformed Polar coordinates is described. The required network structures and its learning scheme are discussed. Experimental results show that by tracking only a small number of distinctive features for each teaching numeral in each coordinate, the proposed system can provide robust recognition of handwritten numerals.

The design goal of an advanced teleoperator control system is twofold: 1) to allow the operator's manual control to be robust to system nonlinearities such as time delays and operator's control errors, and 2) to support the high performance of teleoperation while reducing the operator's control burden by providing the master and slave arms with desirable dynamic properties and by allowing the slave arm to automatically perform such control tasks as compliance and force control in the form of task sharing. The authors present a novel teleoperator control system achieving the above design goal by taking the following into consideration: the human dynamics involved in generating control command based on visual and forced feedback is modeled and incorporated into the controller design and evaluation; the dynamic characteristics of slave and master arms are actively modified in such a way as to implement the desirable dynamic characteristics; and the force feedback is redefined in terms of the combination of opposition and force discrepancies in order to establish the required man/machine dynamic coordination under shared control. The proposed control system with human dynamics in the control loop is simulated and compared with a number of conventional methods in the presence of human control errors and time delays.

A novel neural network approach to robot hand-eye coordination is presented. The approach provides a true sense of visual error servoing, redundant arm configuration control for collision avoidance, and invariant visuo-motor learning under gazing control. A 3-D perception network is introduced to represent the robot internal 3-D metric space in which visual error servoing and arm configuration control are performed. The arm kinematic network performs the bidirectional association between 3-D space arm configurations and joint angles, and enforces the legitimate arm configurations. The arm kinematic net is structured by a radial-based competitive and cooperative network with hierarchical self-organizing learning. The main goal of the present work is to demonstrate that the neural net representation of the robot 3-D perception net serves as an important intermediate functional block connecting robot eyes and arms.

An optimal sensing strategy for an optical proximity sensor system engaged in the recognition and localization of 3-D natural quadric objects is presented. The optimal sensing strategy consists of the selection of an optimal beam orientation and the determination of an optimal probing plane that compose an optimal data collection operation known as an optimal probing. The decision of an optimal probing is based on the measure of discrimination power of a cluster of surfaces on a multiple interpretation image (MII), where the measure of discrimination power is defined in terms of a utility function computing the expected number of interpretations that can be pruned out by a probing. An object representation suitable for active sensing based on a surface description vector (SDV) distribution graph and hierarchical tables is presented. Experimental results are shown.

Sensing-knowledge-command (SKC) fusion is presented as a fundamental paradigm of implementing cooperative control for an advanced man-machine system. SKC fusion operates on the 'SKC fusion network,' which represents the connection between sensor data to commands through knowledge. Sensing, knowledge, and command of a human and a machine are tapped into the network to provide inputs, or stimuli, to the network. Such stimuli automatically invoke an SKC fusion process and generate a fused output for cooperative control. Once invoked by stimuli, the SKC fusion process forces the network to converge to a new equilibrium state through the network dynamics composed of data fusion, feature transformation, and constraint propagation. The SKC fusion process thus integrates redundant information, maintains network consistency, identifies faulty data and concepts, and specifies those concepts to be strengthened through sensor planning.

The authors present the dynamic coordination of a self-reconfigurable manipulator system capable of changing its mechanical structure according to given task requirements. The self-reconfiguration is achieved by reconfiguring the topology of a dual-arm system through serial, parallel, and bracing structures. Particular emphasis is placed on the dynamic coordination of two arms having three different dual-arm topologies. The authors develop the Cartesian space dynamic models of a dual-arm system of three dual-arm topologies and derive the kinematic and dynamic constraints imposed on two arms in cooperation. Dual-arm dynamic manipulabilities are defined to quantify the dynamic performance of three dual-arm topologies in terms of the efficiency of generating Cartesian accelerations. A methodology of selecting serial, parallel, and bracing structures based on dual-arm dynamic manipulabilities is provided.

The authors present a dextrous bracing structure of a dual-arm system as a means of implementing a self-reconfigurable manipulator system. The dextrous bracing structure allows a dual-arm system to relocate the bracing point between two arms, select the type of contact as the bracing point, and lock or release the joints of individual arms. The self-reconfigurable dual-arm system is now capable of reconfiguring its topology through serial, parallel and bracing structures, supporting general types of contact, rigid or sliding, as well as locking or releasing some of its joints as needed. The focus is on an analysis of the effects of the dextrous bracing on the performance of a dual-arm system in terms of dual-arm manipulabilities and resistivities. The analysis shows that a self-reconfigurable dual-arm system with a dextrous bracing structure gives continuously varying performance characteristics ranging from serial to parallel structures.

An artificial dexterous hand is provided for grasping and manipulating objects. The hand includes left and right thumbs that are operatively connected to an engagement assembly which causes movement of the left and right thumbs. The left thumb has a left thumb base and is movable about three separate first left thumb axes which run through the left thumb base. Correspondingly, the right thumb has a right thumb base and is movable about three separate first right thumb axes which run through the right thumb base. The engagement assembly has a gear assembly which is operatively connected to a motor assembly. Upon actuation by the motor assembly, the gear assembly causes movement of the left and right thumbs about the first left thumb axes and first right thumb axes respectively. The hand can also have a center finger which is operatively connected to the engagement assembly and which is interposed between the left and right thumbs. The finger has a finger base and is movable about two separate first finger axes running through the finger base. Therefore, upon actuation by the motor assembly, the gear assembly will also cause movement of the finger about the first finger axes.

An artificial dexterous hand is provided for conformally engaging and manipulating objects. The hand includes an articulated digit which is connected to an engagement sub-assembly and has a first shape adaption mechanism associated with it. The digit has a digit base and first and second phalanges. The digit base is operatively interconnected to the first phalange by a base joint having a base pulley. The phalanges are operatively interconnected by a separate first phalange joint having a first phalange pulley. The engagement sub-assembly includes a tendon, which is received by the base pulley and by the first phalange pulley, and an actuation device for selectively tensioning the tendon. The first shape adaption mechanism is responsive to and receives the tendon. It is also situated between the base joint and the first phalange joint and is connected to the first phalange. Upon actuation by the actuation device, the phalanges are caused to pivot relative to the base joint and the second phalange is caused to pivot relative to the first phalange. At the same time, the first shape adaption mechanism controls the sequence of the aforementioned pivoting of the phalanges through application of braking force to the tendon.

A distributed proximity sensor system is provided with multiple photosensitive devices and light emitters embedded on the surface of a robot hand or other moving member in a geometric pattern. By distributing sensors and emitters capable of detecting distances and angles to points on the surface of an object from known points in the geometric pattern, information is obtained for achieving noncontacting shape and distance perception, i.e., for automatic determination of the object's shape, direction and distance, as well as the orientation of the object relative to the robot hand or other moving member.

The kinematic control of a redundant arm based on multiple tasks assigned to different locations of the manipulator is presented. This is equivalent to decomposing a redundant arm into two (or more) nonredundant local arms, the basearm and the forearm, at an intermediate arm location or task point called the elbow. A redundant arm is transformed into a serially cooperating dual-arm system, with the cooperation between the local arms being carried out at the elbow. Then, a manipulator end-effector motion specified by a given task is decomposed into motions of individual local arms as well as an end-effector free motion based on achieving maximum efficiency in task execution. To consider global optimization, elbow control is applied to reshaping and reorientation of a manipulability ellipsoid at the end effector during task execution. The resolved rate control of elbow in the end-effector null and free motion space is used to maximize arm homogeneity and to match the forearm motion space with the task space. Simulation results are shown.

The use of a redundant manipulator to execute multiple tasks specified at different points on the manipulator is demonstrated. This is accomplished by decomposing a redundant arm at an intermediate arm location called the 'elbow' into two nonredundant local arms referred as the 'basearm' and the 'forearm'. This decomposition transforms a redundant arm into a serially linked dual-arm system, where the cooperation between the basearm and the forearm is carried out through the task distribution and the elbow control. The kinematics of a decomposed redundant manipulator are discussed, and a Cartesian space dynamic model and dynamic equation of a decomposed redundant manipulator are presented. The capability of generating Cartesian force, the local efficiency of generating Cartesian acceleration, and dynamic task distribution are discussed.

An algorithm is presented for the recognition and localization of thre-dimensional polyhedral objects based on an optical proximity sensor system capable of measuring the depth and orientation of a local area of an object surface. Emphasis is given to the determination of an optimal sensor trajectory or an optimal probing, for efficient discrimination among all the possible interpretations. The determination of an optimal sensor trajectory for the next probing consists of the selection of optimal beam orientations based on the surface normal vector distribution of the multiple interpretation image (MII) and the selection of an optimal probing plane by projecting the MII onto the projection plane perpendicular to a selected beam orientation and deriving the optimal path on the projection plane. The selection of optimal beam orientation and probing plane is based on the measure of discrimination power of a cluster of surfaces of an MII. Simulation results are shown.

A method is presented for the automatic determination of assembly partial orders from a liaison graph representation of an assembly through the extraction of preferred subassemblies. In particular, the authors show how to select a set of tentative subassemblies by decomposing a liaison graph into a set of subgraphs based on feasibility and difficulty of disassembly, how to evaluate each of the tentative subassemblies in terms of assembly cost using the subassembly selection indices, and how to construct a hierarchical partial order graph (HPOG) as an assembly plan. The method provides an approach to assembly planning by identifying spatial parallelism in assembly as a means of constructing temporal relationships among assembly operations and solves the problem of finding a cost-effective assembly plan in a flexible environment. A case study of the assembly planning of a mechanical assembly is presented.

Dual-arm dynamic operation quality measures are presented which quantify the efficiency and capability of generating Cartesian accelerations by two cooperative arms based on the analysis of dual-arm dynamic interactions. Dual-arm dynamic manipulability is defined as the efficiency of generating Cartesian accelerations under the dynamic and kinematic interactions between individual arms and an object under manipulation. The analysis of dual-arm dynamic interactions is based on the so-called Cartesian space agent model of an arm, which represents an individual arm as a force source acting upon a point mass with the effective Cartesian space arm dynamics and an environment or an object under manipulation. The Cartesian space agent model of an arm makes it possible to derive the dynamic and kinematic constraints involved in the transport, assembly and grasping modes of dual-arm cooperation. A task-oriented operational quality measure, (TOQd) is defined by evaluating dual-arm dynamic manipulability in terms of given task requirements. TOQd is used in dual-arm joint configuration optimization. Simulation results are shown. A complete set of forward dynamic equations for a dual-arm system is derived, and dual-arm dynamic operational quality measures for various modes of dual-arm cooperation allowing sliding contacts are established.

The authors present dual-arm system static operational quality measures which quantify the efficiency and capability of a dual-arm system in generating Cartesian velocities and static forces. First, they define and analyze the kinematic interactions between the two arms incurred by the various modes of dual-arm cooperation, such as transport, assembly, and grasping modes of cooperation, and specify the kinematic constraints imposed on individual arms in Cartesian space due to the kinematic interactions. Dual-arm static manipulability is presented. Finally, dual-arm operational quality is scaled by a task-oriented operational quality measure (TOQs) obtained by the comparison between the desired and actual static manipulabilities. TOQs is used in the optimization of dual-arm joint configurations. Simulation results are shown.

It is shown that the required motion and force trajectories of a given task can be abstracted by a series of desired manipulability ellipsoids, and that a task-oriented dual-arm manipulability measure (TODAMM) can be mathematically defined by quantifying how the manipulability of one arm affects the other and measuring the geometrical closeness between the desired and the actual manipulability ellipsoids. TODAMM can be used in the optimization of dual-arm joint configurations. The task-oriented manipulability measure developed can also be used in the joint configuration optimization of a single arm, providing efficient joint configurations in terms of joint motions and joint torques for the required Cartesian motions and static forces. The dual-arm joint configuration optimization based on TODAMM can be applied to a variety of tasks which require dual-arm cooperation.

Robot hand includes thumblike members on left and right sides and fingerlike member at middle. Configuration of digits enables hand to adapt to variously shaped objects, grasp them robustly and reliably, and manipulate them. Reduces complexity of control mechanisms and provides kinesthetic perception of shapes of grasped objects. Mechanical hand with two thumbs and middle finger made from commercially available components. With specially designed dc motors and assemblies of gears, size of hand reduced considerably. Suited to handling objects in industrial tasks.

The invention relates to sensors embedded on the surface of a robot hand, or other moving member. By distributing proximity sensors capable of detecting distances and angles to points on the surface of an object, information is obtained for achieving noncontacting shape and distance perception, i.e., for automatic determination of the object's shape, direction, and distance, as well as the orientation of the object relative to the robot hand or other moving member.

A technique is presented which allows use of an exact linearization (EL) control for robot manipulators for those cases when actuator saturation cannot be ignored. A modification of a nonlinear dynamic compensation technique that has been successfully used in the feedback amplifiers is applied to a case of a nonredundant manipulator. Computer simulation for a two-link planar robot arm illustrates the advantages of the modified computed torque technique compared to the traditional linear full state control.

A measure of static manipulability is derived for a dual-redundant-arm (DRA) system engaged in cooperative task execution. Considering the kinematic interaction between the two cooperating arms, the dual-arm (DA) manipulability is defined as the intersection between the two manipulability ellipsoids from individual arms. A task-oriented DA manipulability measure is defined as the measure of geometrical similarity between the desired and the actual DA manipulability ellipsoids at the selected task points. Mathematical formulas are developed to define task-oriented DRA static manipulability, and their application to the optimization of DRA joint and grasp configurations is demonstrated.