Search

Includes bibliographical references, This thesis deals with the control of a humanoid robot based on visual servoing. It seeks to confer a degree of autonomy to the robot in the achievement of tasks such as reaching a desired position, tracking or/and grasping an object. The autonomy of humanoid robots is considered as crucial for the success of the numerous services that this kind of robots can render with their ability to associate dexterity and mobility in structured, unstructured or even hazardous environments. To achieve this objective, a humanoid robot is fully modeled and the control of its locomotion, conditioned by postural balance and gait stability, is studied. The presented approach is formulated to account for all the joints of the biped robot. As a way to conform the reference commands from visual servoing to the discrete locomotion mode of the robot, this study exploits a reactive omnidirectional walking pattern generator and a visual task Jacobian redefined with respect to a floating base on the humanoid robot, instead of the stance foot. The redundancy problem stemming from the high number of degrees of freedom coupled with the omnidirectional mobility of the robot is handled within the task priority framework, allowing thus to achieve con- figuration dependent sub-objectives such as improving the reachability, the manipulability and avoiding joint limits. Beyond a kinematic formulation of visual servoing, this thesis explores a dynamic visual approach and proposes two new visual servoing laws. Lyapunov theory is used first to prove the stability and convergence of the visual closed loop, then to derive a robust adaptive controller for the combined robot-vision dynamics, yielding thus an ultimate uniform bounded solution. Finally, all proposed schemes are validated in simulation and experimentally on the humanoid robot NAO.

Bi-manual picking up of objects to toss them on a conveyor belt are dynamic manipulation activities generated daily in the industry. Such repetitive and physically demanding tasks are still done largely by humans for lack of similarly fast, precise, and robust bi-manual robotic systems. With nowadays booming of e-commerce, the needs for faster package handling solutions continue to increase. Hence, automation and robotics is the only viable solution as the current workforce cannot keep up with the growing industry demands. In current applications, however, robots usually use quasi-static approaches (with near zero relative velocities) to grab and release objects, mainly to avoid impacts. Thus, this thesis aims to develop dynamic alternative solutions to quasi-static manipulation approaches with the goal to accelerate object handling operations and improve their energy efficiency. It focuses on bi-manual (dual-arm) robotic manipulation for its potential to mimic humans' dexterity. To achieve its goal, the thesis considers different scenarios with two types of bi-manual systems: a biped humanoid robot and a pair of fixed base robot manipulators. The first part of the thesis starts by endowing the humanoid robot with balance and locomotion abilities needed for dual-arm cooperative tasks. It proposes a reactive locomotion controller that exploits the capture point dynamics to generate on-the-fly adjustable omnidirectional walking patterns that are consistent with balance constraints. In the second part, the whole body of the humanoid robot is controlled to accomplish bi-manual motion coordination and cooperative compliant manipulation tasks. The proposed approach relies on dynamical systems and exploits a shrinkable virtual object concept with its associated constraints to achieve robust coordination of the robotic hands with smooth transitions between non-contact and contact motion phases. The framework uses quadratic programming (QP) to generate constraint-consistent interaction wrenches that stabilize the grasp and perform the desired manipulation tasks. The third part of the thesis considers more dynamic interactions of the dual-arm system with the objects by allowing the grabbing and releasing of objects with non-zero relative velocities. Such an approach, besides speeding up the task, offers the possibility to expand the robot's reach beyond its physical boundaries. Thus, a unified coordination framework based on modulated dynamical systems is proposed for reaching, grabbing with impact, and tossing objects in one swipe. It is based on modulated dynamical systems that ensure motion continuity and robustness throughout the task. The last part of the thesis extends the dynamic framework by enabling the precise tossing of objects onto a moving target carried by a conveyor belt. It uses a learned inverse throwing map within a kinematic-based bi-level optimization to determine feasible tossing parameters required by the task. Moreover, it proposes and uses a model of the tossable workspace to determine intercept locations that yield a high probability of success. Finally, the proposed approaches are validated both in simulation and on real robotic platforms: a humanoid robot iCub and a pair of KUKA LBR (IIWA7 and IIWA14) robots. Kinetic comparisons with the classical pick-and-place strategy are conducted and the results show that the proposed swift pick-and-toss reduces the task duration and the energy expenditure.