Search

This paper proposes the force/torque control strategy for the robotized transcranial magnetic stimulation (TMS) system, considering the shape of the TMS coil case. Hybrid position/force control is used to compensate for the error between the current and target position of the coil and to maintain the contact between the coil and the subject’s head. The desired force magnitude of the force control part of the hybrid controller is scheduled by the error between the current and target position of the TMS coil for fast error reduction and the comfort of the subject. Additionally, the torque proportional to the torque acting on the coil’s center is generated to stabilize the contact. Compliance control, which makes the robot adaptive to the environment, stabilizes the coil and head interaction during force/torque control. The experimental results showed that the force controller made the coil generate a relatively large force for a short time (less than 10 s) for the fast error reduction, and a relatively small interaction force was maintained for the contact. They showed that the torque controller made the contact area inside the coil. The experiment also showed that the proposed strategy could be used for tracking a new target point estimated by the neuronavigation system when the head moved slightly.

Reinforcement learning (RL) that autonomously explores optimal control policies has become a crucial direction for developing intelligent robots while Dynamic Movement Primitives (DMPs) serve as a powerful tool for efficiently expressing robot trajectories. This article explores an efficient integration of RL and DMP to enhance the learning efficiency and control performance of reinforcement learning in robot manipulation tasks by focusing on the forms of control actions and their smoothness. A novel approach, DDPG-DMP, is proposed to address the efficiency and feasibility issues in the current RL approaches that employ DMP to generate control actions. The proposed method naturally integrates a DMP-based policy into the actor–critic framework of the traditional RL approach Deep Deterministic Policy Gradient (DDPG) and derives the corresponding update formulas to learn the networks that properly decide the parameters of DMPs. A novel inverse controller is further introduced to adaptively learn the translation from observed states into various robot control signals through DMPs, eliminating the requirement for human prior knowledge. Evaluated on five robot arm control benchmark tasks, DDPG-DMP demonstrates significant advantages in control performance, learning efficiency, and smoothness of robot actions compared to related baselines, highlighting its potential in complex robot control applications.

Objects in cluttered environments may have similar sizes and shapes, which remains a huge challenge for robot grasping manipulation. The existing segmentation methods, such as Mask R-CNN and Yolo-v8, tend to lose the shape details of objects when dealing with messy scenes, and this loss of detail limits the grasp performance of robots in complex environments. This paper proposes a high-performance grasp detection algorithm with a multi-target semantic segmentation model, which can effectively improve a robot’s grasp success rate in cluttered environments. The algorithm consists of two cascades: Semantic Segmentation and Grasp Detection modules (SS-GD), in which the backbone network of the semantic segmentation module is developed by using the state-of-the-art Swin Transformer structure. It can extract the detailed features of objects in cluttered environments and enable a robot to understand the position and shape of the candidate object. To construct the grasp schema SS-GD focused on important vision features, a grasp detection module is designed based on the Squeeze-and-Excitation (SE) attention mechanism, to predict the corresponding grasp configuration accurately. The grasp detection experiments were conducted on an actual UR5 robot platform to verify the robustness and generalization of the proposed SS-GD method in cluttered environments. A best grasp success rate of 91.7% was achieved for cluttered multi-target workspaces.

With the increasing demand for robotic manipulators to operate in complex environments, it is important to develop designs that work in obstacle-rich environments and can navigate around obstacles. This paper aims to demonstrate the capabilities of a bio-inspired, underactuated multilink manipulator in environments with fixed and/or movable obstacles. To simplify the system design, a single rotational actuator is used at the base of the manipulator. We present a modeling method for flexible, multilink underactuated manipulators, including their interaction with obstacles. We also demonstrate how to plan a trajectory for the manipulator in environments with fixed obstacles. The robustness of the manipulator is examined by analyzing the effects of uncertainty in its initial state and the position of obstacles. Next, we demonstrate the performance of the manipulator in environments with movable obstacles and show the advantages of controlling the obstacles’ radii and positions. Lastly, we showcase the process of picking up an object in workspaces with obstacles. All the findings are supported by simulations as well as hardware experiments.

Trampolines are recognized as a valuable tool in exercise and rehabilitation due to their unique properties like elasticity, rebound force, low-impact exercise, and enhancement of posture, balance, and cardiopulmonary function. To quantitatively assess the effects of trampoline exercises, it is essential to estimate factors such as stiffness, elements influencing jump dynamics, and user safety. Previous studies assessing trampoline characteristics had limitations in performing repetitive experiments at various locations on the trampoline. Therefore, this research introduces a robotic system equipped with foot-shaped jigs to evaluate trampoline stiffness and quantitatively measure exercise effects. This system, through automated, repetitive movements at various locations on the trampoline, accurately measures the elastic coefficient and vertical forces. The robot maneuvers based on the coordinates of the trampoline, as determined by its torque and position sensors. The force sensor measures data related to the force exerted, along with the vertical force data at X, Y, and Z coordinates. The model’s accuracy was evaluated using linear regression based on Hooke’s Law, with Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Correlation Coefficient Squared (R-squared) metrics. In the analysis including only the distance between X and the foot-shaped jigs, the average MAE, RMSE, and R-squared values were 17.9702, 21.7226, and 0.9840, respectively. Notably, expanding the model to include distances in X, Y, and between the foot-shaped jigs resulted in a decrease in MAE to 15.7347, RMSE to 18.8226, and an increase in R-squared to 0.9854. The integrated model, including distances in X, Y, and between the foot-shaped jigs, showed improved predictive capability with lower MAE and RMSE and higher R-squared, indicating its effectiveness in more accurately predicting trampoline dynamics, vital in fitness and rehabilitation fields.

We present a novel framework, multi-view unified reinforcement learning for robotic manipulation (MURM), which efficiently utilizes multiple camera views to train a goal-conditioned policy for a robot to perform complex tasks. The MURM framework consists of three main phases: (i) demo collection from an expert, (ii) representation learning, and (iii) offline reinforcement learning. In the demo collection phase, we design a scripted expert policy that uses privileged information, such as Cartesian coordinates of a target and goal, to solve the tasks. We add noise to the expert policy to provide sufficient interactive information about the environment, as well as suboptimal behavioral trajectories. We designed three tasks in a Pybullet simulation environment, including placing an object in a desired goal position and picking up various objects that are randomly positioned in the environment. In the representation learning phase, we use a vector-quantized variational autoencoder (VQVAE) to learn a more structured latent representation that makes it feasible to train for RL compared to high-dimensional raw images. We train VQVAE models for each distinct camera view and define the best viewpoint settings for training. In the offline reinforcement learning phase, we use the Implicit Q-learning (IQL) algorithm as our baseline and introduce a separated Q-functions method and dropout method that can be implemented in multi-view settings to train the goal-conditioned policy with supervised goal images. We conduct experiments in simulation and show that the single-view baseline fails to solve complex tasks, whereas MURM is successful.

Robots operating in household environments should detect and estimate the properties of articulated objects to efficiently perform tasks given by human operators. This paper presents the design and implementation of a system for estimating a point-cloud-based model of a scene, enhanced with information about articulated objects, based on a single RGB-D image. This article describes the neural method used to detect handles, detect and extract fronts, detect rotational joints, and build a point cloud model. It compares various architectures of neural networks to detect handles, the fronts of drawers and cabinets, and estimate rotational joints. In the end, the results are merged to build a 3D model of articulated objects in the environment.

Visual object grasping can be complex when dealing with different shapes, points of view, and environments since the robotic manipulator must estimate the most feasible place to grasp. This work proposes a new selective grasping system using only point clouds of objects. For the selection of the object of interest, a deep learning network for object classification is proposed, named Point Encoder Convolution (PEC). The network is trained with a dataset obtained in a realistic simulator and uses an autoencoder with 1D convolution. The developed grasping algorithm used in the system uses geometry primitives and lateral curvatures to estimate the best region to grasp without previously knowing the object’s point cloud. Experimental results show a success ratio of 94% for a dataset with five classes, and the proposed visual selective grasping system can be executed in around 0.004 s, suitable for tasks that require a low execution time or use low-cost hardware.

Autonomous indoor service robots are affected by multiple factors when they are directly involved in manipulation tasks in daily life, such as scenes, objects, and actions. It is of self-evident importance to properly parse these factors and interpret intentions according to human cognition and semantics. In this study, the design of a semantic representation framework based on a knowledge graph is presented, including (1) a multi-layer knowledge-representation model, (2) a multi-module knowledge-representation system, and (3) a method to extract manipulation knowledge from multiple sources of information. Moreover, with the aim of generating semantic representations of entities and relations in the knowledge base, a knowledge-graph-embedding method based on graph convolutional neural networks is proposed in order to provide high-precision predictions of factors in manipulation tasks. Through the prediction of action sequences via this embedding method, robots in real-world environments can be effectively guided by the knowledge framework to complete task planning and object-oriented transfer.

In the development of digital agriculture, agricultural robots play a unique role and confer numerous advantages in farming production. From the invention of the first industrial robots in the 1950s, robots have begun to capture the attention of both research and industry. Thanks to the recent advancements in computer science, sensing, and control approaches, agricultural robots have experienced a rapid evolution, relying on various cutting-edge technologies for different application scenarios. Indeed, significant refinements have been achieved by integrating perception, decision-making, control, and execution techniques. However, most agricultural robots continue to require intelligence solutions, limiting them to small-scale applications without quantity production because of their lack of integration with artificial intelligence. Therefore, to help researchers and engineers grasp the prevalent research status of agricultural robots, in this review we refer to more than 100 pieces of literature according to the category of agricultural robots under discussion. In this context, we bring together diverse agricultural robot research statuses and applications and discuss the benefits and challenges involved in further applications. Finally, directional indications are put forward with respect to the research trends relating to agricultural robots.

In modern robot applications, there is often a need to manipulate previously unknown objects in an unstructured environment. The field of grasp-planning deals with the task of finding grasps for a given object that can be successfully executed with a robot. The predicted grasps can be evaluated according to certain criteria, such as analytical metrics, similarity to human-provided grasps, or the success rate of physical trials. The quality of a grasp also depends on the task which will be carried out after the grasping is completed. Current task-specific grasp planning approaches mostly use probabilistic methods, which utilize categorical task encoding. We argue that categorical task encoding may not be suitable for complex assembly tasks. This paper proposes a transfer-learning-based approach for task-specific grasp planning for robotic assembly. The proposed method is based on an automated pipeline that quickly and automatically generates a small-scale task-specific synthetic grasp dataset using Graspit! and Blender. This dataset is utilized to fine-tune pre-trained grasp quality convolutional neural networks (GQCNNs). The aim is to train GQCNNs that can predict grasps which do not result in a collision when placing the objects. Consequently, this paper focuses on the geometric feasibility of the predicted grasps and does not consider the dynamic effects. The fine-tuned GQCNNs are evaluated using the Moveit! Task Constructor motion planning framework, which enables the automated inspection of whether the motion planning for a task is feasible given a predicted grasp and, if not, which part of the task is responsible for the failure. Our results suggest that fine-tuning GQCNN models can result in superior grasp-planning performance (0.9 success rate compared to 0.65) in the context of an assembly task. Our method can be used to rapidly attain new task-specific grasp policies for flexible robotic assembly applications.

Being an emerging technology, robotic manipulation has encountered tremendous advancements due to technological developments starting from using sensors to artificial intelligence. Over the decades, robotic manipulation has advanced in terms of the versatility and flexibility of mobile robot platforms. Thus, robots are now capable of interacting with the world around them. To interact with the real world, robots require various sensory inputs from their surroundings, and the use of vision is rapidly increasing nowadays, as vision is unquestionably a rich source of information for a robotic system. In recent years, robotic manipulators have made significant progress towards achieving human-like abilities. There is still a large gap between human and robot dexterity, especially when it comes to executing complex and long-lasting manipulations. This paper comprehensively investigates the state-of-the-art development of vision-based robotic application, which includes the current state, components, and approaches used along with the algorithms with respect to the control and application of robots. Furthermore, a comprehensive analysis of those vision-based applied algorithms, their effectiveness, and their complexity has been enlightened here. To conclude, there is a discussion over the constraints while performing the research and potential solutions to develop a robust and accurate vision-based robot manipulation.

Redundant motion, which is possible when robotic manipulators are over-actuated, can be used to control robot arms for a wide range of tasks. One of the best known methods for controlling redundancy is the null space projection, which assigns a priority while executing desired tasks. However, when the manipulator is projected into null space, its motion would be limited, since the motion is only permitted in the direction that does not interfere with the primary task. In this study, we have analyzed the null space projector matrix to derive the appropriate direction of the redundant motion by quantifying the allowed motion in each direction. As a result, we have found an ellipsoidal boundary, in which the redundant motion is permitted to move. We have named this ellipsoidal boundary as ’null space quality’ in directions. The proposed null space quality shows similar aspects with that of the robot manipulability, but it reveals a decisively different value when the manipulator operates within the null space. The experimental results showed that the robotic manipulator tracked the sinusoidal input trajectory with reduced root mean square (RMS) error by 33.84%. Furthermore, we have demonstrated the obstacle avoidance of a robotic arm utilizing the null space projector while considering the null space quality.

Advances in Robotics are leading to a new generation of assistant robots working in ordinary, domestic settings. This evolution raises new challenges in the tasks to be accomplished by the robots. This is the case for object manipulation where the detect-approach-grasp loop requires a robust recovery stage, especially when the held object slides. Several proprioceptive sensors have been developed in the last decades, such as tactile sensors or contact switches, that can be used for that purpose; nevertheless, their implementation may considerably restrict the gripper’s flexibility and functionality, increasing their cost and complexity. Alternatively, vision can be used since it is an undoubtedly rich source of information, and in particular, depth vision sensors. We present an approach based on depth cameras to robustly evaluate the manipulation success, continuously reporting about any object loss and, consequently, allowing it to robustly recover from this situation. For that, a Lab-colour segmentation allows the robot to identify potential robot manipulators in the image. Then, the depth information is used to detect any edge resulting from two-object contact. The combination of those techniques allows the robot to accurately detect the presence or absence of contact points between the robot manipulator and a held object. An experimental evaluation in realistic indoor environments supports our approach.