Search

People with severe motor impairments like tetraplegia are restricted in activities of daily living (ADL) and are dependent on continuous human assistance. Assistive robots perform physical tasks in the context of ADLs to support people in need of assistance. In this work a sensor fusion algorithm and a robot control algorithm for localizing the user’s mouth and autonomously navigating a robot arm are proposed for the assistive drinking task. The sensor fusion algorithm is implemented in a visual tracking system which consists of a 2-D camera and a single point time-of-flight distance sensor. The sensor fusion algorithm utilizes computer vision to combine camera images and distance measurements to achieve reliable localization of the user’s mouth. The robot control algorithm uses visual servoing to navigate a robot-handled drinking cup to the mouth and establish physical contact with the lips. This system features an abort command that is triggered by turning the head and unambiguous tracking of multiple faces which enable safe human robot interaction. A study with nine able-bodied test subjects shows that the proposed system reliably localizes the mouth and is able to autonomously navigate the cup to establish physical contact with the mouth.

The growth of the automated welding sector and emerging technological requirements of Industry 4.0 have driven demand and research into intelligent sensor-enabled robotic systems. The higher production rates of automated welding have increased the need for fast, robotically deployed Non-Destructive Evaluation (NDE), replacing current time-consuming manually deployed inspection. This paper presents the development and deployment of a novel multi-robot system for automated welding and in-process NDE. Full external positional control is achieved in real time allowing for on-the-fly motion correction, based on multi-sensory input. The inspection capabilities of the system are demonstrated at three different stages of the manufacturing process: after all welding passes are complete, between individual welding passes, and during live-arc welding deposition. The specific advantages and challenges of each approach are outlined, and the defect detection capability is demonstrated through inspection of artificially induced defects. The developed system offers an early defect detection opportunity compared to current inspection methods, drastically reducing the delay between defect formation and discovery. This approach would enable in-process weld repair, leading to higher production efficiency, reduced rework rates and lower production costs.

Technological advances in recent years have shown interest in the development of robots in the medical field. The integration of robotic systems in areas of assistance and rehabilitation improves the user’s quality of life. In this context, this article presents a proposal for the unified control of a robotic standing wheelchair. Considering primary and secondary tasks as control objectives, the system performs tasks autonomously and the change of position and orientation can be performed at any time. The development of the control scheme was divided in two parts: (i) kinematic controller to solve the desired motion problem, and (ii) dynamic compensation of the standing wheelchair–human system. The design of the two controllers considers the theory of linear algebra, proposing a low computational cost and an asymptotically stable algorithm, without disturbances. The stability and robustness analysis of the system is performed by analyzing the evolution of the control errors in each sampling period. Finally, real experiments of the performance of the developed controller are performed using a built and instrumented standing wheelchair.

Collaborative part transportation is an interesting application as many industrial sectors require moving large parts among different areas of the workshops, using a large amount of the workforce on this tasks. Even so, the implementation of such kinds of robotic solutions raises technical challenges like force-based control or robot-to-human feedback. This paper presents a path-driven mobile co-manipulation architecture, proposing an algorithm that deals with all the steps of collaborative part transportation. Starting from the generation of force-based twist commands, continuing with the path management for the definition of safe and collaborative areas, and finishing with the feedback provided to the system users, the proposed approach allows creating collaborative lanes for the conveyance of large components. The implemented solution and performed tests show the suitability of the proposed architecture, allowing the creation of a functional robotic system able to assist operators transporting large parts on workshops. This work has received funding from the European Union Horizon 2020 research and innovation programme as part of the project SHERLOCK under grant agreement No 820689.

Vehicle Logo Recognition (VLR) is an important part of vehicle behavior analysis and can provide supplementary information for vehicle identification, which is an essential research topic in robotic systems. However, the inaccurate extraction of vehicle logo candidate regions will affect the accuracy of logo recognition. Additionally, the existing methods have low recognition rate for most small vehicle logos and poor performance under complicated environments. A VLR method based on enhanced matching, constrained region extraction and SSFPD network is proposed in this paper to solve the aforementioned problems. A constrained region extraction method based on segmentation of the car head and car tail is proposed to accurately extract the candidate region of logo. An enhanced matching method is proposed to improve the detection performance of small objects, which augment each of training images by copy-pasting small objects many times in the unconstrained region. A single deep neural network based on a reduced ResNeXt model and Feature Pyramid Networks is proposed in this paper, which is named as Single Shot Feature Pyramid Detector (SSFPD). The SSFPD uses the reduced ResNeXt to improve classification performance of the network and retain more detailed information for small-sized vehicle logo detection. Additionally, it uses the Feature Pyramid Networks module to bring in more semantic context information to build several high-level semantic feature maps, which effectively improves recognition performance. Extensive evaluations have been made on self-collected and public vehicle logo datasets. The proposed method achieved 93.79% accuracy on the Common Vehicle Logos Dataset and 99.52% accuracy on another public dataset, respectively, outperforming the existing methods.

The use of robots has increased significantly in the recent years; rapidly expending to numerous applications. These sophisticated machines are susceptible to different types of faults that might endanger the robot or its surroundings. These faults must be detected and diagnosed in time to allow continual operation. The field of Fault Detection and Diagnosis (FDD) has been studied for many years. This research has given birth to many approaches that are applicable to different types of physical machines. However, the domain of robotics poses unique requirements that challenge traditional FDD approaches. The study of FDD for robotics is relatively new; only few surveys were presented. These surveys have focused on the single robot scenario. To the best of our knowledge, there is no survey that focuses on FDD for Multi-Robot Systems (MRS). In this paper we set out to fill this gap. This paper provides detailed insights to the world of FDD for MRS. We first describe how different attributes of MRS pose different challenges for FDD. With respect to these challenges, we survey different FDD approaches applicable for MRS. We conclude with a description of research opportunities in this field. With these contributions it is the authors’ intention to provide detailed insights to the world of FDD for MRS.

Behavior analysis through posture recognition is an essential research in robotic systems. Sitting with unhealthy sitting posture for a long time seriously harms human health and may even lead to lumbar disease, cervical disease and myopia. Automatic vision-based detection of unhealthy sitting posture, as an example of posture detection in robotic systems, has become a hot research topic. However, the existing methods only focus on extracting features of human themselves and lack understanding relevancies among objects in the scene, and henceforth fail to recognize some types of unhealthy sitting postures in complicated environments. To alleviate these problems, a scene recognition and semantic analysis approach to unhealthy sitting posture detection in screen-reading is proposed in this paper. The key skeletal points of human body are detected and tracked with a Microsoft Kinect sensor. Meanwhile, a deep learning method, Faster R-CNN, is used in the scene recognition of our method to accurately detect objects and extract relevant features. Then our method performs semantic analysis through Gaussian-Mixture behavioral clustering for scene understanding. The relevant features in the scene and the skeletal features extracted from human are fused into the semantic features to discriminate various types of sitting postures. Experimental results demonstrated that our method accurately and effectively detected various types of unhealthy sitting postures in screen-reading and avoided error detection in complicated environments. Compared with the existing methods, our proposed method detected more types of unhealthy sitting postures including those that the existing methods could not detect. Our method can be potentially applied and integrated as a medical assistance in robotic systems of health care and treatment.

The great demographic change leading to an ageing society demands technological solutions to satisfy the increasing varied elderly needs. This paper presents PHAROS, an interactive robot system that recommends and monitors physical exercises designed for the elderly. The aim of PHAROS is to be a friendly elderly companion that periodically suggests personalised physical activities, promoting healthy living and active ageing. Here, it is presented the PHAROS architecture, components and experimental results. The architecture has three main strands: a Pepper robot, that interacts with the users and records their exercises performance, the Human Exercise Recognition, that uses the Pepper recorded information to classify the exercise performed using Deep Leaning methods, and the Recommender, a smart-decision maker that schedules periodically personalised physical exercises in the users&rsquo, agenda. The experimental results show a high accuracy in terms of detecting and classifying the physical exercises (97.35%) done by 7 persons. Furthermore, we have implemented a novel procedure of rating exercises on the recommendation algorithm. It closely follows the users&rsquo, health status (poor performance may reveal health problems) and adapts the suggestions to it. The history may be used to access the physical condition of the user, revealing underlying problems that may be impossible to see otherwise.

Currently, the uses of robotics are limited with respect to performance capabilities. Improving the performance of robotic mechanisms is and still will be the main research topic in the next decade. In this paper, design and integration for improving performance of robotic systems are achieved through three different approaches, i.e., structure synthesis design approach, dynamic balancing approach, and adaptive control approach. The purpose of robotic mechanism structure synthesis design is to propose certain mechanism that has better kinematic and dynamic performance as compared to the old ones. For the dynamic balancing design approach, it is normally accomplished based on employing counterweights or counter-rotations. The potential issue is that more weight and inertia will be included in the system. Here, reactionless based on the reconfiguration concept is put forward, which can address the mentioned problem. With the mechanism reconfiguration, the control system needs to be adapted thereafter. One way to address control system adaptation is by applying the “divide and conquer” methodology. It entails modularizing the functionalities: breaking up the control functions into small functional modules, and from those modules assembling the control system according to the changing needs of the mechanism.

The source localization of gas leaks is important to avoid any potential danger to the surroundings or the probable waste of resources. Currently there are several localization methods using robotic systems that try to find the origin of a gas plume. Many of these methods require wind velocity information involving the use of commercial anemometric systems which are extremely expensive compared to metal oxide gas sensors. This article proposes the validation of the Gaussian plume model inside an empty room and its application to localize the source of a gas plume without employing anemometric sensors, exclusively using concentration data. The model was selected due to its simplicity and since it easily admits variants closer to reality, explaining the behavior of pollutants transported by the wind. An artificial gas source was generated by a conventional fan and liquid ethanol as contaminant. We found that the physical fan, far from making the model impossible to implement, enriched the information and added realism. The use of a robotic system capable of autonomously mapping the room concentration distribution is described. The results showed that the Gaussian plume model is applicable to localize our experimental gas source. An estimated position of the source with a deviation of 14 cm (6.1%) was obtained.

In this research a fully sensorized cooperative robot system for manipulation of needles is presented. The setup consists of a DLR/KUKA Light Weight Robot III especially designed for safe human/robot interaction, a FD-CT robot-driven angiographic C-arm system, and a navigation camera. Also, new control strategies for robot manipulation in the clinical environment are introduced. A method for fast calibration of the involved components and the preliminary accuracy tests of the whole possible errors chain are presented. Calibration of the robot with the navigation system has a residual error of 0.81 mm (rms) with a standard deviation of ± 0.41 mm. The accuracy of the robotic system while targeting fixed points at different positions within the workspace is of 1.2 mm (rms) with a standard deviation of ± 0.4 mm. After calibration, and due to close loop control, the absolute positioning accuracy was reduced to the navigation camera accuracy which is of 0.35 mm (rms). The implemented control allows the robot to compensate for small patient movements.

© 2016 by the authors; licensee MDPI, Basel, Switzerland. This paper presents a multi-axis force/torque sensor based on simply-supported beam and optoelectronic technology. The sensor’s main advantages are: (1) Low power consumption, (2) low-level noise in comparison with conventional methods of force sensing (e.g., using strain gauges), (3) the ability to be embedded into different mechanical structures, (4) miniaturisation, (5) simple manufacture and customisation to fit a wide-range of robot systems, and (6) low-cost fabrication and assembly of sensor structure. For these reasons, the proposed multi-axis force/torque sensor can be used in a wide range of application areas including medical robotics, manufacturing, and areas involving human-robot interaction. This paper shows the application of our concept of a force/torque sensor to flexible continuum manipulators: A cylindrical MIS (Minimally Invasive Surgery) robot, and includes its design, fabrication, and evaluation tests. The research leading to these results has received funding from the European Commission’s Seventh Framework Programme; project STIFF-FLOP (Grant No. 287728), and has received funding from the Wellcome Trust IEH Award (Grant No. 102431).

With the advent of the Fourth Industrial Revolution, Internet of Things (IoT) and robotic systems are closely cooperating, reshaping their relations and managing to develop new-generation devices. Such disruptive technology corresponds to the backbone of the so-called Industry 4.0. The integration of robotic agents and IoT leads to the concept of the Internet of Robotic Things, in which innovation in digital systems is drawing new possibilities in both industrial and research fields, covering several domains such as manufacturing, agriculture, health, surveillance, and education, to name but a few. In this manuscript, the state-of-the-art of IoRT applications is outlined, aiming to mark their impact on several research fields, and focusing on the main open challenges of the integration of robotic technologies into smart spaces. IoRT technologies and applications are also discussed to underline their influence in everyday life, inducing the need for more research into remote and automated applications.