Search

Inspection robots, which improve hazard identification and enhance safety management, play a vital role in the examination of high-risk environments in many fields, such as power distribution, petrochemical, and new energy battery factories. Currently, the position precision of the robots is a major barrier to their broad application. Exact kinematic model and control system of the robots is required to improve their location accuracy during movement on the unstructured surfaces. By a virtual engine and digital twins, this study put forward a visualization monitoring and control system framework which can address the difficulties in the intelligent factories while managing a variety of data sources, such as virtual–real integration, real-time feedback, and other issues. To develop a more realistic dynamic model for the robots, we presented a neural-network-based compensation technique for the nonlinear dynamic model parameters of outdoor mobile robots. A physical prototype was applied in the experiments, and the results showed that the system is capable of controlling and monitoring outdoor mobile robots online with good visualization effects and high real-time performance. By boosting the positional accuracy of robots by 18% when navigating obstacles, the proposed precise kinematic model can increase the inspection efficiency of robots. The visualization monitoring and control system enables visual, digital, multi-method, and complete real-time inspections in high-risk factories, such as new energy battery factories, to ensure the safe and stable operations. [ABSTRACT FROM AUTHOR]

Path planning is a core technology for mobile robots. However, existing state-of-the-art methods suffer from issues such as excessive path redundancy, too many turning points, and poor environmental adaptability. To address these challenges, this paper proposes a novel global and local fusion path-planning algorithm. For global path planning, we reduce path redundancy and excessive turning points by designing a new heuristic function and constructing an improved path generation method. For local path planning, we propose an environment-aware dynamic parameter adjustment strategy, incorporating deviation and avoidance dynamic obstacle evaluation factors, thus addressing issues of local optima and timely avoidance of dynamic obstacles. Finally, we fuse those global and local path-planning improvements to form our fusion path-planning algorithm, which can enhance the robot's adaptability to complex scenarios while reducing path redundancy and turning points. Simulation experiments demonstrate that the improved fusion path-planning algorithm not only effectively addresses existing issues but also operates with higher efficiency. [ABSTRACT FROM AUTHOR]

Odor source localization (OSL) technology allows autonomous agents like mobile robots to localize a target odor source in an unknown environment. This is achieved by an OSL navigation algorithm that processes an agent's sensor readings to calculate action commands to guide the robot to locate the odor source. Compared to traditional 'olfaction-only' OSL algorithms, our proposed OSL algorithm integrates vision and olfaction sensor modalities to localize odor sources even if olfaction sensing is disrupted by non-unidirectional airflow or vision sensing is impaired by environmental complexities. The algorithm leverages the zero-shot multi-modal reasoning capabilities of large language models (LLMs), negating the requirement of manual knowledge encoding or custom-trained supervised learning models. A key feature of the proposed algorithm is the 'High-level Reasoning' module, which encodes the olfaction and vision sensor data into a multi-modal prompt and instructs the LLM to employ a hierarchical reasoning process to select an appropriate high-level navigation behavior. Subsequently, the 'Low-level Action' module translates the selected high-level navigation behavior into low-level action commands that can be executed by the mobile robot. To validate our algorithm, we implemented it on a mobile robot in a real-world environment with non-unidirectional airflow environments and obstacles to mimic a complex, practical search environment. We compared the performance of our proposed algorithm to single-sensory-modality-based 'olfaction-only' and 'vision-only' navigation algorithms, and a supervised learning-based 'vision and olfaction fusion' (Fusion) navigation algorithm. The experimental results show that the proposed LLM-based algorithm outperformed the other algorithms in terms of success rates and average search times in both unidirectional and non-unidirectional airflow environments. [ABSTRACT FROM AUTHOR]

Simultaneous Localization And Mapping (SLAM) algorithms play a critical role in autonomous exploration tasks requiring mobile robots to autonomously explore and gather information in unknown or hazardous environments where human access may be difficult or dangerous. However, due to the resource-constrained nature of mobile robots, they are hindered from performing long-term and large-scale tasks. In this paper, we propose an efficient multi-robot dense SLAM system that utilizes a centralized structure to alleviate the computational and memory burdens on the agents (i.e. mobile robots). To enable real-time dense mapping of the agent, we design a lightweight and accurate dense mapping method. On the server, to find correct loop closure inliers, we design a novel loop closure detection method based on both visual and dense geometric information. To correct the drifted poses of the agents, we integrate the dense geometric information along with the trajectory information into a multi-robot pose graph optimization problem. Experiments based on pre-recorded datasets have demonstrated our system's efficiency and accuracy. Real-world online deployment of our system on the mobile vehicles achieved a dense mapping update rate of ∼14 frames per second (fps), a onboard mapping RAM usage of ∼3.4%, and a bandwidth usage of ∼302 KB/s with a Jetson Xavier NX. [ABSTRACT FROM AUTHOR]

Pathfinding is the process of finding the lowest cost route between a pair of points in space. The aforementioned cost can be based on time, distance, the number of required turns, and other individual or complex criteria. Pathfinding in dynamic environments is a complex issue, which has a long history of academic interest. An environment is considered dynamic when its topology may change in real time, often due to human interference. Influence mapping is a solution originating from the field of video games, which was previously used to solve similar problems in virtual environments, but achieved mixed results in real-life scenarios. The purpose of this study was to find whether the algorithm could be used in real indoor environments when combined with information collected by remote sensors. [ABSTRACT FROM AUTHOR]

This article presents a tuned control algorithm for the speed and course of a four-wheeled automobile-type robot as a single nonlinear object, developed by the analytical approach of compensation for the object's dynamics and additive effects. The method is based on assessment of external effects and as a result new, advanced feedback features may appear in the control system. This approach ensures automatic movement of the object with accuracy up to a given reference filter, which is important for stable and accurate control under various conditions. In the process of the synthesis control algorithm, an inverse mathematical model of the robot was built, and reference filters were developed for a closed-loop control system through external effect channels, providing the possibility of physical implementation of the control algorithm and compensation of external effects through feedback. This combined approach allows us to take into account various effects on the robot and ensure its stable control. The developed algorithm provides control of the robot both when moving forward and backward, which expands the capabilities of maneuvering and planning motion trajectories and is especially important for robots working in confined spaces or requiring precise movement into various directions. The efficiency of the algorithm is demonstrated using a computer simulation of a closed-loop control system under various external effects. It is planned to further develop a digital algorithm for implementation on an onboard microcontroller, in order to use the new algorithm in the overall motion control system of a four-wheeled mobile robot. [ABSTRACT FROM AUTHOR]

The foundation of robot autonomous movement is to quickly grasp the position and surroundings of the robot, which SLAM technology provides important support for. Due to the complex and dynamic environments, single-sensor SLAM methods often have the problem of degeneracy. In this paper, a multi-sensor fusion SLAM method based on the LVI-SAM framework was proposed. First of all, the state-of-the-art feature detection algorithm SuperPoint is used to extract the feature points from a visual-inertial system, enhancing the detection ability of feature points in complex scenarios. In addition, to improve the performance of loop-closure detection in complex scenarios, scan context is used to optimize the loop-closure detection. Ultimately, the experiment results show that the RMSE of the trajectory under the 05 sequence from the KITTI dataset and the Street07 sequence from the M2DGR dataset are reduced by 12% and 11%, respectively, compared to LVI-SAM. In simulated complex environments of animal farms, the error of this method at the starting and ending points of the trajectory is less than that of LVI-SAM, as well. All these experimental comparison results prove that the method proposed in this paper can achieve higher precision and robustness performance in localization and mapping within complex environments of animal farms. [ABSTRACT FROM AUTHOR]

This paper presents a rapidly exploring random tree (RRT) algorithm with an effective post waypoint shift, which is suitable for the path planning of a wheeled mobile robot under kinematic constraints. In the growth of the exploring tree, the nearest node that satisfies the kinematic constraints is selected as the parent node. Once the distance between the new node and the target is within a certain threshold, the tree growth stops and a target connection based on minimum turning radius arc is proposed to generate an initial complete random path. The most significant difference from traditional RRT-based methods is that the proposed method optimizes the path based on Dubins curves through a post waypoint shift after a random path is generated, rather than through parent node selection and rewiring during the exploring tree growth. Then, it is proved that the method can obtain an optimal path in terms of the shortest length. The optimized path has good convergence and almost does not depend on the state of the initial random path. The comparative test results show that the proposed method has significant advantages over traditional RRT-based methods in terms of the sampling point number, the tree node number, and the path node number. Subsequently, an efficient method is further proposed to avoid unknown obstacles, which utilizes the original path information and thus effectively improves the new path planning efficiency. Simulations and real-world tests are carried out to demonstrate the effectiveness of this method. [ABSTRACT FROM AUTHOR]

Although grid maps help mobile robots navigate in indoor environments, some lack semantic information that would allow the robot to perform advanced autonomous tasks. In this paper, a semantic map production system is proposed to facilitate indoor mobile robot navigation tasks. The developed system is based on the employment of LiDAR technology and a vision-based system to obtain a semantic map with rich information, and it has been validated using the robot operating system (ROS) and you only look once (YOLO) v3 object detection model in simulation experiments conducted in indoor environments, adopting low-cost, -size, and -memory computers for increased accessibility. The obtained results are efficient in terms of object recognition accuracy, object localization error, and semantic map production precision, with an average map construction accuracy of 78.86%. [ABSTRACT FROM AUTHOR]

Simultaneous localization and mapping, a critical technology for enabling the autonomous driving of vehicles and mobile robots, increasingly incorporates multi-sensor configurations. Inertial measurement units (IMUs), known for their ability to measure acceleration and angular velocity, are widely utilized for motion estimation due to their cost efficiency. However, the inherent noise in IMU measurements necessitates the integration of additional sensors to facilitate spatial understanding for mapping. Visual–inertial odometry (VIO) is a prominent approach that combines cameras with IMUs, offering high spatial resolution while maintaining cost-effectiveness. In this paper, we introduce our uncertainty-aware depth network (UD-Net), which is designed to estimate both depth and uncertainty maps. We propose a novel loss function for the training of UD-Net, and unreliable depth values are filtered out to improve VIO performance based on the uncertainty maps. Experiments were conducted on the KITTI dataset and our custom dataset acquired from various driving scenarios. Experimental results demonstrated that the proposed VIO algorithm based on UD-Net outperforms previous methods with a significant margin. [ABSTRACT FROM AUTHOR]

With the development of automation and intelligent technologies, the demand for autonomous mobile robots in the industry has surged to alleviate labor-intensive tasks and mitigate labor shortages. However, conventional industrial mobile robots' route-tracking algorithms typically rely on passive markers, leading to issues such as inflexibility in changing routes and high deployment costs. To address these challenges, this study proposes a novel approach utilizing active landmarks—battery-powered luminous landmarks that enable robots to recognize and adapt to flexible navigation requirements. However, the reliance on batteries necessitates frequent recharging, prompting the development of an automatic power supply system. This system integrates omnidirectional contact electrodes on mobile robots, allowing to recharge active landmarks without precise positional alignment. Despite these advancements, challenges such as the large size of electrodes and non-adaptive battery charging across landmarks persist, affecting system efficiency. To mitigate these issues, this research focuses on miniaturizing active landmarks and optimizing power distribution among landmarks. The experimental results of this study demonstrated the effectiveness of our automatic power supply method and the high accuracy of landmark detection. Our power distribution calculation method can adaptively manage energy distribution, improving the system's persistence by nearly three times. This study aims to enhance the practicality and efficiency of mobile robot remote control systems utilizing active landmarks by simplifying installation processes and extending operational durations with adaptive and automatic power supply distribution. [ABSTRACT FROM AUTHOR]

Autonomous decision-making is a hallmark of intelligent mobile robots and an essential element of autonomous navigation. The challenge is to enable mobile robots to complete autonomous navigation tasks in environments with mapless or low-precision maps, relying solely on low-precision sensors. To address this, we have proposed an innovative autonomous navigation algorithm called PEEMEF-DARC. This algorithm consists of three parts: Double Actors Regularized Critics (DARC), a priority-based excellence experience data collection mechanism, and a multi-source experience fusion strategy mechanism. The algorithm is capable of performing autonomous navigation tasks in unmapped and unknown environments without maps or prior knowledge. This algorithm enables autonomous navigation in unmapped and unknown environments without the need for maps or prior knowledge. Our enhanced algorithm improves the agent's exploration capabilities and utilizes regularization to mitigate the overestimation of state-action values. Additionally, the priority-based excellence experience data collection module and the multi-source experience fusion strategy module significantly reduce training time. Experimental results demonstrate that the proposed method excels in navigating the unmapped and unknown, achieving effective navigation without relying on maps or precise localization. [ABSTRACT FROM AUTHOR]

Brain-computer interface (BCI) provides direct communication and control between the human brain and physical devices. It is achieved by converting EEG signals into control commands. Such interfaces have significantly improved the lives of disabled individuals suffering from neurological disorders—such as stroke, amyotrophic lateral sclerosis (ALS), and spinal cord injury—by extending their movement range and thereby promoting self-independence. Brain-controlled mobile robots, however, often face challenges in safety and control performance due to the inherent limitations of BCIs. This paper proposes a shared control scheme for brain-controlled mobile robots by utilizing fuzzy logic to enhance safety, control performance, and robustness. The proposed scheme is developed by combining a self-learning neuro-fuzzy (SLNF) controller with an obstacle avoidance controller (OAC). The SLNF controller robustly tracks the user's intentions, and the OAC ensures the safety of the mobile robot following the BCI commands. Furthermore, SLNF is a model-free controller that can learn as well as update its parameters online, diminishing the effect of disturbances. The experimental results prove the efficacy and robustness of the proposed SLNF controller including a higher task completion rate of 94.29% (compared to 79.29%, and 92.86% for Direct BCI and Fuzzy-PID, respectively), a shorter average task completion time of 85.31 s (compared to 92.01 s and 86.16 s for Direct BCI and Fuzzy-PID, respectively), and reduced settling time and overshoot. [ABSTRACT FROM AUTHOR]

Simultaneous Localization and Mapping (SLAM) enables mobile robots to autonomously perform localization and mapping tasks in unknown environments. Despite significant progress achieved by visual SLAM systems in ideal conditions, relying solely on a single robot and point features for mapping in large-scale indoor environments with weak-texture structures can affect mapping efficiency and accuracy. Therefore, this paper proposes a multi-robot collaborative mapping method based on point-line fusion to address this issue. This method is designed for indoor environments with weak-texture structures for localization and mapping. The feature-extraction algorithm, which combines point and line features, supplements the existing environment point feature-extraction method by introducing a line feature-extraction step. This integration ensures the accuracy of visual odometry estimation in scenes with pronounced weak-texture structure features. For relatively large indoor scenes, a scene-recognition-based map-fusion method is proposed in this paper to enhance mapping efficiency. This method relies on visual bag of words to determine overlapping areas in the scene, while also proposing a keyframe-extraction method based on photogrammetry to improve the algorithm's robustness. By combining the Perspective-3-Point (P3P) algorithm and Bundle Adjustment (BA) algorithm, the relative pose-transformation relationships of multi-robots in overlapping scenes are resolved, and map fusion is performed based on these relative pose relationships. We evaluated our algorithm on public datasets and a mobile robot platform. The experimental results demonstrate that the proposed algorithm exhibits higher robustness and mapping accuracy. It shows significant effectiveness in handling mapping in scenarios with weak texture and structure, as well as in small-scale map fusion. [ABSTRACT FROM AUTHOR]

In the traditional Deep Deterministic Policy Gradient (DDPG) algorithm, path planning for mobile robots in mapless environments still encounters challenges regarding learning efficiency and navigation performance, particularly adaptability and robustness to static and dynamic obstacles. To address these issues, in this study, an improved algorithm frame was proposed that designs the state and action spaces, and introduces a multi-step update strategy and a dual-noise mechanism to improve the reward function. These improvements significantly enhance the algorithm's learning efficiency and navigation performance, rendering it more adaptable and robust in complex mapless environments. Compared to the traditional DDPG algorithm, the improved algorithm shows a 20% increase in the stability of the navigation success rate with static obstacles along with a 25% reduction in pathfinding steps for smoother paths. In environments with dynamic obstacles, there is a remarkable 45% improvement in success rate. Real-world mobile robot tests further validated the feasibility and effectiveness of the algorithm in true mapless environments. [ABSTRACT FROM AUTHOR]

In recent years, with the widespread application of indoor inspection robots, high-precision, robust environmental perception has become essential for robotic mapping. Addressing the issues of visual–inertial estimation inaccuracies due to redundant pose degrees of freedom and accelerometer drift during the planar motion of mobile robots in indoor environments, we propose a visual SLAM perception method that integrates wheel odometry information. First, the robot's body pose is parameterized in SE(2) and the corresponding camera pose is parameterized in SE(3). On this basis, we derive the visual constraint residuals and their Jacobian matrices for reprojection observations using the camera projection model. We employ the concept of pre-integration to derive pose-constraint residuals and their Jacobian matrices and utilize marginalization theory to derive the relative pose residuals and their Jacobians for loop closure constraints. This approach solves the nonlinear optimization problem to obtain the optimal pose and landmark points of the ground-moving robot. A comparison with the ORBSLAM3 algorithm reveals that, in the recorded indoor environment datasets, the proposed algorithm demonstrates significantly higher perception accuracy, with root mean square error (RMSE) improvements of 89.2% in translation and 98.5% in rotation for absolute trajectory error (ATE). The overall trajectory localization accuracy ranges between 5 and 17 cm, validating the effectiveness of the proposed algorithm. These findings can be applied to preliminary mapping for the autonomous navigation of indoor mobile robots and serve as a basis for path planning based on the mapping results. [ABSTRACT FROM AUTHOR]

Interest in deploying deep reinforcement learning (DRL) models on low-power edge devices, such as Autonomous Mobile Robots (AMRs) and Internet of Things (IoT) devices, has seen a significant rise due to the potential of performing real-time inference by eliminating the latency and reliability issues incurred from wireless communication and the privacy benefits of processing data locally. Deploying such energy-intensive models on power-constrained devices is not always feasible, however, which has led to the development of model compression techniques that can reduce the size and computational complexity of DRL policies. Policy distillation, the most popular of these methods, can be used to first lower the number of network parameters by transferring the behavior of a large teacher network to a smaller student model before deploying these students at the edge. This works well with deterministic policies that operate using discrete actions. However, many real-world tasks that are power constrained, such as in the field of robotics, are formulated using continuous action spaces, which are not supported. In this work, we improve the policy distillation method to support the compression of DRL models designed to solve these continuous control tasks, with an emphasis on maintaining the stochastic nature of continuous DRL algorithms. Experiments show that our methods can be used effectively to compress such policies up to 750% while maintaining or even exceeding their teacher's performance by up to 41% in solving two popular continuous control tasks. [ABSTRACT FROM AUTHOR]

As robots become increasingly common in human-populated environments, they must be perceived as social beings and behave socially. People try to preserve their own space during social interactions with others, and this space depends on a variety of factors, such as individual characteristics or their age. In real-world social spaces, there are many different types of people, and robots need to be more sensitive, especially when interacting with vulnerable subjects such as children. However, the current navigation methods do not consider these differences and apply the same avoidance strategies to everyone. Thus, we propose a new navigation framework that considers different social types and defines appropriate personal spaces for each, allowing robots to respect them. To this end, the robot needs to classify people in a real environment into social types and define the personal space for each type as a Gaussian asymmetric function to respect them. The proposed framework is validated through simulations and real-world experiments, demonstrating that the robot can improve the quality of interactions with people by providing each individual with an adaptive personal space. The proposed costmap layer is available on GitHub. [ABSTRACT FROM AUTHOR]

For successful human–robot collaboration, it is crucial to establish and sustain quality interaction between humans and robots, making it essential to facilitate human–robot interaction (HRI) effectively. The evolution of robot intelligence now enables robots to take a proactive role in initiating and sustaining HRI, thereby allowing humans to concentrate more on their primary tasks. In this paper, we introduce a system known as the Robot-Facilitated Interaction System (RFIS), where mobile robots are employed to perform identification, tracking, re-identification, and gesture recognition in an integrated framework to ensure anytime readiness for HRI. We implemented the RFIS on an autonomous mobile robot used for transporting a patient, to demonstrate proactive, real-time, and user-friendly interaction with a caretaker involved in monitoring and nursing the patient. In the implementation, we focused on the efficient and robust integration of various interaction facilitation modules within a real-time HRI system that operates in an edge computing environment. Experimental results show that the RFIS, as a comprehensive system integrating caretaker recognition, tracking, re-identification, and gesture recognition, can provide an overall high quality of interaction in HRI facilitation with average accuracies exceeding 90% during real-time operations at 5 FPS. [ABSTRACT FROM AUTHOR]

Cognitive scientists believe that adaptable intelligent agents like humans perform spatial reasoning tasks by learned causal mental simulation. The problem of learning these simulations is called predictive world modeling. We present the first framework for a learning open-vocabulary predictive world model (OV-PWM) from sensor observations. The model is implemented through a hierarchical variational autoencoder (HVAE) capable of predicting diverse and accurate fully observed environments from accumulated partial observations. We show that the OV-PWM can model high-dimensional embedding maps of latent compositional embeddings representing sets of overlapping semantics inferable by sufficient similarity inference. The OV-PWM simplifies the prior two-stage closed-set PWM approach to the single-stage end-to-end learning method. CARLA simulator experiments show that the OV-PWM can learn compact latent representations and generate diverse and accurate worlds with fine details like road markings, achieving 69 mIoU over six query semantics on an urban evaluation sequence. We propose the OV-PWM as a versatile continual learning paradigm for providing spatio-semantic memory and learned internal simulation capabilities to future general-purpose mobile robots. [ABSTRACT FROM AUTHOR]

In this paper, we address the trajectory-/target-tracking and obstacle-avoidance problem for nonholonomic mobile robots subjected to diamond-shaped velocity constraints and predefined output performance specifications. The proposed scheme leverages the adaptive performance control to dynamically adjust the user-defined output performance specifications, ensuring compliance with input and safety constraints. A key feature of this approach is the integration of multiple constraints into a single adaptive performance function, governed by a simple adaptive law. Additionally, we introduce a robust velocity estimator with a priori-determined performance attributes to reconstruct the unmeasured trajectory/target velocity. Finally, we validate the effectiveness and robustness of the proposed control scheme, through extensive simulations and a real-world experiment. [ABSTRACT FROM AUTHOR]

Communication between connected objects in the Internet of Things (IoT) often requires secure and reliable authentication mechanisms to verify identities of entities and prevent unauthorized access to sensitive data and resources. Unlike other domains, IoT offers several advantages and opportunities, such as the ability to collect real-time data through numerous sensors. These data contains valuable information about the environment and other objects that, if used, can significantly enhance authentication processes. In this paper, we propose a novel idea to building opportunistic sensor-based authentication factors by leveraging existing IoT sensors in a system of systems approach. The objective is to highlight the promising prospects of opportunistic authentication factors in enhancing IoT security. We claim that sensors can be utilized to create additional authentication factors, thereby reinforcing existing object-to-object authentication mechanisms. By integrating these opportunistic sensor-based authentication factors into multi-factor authentication schemes, IoT security can be substantially improved. We demonstrate the feasibility and effectivenness of our idea through illustrative experiments in a parking entry scenario, involving both mobile robots and cars, achieving high identification accuracy. We highlight the potential of this novel method to improve IoT security and suggest future research directions for formalizing and comparing our approach with existing techniques. [ABSTRACT FROM AUTHOR]

Cooperative localization (CL) for air-to-ground robots in a satellite-denial environment has become a current research hotspot. The traditional distance-based heterogeneous multiple-robot CL method requires at least four unmanned aerial vehicles (UAVs) with known positions. When the number of known-position UAVs in a cluster collaborative network is insufficient, the traditional distance-based CL method has a certain inapplicability. A novel adaptive CL method for air-to-ground robots based on relative distance constraints is proposed in this paper. Based on a dynamically changing number of known-position UAVs in the cluster collaborative network, the adaptive fusion estimation threshold is set. When the number of known-position UAVs in the cluster cooperative network is large, the real-time dynamic topology characteristics of multiple robots' spatial geometric configurations are considered. The optimal spatial geometric configuration between UAVs and unmanned ground vehicles (UGVs) is utilized to achieve a high-precision CL solution for UGVs. Otherwise, in the event that the number of known-position UAVs in a cluster collaborative network is insufficient, distance observation constraint information between UAVs and UGVs is retained in real time. Position observation equations for UGVs' inertial navigation system (INS) have been constructed using inertial-based high-precision relative position constraints and relative distance constraints from historical to current times. The experimental results show that the proposed method achieves adaptive fusion estimation with a dynamically changing number of known-position UAVs in the cluster collaborative network, effectively verifying the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Simultaneous Localization and Mapping (SLAM) is one of the key technologies with which to address the autonomous navigation of mobile robots, utilizing environmental features to determine a robot's position and create a map of its surroundings. Currently, visual SLAM algorithms typically yield precise and dependable outcomes in static environments, and many algorithms opt to filter out the feature points in dynamic regions. However, when there is an increase in the number of dynamic objects within the camera's view, this approach might result in decreased accuracy or tracking failures. Therefore, this study proposes a solution called YPL-SLAM based on ORB-SLAM2. The solution adds a target recognition and region segmentation module to determine the dynamic region, potential dynamic region, and static region; determines the state of the potential dynamic region using the RANSAC method with polar geometric constraints; and removes the dynamic feature points. It then extracts the line features of the non-dynamic region and finally performs the point–line fusion optimization process using a weighted fusion strategy, considering the image dynamic score and the number of successful feature point–line matches, thus ensuring the system's robustness and accuracy. A large number of experiments have been conducted using the publicly available TUM dataset to compare YPL-SLAM with globally leading SLAM algorithms. The results demonstrate that the new algorithm surpasses ORB-SLAM2 in terms of accuracy (with a maximum improvement of 96.1%) while also exhibiting a significantly enhanced operating speed compared to Dyna-SLAM. [ABSTRACT FROM AUTHOR]

Snake robots, also known as apodal robots, are among the most common and versatile modular robots. Primarily due to their ability to move in different patterns, they can evolve in scenarios with several constraints, some of them hardly accessible to other robot configurations. This paper deals with a specific environment constraint where the robot needs to climb a prismatic obstacle, similar to a step. The objective is to carry out simulations of this function, before implementing it in the physical model. To this end, we propose two different algorithms, parameterized by the obstacle dimensions determined by image processing, and both are evaluated in simulated experiments. The results show that both algorithms are viable for testing in real robots, although more complex scenarios still need to be further studied. [ABSTRACT FROM AUTHOR]

Mobile robots play an important role in the industrial Internet of Things (IIoT); they need effective mutual communication between the cloud and themselves when they move in a factory. By using the sensor nodes existing in the IIoT environment as relays, mobile robots and the cloud can communicate through multiple hops. However, the mobility and delay sensitivity of mobile robots bring new challenges. In this paper, we propose a dynamic cooperative transmission algorithm with mutual information accumulation to cope with these two challenges. By using rateless coding, nodes can reduce the delay caused by retransmission under poor channel conditions. With the help of mutual information accumulation, nodes can accumulate information faster and reduce delay. We propose a two-step dynamic algorithm, which can obtain the current routing path with low time complexity. The simulation results show that our algorithm is better than the existing heuristic algorithm in terms of delay. [ABSTRACT FROM AUTHOR]

This paper proposes a solution to the problem of mobile robot navigation and trajectory interpolation in dynamic environments with large scenes. The solution combines a semantic laser SLAM system that utilizes deep learning and a trajectory interpolation algorithm. The paper first introduces some open-source laser SLAM algorithms and then elaborates in detail on the general framework of the SLAM system used in this paper. Second, the concept of voxels is introduced into the occupation probability map to enhance the ability of local voxel maps to represent dynamic objects. Then, in this paper, we propose a PointNet++ point cloud semantic segmentation network combined with deep learning algorithms to extract deep features of dynamic point clouds in large scenes and output semantic information of points on static objects. A descriptor of the global environment is generated based on its semantic information. Closed-loop completion of global map optimization is performed to reduce cumulative error. Finally, T-trajectory interpolation is utilized to ensure the motion performance of the robot and improve the smooth stability of the robot trajectory. The experimental results indicate that the combination of the semantic laser SLAM system with deep learning and the trajectory interpolation algorithm proposed in this paper yields better graph-building and loop-closure effects in large scenes at SIASUN large scene campus. The use of T-trajectory interpolation ensures vibration-free and stable transitions between target points. [ABSTRACT FROM AUTHOR]

Visual Place Recognition (VPR) aims to determine whether a robot or visual navigation system locates in a previously visited place using visual information. It is an essential technology and challenging problem in computer vision and robotic communities. Recently, numerous works have demonstrated that the performance of Convolutional Neural Network (CNN)-based VPR is superior to that of traditional methods. However, with a huge number of parameters, large memory storage is necessary for these CNN models. It is a great challenge for mobile robot platforms equipped with limited resources. Fortunately, Binary Neural Networks (BNNs) can reduce memory consumption by converting weights and activation values from 32-bit into 1-bit. But current BNNs always suffer from gradients vanishing and a marked drop in accuracy. Therefore, this work proposed a BinVPR model to handle this issue. The solution is twofold. Firstly, a feature restoration strategy was explored to add features into the latter convolutional layers to further solve the gradient-vanishing problem during the training process. Moreover, we identified two principles to address gradient vanishing: restoring basic features and restoring basic features from higher to lower layers. Secondly, considering the marked drop in accuracy results from gradient mismatch during backpropagation, this work optimized the combination of binarized activation and binarized weight functions in the Larq framework, and the best combination was obtained. The performance of BinVPR was validated on public datasets. The experimental results show that it outperforms state-of-the-art BNN-based approaches and full-precision networks of AlexNet and ResNet in terms of both recognition accuracy and model size. It is worth mentioning that BinVPR achieves the same accuracy with only 1% and 4.6% model sizes of AlexNet and ResNet. [ABSTRACT FROM AUTHOR]

It is worthwhile to calculate the execution cost of a manipulator for selecting a planning algorithm to generate trajectories, especially for an agricultural robot. Although there are various off-the-shelf trajectory planning methods, such as pursuing the shortest stroke or the smallest time cost, they often do not consider factors synthetically. This paper uses the state-of-the-art Python version of the Robotics Toolbox for manipulator trajectory planning instead of the traditional D–H method. We propose a cost function with mass, iteration, and residual to assess the effort of a manipulator. We realized three inverse kinematics methods (NR, GN, and LM with variants) and verified our cost function's feasibility and effectiveness. Furthermore, we compared it with state-of-the-art methods such as Double A* and MoveIt. Results show that our method is valid and stable. Moreover, we applied LM (Chan λ = 0.1) in mobile operation on our agricultural robot platform. [ABSTRACT FROM AUTHOR]

This paper addresses the issue of how to endow robots with motion skills, flexibility, and adaptability similar to human arms. It innovatively proposes a hybrid-primitive-frame-based robot skill learning algorithm and utilizes the policy improvement with a path integral algorithm to optimize the parameters of the hybrid primitive framework, enabling robots to possess skills similar to human arms. Firstly, the end of the robot is dynamically modeled using an admittance control model to give the robot flexibility. Secondly, the dynamic movement primitives are employed to model the robot's motion trajectory. Additionally, novel stiffness primitives and damping primitives are introduced to model the stiffness and damping parameters in the impedance model. The combination of the dynamic movement primitives, stiffness primitives, and damping primitives is called the hybrid primitive framework. Simulated experiments are designed to validate the effectiveness of the hybrid-primitive-frame-based robot skill learning algorithm, including point-to-point motion under external force disturbance and trajectory tracking under variable stiffness conditions. [ABSTRACT FROM AUTHOR]

The accurate perception of external environment information through the robot foot is crucial for the mobile robot to evaluate its ability to traverse terrain. Adequate foot-end contact signals can provide robust support for robot motion control and decision-making processes. The shape and uncertain rotation of the wheel-legged robot foot end represent a significant challenge to sensing the robot foot-end contact state, which current foot-end sensing schemes cannot solve. This paper presents a sensing method for the tire stress field of wheel-legged robots. A finite element analysis was conducted to study the deformation characteristics of the foot-end tire under force. Based on this analysis, a heuristic contact position estimator was designed that utilizes symmetrical deformation characteristics. Strain sensors, arranged in an array, extract the deformation information on the inner surface of the tire at a frequency of 200 Hz. The contact position estimator reduces the dimensionality of the data and fits the eigenvalues to the estimated contact position. Using support vector regression, the force estimator utilizes the estimated contact position and sensor signal to estimate the normal reaction force, designated as FZ. The sensing system is capable of detecting the contact position on the wheel circumference (with a root mean square error of 1.150°), as well as the normal force of 160 N on the Z axis (with a root mean square error of 6.04%). To validate the efficacy of the sensor detection method, a series of randomized and repeated experiments were conducted on a self-constructed test platform. This novel approach offers a promising avenue for perceiving contact states in wheel-legged robots. [ABSTRACT FROM AUTHOR]

The article discusses the increasing demand for efficient automation in various sectors, such as e-commerce and healthcare, due to factors like the COVID-19 pandemic and aging populations. It highlights the need for innovative solutions in robotics, automation, and sensor systems to address these challenges. The article introduces a collection of fifteen research articles in the field of smart robotics for automation, covering topics such as industrial automation, robot control, mobile robots, environmental sensing, agriculture, and human-robot interaction. These articles offer diverse and innovative approaches to address pressing societal issues through the use of smart robotics and sensor technologies. [Extracted from the article]

For mobile robots, the high-precision integrated calibration and structural robustness of multi-sensor systems are important prerequisites for ensuring healthy operations in the later stage. Currently, there is no well-established validation method for the calibration accuracy and structural robustness of multi-sensor systems, especially for dynamic traveling situations. This paper presents a novel validation method for the calibration accuracy and structural robustness of a multi-sensor mobile robot. The method employs a ground–object–air cooperation mechanism, termed the "ground surface simulation field (GSSF)—mobile robot -photoelectric transmitter station (PTS)". Firstly, a static high-precision GSSF is established with the true north datum as a unified reference. Secondly, a rotatable synchronous tracking system (PTS) is assembled to conduct real-time pose measurements for a mobile vehicle. The relationship between each sensor and the vehicle body is utilized to measure the dynamic pose of each sensor. Finally, the calibration accuracy and structural robustness of the sensors are dynamically evaluated. In this context, epipolar line alignment is employed to assess the accuracy of the evaluation of relative orientation calibration of binocular cameras. Point cloud projection and superposition are utilized to realize the evaluation of absolute calibration accuracy and structural robustness of individual sensors, including the navigation camera (Navcam), hazard avoidance camera (Hazcam), multispectral camera, time-of-flight depth camera (TOF), and light detection and ranging (LiDAR), with respect to the vehicle body. The experimental results demonstrate that the proposed method offers a reliable means of dynamic validation for the testing phase of a mobile robot. [ABSTRACT FROM AUTHOR]

In the domain of mobile robot navigation, conventional path-planning algorithms typically rely on predefined rules and prior map information, which exhibit significant limitations when confronting unknown, intricate environments. With the rapid evolution of artificial intelligence technology, deep reinforcement learning (DRL) algorithms have demonstrated considerable effectiveness across various application scenarios. In this investigation, we introduce a self-exploration and navigation approach based on a deep reinforcement learning framework, aimed at resolving the navigation challenges of mobile robots in unfamiliar environments. Firstly, we fuse data from the robot's onboard lidar sensors and camera and integrate odometer readings with target coordinates to establish the instantaneous state of the decision environment. Subsequently, a deep neural network processes these composite inputs to generate motion control strategies, which are then integrated into the local planning component of the robot's navigation stack. Finally, we employ an innovative heuristic function capable of synthesizing map information and global objectives to select the optimal local navigation points, thereby guiding the robot progressively toward its global target point. In practical experiments, our methodology demonstrates superior performance compared to similar navigation methods in complex, unknown environments devoid of predefined map information. [ABSTRACT FROM AUTHOR]

Extrinsic parameter calibration is the foundation and prerequisite for LiDAR and camera data fusion of the autonomous system. This technology is widely used in fields such as autonomous driving, mobile robots, intelligent surveillance, and visual measurement. The learning-based method is one of the targetless calibrating methods in LiDAR and camera calibration. Due to its advantages of fast speed, high accuracy, and robustness under complex conditions, it has gradually been applied in practice from a simple theoretical model in just a few years, becoming an indispensable and important method. This paper systematically summarizes the research and development of this type of method in recent years. According to the principle of calibration parameter estimation, learning-based calibration algorithms are divided into two categories: accurate calibrating estimation and relative calibrating prediction. The evolution routes and algorithm frameworks of these two types of algorithms are elaborated, and the methods used in the algorithms' steps are summarized. The algorithm mechanism, advantages, limitations, and applicable scenarios are discussed. Finally, we make a summary, pointing out existing research issues and trends for future development. [ABSTRACT FROM AUTHOR]

Robotic inspection is advancing in performance capabilities and is now being considered for industrial applications beyond laboratory experiments. As industries increasingly rely on complex machinery, pipelines, and structures, the need for precise and reliable inspection methods becomes paramount to ensure operational integrity and mitigate risks. AI-assisted autonomous mobile robots offer the potential to automate inspection processes, reduce human error, and provide real-time insights into asset conditions. A primary concern is the necessity to validate the performance of these systems under real-world conditions. While laboratory tests and simulations can provide valuable insights, the true efficacy of AI algorithms and robotic platforms can only be determined through rigorous field testing and validation. This paper aligns with this need by evaluating the performance of one-stage models for object detection in tasks that support and enhance the perception capabilities of autonomous mobile robots. The evaluation addresses both the execution of assigned tasks and the robot's own navigation. Our benchmark of classification models for robotic inspection considers three real-world transportation and logistics use cases, as well as several generations of the well-known YOLO architecture. The performance results from field tests using real robotic devices equipped with such object detection capabilities are promising, and expose the enormous potential and actionability of autonomous robotic systems for fully automated inspection and maintenance in open-world settings. [ABSTRACT FROM AUTHOR]

The development and study of an optimal control method for the problem of controlling the formation of a group of mobile robots is still a current and popular theme of work. However, there are few works that take into account the issues of time synchronization of units in a decentralized group. The motivation for taking up this topic was the possibility of improving the accuracy of the movement of a group of robots by including dynamic time synchronization in the control algorithm. The aim of this work was to develop a two-layer synchronous motion control system for a decentralized group of mobile robots. The system consists of a master layer and a sublayer. The sublayer of the control system performs the task of tracking the reference trajectory using a single robot with a kinematic and dynamic controller. In this layer, the input and output signals are linear and angular velocity. The master layer realizes the maintenance of the desired group formation and synchronization of robots during movement. Consensus tracking and virtual structure algorithms were used to implement this level of control. To verify the correctness of operation and evaluate the quality of control for the proposed proprietary approach, simulation studies were conducted in the MATLAB/Simulink environment, followed by laboratory tests using real robots under ROS. The developed system can successfully find application in transportation and logistics tasks in both civilian and military areas. [ABSTRACT FROM AUTHOR]

In this paper, a planning method based on the spatiotemporal variable-step-size A* algorithm is proposed to address the problem of safe trajectory planning for incremental, wheeled, mobile robots in complex motion scenarios with multiple robots. After constructing the known conditions, the spatiotemporal variable-step-size A* algorithm is first used to perform a collision-avoiding initial spatiotemporal trajectory search, and a variable time step is utilized to ensure that the robot completes the search at the target speed. Subsequently, the trajectory is instantiated using B-spline curves in a numerical optimization considering constraints to generate the final smooth trajectory. The results of simulation tests in a field-shaped, complex, dynamic scenario show that the proposed trajectory planning method is more applicable, and the results indicate higher efficiency compared to the traditional method in the incremental robot trajectory planning problem. [ABSTRACT FROM AUTHOR]

This paper presents a novel robust output feedback control that simultaneously performs both stabilization and trajectory tracking for a class of underactuated nonholonomic systems despite model uncertainties, external disturbance, and the absence of velocity measurement. To solve this challenging problem, a generalized normal form has been successfully created by employing an input–output feedback linearization approach and a change in coordinates (diffeomorphism). This research mainly focuses on the stabilization problem of nonholonomic systems that can be transformed to a normal form and pose several challenges, including (i) a nontriangular normal form, (ii) the internal dynamics of the system are non-affine in control, and (iii) the zero dynamics of the system are not in minimum phase. The proposed scheme utilizes combined backstepping and sliding mode control (SMC) techniques. Furthermore, the full-order high gain observer (HGO) has been developed to estimate the derivative of output functions and internal dynamics. Then, full-order HGO and the backstepping SMC have been integrated to synthesize a robust output feedback controller. A differential-drive type (2,0) the wheeled mobile robot has been considered as an example to support the theoretical results. The simulation results demonstrate that the backstepping SMC exhibits robustness against bounded uncertainties. [ABSTRACT FROM AUTHOR]

The artificial potential field method has efficient obstacle avoidance ability, but this traditional method suffers from local minima, unreasonable paths, and sudden changes in heading angles during obstacle avoidance, leading to rough paths and increased energy consumption. To enable autonomous mobile robots (AMR) to escape from local minimum traps and move along reasonable, smooth paths while reducing travel time and energy consumption, in this paper, an artificial potential field method based on subareas is proposed. First, the optimal virtual subgoal was obtained around the obstacles based on the relationship between the AMR, obstacles, and goal points in the local environment. This was done according to the virtual subgoal benefit function to solve the local minima problem and select a reasonable path. Secondly, when AMR encountered an obstacle, the subarea-potential field model was utilized to solve problems such as path zigzagging and increased energy consumption due to excessive changes in the turning angle; this helped to smooth its planning path. Through simulations and actual testing, the algorithm in this paper demonstrated smoother heading angle changes, reduced energy consumption, and a 10.95% average reduction in movement time when facing a complex environment. This proves the feasibility of the algorithm. [ABSTRACT FROM AUTHOR]

Path planning creates the shortest path from the source to the destination based on sensory information obtained from the environment. Within path planning, obstacle avoidance is a crucial task in robotics, as the autonomous operation of robots needs to reach their destination without collisions. Obstacle avoidance algorithms play a key role in robotics and autonomous vehicles. These algorithms enable robots to navigate their environment efficiently, minimizing the risk of collisions and safely avoiding obstacles. This article provides an overview of key obstacle avoidance algorithms, including classic techniques such as the Bug algorithm and Dijkstra's algorithm, and newer developments like genetic algorithms and approaches based on neural networks. It analyzes in detail the advantages, limitations, and application areas of these algorithms and highlights current research directions in obstacle avoidance robotics. This article aims to provide comprehensive insight into the current state and prospects of obstacle avoidance algorithms in robotics applications. It also mentions the use of predictive methods and deep learning strategies. [ABSTRACT FROM AUTHOR]

Many mobile robotics applications require robots to navigate around humans who may interpret the robot's motion in terms of social attitudes and intentions. It is essential to understand which aspects of the robot's motion are related to such perceptions so that we may design appropriate navigation algorithms. Current works in social navigation tend to strive towards a single ideal style of motion defined with respect to concepts such as comfort, naturalness, or legibility. These algorithms cannot be configured to alter trajectory features to control the social interpretations made by humans. In this work, we firstly present logistic regression models based on perception experiments linking human perceptions to a corpus of linear velocity profiles, establishing that various trajectory features impact human social perception of the robot. Secondly, we formulate a trajectory planning problem in the form of a constrained optimization, using novel constraints that can be selectively applied to shape the trajectory such that it generates the desired social perception. We demonstrate the ability of the proposed algorithm to accurately change each of the features of the generated trajectories based on the selected constraints, enabling subtle variations in the robot's motion to be consistently applied. By controlling the trajectories to induce different social perceptions, we provide a tool to better tailor the robot's actions to its role and deployment context to enhance acceptability. [ABSTRACT FROM AUTHOR]

One of the key challenges in Multi-Spectral Automatic Diagnostic (MAD) robot design is the precise targeting of narrow-angle cameras on a specific part of the equipment. The paper shows that a low-cost MAD robot, whose navigation system is based on open-source ArduRover firmware and a pair of low-cost Ublox F9P GNSS receivers, can inspect the 8 × 4 degree ultraviolet camera bounding the targeting error within 0.5 degrees. To achieve this result, we propose a new targeting procedure that can be implemented without any modifications in ArduRover firmware and outperforms more expensive solutions based on LiDAR SLAM and UWB. This paper will be interesting to the developers of robotic systems for power equipment inspection because it proposes a simple and effective solution for MAD robots' camera targeting and provides the first quantitative analysis of the GNSS reception conditions during power equipment inspection. This analysis is based on the experimental results collected during the inspection of the overhead power transmission lines and equipment inspections on the open switchgear of different power plants. Moreover, it includes not only satellite, dilution of precision, and positioning/heading estimation accuracy but also the direct measurements of angular errors that could be achieved on operating power plants using GNSS-only camera targeting. [ABSTRACT FROM AUTHOR]

This paper describes the development of an in-pipe inspection robot system designed for large-diameter water pipes. The robot is equipped with a Magnetic Flux Leakage (MFL) sensor module. The robot system is intended for pipes with diameters ranging from 900 mm to 1200 mm. The structure of the in-pipe inspection robot consists of the front and rear driving parts, with the inspection module located centrally. The robot is powered by 22 motors, including eight wheels with motors positioned at both the bottom and the top for propulsion. To ensure that the robot's center aligns with that of the pipeline during operation, lifting units have been incorporated. The robot is equipped with cameras and LiDAR sensors at the front and rear to monitor the internal environment of the pipeline. Pipeline inspection is conducted using the MFL inspection modules, and the robot's driving mechanism is designed to execute spiral maneuvers while maintaining contact with the pipeline surface during rotation. The in-pipe inspection robot is configured with wireless communication modules and batteries, allowing for wireless operation. Following its development, the inspection robot underwent driving experiments in actual pipelines to validate its performance. The field test bed used for these experiments is approximately 1 km in length. Results from the driving experiments on the field test bed confirmed the robot's ability to navigate various curvatures and obstacles within the pipeline. It is posited that the use of the developed in-pipe inspection robot can reduce economic costs and enhance the safety of inspectors when examining aging pipes. [ABSTRACT FROM AUTHOR]

In hazardous environments like mining sites, mobile inspection robots play a crucial role in condition monitoring (CM) tasks, particularly by collecting various kinds of data, such as images. However, the sheer volume of collected image samples and existing noise pose challenges in processing and visualizing thermal anomalies. Recognizing these challenges, our study addresses the limitations of industrial big data analytics for mobile robot-generated image data. We present a novel, fully integrated approach involving a dimension reduction procedure. This includes a semantic segmentation technique utilizing the pre-trained VGG16 CNN architecture for feature selection, followed by random forest (RF) and extreme gradient boosting (XGBoost) classifiers for the prediction of the pixel class labels. We also explore unsupervised learning using the PCA-K-means method for dimension reduction and classification of unlabeled thermal defects based on anomaly severity. Our comprehensive methodology aims to efficiently handle image-based CM tasks in hazardous environments. To validate its practicality, we applied our approach in a real-world scenario, and the results confirm its robust performance in processing and visualizing thermal data collected by mobile inspection robots. This affirms the effectiveness of our methodology in enhancing the overall performance of CM processes. [ABSTRACT FROM AUTHOR]

Ultraviolet (UV) radiation has been widely utilized as a disinfection strategy to effectively eliminate various pathogens. The disinfection task achieves complete coverage of object surfaces by planning the motion trajectory of autonomous mobile robots and the UVC irradiation strategy. This introduces an additional layer of complexity to path planning, as every point on the surface of the object must receive a certain dose of irradiation. Nevertheless, the considerable dosage required for virus inactivation often leads to substantial energy consumption and dose redundancy in disinfection tasks, presenting challenges for the implementation of robots in large-scale environments. Optimizing energy consumption of light sources has become a primary concern in disinfection planning, particularly in large-scale settings. Addressing the inefficiencies associated with dosage redundancy, this study proposes a dose coverage planning framework, utilizing MOPSO to solve the multi-objective optimization model for planning UVC dose coverage. Diverging from conventional path planning methodologies, our approach prioritizes the intrinsic characteristics of dose accumulation, integrating a UVC light efficiency factor to mitigate dose redundancy with the aim of reducing energy expenditure and enhancing the efficiency of robotic disinfection. Empirical trials conducted with autonomous disinfecting robots in real-world settings have corroborated the efficacy of this model in deactivating viruses. [ABSTRACT FROM AUTHOR]

Autonomous systems are becoming increasingly relevant in our everyday life. The transportation field is no exception and the smart cities concept raises new tasks and challenges for the development of autonomous systems development which has been progressively researched in literature. One of the main challenges is communication between different traffic objects. For instance, a mobile robot system can work as a standalone autonomous system reacting to a static environment and avoiding obstacles to reach a target. Nevertheless, more intensive communication and decision making is needed when additional dynamic objects and other autonomous systems are present in the same working environment. Traffic is a complicated environment consisting of vehicles, pedestrians, and various infrastructure elements. To apply autonomous systems in this kind of environment it is important to integrate object localization and to guarantee functional and trustworthy communication between each element. To achieve this, various sensors, communication standards, and equipment are integrated via the application of sensor fusion and AI machine learning methods. In this work review of vehicular communication systems is presented. The main focus is the researched sensors, communication standards, devices, machine learning methods, and vehicular-related data to find existing gaps for future vehicular communication system development. In the end, discussion and conclusions are presented. [ABSTRACT FROM AUTHOR]

A Cable-Driven Continuum Robot (CDCR) that consists of a set of identical Cable-Driven Continuum Joint Modules (CDCJMs) is proposed in this paper. The CDCJMs merely produce 2-DOF bending motions by controlling driving cable lengths. In each CDCJM, a pattern-based flexible backbone is employed as a passive compliant joint to generate 2-DOF bending deflections, which can be characterized by two joint variables, i.e., the bending direction angle and the bending angle. However, as the bending deflection is determined by not only the lengths of the driving cables but also the gravity and payload, it will be inaccurate to compute the two joint variables with its kinematic model. In this work, two stretchable capacitive sensors are employed to measure the bending shape of the flexible backbone so as to accurately determine the two joint variables. Compared with FBG-based and vision-based shape-sensing methods, the proposed method with stretchable capacitive sensors has the advantages of high sensitivity to the bending deflection of the backbone, ease of implementation, and cost effectiveness. The initial location of a stretchable sensor is generally defined by its two endpoint positions on the surface of the backbone without bending. A generic shape-sensing model, i.e., the relationship between the sensor reading and the two joint variables, is formulated based on the 2-DOF bending deflection of the backbone. To further improve the accuracy of the shape-sensing model, a calibration method is proposed to compensate for the location errors of stretchable sensors. Based on the calibrated shape-sensing model, a sliding-mode-based closed-loop control method is implemented for the CDCR. In order to verify the effectiveness of the proposed closed-loop control method, the trajectory tracking accuracy experiments of the CDCR are conducted based on a circle trajectory, in which the radius of the circle is 55 mm . The average tracking errors of the CDCR measured by the Qualisys motion capture system under the open-loop and the closed-loop control are 49.23 and 8.40 mm , respectively, which is reduced by 82.94%. [ABSTRACT FROM AUTHOR]

This study develops a comprehensive robotic system, termed the robot cognitive system, for complex environments, integrating three models: the engagement model, the intention model, and the human–robot interaction (HRI) model. The system aims to enhance the naturalness and comfort of HRI by enabling robots to detect human behaviors, intentions, and emotions accurately. A novel dual-arm-hand mobile robot, Mobi, was designed to demonstrate the system's efficacy. The engagement model utilizes eye gaze, head pose, and action recognition to determine the suitable moment for interaction initiation, addressing potential eye contact anxiety. The intention model employs sentiment analysis and emotion classification to infer the interactor's intentions. The HRI model, integrated with Google Dialogflow, facilitates appropriate robot responses based on user feedback. The system's performance was validated in a retail environment scenario, demonstrating its potential to improve the user experience in HRIs. [ABSTRACT FROM AUTHOR]