Search

Current robotic endoluminal interventions require surgeons to hold a proximal joystick to control the distal flexible robot under 2-D X-ray guidance. However, the 2-D X-ray image is not intuitive, which not only increases the risk of surgical misoperation but also the workload of surgeons. Moreover, contact teleoperation exposes surgeons to the potentially infectious environment. To address it, this article proposes an augmented-reality-assisted touchless teleoperated robot for endoluminal intervention, called ARei. It aims to provide immersive experiences with augmented information. The robot integrates perceptual information obtained from an electromagnetic (EM) sensor, a shape sensor, and the virtual anatomy into a head-mounted display (HMD). The touchless teleoperation is used to control the robot, with the assistance of gesture recognition technology. Results show that the mean error of the calibration between the HMD and the EM tracking system is 4.67 mm, and the mean distance error between the points measured by the EM sensor and the points obtained by shape reconstruction with calibration is 5.19 mm (3.05%).

Cable-driven continuum manipulators have shown excellent benefits to work for endoluminal intervention. Demand of small diameter for confined anatomy limits the usage of multiple actuations, leading to limited DOFs and bending shapes. To address this problem, this letter proposes a multi-contact-aided continuum manipulator with anisotropic bending shapes. First, contact-aided compliant mechanisms (CCMs) are configured at different locations to introduce the specific constraints to enable the anisotropy. Then, the forward and inverse kinematic models considering contact blocks are built. The reachable workspace of the continuum manipulator is given, and simulation cases are studied to demonstrate the superiority of the proposed manipulator. Finally, a 3D-printed physical prototype is fabricated, and preliminary experiments are conducted to evaluate the model accuracy. Results show an average shape error of 1.98 mm (4.2%) and a maximum of 3.58 mm (7.6%). A robotic bronchoscopy platform integrated with the continuum manipulator is developed to conduct the airway phantom experiments. The shape deviation of the proposed manipulator from the centerline of the bronchus is 31.8% smaller than that of the constant curvature manipulator. The experiments validate the system-level feasibility and effectiveness of the developed continuum manipulator.