Back to Search Start Over

Mixed reality based teleoperation and visualization of surgical robotics

Authors :
Letian Ai
Peter Kazanzides
Ehsan Azimi
Source :
Healthcare Technology Letters, Vol 11, Iss 2-3, Pp 179-188 (2024)
Publication Year :
2024
Publisher :
Wiley, 2024.

Abstract

Abstract Surgical robotics has revolutionized the field of surgery, facilitating complex procedures in operating rooms. However, the current teleoperation systems often rely on bulky consoles, which limit the mobility of surgeons. This restriction reduces surgeons' awareness of the patient during procedures and narrows the range of implementation scenarios. To address these challenges, an alternative solution is proposed: a mixed reality‐based teleoperation system. This system leverages hand gestures, head motion tracking, and speech commands to enable the teleoperation of surgical robots. The implementation focuses on the da Vinci research kit (dVRK) and utilizes the capabilities of Microsoft HoloLens 2. The system's effectiveness is evaluated through camera navigation tasks and peg transfer tasks. The results indicate that, in comparison to manipulator‐based teleoperation, the system demonstrates comparable viability in endoscope teleoperation. However, it falls short in instrument teleoperation, highlighting the need for further improvements in hand gesture recognition and video display quality.

Details

Language :
English
ISSN :
20533713
Volume :
11
Issue :
2-3
Database :
Directory of Open Access Journals
Journal :
Healthcare Technology Letters
Publication Type :
Academic Journal
Accession number :
edsdoj.430f2754e474cc383af39cbb9ed66ae
Document Type :
article
Full Text :
https://doi.org/10.1049/htl2.12079