1. Objective evaluation of laparoscopic surgical skills in wet lab training based on motion analysis and machine learning
- Author
-
Ebina, Koki, 1000010399842, Abe, Takashige, 1000090443936, Hotta, Kiyohiko, Higuchi, Madoka, Furumido, Jun, Iwahara, Naoya, 1000040802799, Kon, Masafumi, Miyaji, Kou, Shibuya, Sayaka, Yan, Lingbo, Komizunai, Shunsuke, 1000040374350, Kurashima, Yo, 1000020828305, Kikuchi, Hiroshi, 1000010762536, Matsumoto, Ryuji, 1000060374443, Osawa, Takahiro, Murai, Sachiyo, 1000040554473, Tsujita, Teppei, Sase, Kazuya, Chen, Xiaoshuai, Konno, Atsushi, 1000090250422, Shinohara, Nobuo, Ebina, Koki, 1000010399842, Abe, Takashige, 1000090443936, Hotta, Kiyohiko, Higuchi, Madoka, Furumido, Jun, Iwahara, Naoya, 1000040802799, Kon, Masafumi, Miyaji, Kou, Shibuya, Sayaka, Yan, Lingbo, Komizunai, Shunsuke, 1000040374350, Kurashima, Yo, 1000020828305, Kikuchi, Hiroshi, 1000010762536, Matsumoto, Ryuji, 1000060374443, Osawa, Takahiro, Murai, Sachiyo, 1000040554473, Tsujita, Teppei, Sase, Kazuya, Chen, Xiaoshuai, Konno, Atsushi, 1000090250422, and Shinohara, Nobuo
- Abstract
Background Our aim was to build a skill assessment system, providing objective feedback to trainees based on the motion metrics of laparoscopic surgical instruments. Methods Participants performed tissue dissection around the aorta (tissue dissection task) and renal parenchymal closure (parenchymal-suturing task), using swine organs in a box trainer under a motion capture (Mocap) system. Two experts assessed the recorded movies, according to the formula of global operative assessment of laparoscopic skills (GOALS: score range, 5-25), and the mean scores were utilized as objective variables in the regression analyses. The correlations between mean GOALS scores and Mocap metrics were evaluated, and potential Mocap metrics with a Spearman's rank correlation coefficient value exceeding 0.4 were selected for each GOALS item estimation. Four regression algorithms, support vector regression (SVR), principal component analysis (PCA)-SVR, ridge regression, and partial least squares regression, were utilized for automatic GOALS estimation. Model validation was conducted by nested and repeated k-fold cross validation, and the mean absolute error (MAE) was calculated to evaluate the accuracy of each regression model. Results Forty-five urologic, 9 gastroenterological, and 3 gynecologic surgeons, 4 junior residents, and 9 medical students participated in the training. In both tasks, a positive correlation was observed between the speed-related parameters (e.g., velocity, velocity range, acceleration, jerk) and mean GOALS scores, with a negative correlation between the efficiencyrelated parameters (e.g., task time, path length, number of opening/closing operations) and mean GOALS scores. Among the 4 algorithms, SVR showed the highest accuracy in the tissue dissection task (MAE(median) = 2.2352), and PCA-SVR in the parenchymal-suturing task (MAE(median) = 1.2714), based on 100 iterations of the validation process of automatic GOALS estimation. Conclusion We developed a machine lea
- Published
- 2022