1. A First Evaluation of a Multi-Modal Learning System to Control Surgical Assistant Robots via Action Segmentation
- Author
-
Federica Ferraguti, Riccardo Muradore, Serena Roin, Cristian Secchi, Francesco Setti, Alessio Sozzi, Marcello Bonfe, Giacomo De Rossi, Marco Minelli, and Fabio Falezza
- Subjects
Model-predictive control ,Computer science ,PE6_7 ,Cognitive robotics ,Action segmentation ,Medical robotics ,R-MIS ,NO ,Task (project management) ,action segmentation ,Deterministic automaton ,Control theory ,model-predictive control ,supervisory controller ,PE7_1 ,statecharts ,Robot kinematics ,Artificial neural network ,PE7_10 ,business.industry ,surgical robotics ,Robotics ,cognitive robotics ,Task analysis ,autonomous robotics ,Robot ,Artificial intelligence ,business ,surgical robotics, statecharts, supervisory controller, autonomous robotics - Abstract
The next stage for robotics development is to introduce autonomy and cooperation with human agents in tasks that require high levels of precision and/or that exert considerable physical strain. To guarantee the highest possible safety standards, the best approach is to devise a deterministic automaton that performs identically for each operation. Clearly, such approach inevitably fails to adapt itself to changing environments or different human companions. In a surgical scenario, the highest variability happens for the timing of different actions performed within the same phases. This paper presents a cognitive control architecture that uses a multi-modal neural network trained on a cooperative task performed by human surgeons and produces an action segmentation that provides the required timing for actions while maintaining full phase execution control via a deterministic Supervisory Controller and full execution safety by a velocity-constrained Model-Predictive Controller.
- Published
- 2021
- Full Text
- View/download PDF