Virtual tools that carry attributes for interactively specifying intermediate manufacturing processes

Abstract: This paper describes an interactive system for specifying robotic tasks using virtual tools that allow an operator to reach into a live video scene and direct robots to use corresponding real tools in complex scenarios that involve integrating a variety of otherwise autonomous technologies. The attribute rich virtual tools concept provides a human-machine interface that is robust to unanticipated developments and tunable to the specific requirements of a particular task. This Interactive Specification concept is applied to intermediate manufacturing tasks.