Search

In this paper, we present a mechanical hand-tracking system with tactile feedback designed for fine manipulation in teleoperation scenarios. Alternative tracking methods based on artificial vision and data gloves have become an asset for virtual reality interaction. Yet, occlusions, lack of precision, and the absence of effective haptic feedback beyond vibrotactile still appear as a limit for teleoperation applications. In this work, we propose a methodology to design a linkage mechanism for hand pose tracking purposes, preserving complete finger mobility. Presentation of the method is followed by design and implementation of a working prototype, and by evaluation of the tracking accuracy using optical markers. Moreover, a teleoperation experiment involving a dexterous robotic arm and hand was proposed to ten participants. It investigated the effectiveness and repeatability of the hand tracking with combined haptic feedback during a proposed pick and place manipulation tasks.

Background: Human sensorimotor control of dexterous manipulation relies on afferent sensory signals. Explicit tactile feedback is generally not available to prosthetic hand users, who have to rely on incidental information sources to partly close the control loop, resulting in suboptimal performance and manipulation difficulty. Recent studies on non-invasive supplementary sensory feedback indicated that time-discrete vibrational feedback delivered upon relevant mechanical events outperforms continuous tactile feedback. However, we hypothesize that continuous tactile feedback can be more effective in non-routine manipulation tasks (i.e., tasks where the grip force is modified reactively in response to the sensory feedback due to the unpredictable behavior of the manipulated object, such as picking and holding a virtual fragile object) if delivered to highly sensitive areas. We further hypothesize that this continuous tactile feedback is not necessary during all the duration of the manipulation task, since adaptation occurs., Methods: We investigated the effectiveness of continuous tactile feedback in precision manipulation, together with a new sensory feedback policy, where the continuous tactile feedback is gradually removed when the grasp reaches a steady state (namely, transient tactile feedback). We carried out an experiment in a virtual-reality setting with custom tactile feedback devices, which can apply continuous pressure and vibrations, attached to the thumb and index finger. We enrolled 24 healthy participants and instructed them to pick and hold a fragile virtual cube without breaking it. We compared their manipulation performance when using four different sensory feedback methods, i.e., no tactile feedback, discrete vibrations, continuous tactile feedback, and transient tactile feedback. The latter consisted of gradually removing the continuous feedback in the static phase of the grasp., Results: Continuous tactile feedback leads to a significantly larger number of successful trials than discrete vibrational cues and no feedback conditions, yet the gradual removal of the continuous feedback yields to comparable outcomes. Moreover, the participants preferred the continuous stimuli over the vibrational cues and the removal in the static phase did not significantly impact their appreciation of the continuous tactile feedback., Conclusions: These results advocate for the use of continuous supplementary tactile feedback for fine manipulation control and indicate that it can seamlessly be removed in the static phase of the grasp, possibly due to the mechanism of sensory adaptation. This encourages the development of energy-efficient supplementary feedback devices for prosthetic and telemanipulation applications, where encumbrance and power consumption are burdensome constraints.

The use of robotic devices to provide active motor support and sensory feedback of ongoing motor intention, by means of a Brain Computer Interface (BCI), has received growing support by recent literature, with particular focus on neurorehabilitation therapies. At the same time, performance in the use of the BCI has become a more critical factor, since it directly influences congruency and consistency of the provided sensory feedback. As motor imagery is the mental simulation of a given movement without depending on residual function, training of patients in the use of motor imagery BCI can be extended beyond each rehabilitation session, and practiced by using simpler devices than rehabilitation robots available in the hospital. In this work, we investigated the use of haptic stimulation provided by vibrating electromagnetic motors to enhance BCI system training. The BCI is based on motor imagery of hand grasping and designed to operate a hand exoskeleton. We investigated whether haptic stimulation at fingerpads proves to be more effective than stimulation at wrist, already experimented in literature, due to the higher density of mechano-receptors. Our results did not show significant differences between the two body locations in BCI performance, yet a wider and more stable event-relateddesynchronization appeared for the finger-located stimulation. Future investigations will put in relation training with haptic feedback at fingerpads with BCI performance using the handexoskeleton, in grasping tasks that naturally involve haptic feedback at fingerpads.