Back to Search Start Over

Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine Vision

Authors :
Minas Dasygenis
Nikolaos Baras
George Nantzios
Source :
Automation, Vol 2, Iss 15, Pp 238-251 (2021)
Publication Year :
2021
Publisher :
MDPI AG, 2021.

Abstract

It is evident that the technological growth of the last few decades has signaled the development of several application domains. One application domain that has expanded massively in recent years is robotics. The usage and spread of robotic systems in commercial and non-commercial environments resulted in increased productivity, efficiency, and higher quality of life. Many researchers have developed systems that improve many aspects of people’s lives, based on robotics. Most of the engineers use high-cost robotic arms, which are usually out of the reach of typical consumers. We fill this gap by presenting a low-cost and high-accuracy project to be used as a robotic assistant for every consumer. Our project aims to further improve people’s quality of life, and more specifically people with physical and mobility impairments. The robotic system is based on the Niryo-One robotic arm, equipped with a USB (Universal Serial Bus) HD (High Definition) camera on the end-effector. To achieve high accuracy, we modified the YOLO algorithm by adding novel features and additional computations to be used in the kinematic model. We evaluated the proposed system by conducting experiments using PhD students of our laboratory and demonstrated its effectiveness. The experimental results indicate that the robotic arm can detect and deliver the requested object in a timely manner with a 96.66% accuracy.

Details

ISSN :
26734052
Volume :
2
Database :
OpenAIRE
Journal :
Automation
Accession number :
edsair.doi.dedup.....5068ea6abd5ff5958482d533975e35b5
Full Text :
https://doi.org/10.3390/automation2040015