Back to Search Start Over

Convert Gestures of Arabic Words into Voice

Authors :
Ali Al-Sherbaz
Shaker K. Ali
Zahoor M. Aydam
Source :
Journal of Physics: Conference Series. 1591:012023
Publication Year :
2020
Publisher :
IOP Publishing, 2020.

Abstract

Gestures are one of the best ways of communication between dumbs and other people using the expression of signs language. In this paper, we suggest an algorithm for recognizing hand gestures of Arabic words (اتمنى لك حیاة سعیدة-اقتباس) to by using dumb (through signs) and convert the sings into voice corresponding to sings words. The proposed algorithm for Convert Gestures of Arabic Words into Voice, record video of gesture (of the dumb person) then convert the video into frames (images), preprocessing for the resulted image must done by remove the noise, resize the images and increase the contrast, then calculate the distance to clustering the words by using (C4.5, k-mean, k- medoid and artificial neural network), calculate the distance (or features) by using Euclidean distance and slope where, there are eighteen features (eight features from Euclidean distance, eight features from slop, Area, and perimeter). The results in the training stage were (C4.5 gave 100%, k-mean gave 95.2% k-medoid gave 91.9% and ANN gave 91.27%). While in the testing stage we used three classifiers (Euclidian Distance, Modify of the Standardize Euclidian Distance and Correlation) and the results show that (Euclidian Distance gave 94.4%, Modify of the Standardize Euclidian Distance gave 100% and Correlation gave 94.4%) We create our database (three videos with 250 frames) for training and one video for testing.

Details

ISSN :
17426596 and 17426588
Volume :
1591
Database :
OpenAIRE
Journal :
Journal of Physics: Conference Series
Accession number :
edsair.doi...........78666c4b3ff631b22ac1c14a90d7357f
Full Text :
https://doi.org/10.1088/1742-6596/1591/1/012023