Back to Search Start Over

An AI-Based Framework for Translating American Sign Language to English and Vice Versa.

Authors :
Avina, Vijayendra D.
Amiruzzaman, Md
Amiruzzaman, Stefanie
Ngo, Linh B.
Dewan, M. Ali Akber
Source :
Information (2078-2489); Oct2023, Vol. 14 Issue 10, p569, 11p
Publication Year :
2023

Abstract

In this paper, we propose a framework to convert American Sign Language (ASL) to English and English to ASL. Within this framework, we use a deep learning model along with the rolling average prediction that captures image frames from videos and classifies the signs from the image frames. The classified frames are then used to construct ASL words and sentences to support people with hearing impairments. We also use the same deep learning model to capture signs from the people with deaf symptoms and convert them into ASL words and English sentences. Based on this framework, we developed a web-based tool to use in real-life application and we also present the tool as a proof of concept. With the evaluation, we found that the deep learning model converts the image signs into ASL words and sentences with high accuracy. The tool was also found to be very useful for people with hearing impairment and deaf symptoms. The main contribution of this work is the design of a system to convert ASL to English and vice versa. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
20782489
Volume :
14
Issue :
10
Database :
Complementary Index
Journal :
Information (2078-2489)
Publication Type :
Academic Journal
Accession number :
173315215
Full Text :
https://doi.org/10.3390/info14100569