1. Bidirectional Braille-Speech Communication System for Deafblind Students
- Author
-
Ana Paula Pérez-Aguirre, Iván Arturo Morales-Pérez, Jorge Allan Gómez-Mercado, Rodrigo Alberto Gutiérrez-Martínez, Iván Matehuala-Moran, and Rubén Fuentes-Alvarez
- Abstract
Deaf-blindness is a type of dual disability wherein visual and auditory capabilities are significantly impaired. Special communication methods have been developed for the deaf-blind community. Yet, these methods require that both people involved have prior knowledge and training to successfully communicate, limiting deaf-blind people's social interactions, particularly in academic settings. This paper describes the development of a device that enables two-way communication between a severely deaf-blind user and a hearing person with no prior knowledge of Braille and no additional intermediaries. A Convolutional Neural Network (CNN) scheme for speech recognition was designed and implemented along with the development of an algorithm capable of developing both text-to-speech and Finger-Braille-to-text conversion. Lastly, a system integration via 3D modeling and additive manufacturing was carried out to deliver a functional prototype. The resulting device aims to allow deaf-blind students to send and receive information entirely in finger Braille, using buttons and vibrotactile feedback. In contrast, the hearing tutor receives auditory messages and speaks to reply, making the educational experience as familiar as possible for both parties. Users testing the device achieved an average typing accuracy of over 95% and demonstrated an understanding of commands transmitted through the device's components.
- Published
- 2024