Back to Search
Start Over
An Environmental Perception and Navigational Assistance System for Visually Impaired Persons Based on Semantic Stixels and Sound Interaction
- Source :
- SMC
- Publication Year :
- 2018
- Publisher :
- IEEE, 2018.
-
Abstract
- Assistive technologies aim at enhancing personal mobility of individuals with disabilities to improve their independence and access to social life. For the visually impaired, perception during navigation comprises a major ingredient of independent living. With the development of computer vision, it is possible to meet the richer needs of visually impaired people. However, research on navigation assistance for the visually impaired is still relatively unexplored when compared with the active progress in autonomous driving which is already in full swing. In respond to this issue, we aim to leverage the study of the Stixel-World for automotive systems and transfer it to develop assistive technology for visually impaired people. The impressive research results of deep learning also suppose benefits for vision-based technology. Precisely, semantic segmentation is a task that enables identification of different objects uniformly. Inspired by these observations, we design a set of wearable visual aids, while the core algorithm is based on the stixel representations for three-dimensional world combined with pixel-wise semantic segmentation. Predetermined conditions for stixels in automotive research, such as camera angles, position fixes, and unsuitable assumptions made about the real world are optimized to fit the needs of navigation assistance in our algorithm, along with the incorporation of traversability-related semantic information. We also propose a sound mapping scheme, so that the environmental awareness about geographic and semantic information are conveyed to the visually impaired through acoustic feedback.
- Subjects :
- Computer science
business.industry
Deep learning
media_common.quotation_subject
010401 analytical chemistry
Personal mobility
Wearable computer
02 engineering and technology
01 natural sciences
0104 chemical sciences
Identification (information)
Human–computer interaction
Perception
0202 electrical engineering, electronic engineering, information engineering
020201 artificial intelligence & image processing
Artificial intelligence
Set (psychology)
business
media_common
Subjects
Details
- Database :
- OpenAIRE
- Journal :
- 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)
- Accession number :
- edsair.doi...........6acc568010018bd8540618a25179588e