Search

Your search keyword '"CPV"' showing total 26 results
Start Over Author "CPV" Topic [info.info-hc]computer science [cs]/human-computer interaction [cs.hc]
26 results on '"CPV"'

1. Évaluation d’un dispositif audio-tangible pour l’apprentissage spatial chez les enfants déficients visuels

Author

Julie Mulet, Lachezar Dimitrov, Anna Bartolucci, Mathieu Raynal, Valérie Tartas, Julie Ducasse, M Macé, Marc J., Bernard Oriola, Julie Lemarié, Christophe Jouffrais, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Institut des Jeunes Aveugles [Toulouse] (IJA), Unité de Recherche Interdisciplinaire Octogone-Lordat (Octogone-Lordat), Université Toulouse - Jean Jaurès (UT2J), Cognition, Langues, Langage, Ergonomie (CLLE), École pratique des hautes études (EPHE), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université Toulouse - Jean Jaurès (UT2J)-Centre National de la Recherche Scientifique (CNRS), Centre National de la Recherche Scientifique (CNRS), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Institut Fédératif de Recherche sur les Aides Techniques pour personnes Handicapées (IFRATH), C. Jost, G. Uzan, and Jouffrais, Christophe

Subjects
[SCCO]Cognitive science, enseignement spécialisé, carte interactive, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], [SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology, navigation autonome, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [SCCO] Cognitive science, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], déficiencevisuelle, accessibilité
Abstract

International audience; Cette communication propose une évaluation préliminaire d’un dispositif numérique interactif conçu pour l’exploration de maquette en 3D (application Tangi Space). Ce dispositif associe des retours sonores verbaux et non verbaux à l’exploration d’un plan en Lego d’un bâtiment connu. Ces retours sonores correspondent aux sons réels qui ont été enregistrés dans les locaux: ils se déclenchent lors de l’exploration du plan interactif et ont pour objectif de rendre l’expérience d’exploration plus immersive. L’évaluation préliminaire a été conduite auprès de 5 élèves déficients visuels pris en charge dans un centre spécialisé et d’une instructrice de locomotion. Les performances des élèves ainsi que l’expérience utilisateur vécue pendant l’exploration(mesurées par questionnaire) ont été évaluées et comparées à une condition d’utilisation d’un plan Lego sans retour sonore. Les perceptions de l’instructrice ont été recueillies sur la base d’un entretien. Si les premières mesures ne font pas apparaître de différence entre les deux dispositifs, les commentaires de l’instructrice permettent de considérer les avantages pédagogiques supposés de l’outil, mais aussi quelques difficultés d’utilisation et des interrogations concernant les modalités d’utilisation.

Published
2020

2. Robots for Inclusive Play: Co-designing an Educational Game With Visually Impaired and sighted Children

Author

Oussama Metatla, Sandra Bardot, Marcos Serrano, Christophe Jouffrais, Clare Cullen, School of Electronic Engineering and Computer Science, Queen Mary University of London (QMUL), University of Bristol [Bristol], Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), and Centre National de la Recherche Scientifique (CNRS)

Subjects
Visual impairment, Applied psychology, Context (language use), 02 engineering and technology, Education, [SCCO]Cognitive science, Co-design, 0202 electrical engineering, electronic engineering, information engineering, medicine, Mainstream, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Goal setting, 050107 human factors, Inclusion, 4. Education, 05 social sciences, ComputingMilieux_PERSONALCOMPUTING, 020207 software engineering, Collaborative learning, Social engagement, Focus group, [SCCO.PSYC]Cognitive science/Psychology, Accessibility design and evaluation methods, Visual Impairment, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], medicine.symptom, Games, Psychology, Inclusion (education)
Abstract

This paper has been selected for a Best Paper award at CHI2020.The SIGCHI “Best of CHI” awards honour exceptional submissions to SIGCHI sponsored conferences.A total of 31 Papers received a Best Paper award (top 1% of submissions), 125 papers received Honourable Mention (remaining top 5% of submissions). Process: the Best Paper Committee, which includes the Awards Chairs and 19 committee members (one from each subcommittee), adjudicated the selection of the Best Papers and Honourable Mentions based on nomination scores and paragraphs that were provided by the CHI Associate Chairs.; International audience; Despite being included in mainstream schools, visually impaired children still face barriers to social engagement and participation. Games could potentially help, but games that cater for both visually impaired and sighted players are scarce. We used a co-design approach to design and evaluate a robot-based educational game that could be inclusive of both visually impaired and sighted children in the context of mainstream education. We ran a focus group discussion with visual impairment educators to understand barriers to inclusive play. And then a series of co-design workshops to engage visually impaired and sighted children and educators in learning about robot technology and exploring its potential to support inclusive play experiences. We present design guidelines and an evaluation workshop of a game prototype, demonstrating group dynamics conducive to collaborative learning experiences, including shared goal setting/execution, closely coupled division of labour, and interaction symmetry.

Published
2020

3. Vibrotactile Feedback for Vertical 2D Space Exploration

Author

Simon T. Perrault, Lancelot Dupont, Christophe Jouffrais, Jouffrais, Christophe, École nationale supérieure de physique, électronique, matériaux (Grenoble INP PHELMA), Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA), Singapore University of Technology and Design (SUTD), Laboratoire Cherchons Pour Voir (CPV), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Image & Pervasive Access Lab (IPAL), National University of Singapore (NUS)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-Agency for science, technology and research [Singapore] (A*STAR)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], Centre National de la Recherche Scientifique (CNRS), and Yale-NUS College

Subjects
FOS: Computer and information sciences, Computer science, Computer Science - Human-Computer Interaction, [SCCO.COMP]Cognitive science/Computer science, Wearable computer, wearable computing, 02 engineering and technology, Space (commercial competition), Space exploration, Human-Computer Interaction (cs.HC), [SCCO]Cognitive science, [SCCO.COMP] Cognitive science/Computer science, Position (vector), Human–computer interaction, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Everyday life, object acquisition, 050107 human factors, Horizontal axis, visually impaired users, 05 social sciences, Work (physics), 020207 software engineering, [SCCO] Cognitive science, Object (computer science), Vibrotactile feedback, [SCCO.PSYC]Cognitive science/Psychology, [SCCO.PSYC] Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC]
Abstract

Visually impaired people encounter many challenges in their everyday life, especially when it comes to navigating and representing space. The issue of shopping is addressed mostly on the level of navigation and product detection, but conveying clues about the object position to the user is rarely implemented. This work presents a prototype of vibrotactile wristband using spatiotemporal patterns to help visually impaired users reach an object in the 2D plane in front of them. A pilot study on twelve blindfolded sighted subjects showed that discretizing space in a seven by seven targets matrix and conveying clues with a discrete pattern on the vertical axis and a continuous pattern on the horizontal axis is an intuitive and effective design., 4+1 pages

Published
2020

4. ALCOVE

Author

Bernard Oriola, Frédéric Rayar, Christophe Jouffrais, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre National de la Recherche Scientifique (CNRS), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Centre National de la Recherche Scientifique - CNRS (FRANCE), Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), Université de Tours (FRANCE), and Institut de Recherche en Informatique de Toulouse - IRIT (Toulouse, France)

Subjects
Activities of daily living, Computer science, media_common.quotation_subject, Internet privacy, Visual impairment, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, Comics, Page layout, [SCCO]Cognitive science, 03 medical and health sciences, Presentation, 0302 clinical medicine, Reading (process), 0202 electrical engineering, electronic engineering, information engineering, medicine, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Recreation, media_common, Evaluation methods, business.industry, Reading mode, 4. Education, 16. Peace & justice, Accessibility design, [SCCO.PSYC]Cognitive science/Psychology, 030221 ophthalmology & optometry, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], 020201 artificial intelligence & image processing, Accessible comics, Low vision people, medicine.symptom, business, Mobile device, Alcove
Abstract

International audience; Low vision is a visual impairment that affects one's capacity to perform daily activities, among others, reading. Since difficulty to access printed materials is an obstacle to education, employment and social activities, adaptations of these material is often required, such as the usage of large print or audio transcriptions. The advent of digital documents, on computers and mobile devices, has enhanced the accessibility of text for people with low vision; however, there is still a lack of supply regarding accessible books for recreation reading. In this work, we study how an accessible reader can impact reader's engagement with comics, for both children and adults. We summarise the results of online surveys that have been conducted about the current usage of comics by reader with low vision and how professional attempt to provide them. This led to the design of ALCOVE, an accessible comic reader for people with low vision. We report the results of a user study with 11 participants with low vision, that examined both the usefulness of the proposed comic reader and the reading presentation mode. Results show that the participants found our application easy and very convenient to use.

Published
2020

5. VibHand: On-Hand Vibrotactile Interface Enhancing Non-Visual Exploration of Digital Graphics

Author

Kaixing Zhao, Bernard Oriola, Christophe Jouffrais, Marcos Serrano, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Image & Pervasive Access Lab (IPAL), National University of Singapore (NUS)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-Agency for science, technology and research [Singapore] (A*STAR)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], and Zhao, Kaixing

Subjects
Vibrotactile interface, Computer Networks and Communications, Computer science, Interface (computing), Visual impairment, 02 engineering and technology, Task (project management), Digital media, Interactive graphics, Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, medicine, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Graphics, Set (psychology), 050107 human factors, business.industry, 05 social sciences, 020207 software engineering, Usability, Tactile display, Accessibility, Human-Computer Interaction, Identification (information), medicine.symptom, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], business, Social Sciences (miscellaneous)
Abstract

This paper has been selected to receive a Best of ISS Honorable Mention Award. The Best of ISS Awards honor exceptional submissions to the conference; receiving an Honorable Mention Award indicates that your paper was identified by the ISS Program Committee Members and ISS Best Paper Committee as being among the top 5% of all submissions to ISS 2020.; International audience; Visual graphics are widely spread in digital media and are useful in many contexts of daily life. However, access to this type of graphical information remains a challenging task for people with visual impairments (VI). In this study, we designed and evaluated an on-hand vibrotactile interface that enables users with VI to explore digital graphics presented on tablets. We first conducted a set of exploratory tests with both people with VI and blindfolded (BF) people to investigate several design factors. We then conducted a comparative experiment to verify that on-hand vibrotactile cues (indicating direction and progression) can enhance the non-visual exploration of digital graphics. The results based on 12 participants with VI and 12 BF participants confirmed the usability of the technique and revealed that the visual status of the users does not impact graphics identification and comparison tasks.

Published
2020

6. Vers l'Utilisation de Tablettes à Picots pour l'Illustration de Livres Tactiles

Author

Carolane Mascle, Christophe Jouffrais, Gwenaël Kaminski, Florence Bara, Jouffrais, Christophe, Cognition, Langues, Langage, Ergonomie (CLLE-LTC), École pratique des hautes études (EPHE), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université Toulouse - Jean Jaurès (UT2J)-Centre National de la Recherche Scientifique (CNRS), Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Cognition, Langues, Langage, Ergonomie (CLLE), and Région Occitanie

Subjects
enfants, [SCCO.COMP]Cognitive science/Computer science, [SCCO] Cognitive science, déficience visuelle, tactile, images, [SCCO]Cognitive science, [SCCO.COMP] Cognitive science/Computer science, [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], [SCCO.PSYC] Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], technologie
Abstract

International audience; Les livres illustrés occupent une place particulière dans le développement de la littéracie précoce des enfants. Chez les enfants déficients visuels, la participation aux activités de lecture augmente lors de l'utilisation de livres tactiles illustrés. Cependant, ces livres sont peu disponibles et les enfants déficients visuels y ont peu accès. Les nouvelles technologies telles que les tablettes à picots physiques peuvent offrir la possibilité de créer et stocker de nombreuses illustrations pour plusieurs livres avec le même dispositif. Nous avons utilisé une tâche d'apprentissage « paired-assiociate learning » pour évaluer la capacité d'enfants voyants (les yeux bandés) et non-voyants à associer des pictogrammes en points en relief à un mot. Les enfants non-voyants montrent de meilleures performances que les enfants voyants et ont été capables de reconnaitre assez rapidement plus de la moitié des pictogrammes. Ces résultats sont encourageants, et devraient être complétés par d'autres études sur l'utilisation de ces stimuli en points en relief.

Published
2020

7. Investigating Feedback for Two-Handed Exploration of Digital Maps Without Vision

Author

Simon T. Perrault, Sandra Bardot, Marcos Serrano, Christophe Jouffrais, Shengdong Zhao, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Singapore University of Technology and Design (SUTD), National University of Singapore (NUS), Image & Pervasive Access Lab (IPAL), National University of Singapore (NUS)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-Agency for science, technology and research [Singapore] (A*STAR)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, Panayiotis Zaphiris, and TC 13

Subjects
Smartwatches, Auditory feedback, Digital mapping, Computer science, business.industry, 05 social sciences, 020207 software engineering, 02 engineering and technology, Accessibility, Wearable devices, [SCCO]Cognitive science, Human–computer interaction, Map exploration, [SCCO.PSYC]Cognitive science/Psychology, Similarity (psychology), 0202 electrical engineering, electronic engineering, information engineering, Users with visual impairment, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], business, Multimodal feedback, 050107 human factors, Wearable technology
Abstract

Part 4: Assistive Technology for Visually Impaired; International audience; Digital Interactive Maps on touch surfaces are a convenient alternative to physical raised-line maps for users with visual impairments. To compensate for the absence of passive tactile information, they provide vibrotactile and auditory feedback. However, this feedback is ambiguous when using multiple fingers since users may not identify which finger triggered it. To address this issue, we explored the use of bilateral feedback, i.e. collocated with each hand, for two-handed map exploration. We first introduced a design space of feedback for two-handed interaction combining two dimensions: spatial location (unilateral vs. bilateral feedback) and similarity (same vs. different feedback). We implemented four techniques resulting from our design space, using one or two smartwatches worn on the wrist (unilateral vs. bilateral feedback respectively). A first study with fifteen blindfolded participants showed that bilateral feedback outperformed unilateral feedback and that feedback similarity has little influence on exploration performance. Then we did a second study with twelve users with visual impairments, which confirmed the advantage of two-handed vs. one-handed exploration, and of bilateral vs. unilateral feedback. The results also bring to light the impact of feedback on exploration strategies.

Published
2019

8. Learning space through cooperation: a study of spatial expressions by sighted and visually impaired children

Author

Kolodziej, Agnieszka, Jouffrais, Christophe, Tartas, Valérie, Cognition, Langues, Langage, Ergonomie (CLLE-LTC), École pratique des hautes études (EPHE), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Université Toulouse - Jean Jaurès (UT2J)-Centre National de la Recherche Scientifique (CNRS), Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Unité de Recherche Interdisciplinaire Octogone-Lordat (Octogone-Lordat), Université Toulouse - Jean Jaurès (UT2J), and Jouffrais, Christophe

Subjects
[SCCO]Cognitive science, [SCCO.COMP] Cognitive science/Computer science, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], [SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology, [SCCO.COMP]Cognitive science/Computer science, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [SCCO] Cognitive science, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], ComputingMilieux_MISCELLANEOUS
Abstract

International audience

Published
2018

9. Inclusive Education Technologies

Author

Marcos Serrano, Stacy M. Branham, Emeline Brulé, Christophe Jouffrais, Shaun K. Kane, Oussama Metatla, Anja Thieme, Cynthia L. Bennett, University of Bristol [Bristol], Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Microsoft Research [Cambridge] (Microsoft), Microsoft Research, University of Colorado [Boulder], University of Maryland [Baltimore County] (UMBC), University of Maryland System, Télécom ParisTech, University of Washington [Seattle], Centre National de la Recherche Scientifique - CNRS (FRANCE), Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE), Télécom Paris (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), University of Bristol (UNITED KINGDOM), University of Maryland (USA), Microsoft (USA), University of Colorado at Boulder - UCB (USA), University of Washington (USA), Institut de Recherche en Informatique de Toulouse - IRIT (Toulouse, France), Institut National Polytechnique de Toulouse - INPT (FRANCE), Telecom ParisTech (FRANCE), School of Electronic Engineering and Computer Science, Queen Mary University of London (QMUL), Université Toulouse 1 Capitole (UT1)-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1)-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Culture Lab [Newcastle], Newcastle University [Newcastle], Département Sciences économiques et sociales (SES), Laboratoire Traitement et Communication de l'Information (LTCI), and Télécom ParisTech-Institut Mines-Télécom [Paris] (IMT)-Centre National de la Recherche Scientifique (CNRS)-Télécom ParisTech-Institut Mines-Télécom [Paris] (IMT)-Centre National de la Recherche Scientifique (CNRS)

Subjects
Knowledge management, Computer science, Best practice, [SCCO.COMP]Cognitive science/Computer science, Engineering Education Research Group, 02 engineering and technology, Space (commercial competition), Education, [SCCO]Cognitive science, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], Visual impairments, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Hobby, ComputingMilieux_MISCELLANEOUS, 050107 human factors, Inclusion, Scope (project management), business.industry, 4. Education, 05 social sciences, 020207 software engineering, Cognition, Accessibility, Apprentissage, Variety (cybernetics), Work (electrical), [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], business, Inclusion (education)
Abstract

International audience; Technology has become central to many activities of learning, ranging from its use in classroom education to work training, mastering a new hobby, or acquiring new skills of living. While digitally-enhanced learning tools can provide valuable access to information and personalised support, people with specific accessibility needs, such as low or no vision, can often be excluded from their use. This requires technology developers to build more inclusive designs and to offer learning experiences that can be shared by people with mixed-visual abilities. There is also scope to integrate DIY approaches and provide specialised teachers with the ability to design their own low cost educational tools, adapted to pedagogical objectives and to the variety of visual and cognitive abilities of their students. For researchers, this invites new challenges of how to best support technology adoption and its evaluation in often complex educational settings. This workshop seeks to bring together researchers and practitioners interested in accessibility and education to share best practices and lessons learnt for technology in this space; and to jointly discuss and develop future directions for the next generation design of inclusive and effective education technologies.

Published
2018

10. Tangible Maps for Visually Impaired Users: Shape-Changing Perspectives

Author

Julie Ducasse, M Macé, Marc J., Marcos Serrano, Christophe Jouffrais, Jouffrais, Christophe, Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE), Centre National de la Recherche Scientifique - CNRS (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre National de la Recherche Scientifique (CNRS), Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université de Toulouse (UT)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT), Université de Toulouse (UT)-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), and National University of Singapore (NUS)-Agency for science, technology and research [Singapore] (A*STAR)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore]

Subjects
InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.,HCI), [SCCO.COMP]Cognitive science/Computer science, Actuated tangibles, [SCCO] Cognitive science, Intelligence artificielle, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], Interactive graphics, [SCCO]Cognitive science, [SCCO.COMP] Cognitive science/Computer science, [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], [SCCO.PSYC] Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], Non-visual tangible interfaces
Abstract

International audience; Interactive maps for visually impaired people are rarely dynamic and if so, very expensive. We developed a low-cost tangible tabletop interface that enables visually impaired users to dynamically construct maps. To do so, we designed a novel type of physical icons, called Tangible Reels. In this paper, we discuss how actuated Tangible Reels could be used to provide visually impaired users with an access to dynamic tangible maps and advanced functionalities (zoom, pan and exploration of geostatistical data). The three design ideas that we propose open new avenues for shape-changing interfaces for visually impaired users

Published
2016

11. From Tactile to Virtual: Using a Smartwatch to Improve Spatial Map Exploration for Visually Impaired Users

Author

Christophe Jouffrais, Sandra Bardot, Marcos Serrano, Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE), Centre National de la Recherche Scientifique - CNRS (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université de Toulouse (UT)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT), Université Joseph Fourier - Grenoble 1 (UJF)-Université Pierre et Marie Curie - Paris 6 (UPMC)-National University of Singapore (NUS)-Agency for science, technology and research [Singapore] (A*STAR)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], and Université de Toulouse (UT)-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP)

Subjects
Geospatial analysis, Computer science, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, computer.software_genre, Interface homme-machine, Smartwatch, [SCCO]Cognitive science, Human–computer interaction, Visually impaired users, Map exploration, 0202 electrical engineering, electronic engineering, information engineering, 0501 psychology and cognitive sciences, Computer vision, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, Wearable technology, business.industry, 05 social sciences, SwIPe, 020207 software engineering, Usability, Filter (signal processing), Grid, Wearable devices, Geospatial data, [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Artificial intelligence, business, computer, Gesture
Abstract

International audience; Tactile raised-line maps are paper maps widely used by visually impaired people. We designed a mobile technique, based on hand tracking and a smartwatch, in order to leverage pervasive access to virtual maps. We use the smartwatch to render localized text-to-speech and vibratory feedback during hand exploration, but also to provide filtering functions activated by swipe gestures. We conducted a first study to compare the usability of a raised-line map with three virtual maps (plain, with filter, with filter and grid). The results show that virtual maps are usable, and that adding a filter, or a filter and a grid, significantly speeds up data exploration and selection. The results of a following case study showed that visually impaired users were able to achieve a complex task with the device, i.e. finding spatial correlations between two sets of data.

Published
2016

12. LOVIE: A Word List Optimized for Visually Impaired UsErs on Smartphones

Author

Roussille, Philippe, Raynal, Mathieu, Jouffrais, Christophe, Systèmes d’Informations Généralisées (IRIT-SIG), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), and Centre National de la Recherche Scientifique (CNRS)

Subjects
Word list, Visually impaired, Computer science, Speech recognition, 05 social sciences, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, [SCCO]Cognitive science, [SCCO.PSYC]Cognitive science/Psychology, 0202 electrical engineering, electronic engineering, information engineering, A priori and a posteriori, 020201 artificial intelligence & image processing, Audio feedback, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Text entry, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 0509 other social sciences, 050904 information & library sciences, Mobile device, Word (computer architecture), Gesture
Abstract

International audience; On mobile devices, most text entry systems offer assistance through the means of prediction or correction word lists. These lists can hardly be used by visually impaired users in a short time. In this paper, we present three studies to find an interaction which minimizes the time required to select a word from a list without knowing its elements a priori. First, we explored the various possible item layouts, to conclude that a linear spatial arrangement is preferable. Then we studied the audio feedback, and we have determined that providing on-demand audio feedback is enough. Finally, we proposed four validation interactions to retain a validation based on the principle of a press-release gesture.

Published
2016

13. Empowering Low-Vision Rehabilitation Professionals with 'Do-It-Yourself' Methods

Author

Stéphanie Giraud, Christophe Jouffrais, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), and Centre National de la Recherche Scientifique (CNRS)

Subjects
Rapid prototyping, 3d printed, Low vision rehabilitation, Process (engineering), Computer science, Visually impaired, Visual impairment, 3D printing, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, [SCCO]Cognitive science, Human–computer interaction, 0202 electrical engineering, electronic engineering, information engineering, medicine, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], 050107 human factors, ComputingMilieux_MISCELLANEOUS, business.industry, 4. Education, 05 social sciences, 020207 software engineering, Focus group, [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], medicine.symptom, business
Abstract

Teachers and educators working with visually impaired students need to create numerous adapted learning materials that represent maps, shapes, objects, concepts, etc. This process usually relies on tactile document makers. It is time consuming and expensive. Recent “Do-It-Yourself” (DIY) techniques, including 3D printing and low-cost rapid prototyping, may enable to easily and quickly create learning materials that is versatile, interactive and cheap. In this study, we first analyzed the needs of many professionals at an institute for visually impaired children. It appeared that many of the students also present associated behavioral disorders, which has consequences on the design of adapted materials. In a second step, we used a focus group with design probes made with regular or 3D printed objects, and low-cost microcontrollers. At the end of the focus group, we identified four specific scenarios with different teachers and students. We created four low-cost interactive prototypes, and we observed how they were used during learning sessions. In conclusion, DIY methods appear to be a valuable solution for enabling professionals to quickly design new adapted materials or modify existing ones. Furthermore, DIY methods provide a collaborative framework between teachers and visually impaired students, which has a positive impact on their motivation.

Published
2016

14. Haptic Recognition of Emotions in Raised-Line Drawings by Congenitally Blind and Sighted Adults

Author

Christophe Jouffrais, Samuel Lebaz, Delphine Picard, Centre de Recherche en Psychologie de la Connaissance, du Langage et de l'Émotion (PsyCLÉ), Aix Marseille Université (AMU), Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université de Toulouse (UT)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT), Image & Pervasive Access Lab (IPAL), Université Joseph Fourier - Grenoble 1 (UJF)-Université Pierre et Marie Curie - Paris 6 (UPMC)-National University of Singapore (NUS)-Agency for science, technology and research [Singapore] (A*STAR)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], Laboratoire Cherchons Pour Voir (CPV), Université de Toulouse (UT)-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Octogone Unité de Recherche Interdisciplinaire (Octogone), Université de Toulouse (UT)-Université de Toulouse (UT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), and Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP)

Subjects
Visual perception, media_common.quotation_subject, [SCCO.COMP]Cognitive science/Computer science, Facial recognition system, 050105 experimental psychology, Task (project management), [SCCO]Cognitive science, 03 medical and health sciences, 0302 clinical medicine, Perception, 0501 psychology and cognitive sciences, Computer vision, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Emotion recognition, media_common, Haptic technology, business.industry, 05 social sciences, Line drawings, Computer Science Applications, Visualization, Human-Computer Interaction, [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Artificial intelligence, Psychology, business, 030217 neurology & neurosurgery, Cognitive psychology
Abstract

International audience; 15 sighted and 15 congenitally blind adults were to classify raised-line pictures of emotional faces through haptics. Whereas accuracy did not vary significantly between the two groups, the blind adults were faster at the task. These results suggest that raised-line pictures of emotional faces are intelligible to blind adults.

Published
2011

15. Les neuroprothèses visuelles basse-résolution sont-elles utilisables?

Author

Jouffrais, Christophe, Macé, Marc J.-M., Vergnieux, Victor, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1)-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1)-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées, Laboratoire Cherchons Pour Voir (CPV), and Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP)

Subjects
[SCCO]Cognitive science, [SCCO.PSYC]Cognitive science/Psychology, [SCCO.COMP]Cognitive science/Computer science, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], ComputingMilieux_MISCELLANEOUS
Abstract

National audience

Published
2015

16. Human faces detection and localization with simulated prosthetic vision

Author

Grégoire Denis, Marc J.-M. Macé, Christophe Jouffrais, Victor Vergnieux, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE), Centre National de la Recherche Scientifique - CNRS (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), and Université Toulouse 1 Capitole - UT1 (FRANCE)

Subjects
Heading (navigation), Neuroprosthetics, genetic structures, Computer science, 0206 medical engineering, Visual impairment, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, 03 medical and health sciences, [SCCO]Cognitive science, 0302 clinical medicine, SISA, medicine, Computer vision, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Visual resolution, business.industry, Neurosciences, Prosthetic vision, 020601 biomedical engineering, Retinal Prosthesis, [SCCO.PSYC]Cognitive science/Psychology, 030221 ophthalmology & optometry, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Retinal prosthesis, Artificial intelligence, Simulated, medicine.symptom, business
Abstract

International audience; Clinical trials reveal that current visual neuroprosthesis are not yet usable. The main reason is the small number of implanted electrodes, leading to a very poor visual resolution. The resolution is especially not sufficient to detect specific objects (faces, signs, etc.) in the surroundings. We used simulated prosthetic vision (SPV) to show that pre-processing of the camera image could restore these functions, even with low- resolution implants. Specifically, we showed that it is possible to quickly detect and localize human faces located nearby. We suggest that high-level processing of the video stream may be included in current visual neuroprosthesis. This would restore many visuomotor behaviors such as grasping, heading, steering, etc.

Published
2013

17. ARTIFICIAL VISION FOR THE BLIND: A BIO-INSPIRED ALGORITHM FOR OBJECTS AND OBSTACLES DETECTION

Author

Simon J. Thorpe, Florian Dramas, Christophe Jouffrais, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre de recherche cerveau et cognition (CERCO), Institut des sciences du cerveau de Toulouse. (ISCT), Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-CHU Toulouse [Toulouse]-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS)-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-CHU Toulouse [Toulouse]-Institut National de la Santé et de la Recherche Médicale (INSERM)-Centre National de la Recherche Scientifique (CNRS)-Centre National de la Recherche Scientifique (CNRS), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), and Centre National de la Recherche Scientifique (CNRS)

Subjects
Computer science, Interface (computing), [SCCO.COMP]Cognitive science/Computer science, Field of view, Image processing, Stereoscopy, 050105 experimental psychology, Image (mathematics), law.invention, 03 medical and health sciences, [SCCO]Cognitive science, 0302 clinical medicine, Stimulus modality, law, 0501 psychology and cognitive sciences, Computer vision, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], business.industry, 05 social sciences, Cognitive neuroscience of visual object recognition, Computer Graphics and Computer-Aided Design, Computer Science Applications, [SCCO.PSYC]Cognitive science/Psychology, Key (cryptography), [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Computer Vision and Pattern Recognition, Artificial intelligence, business, Algorithm, 030217 neurology & neurosurgery
Abstract

Although artificial vision systems could potentially provide very useful input to assistive devices for blind people, such devices are rarely used outside of laboratory experiments. Many current systems attempt to reproduce the visual image via an alternative sensory modality (often auditory or somatosensory), but this dominant "scoreboard" approach, is often difficult to interpret for the user. Here, we propose to offload the recognition problem onto a separate image processing system that then provides the user with just the essential information about the location of objects in the surrounding environment. Specifically, we show that a bio-inspired image processing algorithm (SpikeNet) can not only robustly, precisely, and rapidly recognize and locate key objects in the image, but also in space if the objects are in a stereoscopic field of view. In addition, the bio-inspired algorithm allows real-time calculation of optic flow. We hence propose that this system, coupled with a restitution interface allowing localization in space (i.e. three-dimensional virtual sounds synthesis) can be used to restore essential visuomotor behaviors such as grasping desired objects and navigating (finding directions, avoiding obstacles) in unknown environments.

Published
2012

18. Towards a Geographic Information System facilitating navigation of Visually Impaired users

Author

Bernard Oriola, Marc J.-M. Macé, Slim Kammoun, Christophe Jouffrais, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre National de la Recherche Scientifique (CNRS), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), and Jouffrais, Christophe

Subjects
Geographic information system, Computer science, 0211 other engineering and technologies, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, computer.software_genre, [SCCO]Cognitive science, Human–computer interaction, [SCCO.COMP] Cognitive science/Computer science, 0502 economics and business, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Adaptation (computer science), 021101 geological & geomatics engineering, 050210 logistics & transportation, Multimedia, business.industry, 05 social sciences, Orientation and Mobility, Navigation system, [SCCO] Cognitive science, GNSS applications, [SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology, Global Positioning System, Design process, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Enterprise GIS, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], business, computer
Abstract

International audience; In this paper, we propose some adaptation to Geographical Infor-mation System (GIS) components used in GPS based navigation system. In our design process, we adopted a user-centered design approach in collaboration with final users and Orientation and Mobility (O&M) instructors. A database scheme is presented to integrate the principal classes proposed by users and O&M instructors. In addition, some analytical tools are also implemented and integrated in the GIS. This adapted GIS can improve the guidance process of existing and future EOAs. A first implementation of an adapted guidance process allowing a better representation of the surroundings is provided as an il-lustration of this adapted GIS. This work is part of the NAVIG system (Naviga-tion Assisted by Artificial VIsion and GNSS), an assistive device, whose aim is to improve the Quality of Life of Visually Impaired (VI) persons via increased orientation and mobility capabilities.

Published
2012

19. Reaching to Sound Accuracy in the Peri-personal Space of Blind and Sighted Humans

Author

Marc J.-M. Macé, Florian Dramas, Christophe Jouffrais, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre National de la Recherche Scientifique (CNRS), Laboratoire Cherchons Pour Voir (CPV), and Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP)

Subjects
Masking (art), Sound localization, Computer science, [SCCO.COMP]Cognitive science/Computer science, Space (commercial competition), 050105 experimental psychology, 03 medical and health sciences, [SCCO]Cognitive science, 0302 clinical medicine, medicine, Auditory system, 0501 psychology and cognitive sciences, Computer vision, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], ComputingMilieux_MISCELLANEOUS, Sound (medical instrument), business.industry, 05 social sciences, White noise, medicine.anatomical_structure, Duration (music), [SCCO.PSYC]Cognitive science/Psychology, Augmented reality, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Artificial intelligence, business, 030217 neurology & neurosurgery
Abstract

With the aim of designing an assistive device for the Blind, we compared the ability of blind and sighted subjects to accurately locate several types of sounds generated in the peri-personal space. Despite a putative lack of calibration of their auditory system with vision, blind subjects performed with a similar accuracy as sighted subjects. The average error was sufficiently low (10° in azimuth and 10 cm in distance) to orient a user towards a specific goal or to guide a hand grasping movement to a nearby object. Repeated white noise bursts of short duration induced better performance than continuous sounds of similar total duration. These types of sound could be advantageously used in an assistive device. They would provide indications about direction to follow or position of surrounding objects, with limited masking of environmental sounds, which are of primary importance for the Blind.

Published
2012

20. Fusion of Artificial Vision and GPS to Improve Blind Pedestrian Positioning

Author

Adrien Brilhault, Slim Kammoun, Christophe Jouffrais, Olivier Gutierrez, Philippe Truillet, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre National de la Recherche Scientifique (CNRS), Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université de Toulouse (UT)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT), Université Joseph Fourier - Grenoble 1 (UJF)-Université Pierre et Marie Curie - Paris 6 (UPMC)-National University of Singapore (NUS)-Agency for science, technology and research [Singapore] (A*STAR)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], and Université de Toulouse (UT)-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP)

Subjects
030506 rehabilitation, Situation awareness, Computer science, [SCCO.COMP]Cognitive science/Computer science, 02 engineering and technology, GPS signals, [SCCO]Cognitive science, 03 medical and health sciences, 11. Sustainability, 0202 electrical engineering, electronic engineering, information engineering, Computer vision, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], ComputingMilieux_MISCELLANEOUS, business.industry, Hybrid positioning system, Orientation and Mobility, Sensor fusion, Assisted GPS, [SCCO.PSYC]Cognitive science/Psychology, Global Positioning System, Robot, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], 020201 artificial intelligence & image processing, Artificial intelligence, 0305 other medical science, business
Abstract

Orientation and mobility are tremendous problems for Blind people. Assistive technologies based on Global Positioning System (GPS) could provide them with a remarkable autonomy. Unfortunately, GPS accuracy, Geographical Information System (GIS) data and map-matching techniques are adapted to vehicle navigation only, and fail in assisting pedestrian navigation, especially for the Blind. In this paper, we designed an assistive device for the Blind based on adapted GIS, and fusion of GPS and vision based positioning. The proposed assistive device may improve user positioning, even in urban environment where GPS signals are degraded. The estimated position would then be compatible with assisted navigation for the Blind. Interestingly the vision module may also answer Blind needs by providing them with situational awareness (localizing objects of interest) along the path. Note that the solution proposed for positioning could also enhance autonomous robots or vehicles localization.

Published
2011

21. Route selection algorithm for blind pedestrian

Author

Slim Kammoun, Florian Dramas, Bernard Oriolaand, Christophe Jouffrais, Jouffrais, Christophe, Interacting Humans with Computing Systems (IRIT-IHCS), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Centre National de la Recherche Scientifique (CNRS), Laboratoire Cherchons Pour Voir (CPV), and Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP)

Subjects
030506 rehabilitation, Computer science, [SCCO.COMP]Cognitive science/Computer science, [SCCO]Cognitive science, 03 medical and health sciences, Brainstorming, [SCCO.COMP] Cognitive science/Computer science, 0502 economics and business, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], Information system, Computer vision, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Selection algorithm, Selection (genetic algorithm), ComputingMilieux_MISCELLANEOUS, 050210 logistics & transportation, business.industry, Orientation (computer vision), 05 social sciences, Orientation and Mobility, [SCCO] Cognitive science, GNSS applications, [SCCO.PSYC]Cognitive science/Psychology, [SCCO.PSYC] Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Artificial intelligence, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], 0305 other medical science, business, Dijkstra's algorithm
Abstract

The vast majority of existing route selection processes is designed for vehicle navigation. In this paper we describe an adapted routing algorithm for visually impaired pedestrians based on users needs. Our aim was to find the most adapted route that connects origin and destination points, and which can provide the Blind with a sparse but helpful mental representation of the itinerary and surroundings. Based on multiple brainstorming sessions and interviews with blind people and an orientation and mobility (O&M) instructor, different classes of objects were defined and tagged in the Geographical Information System. The optimal route was then selected using the Dijkstra algorithm. This method will be used in NAVIG (Navigation Assisted by Artificial VIsion and GNSS), an assistive device for the Blind, whose aim is to improve orientation, mobility and objects localization.

Published
2010

22. Haptic Recognition of Two-Dimensional Raised-Line Patterns by Early-Blind, Late-Blind, and Blindfolded Sighted Adults

Author

Delphine Picard, Samuel Lebaz, Catherine Monnier, Christophe Jouffrais, Centre de Recherche en Psychologie de la Connaissance, du Langage et de l'Émotion (PsyCLÉ), Aix Marseille Université (AMU), Octogone Unité de Recherche Interdisciplinaire (Octogone), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT), Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université de Toulouse (UT)-Toulouse Mind & Brain Institut (TMBI), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT), Image & Pervasive Access Lab (IPAL), Université Joseph Fourier - Grenoble 1 (UJF)-Université Pierre et Marie Curie - Paris 6 (UPMC)-National University of Singapore (NUS)-Agency for science, technology and research [Singapore] (A*STAR)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], Laboratoire Cherchons Pour Voir (CPV), Université de Toulouse (UT)-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Dynamique des capacités humaines et des conduites de santé (EPSYLON), Université Montpellier 1 (UM1)-Université Paul-Valéry - Montpellier 3 (UPVM)-Université de Montpellier (UM), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), and Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP)

Subjects
Adult, Male, Adolescent, [SCCO.COMP]Cognitive science/Computer science, Experimental and Cognitive Psychology, Blindness, 050105 experimental psychology, Task (project management), 03 medical and health sciences, Young Adult, [SCCO]Cognitive science, 0302 clinical medicine, Artificial Intelligence, Humans, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Visual experience, ComputingMilieux_MISCELLANEOUS, Haptic technology, Communication, business.industry, 05 social sciences, Kinesthetic learning, Middle Aged, Sensory Systems, Form Perception, Ophthalmology, Pattern Recognition, Visual, Touch, [SCCO.PSYC]Cognitive science/Psychology, Female, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Line (text file), business, Psychology, 030217 neurology & neurosurgery, Cognitive psychology, Mental image
Abstract

We investigated the role of visual experience and visual imagery in the processing of two-dimensional (2-D) tactile patterns. The performance of early-blind (EB), late-blind (LB), and blindfolded sighted (S) adults in the recognition of 2-D raised-line patterns was compared. We also examined whether recognition of 2-D tactile patterns depends on the type of memory strategy (eg spatial, visuo-spatial, verbal, and kinesthetic) used by EB, LB, and S participants to perform the task. Significant between-group differences in the recognition performance have not been found despite significant between-group differences in self-reported memory strategies. Recognition performance does not vary significantly with the strategy, but correlates positively with visuo-spatial imagery abilities in the S participants. These findings may be taken to suggest that the difficulties some blind people experience with tactile pictures are not due to difficulties in processing 2-D tactile patterns.

Published
2010

23. Les nouvelles technologies collaboratives pour les personnes avec déficiences visuelles. État des recherches actuelles

Author

Christophe Jouffrais, Valérie Tartas, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Image & Pervasive Access Lab (IPAL), Institute for Infocomm Research - I²R [Singapore]-Centre National de la Recherche Scientifique (CNRS)-Agency for science, technology and research [Singapore] (A*STAR)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-National University of Singapore (NUS)-Université Pierre et Marie Curie - Paris 6 (UPMC), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Centre National de la Recherche Scientifique (CNRS), Université Toulouse - Jean Jaurès (UT2J), GPEAA : Groupement des professeurs et éductateurs d'aveugles et amblyopes, Bordeaux, and Jouffrais, Christophe

Subjects
[SCCO.COMP] Cognitive science/Computer science, [SCCO.PSYC] Cognitive science/Psychology, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], [SCCO.PSYC]Cognitive science/Psychology, [SCCO.COMP]Cognitive science/Computer science, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], ComputingMilieux_MISCELLANEOUS
Abstract

National audience

24. Simulated Prosthetic Vision: Improving text accessibility with retinal prostheses

Author

Corinne Mailhes, Christophe Jouffrais, Grégoire Denis, Marc J.-M. Macé, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre National de la Recherche Scientifique (CNRS), Signal et Communications (IRIT-SC), Institut National Polytechnique (Toulouse) (Toulouse INP), Université Toulouse 1 Capitole (UT1)-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1)-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE), Centre National de la Recherche Scientifique - CNRS (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), and Institut National Polytechnique de Toulouse - INPT (FRANCE)

Subjects
Male, Time Factors, Computer science, ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION, [SCCO.COMP]Cognitive science/Computer science, Image processing, Retina, Rendering (computer graphics), Pattern Recognition, Automated, chemistry.chemical_compound, Traitement des images, [SCCO]Cognitive science, User-Computer Interface, [INFO.INFO-IM]Computer Science [cs]/Medical Imaging, Image Processing, Computer-Assisted, Humans, Computer vision, Computer Simulation, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], ComputingMilieux_MISCELLANEOUS, Vision, Ocular, Imagerie médicale, Clinical Trials as Topic, business.industry, Eye, Artificial, [SCCO.NEUR]Cognitive science/Neuroscience, Neurosciences, Simulated prosthetic vision, Reproducibility of Results, Retinal, Text accessibility, Visual Prosthesis, chemistry, [INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV], [SCCO.PSYC]Cognitive science/Psychology, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Female, Artificial intelligence, business, Algorithms
Abstract

International audience; Image processing can improve significantly the every-day life of blind people wearing current and upcoming retinal prostheses relying on an external camera. We propose to use a real-time text localization algorithm to improve text accessibility. An augmented text-specific rendering based on automatic text localization has been developed. It has been evaluated in comparison to the classical rendering through a Simulated Prosthetic Vision (SPV) experiment with 16 subjects. Subjects were able to detect text in natural scenes much faster and further with the augmented rendering compared to the control rendering. Our results show that current and next generation of low resolution retinal prostheses may benefit from real-time text detection algorithms.

25. Tactile Fixations: A Behavioral Marker on How People with Visual Impairments Explore Raised-line Graphics

Author

Sandra Bardot, Mathieu Simonnet, Marcos Serrano, Kaixing Zhao, Bernard Oriola, Christophe Jouffrais, Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), University of Manitoba [Winnipeg], Département Logique des Usages, Sciences sociales et Sciences de l'Information (IMT Atlantique - LUSSI), IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), Laboratoire d'Economie et de Gestion de l'Ouest (LEGO), Université de Bretagne Sud (UBS)-Université de Brest (UBO)-Institut Mines-Télécom [Paris] (IMT)-Institut Brestois des Sciences de l'Homme et de la Société (IBSHS), Université de Brest (UBO)-Université Bretagne Loire (UBL)-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT), Môle Armoricain de Recherche sur la SOciété de l'information et des usages d'INternet (MARSOUIN), Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Université de Bretagne Sud (UBS)-Ecole Nationale de la Statistique et de l'Analyse de l'Information [Bruz] (ENSAI)-Université de Brest (UBO)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes 2 (UR2), Université de Rennes (UNIV-RENNES)-Université Bretagne Loire (UBL)-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Centre National de la Recherche Scientifique (CNRS), Image & Pervasive Access Lab (IPAL), National University of Singapore (NUS)-MATHEMATIQUES, SCIENCES ET TECHNOLOGIES DE L'INFORMATION ET DE LA COMMUNICATION (UJF)-Agency for science, technology and research [Singapore] (A*STAR)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université de Toulouse (UT)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT), Université de Toulouse (UT)-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), IMT Atlantique (IMT Atlantique), Université de Brest (UBO)-Université Bretagne Loire (UBL)-IMT Atlantique (IMT Atlantique), Université de Rennes (UR)-Université de Bretagne Sud (UBS)-Ecole Nationale de la Statistique et de l'Analyse de l'Information [Bruz] (ENSAI)-Université de Brest (UBO)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes 2 (UR2)-Université Bretagne Loire (UBL)-IMT Atlantique (IMT Atlantique), National University of Singapore (NUS)-Agency for science, technology and research [Singapore] (A*STAR)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Institute for Infocomm Research - I²R [Singapore], and ACM

Subjects
InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.,HCI), education, 05 social sciences, Visual impairment, 020207 software engineering, Cognition, 02 engineering and technology, Fixation (psychology), InformationSystems_MODELSANDPRINCIPLES, Tactile Fixations, Behavioral study, Line (geometry), 0202 electrical engineering, electronic engineering, information engineering, medicine, Raised-line graphic, 0501 psychology and cognitive sciences, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], medicine.symptom, Graphics, Psychology, 050107 human factors, Cognitive psychology
Abstract

International audience; Raised-line graphics are tactile documents made for people with visual impairments (VI). Their exploration relies on a complex two-handed behavior. To better understand the cognitive processes underlying this exploration, we proposed a new method based on “tactile fixations”. A tactile fixation occurs when a finger is stationary within a specific spatial and temporal window. It is known that stationary fingers play an active role when exploring tactile graphics, but they have never been defined or studied before. In this study, we first defined the concept of tactile fixation, then we conducted a behavioral study with ten participants with VI in order to assess the role of tactile fixations under different conditions. The results show that tactile fixations vary according to different factors such as the graphic type as well as the involved hand and the aim of the exploration.

26. Wayfinding with simulated prosthetic vision: performance comparison with regular and structure-enhanced rendering

Author

Christophe Jouffrais, Marc J.-M. Macé, Victor Vergnieux, Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE), Centre National de la Recherche Scientifique - CNRS (FRANCE), Université Toulouse III - Paul Sabatier - UT3 (FRANCE), Université Toulouse - Jean Jaurès - UT2J (FRANCE), Université Toulouse 1 Capitole - UT1 (FRANCE), Etude de L’Interaction Personne SystèmE (IRIT-ELIPSE), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1), Université Fédérale Toulouse Midi-Pyrénées, Centre National de la Recherche Scientifique (CNRS), Laboratoire Cherchons Pour Voir (CPV), Université Fédérale Toulouse Midi-Pyrénées-Institut des Jeunes Aveugles [Toulouse] (IJA)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Institut National Polytechnique de Toulouse - INPT (FRANCE), and Jouffrais, Christophe

Subjects
Adult, Male, Artificial vision algorithmes, Computer science, Phosphenes, [INFO.INFO-DS]Computer Science [cs]/Data Structures and Algorithms [cs.DS], Algorithme et structure de données, [SCCO.COMP]Cognitive science/Computer science, Models, Biological, 050105 experimental psychology, Rendering (computer graphics), Young Adult, [SCCO]Cognitive science, 03 medical and health sciences, 0302 clinical medicine, [SCCO.COMP] Cognitive science/Computer science, [INFO.INFO-ET] Computer Science [cs]/Emerging Technologies [cs.ET], Humans, Computer Simulation, 0501 psychology and cognitive sciences, Computer vision, [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], Vision, Ocular, ComputingMilieux_MISCELLANEOUS, Cognitive map, Eye, Artificial, business.industry, 05 social sciences, Simulated prosthetic vision, Cognition, [SCCO] Cognitive science, Environnements Informatiques pour l'Apprentissage Humain, Computer vision techniques, Phosphene, Performance comparison, [SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology, Female, [INFO.EIAH]Computer Science [cs]/Technology for Human Learning, [INFO.INFO-ET]Computer Science [cs]/Emerging Technologies [cs.ET], Artificial intelligence, [INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC], business, Algorithms, 030217 neurology & neurosurgery
Abstract

International audience; In this study, we used a simulation of upcoming low-resolution visual neuroprostheses to evaluate the benefit of embedded computer vision techniques in a wayfinding task. We showed that augmenting the classical phosphene rendering with the basic structure of the environment - displaying the ground plane with a different level of brightness - increased both wayfinding performance and cognitive mapping. In spite of the low resolution of current and upcoming visual implants, the improvement of these cognitive functions may already be possible with embedded artificial vision algorithms.

Catalog

Books, media, physical & digital resources
See catalog results