1. Automated inference of cognitive performance by fusing multimodal information acquired by smartphone
- Author
-
Kazuki Kiriu, Jun Ota, Tsukasa Okimura, Kouhei Kaminishi, Yusuke Fukazawa, Yuri Terasawa, Masatoshi Kimoto, Keiichi Ochiai, Takashi Hamatani, Takaki Maeda, Naoki Yamamoto, and Akiya Inagaki
- Subjects
Modalities ,Computer science ,business.industry ,010401 analytical chemistry ,Human error ,Measure (physics) ,Inference ,020207 software engineering ,02 engineering and technology ,Machine learning ,computer.software_genre ,01 natural sciences ,0104 chemical sciences ,Task (project management) ,0202 electrical engineering, electronic engineering, information engineering ,Effects of sleep deprivation on cognitive performance ,Artificial intelligence ,business ,computer - Abstract
Recognizing human cognitive performance is important for preserving working efficiency and preventing human error. This paper presents a method for estimating cognitive performance by leveraging multiple information available in a smartphone. The method employs the Go-NoGo task to measure cognitive performance, and fuses contextual and behavioral features to identify the level of performance. It was confirmed that the proposed method could recognize whether cognitive performance was high or low with an average accuracy of 71%, even when only referring to inertial sensor logs. Combining sensing modalities improved the accuracy up to 74%.
- Published
- 2019