Towards a robot-based multimodal framework to assess the impact of fatigue on user behavior and performance

Objective: In this paper, we present a multimodal robot-based framework to investigate how physical and mental fatigue affect task performance, and how it relates to subjective self-reports.Methodology: In this pilot study, seven healthy participants underwent the robot-based assessment. In each session, the participants performed a series of reaching tasks, including a task with cognitive demands, by moving the end effector of the Barrett WAM arm in the direction of the virtual targets displayed on a computer screen. Multimodal data, including EEG, EMG and user performance data like reaction time, number of targets, trajectory of the robot path, were recorded for further analysis.Results: Based on the analysis of subjective user self-report and objective task performance metrics, we observe that the user's perceived level of task difficulty increased over time while objective task performance also improved over time. We speculate that this might be due to the effect of fatigue on the user's perception of task difficulty.Conclusion: Further studies are required, with a more diverse population, to understand the impact of fatigue on the user's cognitive and physical ability. We must also evaluate how contextual parameters may affect task performance and fatigue.