Search

The increasing prevalence of non-invasive, portable Electroencephalography (EEG) sensors for neuro-physiological measurements has propelled EEG-based assessments of cognitive load (CL) into the spotlight. In this study, we harnessed the capabilities of a four-channel, wearable EEG device that captured brain activity data during two distinct CL states: Baseline (representing a non-CL, resting state) and the Stroop Test (a CL-inducing state). The primary objective of this study is to estimate the CL index through an innovative approach that employs a hybrid, cluster-based, unsupervised learning technique seamlessly integrated with a 1D Convolutional Neural Network (CNN) architecture tailored for automated feature extraction, rather than conventional supervised algorithms, which facilitated in the acquisition of latent complex patterns without the need for manual categorization. The approach was rigorously evaluated using stratified cross-validation, with several assessment criteria assessing both its quality and predictive capability to estimate the CL index. The results obtained (e.g., homogeneity score of 0.7, adjusted rand index of 0.78, silhouette coefficient of 0.5, and an accuracy rate of 93.2%) demonstrate that our module exhibits superiority over supervised approaches. These results are indicative that the adoption of multi-channel wearable EEG devices may facilitate real-time CL estimation, minimizing the need for extensive human intervention, and reducing potential bias, paving the way for more objective and efficient CL assessments.

This work introduces an innovative method for estimating attention levels (cognitive load) using an ensemble of facial analysis techniques applied to webcam videos. Our method is particularly useful, among others, in e-learning applications, so we trained, evaluated, and compared our approach on the mEBAL2 database, a public multi-modal database acquired in an e-learning environment. mEBAL2 comprises data from 60 users who performed 8 different tasks. These tasks varied in difficulty, leading to changes in their cognitive loads. Our approach adapts state-of-the-art facial analysis technologies to quantify the users’ cognitive load in the form of high or low attention. Several behavioral signals and physiological processes related to the cognitive load are used, such as eyeblink, heart rate, facial action units, and head pose, among others. Furthermore, we conduct a study to understand which individual features obtain better results, the most efficient combinations, explore local and global features, and how temporary time intervals affect attention level estimation, among other aspects. We find that global facial features are more appropriate for multimodal systems using score-level fusion, particularly as the temporal window increases. On the other hand, local features are more suitable for fusion through neural network training with score-level fusion approaches. Our method outperforms existing state-of-the-art accuracies using the public mEBAL2 benchmark.

Over an extended period, spelling lessons have consistently played a crucial role in language acquisition, commonly integrated into educational settings to enhance learners’ spelling proficiency. Traditional classroom environments often require learners to spell and write words, leading those facing persistent difficulties to experience anxiety and social disconnection. This challenge is particularly notable in preschool settings where a more interactive approach to spelling sessions could benefit children with difficulties. This research develops a screenless language learning system for spelling acquisition, specifically focusing on minimizing digital screen exposure for preschoolers. The proposed virtual, augmented interface connects with tangible elements and game features. The tangible interface becomes the primary tool for learning, and the system achieves complete accuracy without necessitating learners to hold additional digital devices. The proposed system integrates augmented reality, tangible user interfaces, and serious game-based learning. Utilizing 3D Unity and Vuforia technology, augmented reality and serious game components are employed to create spelling content. The study highlights the importance of tangible letters and objects in conjunction with real-world items to facilitate cooperative and collaborative learning, encouraging social interaction among learners. The proposed learning content levels are adjusted to the age of learners (4-6 years) for alleviating cognitive overload. For gamification, the system incorporates three difficulty levels tailored to three, four, and five-letter words. This structured approach systematically enhances spelling skills while simultaneously addressing the challenge of excessive screen device exposure.

Human operator-induced assembly errors affect the quality of car manufacturing. Understanding the factors influencing assembly errors is critical for quality improvement. The sequence of assembly operations, a factor markedly affecting cognitive load, remains largely understudied. We aimed to assess the effect of changing the sequence of assembly operations on error rates through four field experiments conducted in a car manufacturing plant. The parts (and errors) under study were child lock labels (missing labels), sunroofs (missing bolts), windshield wiper arms (loose bolts), and armrests (wrong selection). Parts were chosen based on data from quality records, and they represent different scenarios regarding the sequencing of assembly operations. Minitab was used to conduct the statistical test for two proportions at a significance level of 0.05. The experiments ran for a period varying from 9 to 25 weeks (22292 to 138456 cars). All four experiments exhibited significant differences in the proportion of errors. MODAPTS cycle-time calculations revealed no negative effect of assembly sequence variations on productivity. The study findings show that changing the assembly operation sequence can reduce the error rates, possibly due to the intermediary effect in reducing the operator’s cognitive load. Overall, realizing quality improvement requires optimizing the assembly operation sequence in terms of time and productivity while considering its possible impact on error rates.

Preprocessing electroencephalographic (EEG) signals during computer-mediated Cognitive Load tasks is crucial in Human-Computer Interaction (HCI). This process significantly influences subsequent EEG analysis and the efficacy of Artificial Intelligence (AI) models employed in Cognitive Load Assessment. Consequently, it stands as an indispensable procedure for developing dependable systems capable of adapting to users’ cognitive capacities and constraints. We systematically analyzed fifty-seven (57) research papers on computer-mediated Cognitive Load EEG experiments published between 2018 and 2023. The preprocessing methods identified were multiple, controversial, and strongly dependent on the particularities of each experiment and the derived experimental dataset. Our investigation involved the meticulous classification of preprocessing methods based on distinct parameters, namely the degree of user intervention, the noise level, and the subject pool size. Particular attention was paid to semi-automated denoising technology since conventional methods, advanced approaches, and standardized pipelines overwhelm research, but no optimum solution is available yet. This survey is anticipated to provide a valuable contribution to the rising demand for an efficient and fully automated preprocessing approach in EEG-based computerized Cognitive Load experiments.

The rapid advancement of technology related to Industry 4.0 has brought about a paradigm shift in the way we interact with assets across various domains. This progress has led to the emergence of the concept of a Human Digital Twin (HDT), a virtual representation of an individual’s cognitive, psychological, and behavioral characteristics. The HDT has demonstrated potential as a strategic tool for enhancing productivity, safety, and collaboration within the framework of Industry 5.0. In response to this challenge, this paper outlines a process for tracking human cognitive load using the galvanic skin response as a physiological marker and proposes a novel method for managing cognitive load based on the extended Human Asset Administration Shell (HAAS). The proposed HAAS framework integrates real-time data streams from wearable sensors, user skills, contextual information, task specifics, and environmental and surrounding conditions to deliver a comprehensive understanding of an individual’s cognitive state, physical wellness, and skill set. Through the incorporation of skills set, physical, physiological, and psychological variables, and task parameters, the developed HAAS framework enables the identification, management, and development of individual capabilities, thereby facilitating individualized training and knowledge exchange. The applicability of the developed framework is proved by an experiments in the Operator 4.0 laboratory with the detailed HAAS parameters.

The safe operation of electrical devices is related to the national economy and people’s safe and well-being. It is crucial for operators to correctly and quickly identify interface information. To achieve this goal, optimizing the facility layout to reduce operator cognitive load and improve layout usability are vital prerequisites. Studies have developed methods for arranging interface elements, but their evaluations have rarely focused on the usability verification of optimized schemes; hence, the optimal effect has been uncertain in real situations. Given these considerations, this study proposed a new method that combines heuristic algorithms (genetic algorithm [GA] and ant colony algorithm [ACA]) and eye movements to obtain optimal interfaces. The optimized mathematical model was constructed using the Delphi method and analytic hierarchy process. A comparative study found that the GA-based interface (GABI) achieved superior results to the ACA-based interface (ACABI). Furthermore, the eye movement results indicated that compared with the original interface (OI) of the armored exhaust AC metal-enclosed switchgear, both algorithm-based interfaces significantly reduced the cognitive load and improved the overall usability. The results demonstrated that the GABI was superior to the ACABI overall. Therefore, the method proposed in this study can obtain better applicable schemes that account for both ergonomic requirements and user experience, thereby facilitating the convenient production of more effective layout schemes and providing a reference for electrical device designers and practitioners.

There has been controversy about the value of offline evaluation of EMG-based neural-machine interfaces (NMIs) for their real-time application. Often, conclusions have been drawn after studying the correlation of the offline EMG decoding accuracy/error with the NMI user’s real-time task performance without further considering other important human performance metrics such as adaptation rate, cognitive load, and physical effort. To fill this gap, this study aimed to investigate the relationship between the offline decoding accuracy of EMG-based NMIs and user adaptation, cognitive load, and physical effort in real-time NMI use. Twelve non-disabled subjects participated in this study. For each subject, we established three EMG decoders that yielded different offline accuracy (low, moderate, and high) in predicting continuous hand and wrist motions. The subject then used each EMG decoder to perform a virtual hand posture matching task in real time with and without a secondary task as the evaluation trials. Results showed that the high-level offline performance decoders yield the fastest adaptation rate and highest posture matching completion rate with the least muscle effort in users during online testing. A secondary task increased the cognitive load and reduced real-time virtual task competition rate for all the decoders; however, the decoder with high offline accuracy still produced the highest task completion rate. These results imply that the offline performance of EMG-based NMIs provide important insight to users’ abilities to utilize them and should play an important role in research and development of novel NMI algorithms.

Wearable functional near-infrared spectroscopy (fNIRS) for measuring brain function, in terms of hemodynamic responses, is pervading our everyday life and holds the potential to reliably classify cognitive load in a naturalistic environment. However, human’s brain hemodynamic response, behavior, and cognitive and task performance vary, even within and across homogeneous individuals (with same training and skill sets), which limits the reliability of any predictive model for human. In the context of high-stakes tasks, such as in military and first-responder operations, the real-time monitoring of cognitive functions and relating it to the ongoing task, performance outcomes, and behavioral dynamics of the personnel and teams is invaluable. In this work, a portable wearable fNIRS system (WearLight) developed by the author was upgraded, and an experimental protocol was designed to image the prefrontal cortex (PFC) area of the brain of 25 healthy homogeneous participants in a naturalistic environment while participants performed n-back working memory (WM) tasks with four difficulty levels. The raw fNIRS signals were processed using a signal processing pipeline to derive the brain’s hemodynamic responses. An unsupervised k-means machine learning (ML) clustering approach, utilizing the task-induced hemodynamic responses as input variables, suggested three unique participant groups. Task performance in terms of % correct, % missing, reaction time, inverse efficiency score (IES), and a proposed IES was extensively evaluated for each participant and the three groups. Results showed that, on average, brain hemodynamic response increased, whereas task performance degraded, with increasing WM load. However, the regression and correlation analysis of WM task, performance, and the brain’s hemodynamic responses (TPH) revealed interesting hidden characteristics and the variation in the TPH relationship between groups. The proposed IES also served as a better scoring method that had distinct score ranges for different load levels as opposed to the overlapping scores of the traditional IES method. Results showed that the k-means clustering has the potential to find groups of individuals in an unsupervised manner using the brain’s hemodynamic responses and to study the underlying relationship between the TPH in groups. Using the method presented in this paper, real-time monitoring of cognitive and task performance of soldiers, and preferentially forming small units to accomplish tasks based on the insights and goals may be helpful. The results showed that WearLight can image PFC, and this study also suggests future directions for the multi-modal body sensor network (BSN) combining advanced ML algorithms for real-time state classification, cognitive and physical performance prediction, and the mitigation of performance degradation in the high-stakes environment.

The dual-channel assumption of the cognitive theory of multimedia learning suggests that importing a large amount of information through a single (visual or audio) channel overloads that channel, causing partial loss of information, while importing it simultaneously through multiple channels relieves the burden on them and leads to the registration of a larger amount of information. In light of such knowledge, this study investigates the possibility of reinforcing visual stimuli with audio for supporting e-learners in memorization tasks. Specifically, we consider three kinds of learning material and two kinds of audio stimuli and partially reinforce each kind of material with each kind of stimuli in an arbitrary way. In a series of experiments, we determine the particular type of audio, which offers the highest improvement for each kind of material. Our work stands out as being the first study investigating the differences in memory performance in relation to different combinations of learning content and stimulus. Our key findings from the experiments are: (i) E-learning is more effective in refreshing memory rather than studying from scratch, (ii) Non-informative audio is more suited to verbal content, whereas informative audio is better for numerical content, (iii) Constant audio triggering degrades learning performance and thus audio triggering should be handled with care. Based on these findings, we develop an ANN-based estimator to determine the proper moment for triggering audio (i.e. when memory performance is estimated to be declining) and carry out follow-up experiments for testing the integrated framework. Our contributions involve (i) determination of the most effective audio for each content type, (ii) estimation of memory deterioration based on learners’ interaction logs, and (iii) the proposal of improvement of memory registration through auditory reinforcement. We believe that such findings constitute encouraging evidence the memory registration of e-learners can be enhanced with content-aware audio incorporation.

Currently there still remains a critical need of human involvements for multi-robot system (MRS) to successfully perform their missions in real-world applications, and the hand-controller has been commonly used for the operator to input MRS control commands. However, in more challenging scenarios involving concurrent MRS control and system monitoring tasks, where the operator’s both hands are busy, the hand-controller alone is inadequate for effective human-MRS interaction. To this end, our study takes a first step toward a multimodal interface by extending the hand-controller with a hands-free input based on gaze and brain-computer interface (BCI), i.e., a hybrid gaze-BCI. Specifically, the velocity control function is still designated to the hand-controller that excels at inputting continuous velocity commands for MRS, while the formation control function is realized with a more intuitive hybrid gaze-BCI, rather than with the hand-controller via a less natural mapping. In a dual-task experimental paradigm that simulated the hands-occupied manipulation condition in real-world applications, operators achieved improved performance for controlling simulated MRS (average formation inputting accuracy increases 3%, average finishing time decreases 5 s), reduced cognitive load (average reaction time for secondary task decreases 0.32 s) and perceived workload (average rating score decreases 15.84) with the hand-controller extended by the hybrid gaze-BCI, over those with the hand-controller alone. These findings reveal the potential of the hands-free hybrid gaze-BCI to extend the traditional manual MRS input devices for creating a more operator-friendly interface, in challenging hands-occupied dual-tasking scenarios. [ABSTRACT FROM AUTHOR]

By situating computer-generated content in the physical world, mobile augmented reality (AR) can support many tasks that involve effective search and inspection of physical environments. Currently, there is limited information regarding the viability of using AR in realistic wide-area outdoor environments and how AR experiences affect human behavior in these environments. Here, we conducted a wide-area outdoor AR user study ($n=48$) using a commercially available AR headset (Microsoft Hololens 2) to compare (1) user interactions with physical and virtual objects in the environment (2) the effects of different lighting conditions on user behavior and AR experience and (3) the impact of varying cognitive load on AR task performance. Participants engaged in a treasure hunt task where they searched for and classified virtual target items (green "gems") in an augmented outdoor courtyard scene populated with physical and virtual objects. Cognitive load was manipulated so that in half the search trials users were required to monitor an audio stream and respond to specific target sounds. Walking paths, head orientation and eye gaze information were measured, and users were queried about their memory of encountered objects and provided feedback on the experience. Key findings included (1) Participants self-reported significantly lower comfort in the ambient natural light condition, with virtual objects more visible and participants more likely to walk into physical objects at night; (2) recall for physical objects was worse than for virtual objects, (3) participants discovered more gems hidden behind virtual objects than physical objects, implying higher attention on virtual objects and (4) dual-tasking modified search behavior. These results suggest there are important technical, perceptual and cognitive factors that must be considered if the full potential of "anywhere and anytime mobile AR" is to be realized. [ABSTRACT FROM AUTHOR]

Stress has been a common disorder in human societies and numerous studies have been conducted on the early diagnosis of stress. Previous studies have shown that it is possible to diagnose stress using eye tracking data. This study aimed to obtain a new and significant method for detecting parameters of the eye tracker and electrodermal activity signal by discrimination of “stress” vs. “relaxation” and to achieve higher accuracy than previous research. We used a Stroop task and a mathematical stressor task in which stress elements were placed in a novel design to separate stress from relaxation in the Stroop task and evaluate three levels of stress in the mathematical task. In the present study, we recorded the eye tracking data of fifteen participants and thoroughly investigated the pupil diameter (PD) and electrodermal activity (EDA) features to discriminate different stress states. After preprocessing, several features were extracted and selected. Then, the features were used for classification by applying support vector machine, linear discriminant analysis, and k-nearest neighbor classifiers. The linear discriminant analysis classifier, for which the accuracy was 88.43% in the Stroop and 91.10% in the mathematical, showed higher accuracy than the other classifiers when using PD and EDA features. Also, PD features demonstrated more reliability and ability to differentiate stress from relaxation compared to traditional EDA.

The advances on the Internet and news media technologies suggest intelligent and personalised media interfaces in order to improve reading efficiency of news readers and enhance news disseminations. Cognitive load is one of factors that affect the understanding ability of news readers and therefore news dissemination. It is expected that the display elements in an intelligent user interface of news media could be automatically adjusted to modulate the audience’s perceived cognitive load level in order to improve the news reading efficiency. While the font style and font colour of news text are the main display elements in the user interface of news media, it is not clear how these elements affect perceived cognitive load of news readers. This paper investigates perceived cognitive load of news readers under different font style and font colour conditions. Experiments with the news text in Chinese as a case study found that the change of text font style of keywords resulted in the increase of the reader’s perceived cognitive load during reading news text under the low introduced cognitive load and blue colour displayed keywords. While under the high introduced cognitive load, the italic font and red colour of keywords text resulted in the decrease of the reader’s perceived cognitive load significantly during reading news text, which therefore improves the news reading efficiency. This paper is limited to the effects of two aspects of news text (font styles and colours) on user’s perceived cognitive load. The future work will focus on the investigation of effects of other factors such as news pictures and their colours, numbers, and locations on user’s perceived cognitive load.

The strong association between hearing loss and cognitive decline has developed into a major health challenge that calls for early detection, diagnosis and prevention. Hearing loss usually results in severe health implications that include loss of mobility, communication problems and cognitive decline. This study provides an overview of the effects of hearing loss on cognition and progressive neurological disorders with a discussion on the future scope of microwave portable technologies in care homes arrangement. Moreover, the efficacy of hearing aids in reversing cognitive decline and dementia has been investigated. The interconnection between hearing loss, cognitive load and neurodegeneration is also explored. Furthermore, this study looks into the prospects of using portable microwave sensors for the detection and monitoring of cognitive load. For early detection of dementia, this study proposes the integration of microwave sensors with hearing aid devices. Implications and design challenges of portable antenna systems for neurodegeneration detection have also been considered. Future improvement areas regarding robust analysis and diagnosis, system accuracy and security, user-centricity and device privacy for a broader clinical implementation are also discussed.

Contribution: This article features a systematic literature review with the objective of presenting a study that reflects the current scenario of research on the cognitive load theory (CLT) in the domain of teaching and learning computer programming. Background: Computer programming is a highly cognitive skill, requiring mastering multiple competencies, and recognized as being difficult to learn, for this reason, the cognitive load (CL) in the learner’s working memory emerged as an influential concept, making CLT one of the most common theories in computing education research. Research Questions: What are the approaches that relate CLT to teaching and learning computer programming? What CLT-related concepts are covered? What evidence is reported with respect to this context? Methodology: Following a formal protocol, a survey was performed for papers linking CLT to teaching and learning programming published between 2010 and 2020. The selection of papers was based on a set of criteria established to drive the selection process, including alignment with the research questions and paper quality assessment. Findings: The approaches applied in the papers are based on measuring the CL; through instructional design based on the development or use of resources or tools, a range of different pedagogy strategies and the CLT concepts. With respect to the concepts, the subjective measurement technique and worked example effect are the most commonly deployed. As far as the evidence reported, the better part is related to the worked example effect and measuring CLs. [ABSTRACT FROM AUTHOR]

Brain visual dynamics encode rich functional and biological patterns of the neural system, and if decoded, are of great promise for many applications such as intention understanding, cognitive load quantization and neural disorder measurement. We here focus on the understanding of the brain visual dynamics for the Amyotrophic lateral sclerosis (ALS) population, and propose a novel system that allows these so- called ‘lock-in’ patients to ‘speak’ with their brain visual movements. More specifically, we propose an intelligent system to decode the eye bio-potential signal, Electrooculogram (EOG), thereby understanding the patients’ intention. We first propose to leverage a deep learning framework for automatic feature learning and classification of the brain visual dynamics, aiming to translate the EOG to meaningful words. We afterwards design and develop an edge computing platform on the smart phone, which can execute the deep learning algorithm, visualize the brain visual dynamics, and demonstrate the edge inference results, all in real-time. Evaluated on 4,500 trials of brain visual movements performed by multiple users, our novel system has demonstrated a high eye-word recognition rate up to 90.47%. The system is demonstrated to be intelligent, effective and convenient for decoding brain visual dynamics for ALS patients. This research thus is expected to greatly advance the decoding and understanding of brain visual dynamics, by leveraging machine learning and edge computing innovations. [ABSTRACT FROM AUTHOR]

Controlling several joints simultaneously is a common feature of natural arm movements. Robotic prostheses shall offer this possibility to their wearer. Yet, existing approaches to control a robotic upper-limb prosthesis from myoelectric interfaces do not satisfactorily respond to this need: standard methods provide sequential joint-by-joint motion control only; advanced pattern recognition-based approaches allow the control of a limited subset of synchronized multi-joint movements and remain complex to set up. In this paper, we exploit a control method of an upper-limb prosthesis based on body motion measurement called Compensations Cancellation Control (CCC). It offers a straightforward simultaneous control of the intermediate joints, namely the wrist and the elbow. Four transhumeral amputated participants performed the Refined Rolyan Clothespin Test with an experimental prosthesis alternatively running CCC and conventional joint-by-joint myoelectric control. Task performance, joint motions, body compensations and cognitive load were assessed. This experiment shows that CCC restores simultaneity between prosthetic joints while maintaining the level of performance of conventional myoelectric control (used on a daily basis by three participants), without increasing compensatory motions nor cognitive load. [ABSTRACT FROM AUTHOR]

Predicting workload using physiological sensors has taken on a diffuse set of methods in recent years. However, the majority of these methods train models on small datasets, with small numbers of channel locations on the brain, limiting a model’s ability to transfer across participants, tasks, or experimental sessions. In this paper, we introduce a new method of modeling a large, cross-participant and cross-session set of high density functional near infrared spectroscopy (fNIRS) data by using an approach grounded in cognitive load theory and employing a Bi-Directional Gated Recurrent Unit (BiGRU) incorporating attention mechanism and self-supervised label augmentation (SLA). We show that our proposed CNN-BiGRU-SLA model can learn and classify different levels of working memory load (WML) and visual processing load (VPL) across participants. Importantly, we leverage a multi-label classification scheme, where our models are trained to predict simultaneously occurring levels of WML and VPL. We evaluate our model using leave-one-participant-out (LOOCV) as well as 10-fold cross validation. Using LOOCV, for binary classification (off/on), we reached an F1-score of 0.9179 for WML and 0.8907 for VPL across 22 participants (each participant did 2 sessions). For multi-level (off, low, high) classification, we reached an F1-score of 0.7972 for WML and 0.7968 for VPL. Using 10-fold cross validation, for multi-level classification, we reached an F1-score of 0.7742 for WML and 0.7741 for VPL. [ABSTRACT FROM AUTHOR]

Assessing comprehension difficulties requires the ability to assess cognitive load. Changes in cognitive load induced by comprehension difficulties could be detected with an adequate time resolution using different biofeedback measures (e.g., changes in the pupil diameter). However, identifying the Spatio-temporal sources of content comprehension difficulties (i.e., when, and where exactly the difficulty occurs in content regions) with a fine granularity is a big challenge that has not been explicitly addressed in the state-of-the-art. This paper proposes and evaluates an innovative approach named Intelligent BiofeedbackAugmented Content Comprehension (TellBack) to explicitly address this challenge. The goal is to autonomously identify regions of digital content that cause user's comprehension difficulty, opening the possibility to provide real-time comprehension support to users. TellBack is based on assessing the cognitive load associated with content comprehension through non-intrusive cheap biofeedback devices that acquire measures such as pupil response or Heart Rate Variability (HRV). To identify when exactly the difficulty in comprehension occurs, physiological manifestations of the Autonomic Nervous System (ANS) such as the pupil diameter variability and the modulation of HRV are exploited, whereas the fine spatial resolution (i.e., the region of content where the user is looking at) is provided by eye-tracking. The evaluation results of this approach show an accuracy of 83.00% ± 0.75 in classifying regions of content as difficult or not difficult using Support Vector Machine (SVM), and precision, recall, and micro F1-score of 0.89, 0.79, and 0.83, respectively. Results obtained with 4 other classifiers, namely Random Forest, k-nearest neighbor, Decision Tree, and Gaussian Naive Bayes, showed a slightly lower precision. TellBack outperforms the state-of-the-art in precision & recall by 23% and 17% respectively.

To further extend the applicability of wearable sensors, methods for accurately extracting subtle psychological information from the sensor data are required. However, accessing subjective information in everyday life, such as cognitive load, remains challenging. To bring consensus on methods for cognitive load monitoring, a machine learning challenge is organized. The participants developed machine learning methods for cognitive load classification using wrist-worn physiological sensors’ data, namely heart rate, R-R intervals, skin conductance, and skin temperature. The data from subjects solving cognitive tasks of varying difficulty is used for the challenge. This article presents a systematic comparison and multi-strategic performance evaluation of the thirteen methods submitted to this challenge. A systematic comparison of preprocessing techniques, classification algorithms, and implementation techniques is presented. Performance variations for different task difficulty levels, different subjects, and different experiment periods are evaluated. The results indicate that the most robust methods used multimodal sensor data, classical classification approaches such as decision trees and support vector machines or their ensembles, and Bayesian hyperparameter optimization for hyperparameter tuning. The most accurate models used handcrafted features that are further selected using sequential backward floating search and evaluated using stratified person-aware cross-validation strategy. Moreover, the results indicated better classification performance for specific test subjects, the tasks with the highest difficulty, and in some cases, the time elapsed since the start of the experiment. This dependency is likely due to model overfitting or due to the subjective nature of the psychophysiological process. The intersubject variability in responses is challenging to be captured through objective binary labels for cognitive load, thereby warranting more sophisticated annotation approaches.

Cognitive research has found people are sometimes adept and sometimes inept at handling complexity. Complexity is a key concept in much of cognitive science, yet the field has scarcely incorporated any of the work in complexity theory. Complexity theory may generally be too abstract to easily apply to human cognition studies. Here, the problem is addressed by considering complexity through constructing a model of epistemic emergence, Cognitive-Habitat Strategy-Ecosystem, (CHSE) to act as an overarching framework into which different conceptions of complexity and cognition can be integrated, describing how they will interact to affect cognition in complex systems. This model provides value both at the micro level, by generating specific predictions, and at the macro level, through hypothesizing interactions between other cognitive theories such as cognitive load and adaptation from failure. We detail the model’s assumptions, functionality, and possible ways to measure variables.

The paper presents the details of a four-year project to test the effectiveness of teaching spreadsheeting with spreadsheet programming, instead of the traditional, widely accepted surface approach methods. The novel method applied in the project, entitled Sprego (Spreadsheet Lego), is a concept-based problem-solving approach adapted from the didactics of other sciences and computer programming. In the experimental group contextualized, real-world programming problems are presented in a spreadsheet environment. A semi-unplugged data-driven analysis is carried out based on each problem, which is followed by the building of a feasible algorithm, expressed by natural language expressions. The coding is completed in the following step by applying a limited number of spreadsheet (Sprego) functions, multilevel, and array formulas. The final steps of the process are discussion and debugging. On the other hand, classical, tool-centered approaches are applied in the control groups. Our research reveals that the traditional surface approach methods for teaching spreadsheeting do not provide long lasting, reliable knowledge which would provide students and end-users with effective problem-solving strategies, while Sprego does. Beyond this finding, the project proves that Sprego supports schema construction and extended abstraction, which is one of the major hiatus points of traditional surface navigation methods. The project also reveals that developing computational thinking skills should not be downgraded, and the misconceptions of self-taught end-users and user-friendly applications should be reconsidered, especially their application in educational environments. Gaining effective computer problem-solving skills and knowledge-transfer abilities is not magic, but a time-consuming process which requires consciously developed and effective methods, and teachers who accept the incremental nature of the sciences.

Target and steering-based techniques are two common approaches to travel in consumer VR applications. In this paper, we present two within-subject studies that employ a prior dual-task methodology to evaluate and compare the cognitive loads, travel performances, and simulator sickness of three common target-based travel techniques and three common steering-based travel techniques. We also present visual meta-analyses comparing our results to prior results using the same dual-task methodology. Based on our results and meta-analyses, we present several design suggestions for travel techniques based on various aspects of user experiences. [ABSTRACT FROM AUTHOR]

The proliferation of modern mobile technologies on grammar learning (i.e., m-grammar learning) has generated a multitude of challenges in developing effective pedagogically-informed learning tools. The existing systems have mostly suffered from low motivation and poor learning effectiveness because of the three key reasons, namely: i) a weak tie to motivational theoretical principles, ii) a lack of proper instructional design, and iii) a lack of proper infrastructural design for data sharing between students and instructors. To deal with this issue, this paper presents MATT: a Mobile-Assisted Tense Tool that encapsulates an m-grammar instructional design leveraging upon cloud-fog-edge collaborative networking. Central to MATT is the incorporation of the Cognitive Theory of Multimedia Learning principles to minimize the extraneous cognitive load and a motivational model to increase motivation and learning effectiveness. To ensure effective instructional design, we exploit adaptive and dynamic approaches embodied in a flexible instructional paradigm that takes advantage of collective learning data exchange across cloud (central unit), fog (regional units) and edge (end devices/learners). To demonstrate the overall effectiveness of this system, we describe our findings in the evaluation of both the learning aspect (using a quantitative research design) and collaborative network performance (using numerical simulation). With an appropriate condition of delay-tolerant network-enabled learning data exchange, the results suggest that the students' cognitive load is low and motivational nature is high after using this system, which led them to perform more positively in the post-test evaluation.

This study presents an instantaneous spectrum analysis for electroencephalograph data processing that would facilitate the practice of learning and instruction through real-time measurements of the learner's cognitive load. The instantaneous spectrum analysis is derived from the ensemble empirical mode decomposition which decomposes signals into a gathering of intrinsic mode functions without mode mixing. The multi-marginal Hilbert-Huang spectrum is introduced to estimate frequency contents. As a result, the amplitude of brain rhythms related to the cognitive load can be determined accurately. A model study was performed at first to test the efficacy of the proposed algorithm by comparing with the Fourier based technique, then a prefrontal experiment was conducted to show the advantages of the proposed method. With the higher resolution and more realistic of the proposed method relative to conventional spectrum analysis, more significant features of the signal can be extracted. We believe that the proposed method has the potential to be a substantial technique in electroencephalograph data analysis.

The recognition of gait pattern variation is of high importance to various industrial and commercial applications, including security, sport, virtual reality, gaming, robotics, medical rehabilitation, mental illness diagnosis, space exploration, and others. The purpose of this paper is to study the nature of gait variability in more detail, by identifying gait intervals responsible for gait pattern variations in individuals, as well as between individuals, using cognitive demanding tasks. This work uses deep learning methods for sensor fusion of 116 plastic optical fiber (POF) distributed sensors for gait recognition. The floor sensor system captures spatiotemporal samples due to varying ground reaction force (GRF) in multiples of up to 4 uninterrupted steps on a continuous $2\times 1$ m area. We demonstrate classifications of gait signatures, achieving up to 100% F1-score with Convolutional Neural Networks (CNN), in the context of gait recognition of 21 subjects, with imposters and clients. Classifications under cognitive load, induced by 4 different dual tasks, manifested lower F1-scores. Layer-Wise Relevance Propagation (LRP) methods are employed to decompose a trained neural network prediction to relevant standard events in the gait cycle, by generating a “heat map” over the input used for classification. This allows valuable insight into which parts of the gait spatiotemporal signal have the heaviest influence on the gait classification and consequently, which gait events, such as heel strike or toe-off, are mostly affected by cognitive load. [ABSTRACT FROM AUTHOR]

Manual workstations play a critical role in flexible assembly lines by enabling human responses to reconfiguration that is faster than machine responses. As a result, human is more adaptive and sometimes unreplaceable by machines in complex assembly. However, with the increasing complexity of tasks, product quality has become highly susceptible to human error due to increments in operators’ cognitive load. One of the errors that affect assembly quality is the operator’s use of a handheld tool with an unfavorable working angle when handling the workpiece. In this case, an assistive mechanism to remind workers about the wrong working angle is necessary to support the process. To this end, this study proposes an angle monitoring system to inspect the working angle of handheld tools and provide feedback in real time with minimal interruption to the assembly process. The proposed system consists of an angle measurement model and an action recognition model, which are both built using deep-learning-based object detection algorithm. Besides, the system was designed with flexibility that it is applicable to different tools and assembly tasks. A case study on fastening a high-end graphical processing unit card is investigated to evaluate their performance. Results show 95.83% and 99.83% accuracies of the models. In practice, the proposed study is expected to facilitate assembly quality by preventing the failure of angle-related operations in a timely and reliable manner. [ABSTRACT FROM AUTHOR]

Theories of cognition inform our decisions when designing human-computer interfaces, and immersive systems enable us to examine these theories. This work explores the sensemaking process in an immersive environment through studying both internal and external user behaviors with a classical visualization problem: a visual comparison and clustering task. We developed an immersive system to perform a user study, collecting user behavior data from different channels: AR HMD for capturing external user interactions, functional near-infrared spectroscopy (fNIRS) for capturing internal neural sequences, and video for references. To examine sensemaking, we assessed how the layout of the interface (planar 2D vs. cylindrical 3D layout) and the challenge level of the task (low vs. high cognitive load) influenced the users' interactions, how these interactions changed over time, and how they influenced task performance. We also developed a visualization system to explore joint patterns among all the data channels. We found that increased interactions and cerebral hemodynamic responses were associated with more accurate performance, especially on cognitively demanding trials. The layout types did not reliably influence interactions or task performance. We discuss how these findings inform the design and evaluation of immersive systems, predict user performance and interaction, and offer theoretical insights about sensemaking from the perspective of embodied and distributed cognition. [ABSTRACT FROM AUTHOR]

The widespread adoption of technology-enhanced learning in various knowledge disciplines has pushed forward the development of information technology-assisted media for language learning and teaching. However, most of the existing electronic-learning (e-learning) solutions have underexplored and under-addressed given specific characteristics of grammar learning, which is one of the most demanding areas of language education. The lack of pedagogically informed instructional design to enhance learning performance on the current system can result in low motivation and engagement due to an imbalance and excessive increase of the cognitive load. This paper attempts to address these deficiencies posed by the existing systems by proposing smart communication networks that are driven by the student learning experience to manage cognitive load in the context of grammar learning. The e-grammar learning networks serve as a collaborative learning platform that combines a pedagogically informed instructional model named attention, relevance, confidence, and satisfaction (ARCS) and cyber interaction among teaching/learning agents. From the technological perspective, our numerical simulations demonstrate the desirable performance indicators of the proposed networks to facilitate information exchange and learning. From the education perspective, our empirical studies show that the overall smart network-enabled e-grammar learning system has desirable characteristics to motivate learners (m = 3.78) and manage their overall cognitive load (m = 1.73), which suggest the promising capability of the proposed system.

The innovations proposed by the cell phone market have grown steadily in recent years, along with the increasing complexity of the hardware, operating systems, and applications available in this market. These changes bring new challenges related to usability that need to be considered during the development process of these applications since the new forms of user-application interactions increasingly require adapting the behavior of smartphone users. In this situation, usability is an important issue that depends on factors such as the Users, their characteristics and abilities, the Task which the users intend to achieve and also the application usage Context. This work presents a systematic literature review with the objective of identifying the heuristics and usability metrics used in the literature and/or industry. Based on the review results, this work presents another contribution with a proposal of a set of usability heuristics focused in mobile applications on smartphones, considering the User, Task and Context as usability factors and Cognitive Load as an important attribute of usability. The components of this set are detailed in a model intended to be used in empirical validations allowing to dynamically incorporate improvements to the proposal.

Introduction: The COVID-19 pandemic brought unprecedented challenges to universities when instruction had to shift entirely online. Universities were quick to survey their students about those challenges, and education researchers are now focused on building more effective online experiences based on student feedback. About the case: The loss of in-person instruction was difficult for engineering students in practice-based courses as they lost the courses’ hands-on aspect, which is essential for reinforcing theoretical concepts. They also lost the support provided through daily interactions with their peers and instructors. Situating the case: Students in a required four-course practice-based mechanical engineering sequence shared their perspectives via reflective portfolio essays on how shifting to online instruction affected their ability to participate in their learning communities and negotiate meaningful learning experiences. Methods/approach: Through thematic analysis of the reflective essays, we applied the lens of communities of practice to put the students’ responses into context. Results/discussion: The students’ concerns varied depending on their position in the course sequence and the course; however, most students felt that the loss of in-person interaction was most detrimental and disruptive in the transition to online instruction and yielded communication and teaming issues. Implications and conclusions: Five implications arose from the results of this study, including recognizing the unique challenges of online learning in practice-based courses, instructing students in virtual communication tools, exercising empathy, being mindful of cognitive load, and researching self-directed learners in online environments. In addition, faculty should consider the importance of students’ communities of practice and build opportunities to maintain and strengthen the bonds of those communities within their courses, both online and face to face. They should also add more opportunities for virtual interaction early in the curriculum to build digital communication skills, which will undoubtedly be required in their careers. [ABSTRACT FROM AUTHOR]

Node-link diagrams are widely used to visualise networks. However, even the best network layout algorithms ultimately result in ‘hairball’ visualisations when the graph reaches a certain degree of complexity, requiring simplification through aggregation or interaction (such as filtering) to remain usable. Until now, there has been little data to indicate at what level of complexity node-link diagrams become ineffective or how visual complexity affects cognitive load. To this end, we conducted a controlled study to understand workload limits for a task that requires a detailed understanding of the network topology-finding the shortest path between two nodes. We tested performance on graphs with 25 to 175 nodes with varying density. We collected performance measures (accuracy and response time), subjective feedback, and physiological measures (EEG, pupil dilation, and heart rate variability). To the best of our knowledge this is the first network visualisation study to include physiological measures. Our results show that people have significant difficulty finding the shortest path in high density node-link diagrams with more than 50 nodes and even low density graphs with more than 100 nodes. From our collected EEG data we observe functional differences in brain activity between hard and easy tasks. We found that cognitive load increased up to certain level of difficulty after which it decreased, likely because participants had given up. We also explored the effects of global network layout features such as size or number of crossings, and features of the shortest path such as length or straightness on task difficulty. We found that global features generally had a greater impact than those of the shortest path. [ABSTRACT FROM AUTHOR]

Although it seems intuitive to address the issue of reduced plantar cutaneous feedback by augmenting it, many approaches have adopted compensatory sensory cues, such as tactile input from another part of the body, for multiple reasons including easiness and accessibility. The efficacy of the compensatory approaches might be limited due to the cognitive involvement to interpret such compensatory sensory cues. The objective of this study is to test the hypothesis that the plantar cutaneous augmentation is more effective than providing compensatory sensory cues on improving postural regulation, when plantar cutaneous feedback is reduced. In our experiments, six healthy human subjects were asked to maintain their balance on a lateral balance board for as long as possible, until the balance board contacted the ground, for 240 trials with five interventions. During these experiments, subjects were instructed to close their eyes to increase dependency on plantar cutaneous feedback for balancing. Foam pad was also added on the board to emulate the condition of reduced plantar cutaneous feedback. The effects of tactile augmentation from the foot sole or the palm on standing balance were tested by applying transcutaneous electrical stimulation on calcaneal or ulnar nerve during the balance board tests, with and without a cognitively-challenging counting task. Experimental results indicate that the plantar cutaneous augmentation was effective on improving balance only with cognitive load, while the palmar cutaneous augmentation was effective only without cognitive load. This result suggests that the location of sensory augmentation should be carefully determined according to the attentional demands. [ABSTRACT FROM AUTHOR]

In this study, we aim to better understand the cognitive-emotional experience of visually impaired people when navigating in unfamiliar urban environments, both outdoor and indoor. We propose a multimodal framework based on random forest classifiers, which predict the actual environment among predefined generic classes of urban settings, inferring on real-time, non-invasive, ambulatory monitoring of brain and peripheral biosignals. Model performance reached 93 for the outdoor and 87 percent for the indoor environments (expressed in weighted AUROC), demonstrating the potential of the approach. Estimating the density distributions of the most predictive biomarkers, we present a series of geographic and temporal visualizations depicting the environmental contexts in which the most intense affective and cognitive reactions take place. A linear mixed model analysis revealed significant differences between categories of vision impairment, but not between normal and impaired vision. Despite the limited size of our cohort, these findings pave the way to emotionally intelligent mobility-enhancing systems, capable of implicit adaptation not only to changing environments but also to shifts in the affective state of the user in relation to different environmental and situational factors. [ABSTRACT FROM AUTHOR]

Background: The cognitive load involved in research article (RA) reading can be overwhelming for L2 novice readers. RA section headings can be used as signals to help novices focus on essential information related to their learning goals to reduce extraneous cognitive processing. There is a need to examine RA macrostructures to inform RA reading instruction. Literature review: RAs do not always follow the Introduction-Methods-Results-Discussion (IMRD) model. Previous research has examined the macrostructure of articles in disciplines such as computer science, applied linguistics, and pure mathematics, but few have investigated the macrostructure of economics RAs. Research questions: 1. Are there any sections frequently used in economics articles apart from the conventional sections? 2. If yes, what are the views of expert economics RA readers on the communicative functions and propositional content of the newly identified sections of economics RAs? Research methods: Eighty RAs were collected from five economics journals using stratified random sampling. Following Yang and Allison's macrostructure analysis method, we conducted an analysis of the overall structure of the RAs based on section headings and the function and content of each section. Results: Compared with the IMRD model, we found six new section types: Background, Theoretical Model, Econometric Model, Robustness, Mechanisms, and Application. Interviews were conducted to explore expert RA readers’ genre knowledge on the newly identified sections. Conclusion: The findings can be useful for RA reading and writing instruction and future research on part-genres of economics articles. [ABSTRACT FROM AUTHOR]

We develop an approach to using microsaccade dynamics for the measurement of task difficulty/cognitive load imposed by a visual search task of a layered surface. Previous studies provide converging evidence that task difficulty/cognitive load can influence microsaccade activity. We corroborate this notion. Specifically, we explore this relationship during visual search for features embedded in a terrain-like surface, with the eyes allowed to move freely during the task. We make two relevant contributions. First, we validate an approach to distinguishing between the ambient and focal phases of visual search. We show that this spectrum of visual behavior can be quantified by a single previously reported estimator, known as Krejtz's $\mathcal {K}$ K coefficient. Second, we use ambient/focal segments based on $\mathcal {K}$ K as a moderating factor for microsaccade analysis in response to task difficulty. We find that during the focal phase of visual search (a) microsaccade magnitude increases significantly, and (b) microsaccade rate decreases significantly, with increased task difficulty. We conclude that the combined use of $\mathcal {K}$ K and microsaccade analysis may be helpful in building effective tools that provide an indication of the level of cognitive activity within a task while the task is being performed. [ABSTRACT FROM AUTHOR]

In this article, a passive physical human–robot interaction (pHRI) controller is proposed to enhance pHRI performance in terms of precision, cognitive load, and user effort, in cases partial knowledge of the task is available. Partial knowledge refers to a subspace of $SE(3)$ determined by the desired task, generally mixing both position and orientation variables, and is mathematically approximated by parametric expressions. The proposed scheme, which utilizes the notion of virtual constraints and the prescribed performance control methodology, is proved to be passive with respect to the interaction force, while guaranteeing constraint satisfaction in all cases. The control scheme is experimentally validated and compared with a dissipative control scheme utilizing a KUKA LWR4+ robot in a master–slave task; experiments also include an application to a robotic assembly case. [ABSTRACT FROM AUTHOR]

Since the beginning of space exploration, Mars and the moon have been examined via orbiters, landers, and rovers. More than 40 missions have targeted Mars, and over 100 have been sent to the moon. Space agencies continue to focus on developing novel strategies and technologies for probing celestial bodies. Multirobot systems are particularly promising for planetary exploration, as they are more robust to individual failure and have the potential to examine larger areas; however, there are limits to how many robots an operator can control individually. We recently took part in the European Space Agency's (ESA's) interdisciplinary equipment test campaign (PANGAEA-X) at a lunar/Mars analog site in Lanzarote, Spain. We used a heterogeneous fleet of unmanned aerial vehicles (UAVs)-a swarm-to study the interplay of systems operations and human factors. Human operators directed the swarm via ad hoc networks and data-sharing protocols to explore unknown areas under two control modes: in one, the operator instructed each robot separately; in the other, the operator provided general guidance to the swarm, which self-organized via a combination of distributed decision making and consensus building. We assessed cognitive load via pupillometry for each condition and perceived task demand and intuitiveness via selfreport. Our results show that implementing higher autonomy with swarm intelligence can reduce workload, freeing the operator for other tasks such as overseeing strategy and communication. Future work will further leverage advances in swarm intelligence for exploration missions. [ABSTRACT FROM AUTHOR]

As a website evolves to align with users’ changing information needs and interests, its structure can outgrow the original design, accumulating links and pages in unanticipated places. This increases complexity to both web pages and the navigation structure, which could cause difficulty in locating relevant links and information. Though the increasing complexity of website and its impact on users’ psychological perception have been anecdotally well-recognized, the need to address it with a formal and rigorous method is understudied in the literature. This paper is one of the first studies to examine how to streamline website structures to enhance user navigation. We use a widely used metric in the literature - a page's outdegree (the number of links in a page) - as the measurement for complexity, because it not only serves as a good proximity for page complexity but also has a significant implication on website structure. We propose a method based on mathematical programming (MP) model that can significantly reduce users’ cognitive load by effectively eliminating appropriate links from pages with high complexity. We have performed extensive experiments on both a real dataset and very large synthetic datasets with statistical similarities to the real dataset. The results indicate that our method not only significantly reduces web page and structure complexity with very small impact to user navigation, but also can be effectively solved and scales up remarkably well, suggesting it is useful for website maintenance on a progressive basis. In addition, we conduct a study to evaluate the performance of streamlined website structures using the real dataset and the results confirm the validity of our method. [ABSTRACT FROM AUTHOR]

From not disturbing a focused programmer to entertaining a restless commuter waiting for a train, personal ubiquitous computing devices could greatly enhance their interaction with humans, should these devices only be aware of their users' cognitive engagement. Despite impressive advances in the inference of human movement, physical activity, routines, and other behavioral aspects, inferring cognitive load remains challenging due to the subtle manifestations of users' mental engagements via vital signal reactions. These signals are traditionally captured with expensive, obtrusive, and purpose-built equipment, preventing seamless cognitive load inference for human–computer interaction adaptation. In this article, we present our achievements toward enabling large-scale unobtrusive cognitive load inference. Our approaches rely on mining sensor data collected by commodity wearable devices, and software-defined radio-based wireless radars. We also discuss further related research avenues, as well as ethical issues surrounding automatic cognitive load inference. [ABSTRACT FROM AUTHOR]

Alzheimer’s disease is characterized by the progressive deterioration of cognitive abilities particularly working memory while mild cognitive impairment (MCI) represents its prodrome. It is generally believed that neural compensation is intact in MCI but absent in Alzheimer’s disease. This study investigated the effects of increasing task load as a means to induce neural compensation through a novel visual working memory (VSWM) task using functional near-infrared spectroscopy (fNIRS). The bilateral prefrontal cortex (PFC) was explored due to its relevance in VSWM and neural compensation. A total of 31 healthy controls (HC), 12 patients with MCI and 18 patients with mild Alzheimer’s disease (mAD) were recruited. Although all groups showed sensitivity in terms of behavioral performance (i.e. score) towards increasing task load (level 1 to 3), only in MCI load effect on cortical response (as measured by fNIRS) was significant. At lower task load, bilateral PFC activation did not differ between MCI and HC. Neural compensation in the form of hyperactivation was only noticeable in MCI with a moderate task load. Lack of hyperactivation in mAD, coupled with significantly poorer task performance across task loads, suggested the inability to compensate due to a greater degree of neurodegeneration. Our findings provided an insight into the interaction of cognitive load theory and neural compensatory mechanisms. The experiment results demonstrated the feasibility of inducing neural compensation with the proposed VSWM task at the right amount of cognitive load. This may provide a promising avenue to develop an effective cognitive training and rehabilitation for dementia population. [ABSTRACT FROM AUTHOR]

Physical activity recognition using wearable sensors has achieved good performance in discriminating heterogeneous activities for health monitoring, but there has been less investigation of sedentary activities, e.g., desk work, which is often physically homogenous, to improve health in office environments. In this study, we explored head movement as a new sensing modality for physical and mental activity analysis. A new algorithm which segments gyroscope signals into atomic head movement events is proposed. Instead of recognizing activities in terms of predefined categories, we recognized four dimensions of task load: cognitive, perceptual, communicative, and physical, analogous to current manual workload assessment methods like NASA-TLX. We collected head movement data from 24 participants who wore a tri-axial inertial sensor at head while performing multiple tasks with varying load levels at office. An average of 70% accuracy was achieved for recognizing cognitive load levels, and more than 80% for the other three load types. The proposed event features outperformed a set of 181 features from previous physical activity recognition studies. We also demonstrated that these atomic event features are diagnostic of different load types in cross-load type classification, showing the promise of physical and mental load monitoring for health. [ABSTRACT FROM AUTHOR]

The investigation of factors contributing at making humans trust Autonomous Vehicles (AVs) will play a fundamental role in the adoption of such technology. The user's ability to form a mental model of the AV, which is crucial to establish trust, depends on effective user-vehicle communication; thus, the importance of Human-Machine Interaction (HMI) is poised to increase. In this work, we propose a methodology to validate the user experience in AVs based on continuous, objective information gathered from physiological signals, while the user is immersed in a Virtual Reality-based driving simulation. We applied this methodology to the design of a head-up display interface delivering visual cues about the vehicle's sensory and planning systems. Through this approach, we obtained qualitative and quantitative evidence that a complete picture of the vehicle's surrounding, despite the higher cognitive load, is conducive to a less stressful experience. Moreover, after having been exposed to a more informative interface, users involved in the study were also more willing to test a real AV. The proposed methodology could be extended by adjusting the simulation environment, the HMI and/or the vehicle's Artificial Intelligence modules to dig into other aspects of the user experience. [ABSTRACT FROM AUTHOR]

For a given individual, the readability of a content determines the amount of cognitive load experienced during the reading. Among many physiological parameters, the brain signals provide direct information about the cognitive load. In this paper, for a silent reading scenario, electroencephalogram (EEG) signal and pupillary response are used to address both global and localized analysis of a content. The global analysis is done using the EEG data collected from a target group of readers on whether the overall content is easy or difficult to understand. The entropy analysis of left temporal brain signals is found to grossly differentiate the texts. Detailed analysis is done using the pupil dilation to localize certain difficult segments in the content. The oscillatory behavior of the pupil dilation reveals detailed characteristics of the effect of the texts on each individual. To carry out the experiment, two types (easy and difficult) of textual contents are considered which are calibrated using standard natural language processing parameters. The proposed work presents a methodology for global and detailed analysis of a content which helps in preparing the reading materials. Furthermore, the methodology provides the insights into the reading characteristics of the individuals. [ABSTRACT FROM AUTHOR]

Computer-assisted concept map building from provided pieces by using Kit-build is an activity which can promote comprehension and retention. However, users are burdened with searching for pieces and organizing the layout, which are believed to increase the overall cognitive load of the activity. In this paper, we describe the Airmap interface, which uses automatic layout management and spatial separation to improve cognitive load during concept map building. Two experiments were done in which participants ($N= 60, N=50$) built a map after reading a text. Results show that Airmap is successful in reducing cognitive load without significant differences in immediate reading comprehension. However, there is a significant difference in performance after a two week retention period. Results give new insight into the retention enhancing aspects of building closed concept maps, indicating that the cognitive load reduced by the new interface is of the germane type, affecting how deep in memory users commit the information. [ABSTRACT FROM AUTHOR]

Recent research has unearthed that blink rate variability (BRV) can be employed as a psychophysiological measure. However, its efficiency for mental state recognition (MSR) has not been investigated yet. Because BRV can indicate dynamics inherent in eye blinks, we conjectured that BRV might exhibit stronger abilities for the MSR if compared with blink rate (BR), known as the leading indicator derived from eye blinks for MSR. Therefore, in this paper, we attempted to differentiate between high and low cognitive loads of an individual through the analyses of BR and BRV, respectively, which could be viewed as a preliminary study for comparing their MSR abilities. First, an $n$ -back experiment was performed to collect data. Then, in order to characterize the phenomenon of BRV, the features were extracted from its time and frequency domains, respectively. Finally, the area under the curve (AUC) values of BRV and BR for MSR were estimated by the ten commonly used classifiers, respectively. The results indicated that BRV achieves significantly higher AUC values than BR, which suggests its strong potentiality for MSR. In sum, the BRV may prove to be a promising method for the MSR, which should be considered in the future. [ABSTRACT FROM AUTHOR]

Orchestration load is the effort a teacher spends in coordinating multiple activities and learning processes. It has been proposed as a construct to evaluate the usability of learning technologies at the classroom level, in the same way that cognitive load is used as a measure of usability at the individual level. However, so far this notion has remained abstract. In order to ground orchestration load in empirical evidence and study it in a more systematic and detailed manner, we propose a method to quantify it, based on physiological data (concretely, mobile eye-tracking measures), along with human-coded behavioral data. This paper presents the results of applying this method to four exploratory case studies, where four teachers orchestrated technology-enhanced face-to-face lessons with primary, secondary school, and university students. The data from these studies provide a first validation of this method in different conditions, and illustrate how it can be used to understand the effect of different classroom factors on orchestration load. From these studies, we also extract empirical insights about classroom orchestration using technology. [ABSTRACT FROM AUTHOR]

This paper presents the results of two cognitive load studies comparing three augmented reality display technologies: spatial augmented reality, the optical see-through Microsoft HoloLens, and the video see-through Samsung Gear VR. In particular, the two experiments focused on isolating the cognitive load cost of receiving instructions for a button-pressing procedural task. The studies employed a self-assessment cognitive load methodology, as well as an additional dual-task cognitive load methodology. The results showed that spatial augmented reality led to increased performance and reduced cognitive load. Additionally, it was discovered that a limited field of view can introduce increased cognitive load requirements. The findings suggest that some of the inherent restrictions of head-mounted displays materialize as increased user cognitive load. [ABSTRACT FROM AUTHOR]