Search

Ocular artifacts, including blinks and saccades, pose significant challenges in the analysis of electroencephalographic (EEG) data, often obscuring crucial neural signals. This tutorial provides a comprehensive guide to the most effective methods for correcting these artifacts, with a focus on algorithms designed for both laboratory and real-world settings. We review traditional approaches, such as regression-based techniques and Independent Component Analysis (ICA), alongside more advanced methods like Artifact Subspace Reconstruction (ASR) and deep learning-based algorithms. Through detailed step-by-step instructions and comparative analysis, this tutorial equips researchers with the tools necessary to maintain the integrity of EEG data, ensuring accurate and reliable results in neurophysiological studies. The strategies discussed are particularly relevant for wearable EEG systems and real-time applications, reflecting the growing demand for robust and adaptable solutions in applied neuroscience.

Background/Objectives: Given the importance of emotion recognition for communication purposes, and the impairment for such skill in CI users despite impressive language performances, the aim of the present study was to investigate the neural correlates of emotion recognition skills, apart from language, in adult unilateral CI (UCI) users during a music in noise (happy/sad) recognition task. Furthermore, asymmetry was investigated through electroencephalographic (EEG) rhythm, given the traditional concept of hemispheric lateralization for emotional processing, and the intrinsic asymmetry due to the clinical UCI condition. Methods: Twenty adult UCI users and eight normal hearing (NH) controls were recruited. EEG gamma and alpha band power was assessed as there is evidence of a relationship between gamma and emotional response and between alpha asymmetry and tendency to approach or withdraw from stimuli. The TAS-20 questionnaire (alexithymia) was completed by the participants. Results: The results showed no effect of background noise, while supporting that gamma activity related to emotion processing shows alterations in the UCI group compared to the NH group, and that these alterations are also modulated by the etiology of deafness. In particular, relative higher gamma activity in the CI side corresponds to positive processes, correlated with higher emotion recognition abilities, whereas gamma activity in the non-CI side may be related to positive processes inversely correlated with alexithymia and also inversely correlated with age; a correlation between TAS-20 scores and age was found only in the NH group. Conclusions: EEG gamma activity appears to be fundamental to the processing of the emotional aspect of music and also to the psychocognitive emotion-related component in adults with CI.

Cochlear implants (CI) allow deaf patients to improve language perception and improving their emotional valence assessment. Electroencephalographic (EEG) measures were employed so far to improve CI programming reliability and to evaluate listening effort in auditory tasks, which are particularly useful in conditions when subjective evaluations are scarcely appliable or reliable. Unfortunately, the presence of CI on the scalp introduces an electrical artifact coupled to EEG signals that masks physiological features recorded by electrodes close to the site of implant. Currently, methods for CI artifact removal have been developed for very specific EEG montages or protocols, while others require many scalp electrodes. In this study, we propose a method based on the Multi-channel Wiener filter (MWF) to overcome those shortcomings. Nine children with unilateral CI and nine age-matched normal hearing children (control) participated in the study. EEG data were acquired on a relatively low number of electrodes (n = 16) during resting condition and during an auditory task. The obtained results obtained allowed to characterize CI artifact on the affected electrode and to significantly reduce, if not remove it through MWF filtering. Moreover, the results indicate, by comparing the two sample populations, that the EEG data loss is minimal in CI users after filtering, and that data maintain EEG physiological characteristics.

Background: Despite substantial progress in investigating its psychophysical complexity, tinnitus remains a scientific and clinical enigma. The present study, through an ecological and multidisciplinary approach, aims to identify associations between electroencephalographic (EEG) and psycho-audiological variables. Methods: EEG beta activity, often related to stress and anxiety, was acquired from 12 tinnitus patients (TIN group) and 7 controls (CONT group) during an audio cognitive task and at rest. We also investigated psychological (SCL-90-R; STAI-Y; BFI-10) and audiological (THI; TQ12-I; Hyperacusis) variables using non-parametric statistics to assess differences and relationships between and within groups. Results: In the TIN group, frontal beta activity positively correlated with hyperacusis, parietal activity, and trait anxiety; the latter is also associated with depression in CONT. Significant differences in paranoid ideation and openness were found between groups. Conclusions: The connection between anxiety trait, beta activity in the fronto-parietal cortices and hyperacusis provides insights into brain functioning in tinnitus patients, offering quantitative descriptions for clinicians and new multidisciplinary treatment hypotheses.

Auditory stimulation activates brain areas associated with higher cognitive processes, like the prefrontal cortex (PFC), and plays a role in postural control regulation. However, the effects of specific frequency stimuli on upright posture maintenance and PFC activation patterns remain unknown. Therefore, the study aims at filling this gap. Twenty healthy adults performed static double- and single-leg stance tasks of 60s each under four auditory conditions: 500, 1000, 1500, and 2000 Hz, binaurally delivered through headphones, and in quiet condition. Functional near-infrared spectroscopy was used to measure PFC activation through changes in oxygenated hemoglobin concentration, while an inertial sensor (sealed at the L5 vertebra level) quantified postural sway parameters. Perceived discomfort and pleasantness were rated through a 0–100 visual analogue scale (VAS). Results showed that in both motor tasks, different PFC activation patterns were displayed at the different auditory frequencies and the postural performance worsened with auditory stimuli, compared to quiet conditions. VAS results showed that higher frequencies were considered more discomfortable than lower ones. Present data prove that specific sound frequencies play a significant role in cognitive resources recruitment and in the regulation of postural control. Furthermore, it supports the importance of exploring the relationship among tones, cortical activity, and posture, also considering possible applications with neurological populations and people with hearing dysfunctions.

Vigilance refers to the capability of humans to respond accordingly to relevant and unpredictable tasks and surrounding environment changes over prolonged periods of time. Identifying vigilance decrements can, therefore, have huge and vital impacts on several operational environments in which a simple slip of mind or a deficit in attention can bear life-threatening and disastrous consequences. Several methodologies have been proposed to assess and characterize vigilance, and the results have indicated that the sole measure of performance and self-reports are not enough to obtain reliable and real-time vigilance measure. Nowadays, monitoring head and body movements to obtain information about performance in daily activities, health conditions, and mental states has become very simple and cheap due to the miniaturization of inertial measurement units and their widespread integration into common electronic devices (e.g., smart glasses, smartwatches). The present study aimed to understand the relationship between head micromovements and body posture changes to vigilance decrease while performing the psychomotor vigilance task. The results highlighted that head micromovements can be employed to track vigilance decrement during prolonged periods of time and discriminate between conditions of high or low vigilance.

Despite the plethora of studies investigating listening effort and the amount of research concerning music perception by cochlear implant (CI) users, the investigation of the influence of background noise on music processing has never been performed. Given the typical speech in noise recognition task for the listening effort assessment, the aim of the present study was to investigate the listening effort during an emotional categorization task on musical pieces with different levels of background noise. The listening effort was investigated, in addition to participants' ratings and performances, using EEG features known to be involved in such phenomenon, that is alpha activity in parietal areas and in the left inferior frontal gyrus (IFG), that includes the Broca's area. Results showed that CI users performed worse than normal hearing (NH) controls in the recognition of the emotional content of the stimuli. Furthermore, when considering the alpha activity corresponding to the listening to signal to noise ratio (SNR) 5 and SNR10 conditions subtracted of the activity while listening to the Quiet condition-ideally removing the emotional content of the music and isolating the difficulty level due to the SNRs- CI users reported higher levels of activity in the parietal alpha and in the homologous of the left IFG in the right hemisphere (F8 EEG channel), in comparison to NH. Finally, a novel suggestion of a particular sensitivity of F8 for SNR-related listening effort in music was provided.

Background noise elicits listening effort. What else is tinnitus if not an endogenous background noise? From such reasoning, we hypothesized the occurrence of increased listening effort in tinnitus patients during listening tasks. Such a hypothesis was tested by investigating some indices of listening effort through electroencephalographic and skin conductance, particularly parietal and frontal alpha and electrodermal activity (EDA). Furthermore, tinnitus distress questionnaires (THI and TQ12-I) were employed. Parietal alpha values were positively correlated to TQ12-I scores, and both were negatively correlated to EDA; Pre-stimulus frontal alpha correlated with the THI score in our pilot study; finally, results showed a general trend of increased frontal alpha activity in the tinnitus group in comparison to the control group. Parietal alpha during the listening to stimuli, positively correlated to the TQ12-I, appears to reflect a higher listening effort in tinnitus patients and the perception of tinnitus symptoms. The negative correlation between both listening effort (parietal alpha) and tinnitus symptoms perception (TQ12-I scores) with EDA levels could be explained by a less responsive sympathetic nervous system to prepare the body to expend increased energy during the “fight or flight” response, due to pauperization of energy from tinnitus perception.

Art experience is not solely the observation of artistic objects, but great relevance is also placed on the environment in which the art experience takes place, often in museums and galleries. Interestingly, in the last few years, the introduction of some forms of virtual reality (VR) in museum contexts has been increasing. This has solicited enormous research interest in investigating any eventual differences between looking at the same artifact either in a real context (e.g. a museum) and in VR. To address such a target, a neuroaesthetic study was performed in which electroencephalography (EEG) and autonomic signals (heart rate and skin conductance) were recorded during the observation of the Etruscan artifact “Sarcophagus of the Spouses”, both in the museum and in a VR reproduction. Results from EEG analysis showed a higher level of the Workload Index during observation in the museum compared to VR (p = 0.04), while the Approach–Withdrawal Index highlighted increased levels during the observation in VR compared to the observation in the museum (p = 0.03). Concerning autonomic indices, the museum elicited a higher Emotional Index response than the VR (p = 0.03). Overall, preliminary results suggest a higher engagement potential of the museum compared to VR, although VR could also favour higher embodiment than the museum.

Poetry elicits emotions, and emotion is a fundamental component of human ontogeny. Although neuroaesthetics is a rapidly developing field of research, few studies focus on poetry, and none address its different modalities of fruition (MOF) of universal cultural heritage works, such as the Divina Commedia (DC) poem. Moreover, alexithymia (AX) resulted in being a psychological risk factor during the COVID-19 pandemic. The present study aims to investigate the emotional response to poetry excerpts from different cantica (Inferno, Purgatorio, Paradiso) of DC with the dual objective of assessing the impact of both the structure of the poem and MOF and that of the characteristics of the acting voice in experts and non-experts, also considering AX. Online emotion facial coding biosignal (BS) techniques, self-reported and psychometric measures were applied to 131 literary (LS) and scientific (SS) university students. BS results show that LS globally manifest more JOY than SS in both reading and listening MOF and more FEAR towards Inferno. Furthermore, LS and SS present different results regarding NEUTRAL emotion about acting voice. AX influences listening in NEUTRAL and SURPRISE expressions. DC’s structure affects DISGUST and SADNESS during listening, regardless of participant characteristics. PLEASANTNESS varies according to DC’s structure and the acting voice, as well as AROUSAL, which is also correlated with AX. Results are discussed in light of recent findings in affective neuroscience and neuroaesthetics, suggesting the critical role of poetry and listening in supporting human emotional processing.

Display and native ads represent two of the most widely used digital advertising formats employed by advertisers that aim to grab the attention of online users. In recent years, the native format has become very popular because it relies on deceptive features that make harder the recognition of its advertising nature, reducing avoiding behaviors such as the banner blindness phenomena, traditionally associated to display advertising, and so increasing its advertising effectiveness. The present study, based on a forefront research protocol specifically designed for the advertising research on smartphone devices, aims to investigate through neurophysiological and self-reported measures, the perception of display and native ads placed within article webpages, and to assess the efficacy of an integrated approach. Eye-tracking results showed higher visual attention and longer viewing time associated with native advertisements in comparison to traditional display advertisements, confirming and extending evidence provided by previous research. Despite a significantly higher rate of self-reported advertising intent was detected for articles containing display ads when compared to articles containing native ads, no differences have been found while performing the same comparison for the neurophysiological measures of emotional involvement and approaching motivation of for the self-reported measures of pleasantness and annoyance. Such findings along with the employment of an innovative research protocol, contribute to providing further cues to the current debate related to the effectiveness of two of the most widely used digital advertising formats.

In recent years, technological advances and the introduction of social streaming platforms (e.g., Twitch) have contributed to an increase in the popularity of esports, a highly profitable industry with millions of active users. In this context, there is little evidence, if any, on how users perceive in-game advertising (IGA) and other key elements of the game viewing experience (e.g., facecam and chat) in terms of visual attention. The present eye-tracking study aimed at investigating those aspects, and introducing an eye-tracking research protocol specifically designed to accurately measure the visual attention associated with key elements of the game viewing experience. Results showed that (1) the ads available in the game view (IGAs) are capable altogether to attract 3.49% of the users’ visual attention; (2) the chat section draws 10.68% of the users’ visual attention and more than the streamer’s face, known as a powerful attentional driver; (3) the animated ad format elicits higher visual attention (1.46%) than the static format (1.12%); and (4) in some circumstances, the visual attention elicited by the ads is higher in the “Goal” scenes (0.69%) in comparison to “No-Goal” scenes (0.51%). Relevant managerial implications and future directions for the esports industry are reported and discussed.

This pilot study investigates the neurophysiological patterns of visual and auditory verbal working memory (VWM) in unilateral cochlear implant users (UCIs). We compared the task-related electroencephalogram (EEG) power spectral density of 7- to 13-year-old UCIs (n = 7) with a hearing control group (HC, n = 10) during the execution of a three-level n-back task with auditory and visual verbal (letters) stimuli. Performances improved as memory load decreased regardless of sensory modality (SM) and group factors. Theta EEG activation over the frontal area was proportionally influenced by task level; the left hemisphere (LH) showed greater activation in the gamma band, suggesting lateralization of VWM function regardless of SM. However, HCs showed stronger activation patterns in the LH than UCIs regardless of SM and in the parietal area (PA) during the most challenging audio condition. Linear regressions for gamma activation in the PA suggest the presence of a pattern-supporting auditory VWM only in HCs. Our findings seem to recognize gamma activation in the PA as the signature of effective auditory VWM. These results, although preliminary, highlight this EEG pattern as a possible cause of the variability found in VWM outcomes in deaf children, opening up new possibilities for interdisciplinary research and rehabilitation intervention.

In deaf children, huge emphasis was given to language; however, emotional cues decoding and production appear of pivotal importance for communication capabilities. Concerning neurophysiological correlates of emotional processing, the gamma band activity appears a useful tool adopted for emotion classification and related to the conscious elaboration of emotions. Starting from these considerations, the following items have been investigated: (i) whether emotional auditory stimuli processing differs between normal-hearing (NH) children and children using a cochlear implant (CI), given the non-physiological development of the auditory system in the latter group; (ii) whether the age at CI surgery influences emotion recognition capabilities; and (iii) in light of the right hemisphere hypothesis for emotional processing, whether the CI side influences the processing of emotional cues in unilateral CI (UCI) children. To answer these matters, 9 UCI (9.47 ± 2.33 years old) and 10 NH (10.95 ± 2.11 years old) children were asked to recognize nonverbal vocalizations belonging to three emotional states: positive (achievement, amusement, contentment, relief), negative (anger, disgust, fear, sadness), and neutral (neutral, surprise). Results showed better performances in NH than UCI children in emotional states recognition. The UCI group showed increased gamma activity lateralization index (LI) (relative higher right hemisphere activity) in comparison to the NH group in response to emotional auditory cues. Moreover, LI gamma values were negatively correlated with the percentage of correct responses in emotion recognition. Such observations could be explained by a deficit in UCI children in engaging the left hemisphere for more demanding emotional task, or alternatively by a higher conscious elaboration in UCI than NH children. Additionally, for the UCI group, there was no difference between the CI side and the contralateral side in gamma activity, but a higher gamma activity in the right in comparison to the left hemisphere was found. Therefore, the CI side did not appear to influence the physiologic hemispheric lateralization of emotional processing. Finally, a negative correlation was shown between the age at the CI surgery and the percentage of correct responses in emotion recognition and then suggesting the occurrence of a sensitive period for CI surgery for best emotion recognition skills development.

Air Traffic Management (ATM) will be more complex in the coming decades due to the growth and increased complexity of aviation and has to be improved in order to maintain aviation safety. It is agreed that without significant improvement in this domain, the safety objectives defined by international organisations cannot be achieved and a risk of more incidents/accidents is envisaged. Nowadays, computer science plays a major role in data management and decisions made in ATM. Nonetheless, despite this, Artificial Intelligence (AI), which is one of the most researched topics in computer science, has not quite reached end users in ATM domain. In this paper, we analyse the state of the art with regards to usefulness of AI within aviation/ATM domain. It includes research work of the last decade of AI in ATM, the extraction of relevant trends and features, and the extraction of representative dimensions. We analysed how the general and ATM eXplainable Artificial Intelligence (XAI) works, analysing where and why XAI is needed, how it is currently provided, and the limitations, then synthesise the findings into a conceptual framework, named the DPP (Descriptive, Predictive, Prescriptive) model, and provide an example of its application in a scenario in 2030. It concludes that AI systems within ATM need further research for their acceptance by end-users. The development of appropriate XAI methods including the validation by appropriate authorities and end-users are key issues that needs to be addressed.

Abstract Several models defining different types of cognitive human behaviour are available. For this work, we have selected the Skill, Rule and Knowledge (SRK) model proposed by Rasmussen in 1983. This model is currently broadly used in safety critical domains, such as the aviation. Nowadays, there are no tools able to assess at which level of cognitive control the operator is dealing with the considered task, that is if he/she is performing the task as an automated routine (skill level), as procedures-based activity (rule level), or as a problem-solving process (knowledge level). Several studies tried to model the SRK behaviours from a Human Factor perspective. Despite such studies, there are no evidences in which such behaviours have been evaluated from a neurophysiological point of view, for example, by considering brain activity variations across the different SRK levels. Therefore, the proposed study aimed to investigate the use of neurophysiological signals to assess the cognitive control behaviours accordingly to the SRK taxonomy. The results of the study, performed on 37 professional Air Traffic Controllers, demonstrated that specific brain features could characterize and discriminate the different SRK levels, therefore enabling an objective assessment of the degree of cognitive control behaviours in realistic settings.

Scents have the ability to affect peoples’ mental states and task performance with to different extents. It has been widely demonstrated that the lemon scent, included in most all-purpose cleaners, elicits stimulation and activation, while the lavender scent elicits relaxation and sedative effects. The present study aimed at investigating and fostering a novel approach to evaluate users’ experience with respect to scents’ effects through the joint employment of Virtual Reality and users’ neurophysiological monitoring, in particular Electroencephalography. In particular, this study, involving 42 participants, aimed to compare the effects of lemon and lavender scents on the deployment of cognitive resources during a daily life experience consisting in a train journey carried out in virtual reality. Our findings showed a significant higher request of cognitive resources during the processing of an informative message for subjects exposed to the lavender scent with respect to the lemon exposure. No differences were found between lemon and lavender conditions on the self-reported items of pleasantness and involvement; as this study demonstrated, the employment of the lavender scent preserves the quality of the customer experience to the same extent as the more widely used lemon scent.

Neuroaesthetics, the science studying the biological underpinnings of aesthetic experience, recently extended its area of investigation to literary art; this was the humus where neurocognitive poetics blossomed. Divina Commedia represents one of the most important, famous and studied poems worldwide. Poetry stimuli are characterized by elements (meter and rhyme) promoting the processing fluency, a core aspect of neuroaesthetics theories. In addition, given the evidence of different neurophysiological reactions between experts and non-experts in response to artistic stimuli, the aim of the present study was to investigate, in poetry, a different neurophysiological cognitive and emotional reaction between Literature (L) and Non-Literature (NL) students. A further aim was to investigate whether neurophysiological underpinnings would support explanation of behavioral data. Investigation methods employed: self-report assessments (recognition, appreciation, content recall) and neurophysiological indexes (approach/withdrawal (AW), cerebral effort (CE) and galvanic skin response (GSR)). The main behavioral results, according to fluency theories in aesthetics, suggested in the NL but not in the L group that the appreciation/liking went hand by hand with the self-declared recognition and with the content recall. The main neurophysiological results were: (i) higher galvanic skin response in NL, whilst higher CE values in L; (ii) a positive correlation between AW and CE indexes in both groups. The present results extended previous evidence relative to figurative art also to auditory poetry stimuli, suggesting an emotional attenuation “expertise-specific” showed by experts, but increased cognitive processing in response to the stimuli.

Tobacco constitutes a global emergency with totally preventable millions of deaths per year and smoking-related illnesses. Public service announcements (PSAs) are the main tool against smoking and by now their efficacy is still assessed through questionnaires and metrics, only months after their circulation. The present study focused on the young population, because at higher risk of developing tobacco addiction, investigating the reaction to the vision of Effective, Ineffective and Awarded antismoking PSAs through: electroencephalography (EEG), autonomic activity variation (Galvanic skin response—GSR- and Heart Rate—HR-) and Eye-Tracking (ET). The employed indices were: the EEG frontal alpha band asymmetry and the frontal theta; the Emotional Index (EI), deriving from the GSR and HR signals matching; the ET Visual Attention (VA) index, based on the ratio between the total time spent fixating an area of interest (AOI) and its area. Smokers expressed higher frontal alpha asymmetry values in comparison to non-smokers. Concerning frontal theta, Awarded PSAs reported the highest values in comparison to both Effective and Ineffective PSAs. EI results highlighted that lowest values were expressed by Heavy Smokers (HS), and Effective PSAs obtained the highest EI values. Finally, concerning the Effective PSAs, regression analysis highlighted a correlation between the number of cigarettes smoked by participants (independent variable) and frontal alpha asymmetry, frontal theta and EI values. ET results suggested that for the Ineffective PSAs the main focus were texts, while for the Effective and Awarded PSAs were the visual elements. Results support the use of methods aimed at assessing the physiological reaction for the evaluation of PSAs images, in particular when considering the smoking habits of target populations.

Investment decisions are largely based on the information investors received from the target firm. Thaler introduced the hedonic editing framework, in which suggests that integration/segregation of information influence individual's perceived value. Meanwhile, when evaluating the evidence and information in a sequence, order effect and biases have been found to have an impact in various areas. In this research, the influence of the Organization of Information (Integration vs. Segregation) and the Sequence of Information (Negative-Positive order vs. Positive-Negative order) on individual's investment decision-making both at the behavioral level (decision) and neurometrix level (measured by an individual's emotion and Approach Withdraw tendency) was assessed for the three groups of information: a piece of Big Positive Information and a piece of Small Negative Information, a piece of Big Negative Information and a piece of Small Positive Information, and a piece of Small Negative information. The behavioral results, which are an individual's final investment decision, were consistent for all three scenarios. In general, individuals will invest more/retire less when receiving two pieces of information in a Negative-Positive order. However, the neurometric results (Emotional Index, Approach Withdraw Index and results from LORETA) show differences among information groups. An effect of the Sequence of Information and the Organization of Information was found for the different scenarios. The results suggest that in the scenarios that involve large-scale information, the organization of information (Integration vs. Segregation) influences the emotion and Approach Withdraw tendency. The results of this investigation should provide insight for effective communication of information, especially when large-scale information is involved.