Search

Objective: This study aimed to examine the potential of experiencing aesthetic chills to enhance reward learning in individuals with elevated depressive symptoms, specifically anhedonia, by investigating the effect of chills on participants' ability to modulate behavior as a function of rewards., Methods: A total of 103 participants with elevated depressive symptoms took part in the experiment. Among them, 59 participants had depressive symptoms (BDI ≥ 20), with 26 classified as "High Anhedonic" (HA) and 33 as "Low Anhedonic" (LA). Additionally, 39 participants without elevated depressive symptoms (BDI < 20 and SHAPs <32) were included as the control group. We utilized ChillsDB, an open-source database of validated audiovisual stimuli known to elicit chills in the US population., Results: Anhedonic participants who experienced chills demonstrated a significant increase in response bias (p = .004) towards rewards compared to those who did not experience chills. Highlighting specificity, no significant difference in reward bias was observed among LA participants., Conclusions: These findings suggest that the experience of chills has the potential to impact reward learning in anhedonic individuals, aligning with the known neurobiology of this phenomenon. These results highlight the potential of aesthetic chills as a novel approach to elicit and enhance positive affect in depressed populations., Competing Interests: Declaration of competing interest Dr. Schoeller is the co-founder of BeSound SAS and Nested Minds LTD, holds ownership shares and has received compensation from both companies. Over the past 3 years, Dr. Pizzagalli has received consulting fees from Boehringer Ingelheim, Compass Pathways, Engrail Therapeutics, Neumora Therapeutics (formerly BlackThorn Therapeutics), Neurocrine Biosciences, Neuroscience Software, Otsuka, Sunovion, Sage Therapeutics, Sama Therapeutics, and Takeda; he has received honoraria from the American Psychological Association, Psychonomic Society and Springer (for editorial work) and from Alkermes; he has received research funding from the Brain and Behavior Research Foundation, BIRD Foundation, the Dana Foundation, DARPA, Millennium Pharmaceuticals, NIMH, and Wellcome Leap MCPsych; he has received stock options from Compass Pathways, Engrail Therapeutics, Neumora Therapeutics, and Neuroscience Software; he has a financial interest in Neumora Therapeutics, which has licensed the copyright to the probabilistic reward task through Harvard University. Dr. Pizzagalli's interests were reviewed and are managed by McLean Hospital and Partners HealthCare in accordance with their conflict of interest policies. No funding from these entities was used to support the current work, and all views expressed are solely those of the authors. All other authors have no conflicts of interest or relevant disclosures., (Copyright © 2024. Published by Elsevier B.V.)

Recent advances in visual decoding have enabled the classification and reconstruction of perceived images from the brain. However, previous approaches have predominantly relied on stationary, costly equipment like fMRI or high-density EEG, limiting the real-world availability and applicability of such projects. Additionally, several EEG-based paradigms have utilized artifactual, rather than stimulus-related information yielding flawed classification and reconstruction results. Our goal was to reduce the cost of the decoding paradigm, while increasing its flexibility. Therefore, we investigated whether the classification of an image category and the reconstruction of the image itself is possible from the visually evoked brain activity measured by a portable, 8-channel EEG. To compensate for the low electrode count and to avoid flawed predictions, we designed a theory-guided EEG setup and created a new experiment to obtain a dataset from 9 subjects. We compared five contemporary classification models with our setup reaching an average accuracy of 34.4% for 20 image classes on hold-out test recordings. For the reconstruction, the top-performing model was used as an EEG-encoder which was combined with a pretrained latent diffusion model via double-conditioning. After fine-tuning, we reconstructed images from the test set with a 1000 trial 50-class top-1 accuracy of 35.3%. While not reaching the same performance as MRI-based paradigms on unseen stimuli, our approach greatly improved the affordability and mobility of the visual decoding technology., (© 2024. The Author(s).)

Purpose: Non-verbal utterances are an important tool of communication for individuals who are non- or minimally-speaking. While these utterances are typically understood by caregivers, they can be challenging to interpret by their larger community. To date, there has been little work done to detect and characterize the vocalizations produced by non- or minimally-speaking individuals. This paper aims to characterize five categories of utterances across a set of 7 non- or minimally-speaking individuals., Methods: The characterization is accomplished using a correlation structure methodology, acting as a proxy measurement for motor coordination, to localize similarities and differences to specific speech production systems., Results: We specifically find that frustrated and dysregulated utterances show similar correlation structure outputs, especially when compared to self-talk, request, and delighted utterances. We additionally witness higher complexity of coordination between articulatory and respiratory subsystems and lower complexity of coordination between laryngeal and respiratory subsystems in frustration and dysregulation as compared to self-talk, request, and delight. Finally, we observe lower complexity of coordination across all three speech subsystems in the request utterances as compared to self-talk and delight., Conclusion: The insights from this work aid in understanding of the modifications made by non- or minimally-speaking individuals to accomplish specific goals in non-verbal communication., (© 2024. The Author(s).)

Background: Depression is a major global health challenge, affecting over 300 million people worldwide. Current pharmacological and psychotherapeutic interventions have limited efficacy, underscoring the need for novel approaches. Emerging evidence suggests that peak emotional experiences characterized by awe, transcendence, and meaning hold promise for rapidly shifting maladaptive cognitive patterns in depression. Aesthetic chills, a peak positive emotion characterized by physical sensations such as shivers and goosebumps, may influence reward-related neural pathways and hold promise for modifying core maladaptive beliefs rooted in early adverse experiences., Methods: We enrolled 96 patients diagnosed with major depressive disorder. A validated database of multimedia known to elicit chills responses (ChillsDB) was used for stimulus presentation. Participants' emotional responses were assessed using the Emotional Breakthrough Inventory (EBI), while shifts in self-schema were measured via the Young Positive Schema Questionnaire (YSPQ)., Results: The study found that chill-inducing stimuli have the potential to positively influence the core schema of individuals with depression, impacting areas of self-related beliefs. The associated phenomenology triggered by chills appears to share similarities with the altered states of consciousness induced by psychedelic substances like psilocybin., Conclusions: These preliminary results suggest that the biological processes involved in aesthetic chills could be harnessed as a non-pharmacological intervention for depression. However, further investigation is necessary to comprehensively understand the neurophysiological responses to chills and to evaluate the practicality, effectiveness, and safety of utilizing aesthetic chills as a preventive measure in mental health care., (© 2024. The Author(s).)

Interoception-the perception of internal bodily signals-has emerged as an area of interest due to its implications in emotion and the prevalence of dysfunctional interoceptive processes across psychopathological conditions. Despite the importance of interoception in cognitive neuroscience and psychiatry, its experimental manipulation remains technically challenging. This is due to the invasive nature of existing methods, the limitation of self-report and unimodal measures of interoception, and the absence of standardized approaches across disparate fields. This article integrates diverse research efforts from psychology, physiology, psychiatry, and engineering to address this oversight. Following a general introduction to the neurophysiology of interoception as hierarchical predictive processing, we review the existing paradigms for manipulating interoception (e.g., interoceptive modulation), their underlying mechanisms (e.g., interoceptive conditioning), and clinical applications (e.g., interoceptive exposure). We suggest a classification for interoceptive technologies and discuss their potential for diagnosing and treating mental health disorders. Despite promising results, considerable work is still needed to develop standardized, validated measures of interoceptive function across domains and before these technologies can translate safely and effectively to clinical settings., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

Nonverbal vocalizations, such as sighs, grunts, and yells, are informative expressions within typical verbal speech. Likewise, individuals who produce 0-10 spoken words or word approximations ("minimally speaking" individuals) convey rich affective and communicative information through nonverbal vocalizations even without verbal speech. Yet, despite their rich content, little to no data exists on the vocal expressions of this population. Here, we present ReCANVo: Real-World Communicative and Affective Nonverbal Vocalizations - a novel dataset of non-speech vocalizations labeled by function from minimally speaking individuals. The ReCANVo database contains over 7000 vocalizations spanning communicative and affective functions from eight minimally speaking individuals, along with communication profiles for each participant. Vocalizations were recorded in real-world settings and labeled in real-time by a close family member who knew the communicator well and had access to contextual information while labeling. ReCANVo is a novel database of nonverbal vocalizations from minimally speaking individuals, the largest available dataset of nonverbal vocalizations, and one of the only affective speech datasets collected amidst daily life across contexts., (© 2023. Springer Nature Limited.)

Millions suffer from sleep disorders, and sleep clinics and research institutions seek improved sleep study methods. This paper proposes the Fascia Ecosystem for Sleep Engineering to improve traditional sleep studies. The Fascia Sleep Mask is more comfortable and accessible than overnight stays at a sleep center, and the Fascia Portal and Fascia Hub allow for home-based sleep studies with real-time intervention and data analysis capabilities.A study of 10 sleep experts found that the Fascia Portal is easy to access, navigate, and use, with 44.4% finding it very easy to access, 33.3% very easy to navigate, and 60% very easy to get used to. Most experts found the Fascia Portal reliable and easy to use.Moreover, the study analyzed physiological signals during various states of sleep and wakefulness in two subjects. The results demonstrated that the Fascia dataset captured higher amplitude spindles in N2 sleep (72.20 V and 109.87 V in frontal and parietal regions, respectively) and higher peak-to-peak amplitude slow waves in N3 sleep (93.51 V) compared to benchmark datasets. Fascia produced stronger and more consistent EOG signals during REM sleep, indicating its potential to improve sleep disorder diagnosis and treatment by providing a deeper understanding of sleep patterns.

We introduce ChillsDB the first validated database of audiovisual stimuli eliciting aesthetic chills (goosebumps, psychogenic shivers) in a US population. To discover chills stimuli "in the wild", we devised a bottom-up, ecologically-valid method consisting in searching for mentions of the emotion' somatic markers in user comments throughout social media platforms (YouTube and Reddit). We successfully captured 204 chills-eliciting videos of three categories: music, film, and speech. We then tested the top 50 videos in the database on 600+ participants and validated a gold standard of 10 stimuli with a 0.9 probability of generating chills. All ChillsDB tools and data are fully available on GitHub for researchers to be able to contribute and perform further analysis., (© 2023. The Author(s).)

The link between dreams and creativity has been a topic of intense speculation. Recent scientific findings suggest that sleep onset (known as N1) may be an ideal brain state for creative ideation. However, the specific link between N1 dream content and creativity has remained unclear. To investigate the contribution of N1 dream content to creative performance, we administered targeted dream incubation (a protocol that presents auditory cues at sleep onset to introduce specific themes into dreams) and collected dream reports to measure incorporation of the selected theme into dream content. We then assessed creative performance using a set of three theme-related creativity tasks. Our findings show enhanced creative performance and greater semantic distance in task responses following a period of N1 sleep as compared to wake, corroborating recent work identifying N1 as a creative sweet spot and offering novel evidence for N1 enabling a cognitive state with greater associative divergence. We further demonstrate that successful N1 dream incubation enhances creative performance more than N1 sleep alone. To our knowledge, this is the first controlled experiment investigating a direct role of incubating dream content in the enhancement of creative performance., (© 2023. The Author(s).)

Aesthetic chills are an embodied peak emotional experience induced by stimuli such as music, films, and speeches and characterized by dopaminergic release. The emotional consequences of chills in terms of valence and arousal are still debated and the existing empirical data is conflicting. In this study, we tested the effects of ChillsDB, an open-source repository of chills-inducing stimuli, on the emotional ratings of 600+ participants. We found that participants experiencing chills reported significantly more positive valence and greater arousal during the experience, compared to participants who did not experience chills. This suggests that the embodied experience of chills may influence one's perception and affective evaluation of the context, in favor of theoretical models emphasizing the role of interoceptive signals such as chills in the process of perception and decision-making. We also found an interesting pattern in the valence ratings of participants, which tended to harmonize toward a similar mean after the experiment, though initially disparately distributed. We discuss the significance of these results for the diagnosis and treatment of dopaminergic disorders such as Parkinson's, schizophrenia, and depression., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2023 Jain, Schoeller, Horowitz, Hu, Yan, Salomon and Maes.)

The vision of extended reality (XR) systems is living in a world where real and virtual elements seamlessly and contextually augment experiences of ourselves and the worlds we inhabit. While this integration promises exciting opportunities for the future of XR, it comes with the risk of experiential distortions and feelings of dissociation, especially related to virtual reality (VR). When transitioning from a virtual world to the real world, users report of experiential structures that linger on, as sort of after images, causing disruptions in their daily life. In this work, we define these atypical experiences as experiential artifacts (EAs) and present preliminary results from an informal survey conducted online with 76 VR users to highlight different types of artifacts and their durations. To avoid disruptions caused by these artifacts and simultaneously increase the user's sense of presence, we propose the idea of situated VR, which blends the real and virtual in novel ways that can reduce incongruencies between the two worlds. We discuss the implications of EAs, and through examples from our own work in building hybrid experiences, we demonstrate the potential and relevance of situated VR in the design of a future, more immersive, artifact-free hybrid reality.

Ezzence is the first smartphone-controlled olfactometer designed for both day and night conditions. We discuss the design and technical implementation of Ezzence and report on a study to evaluate the feasibility of using the device in home-based sleep environments. The study results ( N = 40) show that participants were satisfied with the device and found it easy to use. Furthermore, participants reported a significant improvement in sleep quality when using the device with scent in comparison to the control condition ( p = 0.003), as well as better mood the following morning ( p = 0.038) and shorter time to sleep onset ( p = 0.008). The device is integrated with a wearable EEG and real-time sleep staging algorithm to release scent during specific sleep stages (N1, N2, N3, and REM), which is important for certain use cases (e.g., to study the effect of scent on REM dreams, or to improve memory consolidation with a re-exposure of scent during N2 and N3). Ezzence can be used for several applications, including those that require scent triggered day and night. They include targeted memory reactivation, longitudinal health treatments, therapy, and mental or physical exercises. Finally, this article proposes an interaction framework to understand relationships between scents and environments based on proxemic dimensions and passive or active interactions during sleep., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Amores, Dotan and Maes.)

Information processing during sleep is active, ongoing and accessible to engineering. Protocols such as targeted memory reactivation use sensory stimuli during sleep to reactivate memories and demonstrate subsequent, specific enhancement of their consolidation. These protocols rely on physiological, as opposed to phenomenological, evidence of their reactivation. While dream content can predict post-sleep memory enhancement, dreaming itself remains a black box. Here, we present a novel protocol using a new wearable electronic device, Dormio, to automatically generate serial auditory dream incubations at sleep onset, wherein targeted information is repeatedly presented during the hypnagogic period, enabling direct incorporation of this information into dream content, a process we call targeted dream incubation (TDI). Along with validation data, we discuss how Dormio and TDI protocols can serve as tools for controlled experimentation on dream content, shedding light on the role of dreams in the overnight transformation of experiences into memories., Competing Interests: Declaration of Competing Interest The authors report no conflicts of interest, (Copyright © 2020 Elsevier Inc. All rights reserved.)

We explore the application of a wide range of sensory stimulation technologies to the area of sleep and dream engineering. We begin by emphasizing the causal role of the body in dream generation, and describe a circuitry between the sleeping body and the dreaming mind. We suggest that nearly any sensory stimuli has potential for modulating experience in sleep. Considering other areas that might afford tools for engineering sensory content in simulated worlds, we turn to Virtual Reality (VR). We outline a collection of relevant VR technologies, including devices engineered to stimulate haptic, temperature, vestibular, olfactory, and auditory sensations. We believe these technologies, which have been developed for high mobility and low cost, can be translated to the field of dream engineering. We close by discussing possible future directions in this field and the ethics of a world in which targeted dream direction and sleep manipulation are feasible., (Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.)

Augmentative and alternative communication devices (AAC) can help support communication for millions of people who have differences in speech and language abilities. Existing commercial devices do not meet all the diverse needs of some individuals. Interviews and surveys were conducted with individuals who have speech or language challenges (n=4 interviews; n=15 survey respondents), or their loved ones (n=9 interviews, n=49 survey respondents). Summaries of communication practices, usage preferences, and ratings of hypothetical devices are shown. We consolidate and present qualitative feedback on user difficulties and likes for types of available commercial devices. The collected quantitative data has been de-identified and published and may be useful for others working with AAC devices and users. Building on our results, we discuss how three directions for impactful AAC development - customizable input, context-aware output, and personalized devices - could help meet the needs expressed by survey respondents in the context of technological advancements and research in the field.

Information about a person's engagement and attention might be a valuable asset in many settings including work situations, driving, and learning environments. To this end, we propose the first prototype of a device called AttentivU-a system that uses a wearable system which consists of two main components. Component 1 is represented by an EEG headband used to measure the engagement of a person in real-time. Component 2 is a scarf, which provides subtle, haptic feedback (vibrations) in real-time when the drop in engagement is detected. We tested AttentivU in two separate studies with 48 adults. The participants were engaged in a learning scenario of either watching three video lectures on different subjects or participating in a set of three face-to-face lectures with a professor. There were three conditions administrated during both studies: (1) biofeedback, meaning the scarf (component 2 of the system) was vibrating each time the EEG headband detected a drop in engagement; (2) random feedback, where the vibrations did not correlate or depend on the engagement level detected by the system, and (3) no feedback, when no vibrations were administered. The results show that the biofeedback condition redirected the engagement of the participants to the task at hand and improved their performance on comprehension tests.

This paper studies the feasibility of using low-cost motion sensors to provide opportunistic heart rate assessments from ballistocardiographic signals during restful periods of daily life. Three wearable devices were used to capture peripheral motions at specific body locations (head, wrist, and trouser pocket) of 15 participants during five regular workdays each. Three methods were implemented to extract heart rate from motion data and their performance was compared to those obtained with an FDA-cleared device. With a total of 1358 h of naturalistic sensor data, our results show that providing accurate heart rate estimations from peripheral motion signals is possible during relatively "still" moments. In our real-life workplace study, the head-mounted device yielded the most frequent assessments (22.98% of the time under 5 beats per minute of error) followed by the smartphone in the pocket (5.02%) and the wrist-worn device (3.48%). Most importantly, accurate assessments were automatically detected by using a custom threshold based on the device jerk. Due to the pervasiveness and low cost of wearable motion sensors, this paper demonstrates the feasibility of providing opportunistic large-scale low-cost samples of resting heart rate.

Releasing scent during sleep has been shown to influence the emotional valence of dreams, reduce cigarette smoking behavior, strengthen memories as well as enhance restorative slow-wave activity. Nevertheless, current scent technologies used in sleep laboratories are not portable and require the use of nasal masks and large olfactometers. In this paper we investigated the preferred form factor and acceptance of a set of biometric wearables that can release scent based on the user's physiological state. We conducted an online survey with 163 participants and evaluated 8 different form factors. The results showed that 73.5% of the subjects preferred the designs that are not wearable during the night but that can be worn during the day. We provide insights to take into account for the design of next generation sleep-olfactory technologies. We provide a literature review of sleep and scent studies and discuss the opportunities for well-being and memory applications.

Everyday work is becoming increasingly complex and cognitively demanding. A person's level of attention influences how effectively their brain prepares itself for action, and how much effort they apply to a task. However, the various distractions of the modern work environment often make it hard to pay and sustain attention. To address this issue, we present AttentivU - a system that uses wearable electroencephalography (EEG) to measure the attention of a person in real-time. When the user's attention level is low, the system provides real-time, subtle feedback to nudge the person to become attentive again. Users can choose to turn the device on or off based on whether their current task requires focused attention. We tested the system on 12 adults in a real workplace setting. The preliminary results show that the biofeedback redirects the attention of the participants to the task at hand and improves their performance.

Wearables are being widely researched for monitoring individual's health and wellbeing. Current generation wearable devices sense an individual's physiological data such as heart rate, respiration, electrodermal activity, and EEG, but lack in sensing their biological counterparts, which drive the majority of individual's physiological signals. On the other hand, biosensors for detecting biochemical markers are currently limited to one-time use, are non-continuous and don't provide flexibility in choosing which biomarker they sense. We present "wearable lab on body", a platform for active continuous monitoring of human biomarkers from the biological fluid. Our platform contains both digital sensors such as IMU for activity recognition, as well as an automated system for continuous sampling of biomarkers from saliva by leveraging already existing paper-based biochemical sensors. The platform could aid with longitudinal studies of biomarkers and early diagnosis of diseases.

We propose a new area for wearable technology and interaction by acquiring gastrointestinal signals non-invasively from the abdomen. The mind-gut connection has flourished as a research area in the past two decades, elucidating the guts key role in stress, affect, and memory. Meanwhile, engineering advancements have shown potential in accuracy of non-invasive gastric recordings. Here, we investigate the design and specification of a wearable system for the recording of gut-brain activity non-invasively. We also present results from a preliminary pilot test of a wearable gut-brain computer interface (GBCI).

We present Oasis, a novel system for automatically generating immersive and interactive virtual reality environments for single and multiuser experiences. Oasis enables real-walking in the generated virtual environment by capturing indoor scenes in 3D and mapping walkable areas. It makes use of available depth information for recognizing objects in the real environment which are paired with virtual counterparts to leverage the physicality of the real world, for a more immersive virtual experience. Oasis allows co-located and remotely located users to interact seamlessly and walk naturally in a shared virtual environment. Experiencing virtual reality with currently available devices can be cumbersome due to presence of objects and furniture which need to be removed every time the user wishes to use VR. Our approach is new, in that it allows casual users to easily create virtual reality environments in any indoor space without rearranging furniture or requiring specialized equipment, skill or training. We demonstrate our approach to overlay a virtual environment over an existing physical space through fully working single and multiuser systems implemented on a Tango tablet device.

Occurrences of unknown words in a conversation can be challenging and often prevent people from engaging in fluent communication with each other. Even worse, currently very little is known about possible bodily responses when a listener comes across unknown words, especially when context information is not available in the conversation to facilitate understanding. In this work, we look at facial expressions and electroencephalography (EEG) as two potential body signals that may convey whether users are having difficulties understanding the words they hear. We performed an experiment to measure the reaction of users during a vocabulary dictation test using meaningful words and pseudowords. Participants were asked to classify words as they heard them into different categories. As a result, we did not see any significant differences in the facial expressions of our participants. However, significant differences were observed in event-related potentials (ERPs) within the time range of 100ms-300ms since the onset of stimuli, with pseudowords showing significantly stronger negative responses than meaningful words. Starting at about 550ms and up to around 750ms, pseudowords elicited significantly stronger negative responses, primarily over the parietal and central brain regions. Analyses for single-electrode sites revealed that pseudowords elicited more negative responses than real words in all investigated regions except the left temporal and lateral frontal regions from 500ms to 700ms since stimuli onset. These results could pave the way for future work that aims to develop real-time solutions for facilitating communication between users with different language backgrounds.

This work introduces a novel wearable olfactory display that provides just-in-time release of scents based on the physiological state of the wearer. The device can release up to three scents and passively captures subtle chest vibrations associated with the beating of the heart and respiration through clothes.BioEssenceiscontrolledviaacustom-madesmartphone app that allows the creation of physiological rules to trigger different scents (e.g., when the heart rate is above 80 beats per minute, release lavender scent). The device is wireless and lightweight, and it is designed to be used during daily life, clipped on clothes around the sternum area or used as a necklace. We provide a description of the design and implementation of the prototype and potential use cases in the context of mental wellbeing.