Search

Michael Busse,1 David Stevens,3 Annette Kraegeloh,2 Christian Cavelius,2 Mathias Vukelic,1 Eduard Arzt,2 Daniel J Strauss1,2 1Systems Neuroscience and Neurotechnology Unit, Saarland University, Faculty of Medicine, Neurocenter, and Saarland University of Applied Sciences, Homburg/Saarbruecken, Germany; 2Leibniz Institute for New Materials, Saarbruecken, Germany; 3Department of Physiology, Saarland University, Faculty of Medicine, Homburg/Saarbruecken, Germany Background: Beside the promising application potential of nanotechnologies in engineering, the use of nanomaterials in medicine is growing. New therapies employing innovative nanocarrier systems to increase specificity and efficacy of drug delivery schemes are already in clinical trials. However the influence of the nanoparticles themselves is still unknown in medical applications, especially for complex interactions in neural systems. The aim of this study was to investigate in vitro effects of coated silver nanoparticles (cAgNP) on the excitability of single neuronal cells and to integrate those findings into an in silico model to predict possible effects on neuronal circuits. Methods: We first performed patch clamp measurements to investigate the effects of nanosized silver particles, surrounded by an organic coating, on excitability of single cells. We then determined which parameters were altered by exposure to those nanoparticles using the Hodgkin–Huxley model of the sodium current. As a third step, we integrated those findings into a well-defined neuronal circuit of thalamocortical interactions to predict possible changes in network signaling due to the applied cAgNP, in silico. Results: We observed rapid suppression of sodium currents after exposure to cAgNP in our in vitro recordings. In numerical simulations of sodium currents we identified the parameters likely affected by cAgNP. We then examined the effects of such changes on the activity of networks. In silico network modeling indicated effects of local cAgNP application on firing patterns in all neurons in the circuit. Conclusion: Our sodium current simulation shows that suppression of sodium currents by cAgNP results primarily by a reduction in the amplitude of the current. The network simulation shows that locally cAgNP-induced changes result in changes in network activity in the entire network, indicating that local application of cAgNP may influence the activity throughout the network. Keywords: coated silver nanoparticles, modeling, patch clamp recordings, neuronal circuit model, neuromodulatory effect, nanocarriers, nonviral vectors, Llinás model

The detection of binaural interaction is of diagnostic interest in patients with central auditory processing disorders (CAPDs), as binaural hearing tasks are frequently affected in these patients. Owing to the comorbidity associated with disorders such as an attention-deficit hyperactivity disorder, pathological results in subjective tests often show extra-auditory factors such as reduced attention rather than impaired central auditory function. Therefore, objective measures for auditory processing disorders are essential. The binaural interaction component (BIC), which is the arithmetical difference between the sum of the monaurally evoked auditory potentials of each ear and the binaurally evoked brainstem potentials, has been used as an objective measure of binaural interaction in humans. BIC measurements can therefore be considered as a possible diagnostic tool in CAPD patients. One aim of the present study was to examine whether and to what extent BIC measurements are capable of differentiating between normal children and children 'at risk for CAPD'. BIC measurements were performed on 17 children at risk for CAPD and in a group of 25 children with normal results in the central audiometric tests used. Using the presence or absence of clearly demonstrable BIC waveforms as an indication of whether a CAPD is present or not, a sensitivity and specificity of 76% could be achieved. We conclude that BIC measurements might be of some diagnostic value in CAPD patients. [ABSTRACT FROM AUTHOR]

The objective of this study was to determine which causes of death are more frequent in persons with autism, and by how much, compared with the general population. Subjects were 13,111 ambulatory Californians with autism, followed between 1983 and 1997. The units of study were person-years, each linked to the subject's age, sex, and cause of death (if any) for the specific year. Observed numbers of cause-specific deaths were compared with numbers expected according to general population mortality rates. Standardized mortality rates (SMRs) were computed for each mental retardation level. Elevated death rates were observed for several causes, including seizures and accidents such as suffocation and drowning; elevated mortality due to respiratory disease was observed among persons with severe mental retardation. Overall, excess mortality was especially marked for persons with severe mental retardation, but life expectancy is reduced even for persons who are fully ambulatory and who have only mild mental retardation. [ABSTRACT FROM AUTHOR]

Objective. To create highly immersive experiences in virtual reality (VR) it is important to not only include the visual sense but also to involve multimodal sensory input. To achieve optimal results, the temporal and spatial synchronization of these multimodal inputs is critical. It is therefore necessary to find methods to objectively evaluate the synchronization of VR experiences with a continuous tracking of the user. Approach. In this study a passive touch experience was incorporated in a visual-tactile VR setup using VR glasses and tactile sensations in mid-air. Inconsistencies of multimodal perception were intentionally integrated into a discrimination task. The participants' electroencephalogram (EEG) was recorded to obtain neural correlates of visual-tactile mismatch situations. Main results. The results showed significant differences in the event-related potentials (ERP) between match and mismatch situations. A biphasic ERP configuration consisting of a positivity at 120 ms and a later negativity at 370 ms was observed following a visual-tactile mismatch. Significance. This late negativity could be related to the N400 that is associated with semantic incongruency. These results provide a promising approach towards the objective evaluation of visual-tactile synchronization in virtual experiences., (Creative Commons Attribution license.)

The vestigial pinna-orienting system in humans is capable of increasing the activity of several auricular muscles in response to lateralized transient auditory stimuli. For example, transient increases in electromyographic activity in the posterior auricular muscle (PAM) to an attention-capturing stimulus have been documented. For the current study, surface electromyograms (EMGs) were recorded from the PAMs and superior auricular muscles (SAMs) of 10 normal-hearing participants. During the experiments, lateralized transient auditory stimuli, such as a crying baby, a shattering vase, or the participant's first names, were presented. These transient stimuli were either presented in silence or when participants actively listened to a podcast. Although ipsilateral PAM activity increased in response to transient stimuli, the SAM displayed the opposite behavior, i.e., a brief, ipsilateral suppression of activity. This suppression of ipsilateral SAM activity was more frequent on the right (75%) than left side (35%), whereas an ipsilateral PAM increase was roughly equal in prevalence on the two sides (left: 90%, right: 95%). During the active listening task, SAM suppression on the right ear was significantly larger in response to ipsilateral stimuli, compared with contralateral ones ( P = 0.002), whereas PAM activity increased significantly ( P = 0.002). Overall, this study provides evidence of a systematic transient suppression of the SAM during exogenous attention. This could suggest a more complex system than previously assumed, as the presence of synchronized excitatory and inhibitory components in different auricular muscles points toward a coordinated attempt at reflexively orienting the pinna toward a sound. NEW & NOTEWORTHY This study provides evidence that two auricular muscles in humans, the posterior and superior auricular muscles (PAM, SAM), react fundamentally different to lateralized transient auditory stimuli, especially during active listening. Although the PAM reacts with a transient increase in ipsilateral activity, ongoing ipsilateral SAM activity is briefly suppressed at the same time. This indicates the presence of a more complex and nuanced pinna-orienting system, with synchronized excitatory and inhibitory components in humans, than previously suspected.

Currently, we face an exponentially increasing interest in immersion, especially sensory-driven immersion, mainly due to the rapid development of ideas and business models centered around a digital virtual universe as well as the increasing availability of affordable immersive technologies for education, communication, and entertainment. However, a clear definition of 'immersion', in terms of established neurocognitive concepts and measurable properties, remains elusive, slowing research on the human side of immersive interfaces. To address this problem, we propose a conceptual, taxonomic model of attention in immersion. We argue (a) modeling immersion theoretically as well as studying immersion experimentally requires a detailed characterization of the role of attention in immersion, even though (b) attention, while necessary, cannot be a sufficient condition for defining immersion. Our broader goal is to characterize immersion in terms that will be compatible with established psychophysiolgical measures that could then in principle be used for the assessment and eventually the optimization of an immersive experience. We start from the perspective that immersion requires the projection of attention to an induced reality, and build on accepted taxonomies of different modes of attention for the development of our two-competitor model. The two-competitor model allows for a quantitative implementation and has an easy graphical interpretation. It helps to highlight the important link between different modes of attention and affect in studying immersion., Competing Interests: Declaration of Competing Interest The authors have declared no competing interest., (Copyright © 2024. Published by Elsevier Inc.)

The combination of neurotechnology and metaverse holds high potentials for orthopedics, as it offers a broad spectrum of possibilities to overcome the limits of traditional medical care. The vision of a medical metaverse providing the infrastructure as a link for innovative technologies opens up new opportunities for therapy, medical collaborations and practical, personalized training for aspiring physicians. However, risks and challenges, such as security and privacy, health-related issues, acceptance by patients and doctors, as well as technical hurdles and access to the technologies, remain. Hence, future research and development is paramount. Nonetheless, due to technological progress, the exploration of new research areas, and the improved availability of the technologies paired with cost reduction, the prospects for neurotechnology and metaverse in orthopedics are promising., (© 2023. The Author(s), under exclusive licence to Springer Medizin Verlag GmbH, ein Teil von Springer Nature.)

Recently, it has been demonstrated that electromyographic (EMG) activity of auricular muscles in humans, especially the postauricular muscle (PAM), depends on the spatial location of auditory stimuli. This observation has only been shown using wet electrodes placed directly on auricular muscles. To move towards a more applied, out-of-the-laboratory setting, this study aims to investigate if similar results can be obtained using electrodes placed in custom-fitted earpieces. Furthermore, with the exception of the ground electrode, only dry-contact electrodes were used to record EMG signals, which require little to no skin preparation and can therefore be applied extremely fast. In two experiments, auditory stimuli were presented to ten participants from different spatial directions. In experiment 1, stimuli were rapid onset naturalistic stimuli presented in silence, and in experiment 2, the corresponding participant's first name, presented in a "cocktail party" environment. In both experiments, ipsilateral responses were significantly larger than contralateral responses. Furthermore, machine learning models objectively decoded the direction of stimuli significantly above chance level on a single trial basis (PAM: ≈ 80%, in-ear: ≈ 69%). There were no significant differences when participants repeated the experiments after several weeks. This study provides evidence that auricular muscle responses can be recorded reliably using an almost entirely dry-contact in-ear electrode system. The location of the PAM, and the fact that in-ear electrodes can record comparable signals, would make hearing aids interesting devices to record these auricular EMG signals and potentially utilize them as control signals in the future., Competing Interests: Declaration of Conflicting InterestsThe authors declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Functional 2-photon microscopy is a key technology for imaging neuronal activity. The recorded image sequences, however, can contain non-rigid movement artifacts which requires high-accuracy movement correction. Variational optical flow (OF) estimation is a group of methods for motion analysis with established performance in many computer vision areas. However, it has yet to be adapted to the statistics of 2-photon neuroimaging data. In this work, we present the motion compensation method Flow-Registration that outperforms previous alignment tools and allows to align and reconstruct even low signal-to-noise ratio 2-photon imaging data and is able to compensate high-divergence displacements during local drug injections. The method is based on statistics of such data and integrates previous advances in variational OF estimation. Our method is available as an easy-to-use ImageJ/FIJI plugin as well as a MATLAB toolbox with modular, object oriented file IO, native multi-channel support and compatibility with existing 2-photon imaging suites., (© 2022 The Authors. Journal of Biophotonics published by Wiley-VCH GmbH.)

The risk for passengers of an automated vehicle to suffer from motion sickness symptoms increases while performing non-driving tasks. Motion sickness, whether at sea, in the air, in a car or in virtual reality, has been studied for years, but the specific motion patterns of different vehicles and the individual physiology of passengers complicate the definition of general applicable models. Technical progress in vehicles, e.g. the development of the chassis or general digitalization, is constantly changing the influences and marginal effects of motion sickness. In recent years, increasing number of investigations concentrated on the influencing factors on motion sickness. However, the relation between emesis and vehicle dynamics itself is predominantly inadequately presented. Therefore, the results can poorly be incorporate in mathematical models of the sensory conflict theory established as leading theory in the research community. In our research, we suggest a method to prepare and present route and driving information to increase the transparency of real-world driving experiments. We used determined position-based spectrograms to simplify the understanding of the provoked acceleration as well as frequency, known as important motion sickness trigger. Standardized use of this method would support review articles about driving experiments and thus support research regarding motion sickness prediction and occurrence in vehicles.

Video motion magnification methods are motion visualization techniques that aim to magnify subtle and imper-ceptibly small motions in videos. They fall into two main groups where Eulerian methods work on the pixel grid with implicit motion information and Lagrangian methods use explicitly estimated motion and modify point trajectories. The motion in high framerate videos of faces can contain a wide variety of information that ranges from microexpressions over pulse or respiratory rate to cues on speech and affective state. In his work, we propose a novel strategy for Lagrangian motion magnification that integrates landmark information from the face as well as an approach to decompose facial motions in an unsupervised manner using sparse PCA. We decompose the estimated displacements into different movement components that are subsequently amplified selectively. We propose two approaches: A landmark-based decomposition into global and local movements and a decomposition into multiple coherent motion components based on sparse PCA. Optical flow estimation is performed using a state-of-the-art deep learning-based method that we retrain on a microexpression database. Clinical relevance- This method could be applied to the annotation and analysis of micromovements for neurocognitive assessment and even novel, medical applications where micro-motions of the face might play a role.

In naturalistic auditory scenes, relevant information is rarely concentrated at a single location, but rather unpredictably scattered in- and out-field-of-view (in-/out-FOV). Although the parsing of a complex auditory scene is a fairly simple job for a healthy human auditory system, the uncertainty represents a major issue in the development of effective hearing aid (HA) processing strategies. Whereas traditional omnidirectional microphones (OM) amplify the complete auditory scene without enhancing signal-to-noise-ratio (SNR) between in- and out-FOV streams, directional microphones (DM) may greatly increase SNR at the cost of preventing HA users to perceive out-FOV information. The present study compares the conventional OM and DM HA settings to a split processing (SP) scheme differentiating between in- and out-FOV processing. We recorded electroencephalographic data of ten young, normal-hearing listeners who solved a cocktail-party-scenario-paradigm with continuous auditory streams and analyzed neural tracking of speech with a stimulus reconstruction (SR) approach. While results for all settings exhibited significantly higher SR accuracies for attended in-FOV than unattended out-FOV streams, there were distinct differences between settings. In-FOV SR performance was dominated by DM and SP and out-FOV SR accuracies were significantly higher for SP compared to OM and DM. Our results demonstrate the potential of a SP approach to combine the advantages of traditional OM and DM settings without introduction of significant compromises.

Objective: To update the life expectancy estimates according to age, sex, mobility, and feeding skills reported in the 2015 study of Brooks et al. To examine trends in survival over the past decade., Design: Observational cohort study., Setting: Poisson regression and life table analysis applied to long-term follow-up data on United States (US) Traumatic Brain Injury (TBI) Model Systems patients recorded in the national database. Functional mobility and feeding skills were assessed with FIM., Participants: A total of 14,803 persons with TBI during the years 1988-2019 who underwent inpatient rehabilitation and provided at least 1 long-term assessment of functional skills 1 year or more postinjury (N=14,803)., Interventions: Not applicable., Main Outcome Measures: Survival, mortality rates, and life expectancy., Results: Life expectancy was lower than that of the age- and sex-matched general population. Older age and severity of functional impairments were risk factors for mortality (both P<.0001 in regression models). Among ambulatory individuals, mortality was 51% (95% confidence interval, 35%-69%) higher in men than women. Life expectancy of 20-year-old women who walked well (FIM ambulation score 7) was 55 (SE=0.8) additional years to age 75, representing a reduction of 6.9 years from the normal general population figure. For 20-year-old men who walked well, the life expectancy was 49 (SE=0.5) additional years, representing a reduction of 8.1 years from normal. Life expectancies for men and women who did not walk and were fed by others were much lower. There was no significant change in mortality rates during the study period (hazard ratio, 1.008; P=.07)., Conclusions: There has been no significant change in the long-term survival of persons with TBI in the US since the late 1980s. The life expectancies reported here are similar to those reported in the 2015 study of Brooks et al, although they are more precise because of the larger sample size and longer follow-up., (Copyright © 2021 The American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.)

Background: In the context of signal analysis and pattern matching, alignment of 1D signals for the comparison of signal morphologies is an important problem. For image processing and computer vision, 2D optical flow (OF) methods find wide application for motion analysis and image registration and variational OF methods have been continuously improved over the past decades., New Method: We propose a variational method for the alignment and displacement estimation of 1D signals. We pose the estimation of non-flat displacements as an optimization problem with a similarity and smoothness term similar to variational OF estimation. To this end, we can make use of efficient optimization strategies that allow real-time applications on consumer grade hardware., Results: We apply our method to two applications from functional neuroimaging: The alignment of 2-photon imaging line scan recordings and the denoising of evoked and event-related potentials in single trial matrices. We can report state of the art results in terms of alignment quality and computing speeds., Existing Methods: Existing methods for 1D alignment target mostly constant displacements, do not allow native subsample precision or precise control over regularization or are slower than the proposed method., Conclusions: Our method is implemented as a MATLAB toolbox and is online available. It is suitable for 1D alignment problems, where high accuracy and high speed is needed and non-constant displacements occur., (Copyright © 2021 Elsevier B.V. All rights reserved.)

This paper introduces and evaluates a speech signal manipulation scheme that generates transient speech induced binaural beats (SBBs). These SBBs can only be perceived when different signals are presented dichotically (to both ears). Event-related potentials were recorded in 22 normal-hearing subjects. Dichotic stimulus presentation reliably evoked auditory late responses (ALRs) in all subjects using such manipulated signals. As control measurements, diotic stimulation modalities were presented to confirm that the ALRs were not evoked by the speech signal itself or that the signal manipulation scheme created audible artifacts. Since diotic measurements evoked no ALRs, responses from dichotic stimulation are a pure correlate of binaural interaction. While there are several auditory stimuli (mostly modulated sinusoids or noise) that share this characteristic, none of them are based on running speech. Because SBBs can be added to any arbitrary speech signal, they could easily be combined with psychoacoustic tests, for example speech reception thresholds, adding an objective measure of binaural interaction.

Unlike dogs and cats, people do not point their ears as they focus attention on novel, salient, or task-relevant stimuli. Our species may nevertheless have retained a vestigial pinna-orienting system that has persisted as a 'neural fossil' within in the brain for about 25 million years. Consistent with this hypothesis, we demonstrate that the direction of auditory attention is reflected in sustained electrical activity of muscles within the vestigial auriculomotor system. Surface electromyograms (EMGs) were taken from muscles that either move the pinna or alter its shape. To assess reflexive, stimulus-driven attention we presented novel sounds from speakers at four different lateral locations while the participants silently read a boring text in front of them. To test voluntary, goal-directed attention we instructed participants to listen to a short story coming from one of these speakers, while ignoring a competing story from the corresponding speaker on the opposite side. In both experiments, EMG recordings showed larger activity at the ear on the side of the attended stimulus, but with slightly different patterns. Upward movement (perking) differed according to the lateral focus of attention only during voluntary orienting; rearward folding of the pinna's upper-lateral edge exhibited such differences only during reflexive orienting. The existence of a pinna-orienting system in humans, one that is experimentally accessible, offers opportunities for basic as well as applied science., Competing Interests: DS, FC, AS, PF, RH, SH No competing interests declared, (© 2020, Strauss et al.)

This paper presents a proof-of-concept for contactless and nonintrusive estimation of electrodermal activity (EDA) correlates using a camera. RGB video of the palm under three different lighting conditions showed that for a suitably chosen illumination strategy the data from the camera is sufficient to estimate EDA correlates which agree with the measurements done using laboratory grade physiological sensors. The effects we see in the recorded video can be attributed to sweat gland activity, which inturn is known to be correlated with EDA. These effects are so pronounced that simple pixel statistics can be used to quantify them. Such a method benefits from advances in computer vision and graphics research and has the potential to be used in affective computing and psychophysiology research where contact based sensors may not be suitable.

We seek to understand the relation between invasive high-resolution data and non-invasive measurement in an animal model in an auditory sensory adaptation experimental setting. In a previous study, we estimated the mutual information between the phase of auditory evoked responses (AER) with the phase of local field potentials (LFP) of auditory cortices at different frequency ranges. The results showed a consistently high level of information sharing between the AER activities as well as the responses from the granular layer, which was known as the main thalamo-recipient layer. However, mutual information was fundamentally an undirected measure of information flow. In this study we investigated how well we could characterize direction of information flow, by using Granger causality (GC), between different cortical laminae and functional projections on to the AER activities. We obtained that based on the GC coefficients, we are able to extract the connectivity between different cortical laminae to some extend and also a strong connection between the AER and granular layer. In our future study, we would like to construct a reliable picture of network connectivity, both functionally and anatomically, between different layers at more specified frequencies and much finer temporal resolutions.

The in-vivo optical imaging of the cortical surface provides the ability to record different types of biophysiological signals, e.g., structural information, intrinsic signals, like blood oxygenation coupled reflection changes as well as extrinsic properties of voltage sensitive probes, like fluorescent voltage-sensitive dyes. The recorded data sets have very high temporal and spatial resolutions on a meso- to macroscopic scale, which surpass conventional multi-electrode recordings. Both, intrinsic and functional data sets, each provide unique information about temporal and spatial dynamics of cortical functioning, yet have individual drawbacks. To optimize the informational value it would thus be opportune to combine different types of optical imaging in a near simultaneous recording.Due to the low signal-to-noise ratio of voltage-sensitive dyes it is necessary to reduce stray light pollution below the level of the camera's dark noise. It is thus impossible to record full-spectrum optical data sets. We address this problem by a time-multiplexed illumination, bespoke to the utilized voltage sensitive dye, to record an alternating series of intrinsic and extrinsic frames by a high-frequency CMOS sensor. These near simultaneous data series can be used to compare the mutual influence of intrinsic and extrinsic dynamics (with regards to extracorporeal functional imaging) as well as for motion compensation and thus for minimizing frame averaging, which in turn results in increased spatial precision of functional data and in a reduction of necessary experimental data sets (3R principle).

Background: Stroke is a leading cause of death and disability in the developed world. The major factor affecting long term survival (other than age) is known to be the severity of disability. Yet to our knowledge there are no studies reporting life expectancies stratified by both age and severity. Remaining life expectancy is a key measure of health., Methods: We identified 11 long-term follow-up studies of stroke patients that reported the multivariate effects of age, sex, the modified Rankin Scale (mRS) grade of disability, and other factors. From these we computed the composite effects of these factors on survival, then used these to calculate age-, sex-, and mRS-specific mortality rates. Finally we used the rates to construct life tables, and hence obtain life expectancies., Results: Life expectancy varies by age, sex, and mRS. The life expectancies of males age 70, for example, were 13, 13, 11, 8, 6, and 5 years for Rankin Grades 0-5, respectively, representing reductions of 1, 1, 3, 6, 8, and 9 years from the corresponding general population figure., Conclusions: These figures demonstrate the importance of rehabilitation following stroke, and can be used in discussion of public policy and benchmarking of future results., (Copyright © 2019 Elsevier Inc. All rights reserved.)

Recent work has shown that sharp spectral edges in acoustic stimuli might have advantageous effects in the treatment of tonal tinnitus. In the course of this paper, we evaluate the long-term effects of spectrally notched hearing aids on the subjective tinnitus distress. By merging recent experimental work with a computational tinnitus model, we modified the commercially available behind-the-ear hearing aids so that a frequency band of 0.5 octaves, centered on the patient's individual tinnitus frequency, was blocked out. Those hearing aids employ a steep notch filter that filters environmental sounds to suppress the tinnitus-related changes in neural firing by lateral inhibition. The computational model reveals a renormalization of pathologically increased neural response reliability and synchrony in response to spectrally modified input. The target group, fitted with spectrally notched hearing aids, was matched with a comparable control group, fitted with standard hearing aids of the same type but without a notch filter. We analyze the subjective self-assessment by tinnitus questionnaires, and we monitor the objective distress correlates in auditory evoked response phase data. Both, subjective and objective results show a noticeable trend of a larger therapeutic benefit for notched hearing correction.

Event related potentials represent a noninvasive means for studying sensory and cognitive processes that occur in response to particular stimuli. Here, we report on a phase measure for estimating single trial interaction of late somatosensory potentials (LSPs) following a tribological well defined mechanical stimulation of the human fingertip. Stimuli are presented via a programmable Braille-display with actively switchable pins which was slid along the apex of the passive fingertip, i.e., the fingertip rested stationarily in a finger holding system with circular opening at the bottom. The event was the raising and the lowering of either one, three, or five lines of pins. Differences were identified by measures based on instantaneous phase synchronization to the stimuli across trials, in particular the wavelet phase synchronization stability (WPSS) measure for single trial sequences of LSPs. In particular, we show that the higher the friction the stronger and more localized the induced phase coherency is. We concluded that the WPSS analysis of single sequences of LSPs represents a reliable method which allows for the quantification of brain responses upon distinct tactile stimuli.

This work relates to recent advances in the field of auditory event-related potentials (ERP), specifically deconvolution-based ERP acquisition and single-trial processing. An efficient stimulus sequence optimization method for ERP deconvolution is proposed, achieving consistent noise attenuation within a broad designated frequency range. Furthermore, a stimulus presentation paradigm for the fast, interleaved acquisition of auditory brainstem, middle-latency and late responses featuring alternating periods of high-rate deconvolution sequences, and subsequent low-rate stimulation is investigated in 20 normal hearing subjects. Deconvolved sequence responses containing early and middle-latency ERP components are fused with subsequent late responses using a time-frequency resolved weighted averaging method based on cross-trial regularity, yielding a uniform signal-to-noise ratio of the full-range auditory ERP across investigated timescales. Obtained average ERP waveforms exhibit morphologies consistent with both literature values and reference recordings acquired in 15 normal hearing subjects using a prior art approach to full-range auditory ERP acquisition, with all prominent waves being visible in the grand average waveforms. Results suggest the proposed interleaved stimulus presentation and associated ERP processing methodology to be suitable for the fast, reliable extraction of full-range auditory processing correlates in future ERP studies.

The importance of binaural cues in auditory stream formation and sound source segregation is widely accepted. When treating one ear with a cochlear implant (CI) the peripheral auditory system gets partially replaced and processing delays get added potentially, thus important interaural time differences get altered. However, these effects are not fully understood, leaving a lack of systematic binaural fitting strategies with respect to an optimal binaural fusion. To get new insights into such alterations, we suggest a novel method of free-field auditory brainstem evoked responses (ABRs) analysis in CI users. This method does not bypass the technically induced intrinsic delays of the sound processor while leaving the whole electrode array active, thus the most natural way of stimulation is provided. We compared the ABRs collected of 12 CI users and 12 normal hearing listeners using two different stimuli (chirp, click) at four different intensities each. We analyzed the ABRs using the average of 2000 trials as well as a single trial analysis and found consistent results in the ABRs' amplitudes and latencies, as well as in single trial relationships between both groups. This method provides a new perspective into the natural CI users' ABRs and can be useful in future research regarding binaural interaction and fusion., Competing Interests: Conflict of interest: the authors declare no potential conflict of interest.

The phase-reset model of oscillatory EEG activity has received a lot of attention in the last decades for decoding different cognitive processes. Based on this model, the ERPs are assumed to be generated as a result of phase reorganization in ongoing EEG. Alignment of the phase of neuronal activities can be observed within or between different assemblies of neurons across the brain. Phase synchronization has been used to explore and understand perception, attentional binding and considering it in the domain of neuronal correlates of consciousness. The importance of the topic and its vast exploration in different domains of the neuroscience presses the need for appropriate tools and methods for measuring the level of phase synchronization of neuronal activities. Measuring the level of instantaneous phase (IP) synchronization has been used extensively in numerous studies of ERPs as well as oscillatory activity for a better understanding of the underlying cognitive binding with regard to different set of stimulations such as auditory and visual. However, the reliability of results can be challenged as a result of noise artifact in IP. Phase distortion due to environmental noise artifacts as well as different pre-processing steps on signals can lead to generation of artificial phase jumps. One of such effects presented recently is the effect of low envelope on the IP of signal. It has been shown that as the instantaneous envelope of the analytic signal approaches zero, the variations in the phase increase, effectively leading to abrupt transitions in the phase. These abrupt transitions can distort the phase synchronization results as they are not related to any neurophysiological effect. These transitions are called spurious phase variation. In this study, we present a model to remove generated artificial phase variations due to the effect of low envelope. The proposed method is based on a simplified form of a Kalman smoother, that is able to model the IP behavior in narrow-bandpassed oscillatory signals. In this work we first explain the details of the proposed Kalman smoother for modeling the dynamics of the phase variations in narrow-bandpassed signals and then evaluate it on a set of synthetic signals. Finally, we apply the model on ongoing-EEG signals to assess the removal of spurious phase variations.

The design of human-machine interfaces (HMIs) by virtual haptics is an emerging field of research. So far, the perception of virtual haptic feedback, e.g., generated by focused ultrasound in midair has not been objectively evaluated. This paper demonstrates the feasibility of eliciting somatosensory evoked potentials (SEPs) with ultrasonic stimuli in midair for the first time. The palm was stimulated by short ultrasonic focal points generated by an ultrasound board. The results are compared with a no stimulation condition as well as with the results of a vibro tactile stimulation. The SEPs are analyzed with the wavelet phase synchronization stability (WPSS) and the M-consecutive averaged WPSS. The results indicate a clear SEP waveform elicited by ultrasound. It can be significantly differentiated from a no stimulation condition by the M-consecutive averaged WPSS. These results could enable the possibility of developing an objective evaluation method for virtual haptic feedback in HMIs.

Video motion magnification forms a relatively novel family of visualization techniques, that aim to magnify imperceivably small motions in videos. The most prominent techniques are based on Eulerian video processing and local phase shifting, which modify pixel time courses, rather than relying on explicit motion estimation.In this work, we show that under ideal conditions in the context of psychophysiological experiments, a Lagrangian motion magnification approach based on dense optical flow estimation, can be superior to Eulerian motion magnification strategies. We present a novel, continuous and motion magnitude driven forward warping scheme of small motions, which implements motion compensation and magnification into a single motion estimation step. Our approach does not rely on temporal filtering and works in the presence of large motion. It does not require the explicit identification of fast moving objects and more generally no segmentation and or matting in the image domain is necessary. We apply our method to the visualization of blinking related modulations in micro-saccadic eye movements ((i.a.. iridodonesis), pupil dilation (hippus) and micro-expression analysis.

In recent years, there has been increasing interest in studying listening effort. Research on listening effort intersects with the development of active theories of speech perception and contributes to the broader endeavor of understanding speech perception within the context of neuroscientific theories of perception, attention, and effort. Due to the multidisciplinary nature of the problem, researchers vary widely in their precise conceptualization of the catch-all term listening effort. Very recent consensus work stresses the relationship between listening effort and the allocation of cognitive resources, providing a conceptual link to current cognitive neuropsychological theories associating effort with the allocation of selective attention. By linking listening effort to attentional effort, we enable the application of a taxonomy of external and internal attention to the characterization of effortful listening. More specifically, we use a vectorial model to decompose the demand causing listening effort into its mutually orthogonal external and internal components and map the relationship between demanded and exerted effort by means of a resource-limiting term that can represent the influence of motivation as well as vigilance and arousal. Due to its quantitative nature and easy graphical interpretation, this model can be applied to a broad range of problems dealing with listening effort. As such, we conclude that the model provides a good starting point for further research on effortful listening within a more differentiated neuropsychological framework.

Functional optical imaging (OI) of intrinsic signals (like blood oxygenation coupled reflection changes) and of extrinsic properties of voltage sensitive probes (like voltage-sensitive dyes (VSD)) forms a group of invasive neuroimaging techniques, that possess up to date the highest temporal and spatial resolution on a meso- to macroscopic scale. There are different sources that contribute to the OI signal of which many are noise. In our previous works, we have used dense optical flow for the reduction of movement artefacts. The translucent surface of the cortex allows contributions from multiple depths. Due to the depth offield (DOF) effect, we get an implicit relation of depth and 2D frequency components. In this work, we introduce registration on the levels of a Laplacian pyramid to remove movement artefacts which have different motion components in different spatial frequency bands. This aims to resolve artefacts that remain after normal registration and are caused e.g. by parallax motion, dead pixels or dust on the sensor and other high frequent, moving particles on the cortex surface without the compromise of using high smoothness weights.

The adjustment of hearing aid devices can heavily depend on the subjective feedback of the patients. Our aim is to investigate measures that can be used objectively to state a subject's listening effort. To obtain a comprehensive and reliable measure as an indicator for a person's listening effort, we need to have a better understanding of electroencephalograpic (EEG) activities. Decoding EEG signals specifically by the analysis of the instantaneous phase information has been a new trend in the last decades. Throughout many studies conducted in the past, it has been shown that the instantaneous phase of oscillatory signals reset in relation to various cognitive processes. This is based on a hypothesis presented for the generation of event related potentials. In this study, we measure the degree of phase re-organization through fitting a von Mises distribution to EEG recordings. The concentration parameter of a von Mises distribution has been shown as an informative feature for reflecting the level of attention. This feature has been used for predicting the listening effort and the results are compared among three different hearing aid settings.

The study of oscillatory electroencephalogram (EEG) data has been one of the main sources for the analysis of different brain functions and decoding a variety of cognitive processes. One of the interesting features that has been the focus of study in the last decades is the study of instantaneous phase information in EEG. Phase synchronization techniques are among the main analysis tools that measure the degree of phase re-organization in signals. In phase re-organization approach, the phase alignment in stimulus induced potentials has been shown to be informative for decoding cognitive processes. Despite the developments in this area, the precision of measures may vary based on the level of noise. Phase distortion due to artefacts and a variety of pre-processing steps that are applied on data, can introduce artificial phase alignment. These artificial phase variations (that is referred to spurious phase variations) are not correlated to any stimulus or event. In a new study, it has been showed that a low instantaneous envelope lead to abrupt changes in IP, which could distort the results of phase synchronization. In this work, we propose a method that is able to estimate the true phase based on the measurements and estimate a standard deviation for the computed phase. The method enables to remove the effect of artificial phase changes due to low envelope. In this approach the analytic signal is modeled by a Kalman smoother, and estimates a more reliable version of the IP from the measurements. At last, we evaluate the model on different synthetic data sets.

In this study, we propose a novel estimate of listening effort using electroencephalographic data. This method is a translation of our past findings, gained from the evoked electroencephalographic activity, to the oscillatory EEG activity. To test this technique, electroencephalographic data from experienced hearing aid users with moderate hearing loss were recorded, wearing hearing aids. The investigated hearing aid settings were: a directional microphone combined with a noise reduction algorithm in a medium and a strong setting, the noise reduction setting turned off, and a setting using omnidirectional microphones without any noise reduction. The results suggest that the electroencephalographic estimate of listening effort seems to be a useful tool to map the exerted effort of the participants. In addition, the results indicate that a directional processing mode can reduce the listening effort in multitalker listening situations.

Functional Optical Imaging (OI) through the opened skull forms a group of Neuroimaging techniques characterized by a high temporal and spatial resolution on a meso-to macroscopic scale. State of the art OI experiments are generally difficult to execute, with a very timely surgical preparation preceding the experiment, that requires a skilled surgeon to mount a sealed imaging chamber onto the skull. The chamber reduces brain pulsation artifacts and swelling of the brain through movement restriction. In this work, we present preliminary results of a novel approach that does not rely on the usage of an imaging chamber with the goal to facilitate heavily the surgical animal preparation and to allow straightforward joint Electroencephalography - Optical Imaging recordings in the future. We carried out experiments to compare the movement restricting properties of the imaging chamber with the movement in a recording of an unconstrained and periodically irrigated brain. We used high-level image processing techniques to reduce brain pulsation artifacts and did a quantitative movement analysis of the recordings. Our results suggest that while recordings with imaging chamber show less sagittal movement, both with and without imaging chamber comprise the same lateral movements.

The Auditory Brainstem, Middle-Latency and Late Responses, a class of event-related potentials (ERPs), are of considerable interest in neuroscience research as robust neural correlates of different processing stages along the auditory pathway. While most research to date centers around one of the responses at a time for practical reasons, recent efforts indicate a paradigm shift towards acquiring them together, enabling the simultaneous monitoring of all auditory processing stages from the brainstem to the cortex. In this paper, we introduce a compact representation for this Auditory Full-Range Response (AFRR) as an ERP map with adaptive sampling rate, making it suitable for computationally inexpencive image filtering. Furthermore, we propose a novel algorithm for the fast denoising of such ERP maps based on the Radon Transform and its inversion by filtered backprojection. Its performance is compared qualitatively to a Gaussian means filter using a real-world chirp-evoked AFRR recording. The algorithm exhibits good noise suppression as well as high preservance of the single-response structure, making it a promising denoising tool for future ERP studies.

Functional optical imaging (OI) of intrinsic signals (like blood oxygenation coupled reflection changes) and of extrinsic properties of voltage sensitive probes (like voltage-sensitive dyes (VSD)) forms a group of neuroimaging techniques that possess up to date highest temporal and spatial resolution on a meso-to macroscopic scale. An inherent problem of OI is a very low signal to noise ratio (SNR), which restricts the recordings to be completely motionless and requires detailed knowledge of the properties of the different noise sources. In our experiments we performed a durectomy and did not use an imaging chamber to allow us future joint electroencephalography-optical imaging (EEG-OI) measures, which resulted in movement artifacts. With the goal of motion compensation in OI recordings and magnification of signal changes, we present a novel processing pipeline, which is based on optic flow guided denoising and gradient domain tone mapping for spatiotemporal contrast enhancement.

In demanding listening situations the individual has to exert an increased listening effort to process interesting auditory signals correctly. Especially people with hearing loss are particularly affected and require more effort to identify sounds compared to those with normal hearing. So far, a suitable objective estimate of listening effort is still not available. In previous studies, we presented an objective estimate of listening effort (OLEosc), which is based on the instantaneous phase distribution of the ongoing EEG activity. In the current study, the proposed measure was analyzed in detail. The task performance was taken into account, which indicates if the participants can solve the auditory task and exert effort or if they ceased solving the task. The EEG data was acquired from people with moderate hearing loss solving a listening task. During the experiment, hearing aid settings with different microphone configurations were tested. The results indicate that the OLEosc reflects the real exerted effort of the participants. Besides the reflection of different task demands related to the hearing aid settings, it was possible to show a decline of focused attention to the auditory stimuli related to an excessive task demand. Furthermore, the data indicate that the OLEosc is not directly correlated to the speech intelligibility presented in the word score data and is not subjectively biased like the results of the presented rating scale.