Search

Survival in complex environments necessitates a flexible navigation system that incorporates memory of recent behavior and associations. Yet, how the hippocampal spatial circuit represents latent information independent of sensory inputs and future goals has not been determined. To address this, we image the activity of large ensembles in subregion CA1 via wide-field fluorescent microscopy during a novel behavioral paradigm. Our results demonstrate that latent information is represented through reliable firing rate changes during unconstrained navigation. We then hypothesize that the representation of latent information in CA1 is mediated by pattern separation/completion processes instantiated upstream within the dentate gyrus (DG) and CA3 subregions. Indeed, CA3 ensemble recordings reveal an analogous code for latent information. Moreover, selective chemogenetic inactivation of DG–CA3 circuitry completely and reversibly abolishes the CA1 representation of latent information. These results reveal a causal and specific role of DG–CA3 circuitry in the maintenance of latent information within the hippocampus., Keinath et al. show that information about the recent past is represented in the hippocampus through changes in firing rates in the absence of task demands. This representation is eliminated when DG–CA3 circuitry is inhibited.

To perform adaptive behaviours, animals have to establish a representation of the physical “outside” world. How these representations are created by sensory systems is a central issue in sensory physiology. This review addresses the history of experimental approaches toward ideas about sensory coding, using the relatively simple auditory system of acoustic insects. I will discuss the empirical evidence in support of Barlow’s “efficient coding hypothesis”, which argues that the coding properties of neurons undergo specific adaptations that allow insects to detect biologically important acoustic stimuli. This hypothesis opposes the view that the sensory systems of receivers are biased as a result of their phylogeny, which finally determine whether a sound stimulus elicits a behavioural response. Acoustic signals are often transmitted over considerable distances in complex physical environments with high noise levels, resulting in degradation of the temporal pattern of stimuli, unpredictable attenuation, reduced signal-to-noise levels, and degradation of cues used for sound localisation. Thus, a more naturalistic view of sensory coding must be taken, since the signals as broadcast by signallers are rarely equivalent to the effective stimuli encoded by the sensory system of receivers. The consequences of the environmental conditions for sensory coding are discussed.

Spatial patterns presented on the tongue using electro-tactile sensory substitution devices (SSDs) have been suggested to be recognized better by tracing the pattern with the tip of the tongue. We examined if the functional benefit of tracing is overcoming the poor sensitivity or low spatial resolution at the back of the tongue or alternatively compensating for limited information processing capacity by fixating on a segment of the spatial pattern at a time. Using a commercially available SSD, the BrainPort, we compared letter recognition performance in three presentation modes; tracing, static, and drawing. Stimulation intensity was either constant or increased from the tip to the back of the tongue to partially compensate for the decreasing sensitivity. Recognition was significantly better for tracing, compared to static and drawing conditions. Confusion analyses showed that letters were confused based on their characteristics presented near the tip in static and drawing conditions. The results suggest that recognition performance is limited by the poor spatial resolution at the back of the tongue, and tracing seems to be an effective strategy to overcome this. Compensating for limited information processing capacity or poor sensitivity by drawing or increasing intensity at the back, respectively, does not improve the performance.

The declarative memory system allows us to accurately recognize a countless number of items and events, particularly those strengthened by repeated exposure. However, increased familiarity due to repetition can also lead to false recognition of related but new items, particularly when mechanisms supporting fine-grain mnemonic discrimination fail. The hippocampus is thought to be particularly important in separating overlapping cortical inputs during encoding so that similar experiences can be differentiated. In the current study of male and female human subjects, we examine how neural pattern similarity between repeated exemplars of a given concept (e.g., apple) influences true and false memory for target or lure images. Consistent with past work, we found that subsequent true recognition was related to pattern similarity between concept exemplars and the entire encoding set (global encoding similarity), particularly in ventral visual stream. In addition, memory for an individual target exemplar (a specific apple) could be predicted solely by the degree of pattern overlap between the other exemplars (different apple pictures) of that concept (concept-specific encoding similarity). Critically, subsequent false memory for lures was mitigated when high concept-specific similarity in cortical areas was accompanied by differentiated hippocampal representations of the corresponding exemplars. Furthermore, both true and false memory entailed the reinstatement of concept-related information at varying levels of specificity. These results link both true and false memory to a measure of concept strength expressed in the overlap of cortical representations, and importantly, illustrate how the hippocampus serves to separate concurrent cortical overlap in the service of detailed memory.SIGNIFICANCE STATEMENTIn some instances, the same processes that help promote memory for a general idea or concept can also hinder more detailed memory judgments, which may involve differentiating between closely related items. The current study shows that increased overlap in cortical representations for conceptually-related pictures is associated with increased recognition of repeated concept pictures. Whether similar lure items were falsely remembered as old further depended on the hippocampus, where the presence of more distinct representations protected against later false memory. This work suggests that the differentiability of brain patterns during perception is related to the differentiability of items in memory, but that fine-grain discrimination depends on the interaction between cortex and hippocampus.

Childhood adversity increases the risk of developing psychiatric symptoms later in life. However, the neuro-biological mechanisms underlying this association are unknown. This paper reviews the current literature regarding structural and functional alterations in the hippocampus and amygdala following childhood adversity, ultimately converging into a model that proposes impaired 'pattern separation' as an important underlying mechanism associated with risk or resilience for psychopathology through increased fear generalization. In the present model, decreased DG/CA3 activity and amygdala hyper-reactivity are considered to be a consequence of childhood adversity, which in turn may result in impaired pattern separation of emotional information. Impaired pattern separation is hypothesized to result in increased fear generalization, threat anticipation, and social threat interpretation, thus increasing risk for later affective, anxiety and psychotic symptoms. The proposed model provides testable hypotheses for future studies and stresses the need to stratify according to childhood adversity as an etiological factor.

Working memory and pattern separation are fundamental cognitive abilities which, when impaired, significantly diminish quality of life. Discovering genetic mechanisms underlying innate and disease-induced variation in these cognitive abilities is a critical step towards treatments for common and devastating neurodegenerative conditions such as Alzheimer's disease. In this regard, the trial-unique nonmatching-to-location assay (TUNL) is a touchscreen operant conditioning procedure allowing simultaneous quantification of working memory and pattern separation in mice and rats. In the present study, we used the TUNL assay to quantify these cognitive abilities in C57BL/6J and DBA/2J mice. These strains are the founders of the BXD recombinant inbred mouse panel which enables discovery of genetic mechanisms underlying phenotypic variation. TUNL testing revealed that pattern separation was significantly influenced by mouse strain, whereas working memory was not. Moreover, horizontal distance and vertical distance between choice-phase stimuli had dissociable effects on TUNL performance. These findings provide novel data on mouse strain differences in pattern separation and support previous findings of equivalent working memory performance in C57BL/6J and DBA/2J mice. Although working memory of the BXD founder strains was equivalent in this study, working memory of BXD strains may be divergent because of transgressive segregation. Collectively, data presented here indicate that pattern separation is heritable in the mouse and that the BXD panel can be used to identify mechanisms underlying variation in pattern separation.

Significance A major challenge in studying intention reading is high motor variability. Analyses conducted across trials provide insights into what happens on average; however, they may obscure how individual observers read intention information in individual movements. We combined motion tracking, psychophysics, and computational analyses to examine intention reading in autism spectrum disorders (ASDs) with single-trial resolution. Results revealed that a sizeable fraction of ASD observers can identify intention-informative variations in ASD (but not in typically developing) movement kinematics, but they are nonetheless unable to extract the encoded intention information. This approach not only enhances our basic understanding of mind reading in ASD but also provides potential avenues for the rational design of training procedures to improve the reading of others’ actions.

Rhythm perception is fundamental to speech and music. Humans readily recognize a rhythmic pattern, such as that of a familiar song, independently of the tempo at which it occurs. This shows that our perception of auditory rhythms is flexible, relying on global relational patterns more than on the absolute durations of specific time intervals. Given that auditory rhythm perception in humans engages a complex auditory-motor cortical network even in the absence of movement and that the evolution of vocal learning is accompanied by strengthening of forebrain auditory-motor pathways, we hypothesize that vocal learning species share our perceptual facility for relational rhythm processing. We test this by asking whether the best-studied animal model for vocal learning, the zebra finch, can recognize a fundamental rhythmic pattern-equal timing between event onsets (isochrony)-based on temporal relations between intervals rather than on absolute durations. Prior work suggests that vocal nonlearners (pigeons and rats) are quite limited in this regard and are biased to attend to absolute durations when listening to rhythmic sequences. In contrast, using naturalistic sounds at multiple stimulus rates, we show that male zebra finches robustly recognize isochrony independent of absolute time intervals, even at rates distant from those used in training. Our findings highlight the importance of comparative studies of rhythmic processing and suggest that vocal learning species are promising animal models for key aspects of human rhythm perception. Such models are needed to understand the neural mechanisms behind the positive effect of rhythm on certain speech and movement disorders.

Pattern separation is a hippocampal process in which highly similar stimuli are recognized as separate representations, and deficits could lead to memory impairments in neuropsychiatric disorders such as schizophrenia. The 5-HT

In this paper, we wanted to verify the hypothesis that extruding cartographic symbols on tactile maps to different heights might allow reducing the minimum (suggested in the literature) horizontal distances between them, without impacting the overall map’s legibility. This approach might allow preparing tactile maps in smaller scales and thus, reducing production cost, or putting additional spatial information on the same map sheet that would not fit otherwise. To verify the hypothesis we have prepared 6 different stimuli variants with or without height differentiation applied and different horizontal distances between tactile symbols adopted (1 mm, 2 mm and 3 mm). In the controlled study sessions with 30 participants with visual impairments we have measured the times required for solving 3 different spatial tasks on 3D printed tactile stimuli. We have also performed qualitative analysis to learn participants’ opinions about the proposed design and materials used. It turns out that applying height differentiation not only results in shorter times required for solving spatial tasks but is also considered by blind individuals as a convenient improvement in terms of use comfort and allows reduction of recommended minimum horizontal distances between symbols on tactile maps.

These bees have “seen” that before Humans excel at mental imagery, and we can transfer those images across senses. For example, an object out of view, but for which we have a mental image, can still be recognized by touch. Such cross-modal recognition is highly adaptive and has been recently identified in other mammals, but whether it is widespread has been debated. Solvi et al. tested for this behavior in bumble bees, which are increasingly recognized as having some relatively advanced cognitive skills (see the Perspective by von der Emde and Burt de Perera). They found that the bees could identify objects by shape in the dark if they had seen, but not touched, them in the light, and vice versa, demonstrating a clear ability to transmit recognition across senses. Science , this issue p. 910 ; see also p. 850

OBJECTIVES: This study aimed to assess pattern perception at different signal-to-noise ratio (SNR) in children with learning disability (LD) and typically developing children. The first objective of this study was to estimate the identification scores in quiet and at different SNR (0 dB SNR and −5 dB SNR) in children with LD and to compare the result with the typically developing children. The second objective of the study was to estimate identification scores for words differing in syllable length (monosyllable, bisyllable, and trisyllable) for both the groups of children with LD and typically developing children and to compare the result for both the groups. MATERIALS AND METHODS: Participants included 60 children including 40 typically developing children and 20 children with LD in the age range 7–11 years. Speech perception was assessed using words varying in syllable length (monosyllables, bisyllables, and trisyllables), and was tested in quiet and at different SNR (0 dB SNR and −5 dB SNR). RESULTS: Compared to typically developing children, perception was affected in children with LD. For children with LD, the perception was best in quiet condition and was least at −5 dB SNR. Trisyllables showed the best result followed by bisyllables and monosyllables. CONCLUSION: Children with LD showed poor pattern perception compared to typically developing children. SNR had a significant effect on the performance of children with LD. The length of the stimuli also had an effect on the perception in children with LD.

Across the animal kingdom, social interactions rely on sound production and perception. From simple cricket chirps to more elaborate bird songs, animals go to great lengths to communicate information critical for reproduction and survival via acoustic signals. Insects produce a wide array of songs to attract a mate, and the intended receivers must differentiate these calls from competing sounds, analyze the quality of the sender from spectrotemporal signal properties, and then determine how to react. Insects use numerically simple nervous systems to analyze and respond to courtship songs, making them ideal model systems for uncovering the neural mechanisms underlying acoustic pattern recognition. We highlight here how the combination of behavioral studies and neural recordings in three groups of insects—crickets, grasshoppers, and fruit flies—reveals common strategies for extracting ethologically relevant information from acoustic patterns and how these findings might translate to other systems.

The task-specific principle asserts that, following deafness or blindness, the deprived cortex is reorganized in a manner such that the task of a given area is preserved even though its input modality has been switched. Accordingly, tactile reading engages the ventral occipitotemporal cortex (vOT) in the blind in a similar way to regular reading in the sighted. Others, however, show that the vOT of the blind processes spoken sentence structure, which suggests that the task-specific principle might not apply to vOT. The strongest evidence for the vOT's engagement in sighted reading comes from orthographic repetition–suppression studies. Here, congenitally blind adults were tested in an fMRI repetition–suppression paradigm. Results reveal a double dissociation, with tactile orthographic priming in the vOT and auditory priming in general language areas. Reconciling our finding with other evidence, we propose that the vOT in the blind serves multiple functions, one of which, orthographic processing, overlaps with its function in the sighted.

We performed a randomised controlled trial comparing two kinds of earcons that could provide intermittent pulse oximetry information about a patient's oxygen saturation (SpO ) and heart rate (HR). Timbre-earcons represented SpO levels with different levels of timbre, and pitch-earcons with different levels of pitch. Both kinds of earcons represented HR with tremolo. Participants using pitch-earcons identified SpO levels alone, and both SpO plus HR levels, significantly better than participants using timbre-earcons: p

Living cells communicate information about physiological conditions by producing signaling molecules in a specific timed manner. Different conditions can result in the same total amount of a signaling molecule, differing only in the pattern of the molecular concentration over time. Such temporally coded information can be completely invisible to even state-of-the-art molecular sensors with high chemical specificity that respond only to the total amount of the signaling molecule. Here, we demonstrate design principles for circuits with temporal specificity, that is, molecular circuits that respond to specific temporal patterns in a molecular concentration. We consider pulsatile patterns in a molecular concentration characterized by three fundamental temporal features - time period, duty fraction and number of pulses. We develop circuits that respond to each one of these features while being insensitive to the others. We demonstrate our design principles using abstract Chemical Reaction Networks and with explicit simulations of DNA strand displacement reactions. In this way, our work develops building blocks for temporal pattern recognition through molecular computation., Comment: 7 pages, 5 figures + appendices

This review addresses the history of neuroethological studies on acoustic communication in insects. One objective is to reveal how basic ethological concepts developed in the 1930s, such as innate releasing mechanisms and fixed action patterns, have influenced the experimental and theoretical approaches to studying acoustic communication systems in Orthopteran insects. The idea of innateness of behaviors has directly fostered the search for central pattern generators that govern the stridulation patterns of crickets, katydids or grasshoppers. A central question pervading 50 years of research is how the essential match between signal features and receiver characteristics has evolved and is maintained during evolution. As in other disciplines, the tight interplay between technological developments and experimental and theoretical advances becomes evident throughout this review. While early neuroethological studies focused primarily on proximate questions such as the implementation of feature detectors or central pattern generators, later the interest shifted more towards ultimate questions. Orthoptera offer the advantage that both proximate and ultimate questions can be tackled in the same system. An important advance was the transition from laboratory studies under well-defined acoustic conditions to field studies that allowed to measure costs and benefits of acoustic signaling as well as constraints on song evolution.

Humans have a striking ability to infer meaning from even the sparsest and most abstract forms of narratives. At the same time, flexibility in the form of a narrative is matched by inherent ambiguity in its interpretation. How does the brain represent subtle, idiosyncratic differences in the interpretation of abstract and ambiguous narratives? In this fMRI study, subjects were scanned either watching a novel 7-min animation depicting a complex narrative through the movement of geometric shapes, or listening to a narration of the animation's social story. Using an intersubject representational similarity analysis that compared interpretation similarity and neural similarity across subjects, we found that the more similar two people's interpretations of the abstract shapes animation were, the more similar were their neural responses in regions of the default mode network (DMN) and fronto-parietal network. Moreover, these shared responses were modality invariant: the shapes movie and the verbal interpretation of the movie elicited shared responses in linguistic areas and a subset of the DMN when subjects shared interpretations. Together, these results suggest a network of high-level regions that are not only sensitive to subtle individual differences in narrative interpretation during naturalistic conditions, but also resilient to large differences in the modality of the narrative.

Auditory neuroscience has provided strong evidence that neural oscillations synchronize to the rhythm of speech stimuli, and oscillations at different frequencies have been linked to processing of different language structures. The present study aims to examine how these ubiquitous neurophysiological attributes may inform us about the brain processes that underpin individual differences in speech perception and production, which in turn elucidate the specific functions of neural oscillations in the domain of speech processing. To this end, we recorded electrophysiological responses to a lexical tone contrast in a passive auditory oddball paradigm from two groups of healthy tone-language speakers who were equal in perceptual discriminability but differed in response latency and production distinctiveness of the tone contrast. Time-frequency analysis was applied to the EEG data, and decomposed into theta (4–7 Hz), beta (12–30 Hz), and gamma (30–50 Hz) frequency bands. Results show that listeners with longer discrimination RT and less distinctive production showed significantly higher induced (non-phase-locked) gamma during tone processing. Moreover, among speakers with less distinctive production, individual differences in induced gamma were significantly correlated with discrimination latency and production distinction. Based on the present findings, we propose that differences in gamma oscillations reflect differential sensory/perceptual computations during acoustic encoding, impacting the quality of perceptual representations, which further mediates individual differences in speech perception and production.

In psychological experiments, behavioral speed varies across trials, and this variation is often associated with corresponding fluctuations in cortical activity. Little is known about such cortical variations in semantic priming tasks where target words are matched with preceding sensory object cues. Here, two visually presented target words ("pear" and "lilac") were repeatedly cued by corresponding odors or pictures, and the participants were to indicate matching or nonmatching combinations. Data were split in behaviorally "fast" versus "slow" trials. We hypothesized that slow trials would be associated with higher prestimulus alpha activity and reduced ERP amplitudes, and that response-time differences between odor-cued and picture-cued trials would be especially large in slow behavioral trials. Results confirmed that slow trials showed increased alpha-band activity prior to word target onset, as well as amplitude decreases in the sensory P1 and semantic N400 components. However, no interactions between cue-modality and processing speed were observed. Instead, odor-cue integration responses were uniquely delayed on incongruent trials, a novel behavioral effect that was not observed in EEG measures. The results show that semantic integration speed is reflected in cortical activity before and during stimulus processing. Behavioral interactions with cue modality did not correspond to observed cortical activity changes, perhaps because olfactory circuits are not readily observed in scalp-recorded EEG. We conclude that combining behavioral speed variability and cortical EEG measures is useful in understanding the fluctuating nature of cognitive processing sequences. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Summary: It has been proposed that sound information is separately streamed into onset and offset pathways for parallel processing. However, how offset responses contribute to auditory perception remains unclear. Here, loose-patch and whole-cell recordings in awake mouse primary auditory cortex (A1) reveal that a subset of pyramidal neurons exhibit a transient “Off” response, with its onset tightly time-locked to the sound termination and its frequency tuning similar to that of the transient “On” response. Both responses are characterized by excitation briefly followed by inhibition, with the latter mediated by parvalbumin (PV) inhibitory neurons. Optogenetically manipulating sound-evoked A1 responses at different temporal phases or artificially creating phantom sounds in A1 further reveals that the A1 phasic On and Off responses are critical for perceptual discrimination of sound duration. Our results suggest that perception of sound duration is dependent on precisely encoding its onset and offset timings by phasic On and Off responses.

Object recognition is among the basic survival skills of human beings and other animals. To date, artificial intelligence (AI) assisted high-performance object recognition is primarily visual-based, empowered by the rapid development of sensing and computational capabilities. Here, we report a tactile-olfactory sensing array, which was inspired by the natural sense-fusion system of star-nose mole, and can permit real-time acquisition of the local topography, stiffness, and odor of a variety of objects without visual input. The tactile-olfactory information is processed by a bioinspired olfactory-tactile associated machine-learning algorithm, essentially mimicking the biological fusion procedures in the neural system of the star-nose mole. Aiming to achieve human identification during rescue missions in challenging environments such as dark or buried scenarios, our tactile-olfactory intelligent sensing system could classify 11 typical objects with an accuracy of 96.9% in a simulated rescue scenario at a fire department test site. The tactile-olfactory bionic sensing system required no visual input and showed superior tolerance to environmental interference, highlighting its great potential for robust object recognition in difficult environments where other methods fall short., For the object recognition in lightless environments, the authors propose the olfactory-tactile machine learning approach, inspired by the star-nose mole’s neural system. They show how bionic flexible sensor arrays allow for real-time acquisition of object’s form and odor when touching it.

Across many species, scream calls signal the affective significance of events to other agents. Scream calls were often thought to be of generic alarming and fearful nature, to signal potential threats, with instantaneous, involuntary, and accurate recognition by perceivers. However, scream calls are more diverse in their affective signaling nature than being limited to fearfully alarming a threat, and thus the broader sociobiological relevance of various scream types is unclear. Here we used 4 different psychoacoustic, perceptual decision-making, and neuroimaging experiments in humans to demonstrate the existence of at least 6 psychoacoustically distinctive types of scream calls of both alarming and non-alarming nature, rather than there being only screams caused by fear or aggression. Second, based on perceptual and processing sensitivity measures for decision-making during scream recognition, we found that alarm screams (with some exceptions) were overall discriminated the worst, were responded to the slowest, and were associated with a lower perceptual sensitivity for their recognition compared with non-alarm screams. Third, the neural processing of alarm compared with non-alarm screams during an implicit processing task elicited only minimal neural signal and connectivity in perceivers, contrary to the frequent assumption of a threat processing bias of the primate neural system. These findings show that scream calls are more diverse in their signaling and communicative nature in humans than previously assumed, and, in contrast to a commonly observed threat processing bias in perceptual discriminations and neural processes, we found that especially non-alarm screams, and positive screams in particular, seem to have higher efficiency in speeded discriminations and the implicit neural processing of various scream types in humans., PLoS Biology, 19 (4), ISSN:1544-9173, ISSN:1545-7885

Brain systems dealing with multiple meanings of ambiguous stimuli are relatively well studied, while the processing of non-selected meanings is less investigated in the neurophysiological literature and provokes controversy between existing theories. It is debated whether these meanings are actively suppressed and, if yes, whether suppression characterizes any task that involves alternative solutions or only those tasks that emphasize semantic processing or the existence of alternatives. The current functional MRI event-related study used a modified version of the word fragment completion task to reveal brain mechanisms involved in implicit processing of the non-selected solutions of ambiguous fragments. The stimuli were pairs of fragmented adjectives and nouns. Noun fragments could have one or two solutions (resulting in two words with unrelated meanings). Adjective fragments had one solution and created contexts strongly suggesting one solution for ambiguous noun fragments. All fragmented nouns were presented twice during the experiment (with two different adjectives). We revealed that ambiguity resolution was associated with a reduced BOLD signal within several regions related to language processing, including the anterior hippocampi and amygdala and posterior lateral temporal cortex. Obtained findings were interpreted as resulting from brain activity inhibition, which underlies a hypothesized mechanism of suppression of non-selected solutions.

Statistical learning (SL) is the ability to extract regularities from the environment. In the domain of language, this ability is fundamental in the learning of words and structural rules. In lack of reliable online measures, statistical word and rule learning have been primarily investigated using offline (post-familiarization) tests, which gives limited insights into the dynamics of SL and its neural basis. Here, we capitalize on a novel task that tracks the online SL of simple syntactic structures combined with computational modeling to show that online SL responds to reinforcement learning principles rooted in striatal function. Specifically, we demonstrate—on 2 different cohorts—that a temporal difference model, which relies on prediction errors, accounts for participants’ online learning behavior. We then show that the trial-by-trial development of predictions through learning strongly correlates with activity in both ventral and dorsal striatum. Our results thus provide a detailed mechanistic account of language-related SL and an explanation for the oft-cited implication of the striatum in SL tasks. This work, therefore, bridges the long-standing gap between language learning and reinforcement learning phenomena., Statistical learning is the ability to extract regularities from the environment; in the domain of language, this ability is fundamental in the learning of words and structural rules. This study uses a combination of computational modelling and functional MRI to reveal a fundamental link between online language statistical learning and reinforcement learning at the algorithmic and implementational levels.

The degree of attention individuals pay to olfactory cues (called odor awareness) influences the role of odors in everyday life. Particularly, odors produced by the human body (i.e., social odors) are able to carry a wide variety of information and to elicit a broad spectrum of emotional reactions, making them essential in interpersonal relationships. Hence, despite the assessment of awareness toward social odors is crucial, a proper tool is still lacking. Here, we designed and initially validated the Social Odor Scale (SOS), a 12-item scale designed to measure the individual differences in awareness towards different social odors. In Study 1, an exploratory factor analysis (EFA; KMO test: MSA = 0.78; Bartlett’s test: χ2(78) = 631.34, p < 0.001; Chi-squared test: χ2(42) = 71.84, p = 0.003) suggests that the three factors structure was the model that best fit with the Italian version of the scale. The confirmatory factor analysis (CFA) supports a second-order model with one higher-order factor representing social odor awareness in general and three lower-order factors representing familiar, romantic partner, and stranger social odors. The final version of the scale presented a good fit (RMSEA = 0.012, SRMR = 0.069, CFI = 0.998, TLI = 0.997). In Study 2, CFA was performed in the German version of the scale confirming the validity of scale structure. Study 3 and 4 revealed that SOS total score and its subscales were positively correlated with other validated olfactory scales, but not with olfactory abilities. Moreover, SOS was found to be related to the gender of the participants: women reported to be more aware to social odors and, specifically, to familiar social odors than men. Overall, the results indicated that SOS is a valid and reliable instrument to assess awareness toward social odors in everyday life.

While the notion of the brain as a prediction machine has been extremely influential and productive in cognitive science, there are competing accounts of how best to model and understand the predictive capabilities of brains. One prominent framework is of a “Bayesian brain” that explicitly generates predictions and uses resultant errors to guide adaptation. We suggest that the prediction-generation component of this framework may involve little more than a pattern completion process. We first describe pattern completion in the domain of visual perception, highlighting its temporal extension, and show how this can entail a form of prediction in time. Next, we describe the forward momentum of entrained dynamical systems as a model for the emergence of predictive processing in non-predictive systems. Then, we apply this reasoning to the domain of language, where explicitly predictive models are perhaps most popular. Here, we demonstrate how a connectionist model, TRACE, exhibits hallmarks of predictive processing without any representations of predictions or errors. Finally, we present a novel neural network model, inspired by reservoir computing models, that is entirely unsupervised and memoryless, but nonetheless exhibits prediction-like behavior in its pursuit of homeostasis. These explorations demonstrate that brain-like systems can get prediction “for free,” without the need to posit formal logical representations with Bayesian probabilities or an inference machine that holds them in working memory.

In very old days past, I used to play piano, but not anymore. Age wore out the fingers, but they are not rusty .

Many tinnitus patients report difficulties understanding speech in noise or competing talkers, despite having “normal” hearing in terms of audiometric thresholds. The interference caused by tinnitus is more likely central in origin. Release from informational masking (more central in origin) produced by competing speech may further illuminate central interference due to tinnitus. In the present study, masked speech understanding was measured in normal hearing listeners with or without tinnitus. Speech recognition thresholds were measured for target speech in the presence of multi-talker babble or competing speech. For competing speech, speech recognition thresholds were measured for different cue conditions (i.e., with and without target-masker sex differences and/or with and without spatial cues). The present data suggest that tinnitus negatively affected masked speech recognition even in individuals with no measurable hearing loss. Tinnitus severity appeared to especially limit listeners’ ability to segregate competing speech using talker sex differences. The data suggest that increased informational masking via lexical interference may tax tinnitus patients’ central auditory processing resources.

Understanding what maintains the broad spectrum of variation in animal phenotypes and how this influences survival is a key question in biology. Frequency dependent selection – where predators temporarily focus on one morph at the expense of others by forming a “search image” – can help explain this phenomenon. However, past work has never tested real prey colour patterns, and rarely considered the role of different types of camouflage. Using a novel citizen science computer experiment that presented crab “prey” to humans against natural backgrounds in specific sequences, we were able to test a range of key hypotheses concerning the interactions between predator learning, camouflage and morph. As predicted, switching between morphs did hinder detection, and this effect was most pronounced when crabs had “disruptive” markings that were more effective at destroying the body outline. To our knowledge, this is the first evidence for variability in natural colour patterns hindering search image formation in predators, and as such presents a mechanism that facilitates phenotypic diversity in nature., Troscianko et al. use a citizen science online game to investigate how humans learn to overcome the natural camouflage of green shore crabs. They found that switching between crab types increased detection times, and the task was made even more difficult when patterns interfered with the crab’s outlines, helping to explain how variability in appearance can hinder predator search image formation.

Recurring structures forming regular patterns are common in sounds. Learning such patterns is thought to be crucial for accurate auditory perceptual organization (scene analysis) and efficient recognition and prediction of sounds. The current study investigated the behavioral and neural signatures of rapid perceptual learning of regular patterns in sounds. In six behavioral and EEG experiments with over 120 human participants from both sexes, we show that individuals are faster to detect regular patterns, are more sensitive to pattern deviations, and are more accurate at judging the temporal order of pattern onset relative to a visual stimulus when patterns are repeated compared to novel. Sustained neural activity indexed perceptual learning in two ways. First, sustained activity increased earlier for repeated compared to novel regular patterns when participants attended to sounds, but not when they ignored them; this earlier response increase mirrored the rapid perceptual learning we observed behaviorally. Second, the magnitude of sustained activity was reduced for repeated compared to novel patterns, independent of whether participants attended to or ignored sounds. The reduction in the magnitude of sustained activity appeared only for later stimulus presentations, suggesting it is not directly related to perceptual learning, but to processes enabled by learning. Our study thus reveals neural markers of perceptual learning of auditory patterns, and of processes that may be related to reduced novelty or better prediction of learned auditory patterns. Significance statement Perceptual learning of regular patterns in sounds may optimize perception, but not much is known about the underlying neural processes. We observed several behavioral indices of perceptual learning, including faster pattern detection and increased sensitivity to pattern deviations for repeated compared to novel patterns. Sustained neural activity – indexing pattern processing – increased earlier for repeated than novel patterns, mirroring perceptual learning observed behaviorally. The magnitude of sustained activity was reduced for repeated relative to novel patterns. This reduction appeared only for later stimulus presentations, suggesting it is not directly related to perceptual learning. Our study thus neurally characterizes the perceptual learning of auditory patterns and of subsequent processes that may index reduced novelty or increased prediction of learned auditory patterns.

Selective attention is a core cognitive function for efficient processing of information. Although it is well known that attention can modulate neural responses in many brain areas, the computational principles underlying attentional modulation remain unclear. Contrary to the prevailing view of a high-dimensional, distributed neural representation, here we show a surprisingly simple, biased neural representation for feature-based attention in a large dataset including five human fMRI studies. We found that when human participants (both sexes) selected one feature from a compound stimulus, voxels in many cortical areas responded consistently higher to one attended feature over the other. This univariate bias was consistent across brain areas within individual subjects. Importantly, this univariate bias showed a progressively stronger magnitude along the cortical hierarchy. In frontoparietal areas, the bias was strongest and contributed largely to pattern-based decoding, whereas early visual areas lacked such a bias. These findings suggest a gradual transition from a more analog to a more abstract representation of attentional priority along the cortical hierarchy. Biased neural responses in high-level areas likely reflect a low-dimensional neural code that can facilitate a robust representation and simple readout of cognitive variables.SIGNIFICANCE STATEMENTIt is typically assumed that cognitive variables are represented by distributed population activities. Although this view is rooted in decades of work in the sensory system, it has not been rigorously tested at different levels of cortical hierarchy. Here we show a novel, low-dimensional coding scheme that dominated the representation of feature-based attention in frontoparietal areas. The simplicity of such a biased code may confer a robust representation of cognitive variables, such as attentional selection, working memory, and decision-making.

Gait recognition is being employed as an effective approach to identify people without requiring subject collaboration. Nowadays, developed techniques for this task are obtaining high performance on current datasets (usually more than 90 % of accuracy). However, those datasets are simple as they only contain one subject in the scene at the same time. This fact limits the extrapolation of the results to real world conditions where, usually, multiple subjects are simultaneously present at the scene, generating different types of occlusions and requiring better tracking methods and models trained to deal with those situations. Thus, with the aim of evaluating more realistic and challenging situations appearing in scenarios with multiple subjects, we release a new framework (MuPeG) that generates augmented datasets with multiple subjects using existing datasets as input. By this way, it is not necessary to record and label new videos, since it is automatically done by our framework. In addition, based on the use of datasets generated by our framework, we propose an experimental methodology that describes how to use datasets with multiple subjects and the recommended experiments that are necessary to perform. Moreover, we release the first experimental results using datasets with multiple subjects. In our case, we use an augmented version of TUM-GAID and CASIA-B datasets obtained with our framework. In these augmented datasets the obtained accuracies are 54.8 % and 42.3 % whereas in the original datasets (single subject), the same model achieved 99.7 % and 98.0 % for TUM-GAID and CASIA-B, respectively. The performance drop shows clearly that the difficulty of datasets with multiple subjects in the scene is much higher than the ones reported in the literature for a single subject. Thus, our proposed framework is able to generate useful datasets with multiple subjects which are more similar to real life situations.

Visual stimuli often dominate nonvisual stimuli during multisensory perception. Evidence suggests higher cognitive processes prioritize visual over nonvisual stimuli during divided attention. Visual stimuli should thus be disproportionally distracting when processing incongruent cross-sensory stimulus pairs. We tested this assumption by comparing visual processing with olfaction, a “primitive” sensory channel that detects potentially hazardous chemicals by alerting attention. Behavioral and event-related brain potentials (ERPs) were assessed in a bimodal object categorization task with congruent or incongruent odor–picture pairings and a delayed auditory target that indicated whether olfactory or visual cues should be categorized. For congruent pairings, accuracy was higher for visual compared to olfactory decisions. However, for incongruent pairings, reaction times (RTs) were faster for olfactory decisions. Behavioral results suggested that incongruent odors interfered more with visual decisions, thereby providing evidence for an “olfactory dominance” effect. Categorization of incongruent pairings engendered a late “slow wave” ERP effect. Importantly, this effect had a later amplitude peak and longer latency during visual decisions, likely reflecting additional categorization effort for visual stimuli in the presence of incongruent odors. In sum, contrary to what might be inferred from theories of “visual dominance,” incongruent odors may in fact uniquely attract mental processing resources during perceptual incongruence. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.

To facilitate hand gesture recognition, we investigated the use of acoustic signals with an accelerometer and gyroscope at the human wrist. As a proof-of-concept, the prototype consisted of 10 microphone units in contact with the skin placed around the wrist along with an inertial measurement unit (IMU). The gesture recognition performance was evaluated through the identification of 13 gestures used in daily life. The optimal area for acoustic sensor placement at the wrist was examined using the minimum redundancy and maximum relevance feature selection algorithm. We recruited 10 subjects to perform over 10 trials for each set of hand gestures. The accuracy was 75% for a general model with the top 25 features selected, and the intra-subject average classification accuracy was over 80% with the same features using one microphone unit at the mid-anterior wrist and an IMU. These results indicate that acoustic signatures from the human wrist can aid IMU sensing for hand gesture recognition, and the selection of a few common features for all subjects could help with building a general model. The proposed multimodal framework helps address the single IMU sensing bottleneck for hand gestures during arm movement and/or locomotion.

Purpose/aim of the study:We aimed to establish psychophysical principles for non-invasive vibrotactile feedback signalling discrete transition events (e.g., extension to flexion) during use of prostheses, especially for the upper limbs. Materials and methods:Two vibrotactile actuators were used on both upper arms of 10 able-bodied human participants. Absolute thresholds, psychometric functions, and magnitude estimates were measured to equalize the sensation magnitudes for the tested vibrotactile frequencies and skin sites. Then, same-different and pattern recognition tasks were run to evaluate, respectfully, the discrimination and closed-set identification of stimuli with varying parameters (2 frequencies, 2 magnitudes, 2 sites). Finally, parameters of the left/right stimuli were mapped to hypothetical prosthesis events representing object/force and movement type. The stimuli were applied sequentially in accordance with the discrete event-driven feedback paradigm. Results:Reliable psychophysical models could be established for individual participants as verified by repetitive threshold measurements and relative adjustment of stimulus levels based on sensation magnitudes. Discrimination accuracy was higher for magnitude versus frequency comparisons; and magnitude discrimination accuracy was correlated with magnitude estimate differences. Pattern recognition recall/precision rates decreased from similar to 0.7 to similar to 0.5 for sequential delivery of two stimulus patterns to one arm versus to two arms. Using the patterns as two and three consecutive prosthesis events yielded statistically similar performance rates not correlated with magnitude estimate differences. Conclusions:By careful calibration of stimuli based on psychophysical principles, discrete event-driven vibrotactile feedback can be used to signal manipulated object and movement information with moderate identification rates as shown by confusion matrices.

Image quality is a key issue affecting the performance of biometric systems. Ensuring the quality of iris images acquired in unconstrained imaging conditions in visible light poses many challenges to iris recognition systems. Poor-quality iris images increase the false rejection rate and decrease the performance of the systems by quality filtering. Methods that can accurately predict iris image quality can improve the efficiency of quality-control protocols in iris recognition systems. We propose a fast blind/no-reference metric for predicting iris image quality. The proposed metric is based on statistical features of the sign and the magnitude of local image intensities. The experiments, conducted with a reference iris recognition system and three datasets of iris images acquired in visible light, showed that the quality of iris images strongly affects the recognition performance and is highly correlated with the iris matching scores. Rejecting poor-quality iris images improved the performance of the iris recognition system. In addition, we analyzed the effect of iris image quality on the accuracy of the iris segmentation module in the iris recognition system. ©2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access articledistributed under the terms and conditions of the Creative Commons Attribution (CC BY)license (http://creativecommons.org/licenses/by/4.0/.0/).

Object recognition through tactile perception involves two elements: the shape of the object (macrogeometric properties) and the material of the object (microgeometric properties). Here we sought to determine the characteristics of microgeometric tactile representations regarding object recognition through tactile perception. Participants were directed to recognize objects with different surface materials using either tactile information or visual information. With a quantitative analysis of the cognitive process regarding object recognition, Experiment 1 confirmed the same eight concepts (composed of rules defining distinct cognitive processes) commonly generated in both tactile and visual perceptions to accomplish the task, although an additional concept was generated during the visual task. Experiment 2 focused only on tactile perception. Three tactile objects with different surface materials (plastic, cloth and sandpaper) were used for the object recognition task. The participants answered a questionnaire regarding the process leading to their answers (which was designed based on the results obtained in Experiment 1) and to provide ratings on the vividness, familiarity and affective valence. We used these experimental data to investigate whether changes in material attributes (tactile information) change the characteristics of tactile representation. The observation showed that differences in tactile information resulted in differences in cognitive processes, vividness, familiarity and emotionality. These two experiments collectively indicated that microgeometric tactile information contributes to object recognition by recruiting various cognitive processes including episodic memory and emotion, similar to the case of object recognition by visual information.

Purpose This study aimed to investigate the time course of meaning activation of the 2nd morpheme processing of compound words during Chinese spoken word recognition using eye tracking technique with the printed-word paradigm. Method In the printed-word paradigm, participants were instructed to listen to a spoken target word (e.g., “大方”, /da4fang1/, generous) while presented with a visual display composed of 3 words: a morphemic competitor (e.g., “圆形”, /yuan2xing2/, circle), which was semantically related to the 2nd morpheme (e.g., “方”, /fang1/, square) of the spoken target word; a whole-word competitor (e.g., “吝啬”, /lin4se4/, stingy), which was semantically related to the spoken target word at the whole-word level; and a distractor, which was semantically related to neither the morpheme or the whole target word. Participants were asked to respond whether the spoken target word was on the visual display or not, and their eye movements were recorded. Results The logit mixed-model analysis showed both the morphemic competitor and the whole-word competitor effects. Both the morphemic and whole-word competitors attracted more fixations than the distractor. More importantly, the 2nd-morphemic competitor effect occurred at a relatively later time window (i.e., 1000–1500 ms) compared with the whole-word competitor effect (i.e., 200–1000 ms). Conclusion Findings in this study suggest that semantic information of both the 2nd morpheme and the whole word of a compound was activated in spoken word recognition and that the meaning activation of the 2nd morpheme followed the activation of the whole word.

Total hippocampal volume has previously been shown to correlate with performance on tests for verbal episodic memory. However, there are sparse evidence on how hippocampal subfield volumes are related to verbal episodic memory in healthy adults. The present study investigated the association between volumes of separate hippocampal subfields and verbal episodic memory performance in healthy volunteers. Forty-seven participants (31 females) between 20–71 years age underwent testing with the California Verbal Learning Test II (CVLT II), and the Wechsler Abbreviated Scale of Intelligence (WASI) to obtain an estimate of cognitive functioning. T1-weighted MR images were obtained after cognitive testing, and volumetric estimates adjusted for age and estimated total intracranial volume were calculated in the FreeSurfer 6.0 software suite for cerebral -and hippocampal structures. The sample performed within the statistical normal range on both CVLT II and WASI. Significant correlations adjusted for multiple testing were found between CVLT II subtests of total learning, free immediate recall and free delayed recall and volumes of the left Cornu Ammonis (CA) 1–4 subfields. There were no significant correlations between right hippocampal subfields and CVLT II performance, and no significant correlation between WASI results and hippocampal subfields. The present results suggest that better verbal episodic memory measured by the CVLT II is associated with relative larger volumes of specific left CA hippocampal subfields in healthy adults. Due to the small sample size and large age-span of the participants, the present findings are preliminary and should be confirmed in larger samples.

We formulate the computational processes of perception in the framework of the principle of least action by postulating the theoretical action as a time integral of the free energy in the brain sciences. The free energy principle is accordingly rephrased as that for autopoietic grounds all viable organisms attempt to minimize the sensory uncertainty about the unpredictable environment over a temporal horizon. By varying the informational action, we derive the brain's recognition dynamics (RD) which conducts Bayesian filtering of the external causes from noisy sensory inputs. Consequently, we effectively cast the gradient-descent scheme of minimizing the free energy into Hamiltonian mechanics by addressing only positions and momenta of the organisms' representations of the causal environment. To manifest the utility of our theory, we show how the RD may be implemented in a neuronally based biophysical model at a single-cell level and subsequently in a coarse-grained, hierarchical architecture of the brain. We also present formal solutions to the RD for a model brain in linear regime and analyze the perceptual trajectories around attractors in neural state space., 34 pages, 5 figures; Revised; Figure added

We examined the frequency specificity of amplitude envelope patterns in 4 frequency bands, which universally appeared through factor analyses applied to power fluctuations of critical-band filtered speech sounds in 8 different languages/dialects [Ueda and Nakajima (2017). Sci. Rep., 7 (42468)]. A series of 3 perceptual experiments with noise-vocoded speech of Japanese sentences was conducted. Nearly perfect (92–94%) mora recognition was achieved, without any extensive training, in a control condition in which 4-band noise-vocoded speech was employed (Experiments 1–3). Blending amplitude envelope patterns of the frequency bands, which resulted in reducing the number of amplitude envelope patterns while keeping the average spectral levels unchanged, revealed a clear deteriorating effect on intelligibility (Experiment 1). Exchanging amplitude envelope patterns brought generally detrimental effects on intelligibility, especially when involving the 2 lowest bands ( ≲ 1850 Hz; Experiment 2). Exchanging spectral levels averaged in time had a small but significant deteriorating effect on intelligibility in a few conditions (Experiment 3). Frequency specificity in low-frequency-band envelope patterns thus turned out to be conspicuous in speech perception.

It is well known that auditory nerve (AN) fibers overcome bandwidth limitations through the volley principle, a form of multiplexing. What is less well known is that the volley principle introduces a degree of unpredictability into AN neural firing patterns that may be affecting even simple stimulus categorization learning. We use a physiologically grounded, unsupervised spiking neural network model of the auditory brain with spike time dependent plasticity learning to demonstrate that plastic auditory cortex is unable to learn even simple auditory object categories when exposed to the raw AN firing input without subcortical preprocessing. We then demonstrate the importance of nonplastic subcortical preprocessing within the cochlear nucleus and the inferior colliculus for stabilizing and denoising AN responses. Such preprocessing enables the plastic auditory cortex to learn efficient robust representations of the auditory object categories. The biological realism of our model makes it suitable for generating neurophysiologically testable hypotheses.

A key challenge for cognitive neuroscience is deciphering the representational schemes of the brain. Stimulus-feature-based encoding models are becoming increasingly popular for inferring the dimensions of neural representational spaces from stimulus-feature spaces. We argue that such inferences are not always valid because successful prediction can occur even if the two representational spaces use different, but correlated, representational schemes. We support this claim with three simulations in which we achieved high prediction accuracy despite systematic differences in the geometries and dimensions of the underlying representations. Detailed analysis of the encoding models' predictions showed systematic deviations from ground-truth, indicating that high prediction accuracy is insufficient for making representational inferences. This fallacy applies to the prediction of actual neural patterns from stimulus-feature spaces and we urge caution in inferring the nature of the neural code from such methods. We discuss ways to overcome these inferential limitations, including model comparison, absolute model performance, visualization techniques and attentional modulation.

Primary sensory cortices are classically considered to extract and represent stimulus features, while association and higher-order areas are thought to carry information about stimulus meaning. Here we show that this information can in fact be found in the neuronal population code of the primary auditory cortex (A1). A1 activity was recorded in awake ferrets while they either passively listened or actively discriminated stimuli in a range of Go/No-Go paradigms, with different sounds and reinforcements. Population-level dimensionality reduction techniques reveal that task engagement induces a shift in stimulus encoding from a sensory to a behaviorally driven representation that specifically enhances the target stimulus in all paradigms. This shift partly relies on task-engagement-induced changes in spontaneous activity. Altogether, we show that A1 population activity bears strong similarities to frontal cortex responses. These findings indicate that primary sensory cortices implement a crucial change in the structure of population activity to extract task-relevant information during behavior., Sensory areas are thought to process stimulus information while higher-order processing occurs in association cortices. Here the authors report that during task engagement population activity in ferret primary auditory cortex shifts away from encoding stimulus features toward detection of the behaviourally relevant targets.

Vocal communication is a sensory-motor process requiring auditory self-monitoring to correct errors and to ensure accurate vocal production. When presented with altered speech feedback, humans rapidly change their speech to compensate. Although previous evidence has demonstrated suppression of auditory cortex during both speech and animal vocalization, the specific role of auditory cortex in such feedback-dependent control is unknown. Here we show the relationship between neural activity in the auditory cortex and feedback-dependent vocal control in marmoset monkeys. We demonstrate that marmosets, like humans, exhibit feedback control of vocal acoustics. We further show that feedback-sensitive activity of auditory cortex neurons predict such compensatory vocal changes. Finally, we demonstrate that electrical microstimulation of auditory cortex rapidly evokes similar changes in vocal production. These results are evidence for a causal role of auditory cortex in vocal self-monitoring and feedback-dependent control, and have implications for understanding human speech motor control., During vocalization, mammals change their vocal production to compensate for altered auditory feedback. Here, Eliades and Tsunada show that neural activity in the marmoset’s auditory cortex mediates this effect, and that stimulation of the auditory cortex evokes similar changes in vocalization.

The olfactory system participates in many sensory processes, and olfactory endophenotypes appear in a variety of neurological disorders such as Alzheimer's and Parkinson's disease, depression and schizophrenia. Social withdrawal is a core negative symptom of schizophrenia and animal models have proven to be invaluable for studying the neurobiological mechanisms and cognitive processes behind the formation of social relationships. The subchronic phencyclidine (PCP) rat model is a validated model for negative symptoms of schizophrenia, such as impaired sociability. However, the complete range of social behaviour and deficits in the model are still not fully understood. Intact rodent olfaction is essential for a wide range of social behaviour and disrupted olfactory function could have severe effects on social communication and recognition. In order to examine the olfactory ability of male rats treated with subchronic PCP, we conducted an olfactory habituation/dishabituation test including both non-social and social odours. The subchronic PCP-treated rats successfully recognized and discriminated among the odours, indicative of intact olfaction. Interestingly, the subchronic PCP-treated rats showed greater interest for a novel social odour compared to the saline-treated rats and the rationale remains to be elucidated. Our data indicate that subchronic PCP treatment does not disrupt olfactory function in male rats. By ruling out impaired olfaction as cause for the poor social interaction performance in subchronic PCP-treated rats, our data supports the use of NMDA receptor antagonists to model the negative symptoms of schizophrenia.