Search

The brain predicts regularities in sensory inputs at multiple complexity levels, with neuronal mechanisms that remain elusive. Here, we monitored auditory cortex activity during the local-global paradigm, a protocol nesting different regularity levels in sound sequences. We observed that mice encode local predictions based on stimulus occurrence and stimulus transition probabilities, because auditory responses are boosted upon prediction violation. This boosting was due to both short-term adaptation and an adaptation-independent surprise mechanism resisting anesthesia. In parallel, and only in wakefulness, VIP interneurons responded to the omission of the locally expected sound repeat at the sequence ending, thus providing a chunking signal potentially useful for establishing global sequence structure. When this global structure was violated, by either shortening the sequence or ending it with a locally expected but globally unexpected sound transition, activity slightly increased in VIP and PV neurons, respectively. Hence, distinct cellular mechanisms predict different regularity levels in sound sequences.

Abstract The awake mammalian brain is functionally organized in terms of large-scale distributed networks that are constantly interacting. Loss of consciousness might disrupt this temporal organization leaving patients unresponsive. We hypothesize that characterizing brain activity in terms of transient events may provide a signature of consciousness. For this, we analyze temporal dynamics of spatiotemporally overlapping functional networks obtained from fMRI transient activity across different anesthetics and levels of anesthesia. We first show a striking homology in spatial organization of networks between monkeys and humans, indicating cross-species similarities in resting-state fMRI structure. We then track how network organization shifts under different anesthesia conditions in macaque monkeys. While the spatial aspect of the networks is preserved, their temporal dynamics are highly affected by anesthesia. Networks express for longer durations and co-activate in an anesthetic-specific configuration. Additionally, hierarchical brain organization is disrupted with a consciousness-level-signature role of the default mode network. In conclusion, large-scale brain network temporal dynamics capture differences in anesthetic-specific consciousness-level, paving the way towards a clinical translation of these cortical signature.

Abstract The Individual Brain Charting (IBC) is a multi-task functional Magnetic Resonance Imaging dataset acquired at high spatial-resolution and dedicated to the cognitive mapping of the human brain. It consists in the deep phenotyping of twelve individuals, covering a broad range of psychological domains suitable for functional-atlasing applications. Here, we present the inclusion of task data from both naturalistic stimuli and trial-based designs, to uncover structures of brain activation. We rely on the Fast Shared Response Model (FastSRM) to provide a data-driven solution for modelling naturalistic stimuli, typically containing many features. We show that data from left-out runs can be reconstructed using FastSRM, enabling the extraction of networks from the visual, auditory and language systems. We also present the topographic organization of the visual system through retinotopy. In total, six new tasks were added to IBC, wherein four trial-based retinotopic tasks contributed with a mapping of the visual field to the cortex. IBC is open access: source plus derivatives imaging data and meta-data are available in public repositories.

Summary: When exposed to sensory sequences, do macaque monkeys spontaneously form abstract internal models that generalize to novel experiences? Here, we show that neuronal populations in macaque ventrolateral prefrontal cortex jointly encode visual sequences by separate codes for the specific pictures presented and for their abstract sequential structure. We recorded prefrontal neurons while macaque monkeys passively viewed visual sequences and sequence mismatches in the local-global paradigm. Even without any overt task or response requirements, prefrontal populations spontaneously form representations of sequence structure, serial order, and image identity within distinct but superimposed neuronal subspaces. Representations of sequence structure rapidly update following single exposure to a mismatch sequence, while distinct populations represent mismatches for sequences of different complexity. Finally, those representations generalize across sequences following the same repetition structure but comprising different images. These results suggest that prefrontal populations spontaneously encode rich internal models of visual sequences reflecting both content-specific and abstract information.

Summary: The ability to compose successive words into a meaningful phrase is a characteristic feature of human cognition, yet its neural mechanisms remain incompletely understood. Here, we analyze the cortical mechanisms of semantic composition using magnetoencephalography (MEG) while participants read one-word, two-word, and five-word noun phrases and compared them with a subsequent image. Decoding of MEG signals revealed three processing stages. During phrase comprehension, the representation of individual words was sustained for a variable duration depending on phrasal context. During the delay period, the word code was replaced by a working-memory code whose activation increased with semantic complexity. Finally, the speed and accuracy of retrieval depended on semantic complexity and was faster for surface than for deep semantic properties. In conclusion, we propose that the brain initially encodes phrases using factorized dimensions for successive words but later compresses them in working memory and requires a period of decompression to access them.

Abstract Data plots are widely used in science, journalism and politics, since they efficiently allow to depict a large amount of information. Graphicacy, the ability to understand graphs, has thus become a fundamental cultural skill comparable to literacy or numeracy. Here, we introduce a measure of intuitive graphicacy that assesses the perceptual ability to detect a trend in noisy scatterplots (“does this graph go up or down?”). In 3943 educated participants, responses vary as a sigmoid function of the t-value that a statistician would compute to detect a significant trend. We find a minimum level of core intuitive graphicacy even in unschooled participants living in remote Namibian villages (N = 87) and 6-year-old 1st-graders who never read a graph (N = 27). The sigmoid slope that we propose as a proxy of intuitive graphicacy increases with education and tightly correlates with statistical and mathematical knowledge, showing that experience contributes to refining graphical intuitions. Our tool, publicly available online, allows to quickly evaluate and formally quantify a perceptual building block of graphicacy.

According to the language-of-thought hypothesis, regular sequences are compressed in human memory using recursive loops akin to a mental program that predicts future items. We tested this theory by probing memory for 16-item sequences made of two sounds. We recorded brain activity with functional MRI and magneto-encephalography (MEG) while participants listened to a hierarchy of sequences of variable complexity, whose minimal description required transition probabilities, chunking, or nested structures. Occasional deviant sounds probed the participants’ knowledge of the sequence. We predicted that task difficulty and brain activity would be proportional to the complexity derived from the minimal description length in our formal language. Furthermore, activity should increase with complexity for learned sequences, and decrease with complexity for deviants. These predictions were upheld in both fMRI and MEG, indicating that sequence predictions are highly dependent on sequence structure and become weaker and delayed as complexity increases. The proposed language recruited bilateral superior temporal, precentral, anterior intraparietal, and cerebellar cortices. These regions overlapped extensively with a localizer for mathematical calculation, and much less with spoken or written language processing. We propose that these areas collectively encode regular sequences as repetitions with variations and their recursive composition into nested structures.

The relationship between conscious experience and brain activity has intrigued scientists and philosophers for centuries. In the last decades, several theories have suggested different accounts for these relationships. These theories have developed in parallel, with little to no cross-talk among them. To advance research on consciousness, we established an adversarial collaboration between proponents of two of the major theories in the field, Global Neuronal Workspace and Integrated Information Theory. Together, we devised and preregistered two experiments that test contrasting predictions of these theories concerning the location and timing of correlates of visual consciousness, which have been endorsed by the theories' proponents. Predicted outcomes should either support, refute, or challenge these theories. Six theory-impartial laboratories will follow the study protocol specified here, using three complementary methods: Functional Magnetic Resonance Imaging (fMRI), Magneto-Electroencephalography (M-EEG), and intracranial electroencephalography (iEEG). The study protocol will include built-in replications, both between labs and within datasets. Through this ambitious undertaking, we hope to provide decisive evidence in favor or against the two theories and clarify the footprints of conscious visual perception in the human brain, while also providing an innovative model of large-scale, collaborative, and open science practice.

Although words and faces activate neighboring regions in the fusiform gyrus, we lack an understanding of how such category selectivity emerges during development. To investigate the organization of reading and face circuits at the earliest stage of reading acquisition, we measured the fMRI responses to words, faces, houses, and checkerboards in three groups of 60 French children: 6-year-old pre-readers, 6-year-old beginning readers and 9-year-old advanced readers. The results showed that specific responses to written words were absent prior to reading, but emerged in beginning readers, irrespective of age. Likewise, specific responses to faces were barely visible in pre-readers and continued to evolve in the 9-year-olds, yet primarily driven by age rather than by schooling. Crucially, the sectors of ventral visual cortex that become specialized for words and faces harbored their own functional connectivity prior to reading acquisition: the VWFA with left-hemispheric spoken language areas, and the FFA with the contralateral region and the amygdalae. The results support the view that reading acquisition occurs through the recycling of a pre-existing but plastic circuit which, in pre-readers, already connects the VWFA site to other distant language areas. We argue that reading acquisition does not compete with the face system directly, through a pruning of preexisting face responses, but indirectly, by hindering the slow growth of face responses in the left hemisphere, thus increasing a pre-existing right hemispheric bias.

The neuronal mechanisms underlying recognition of written letters remain unknown. Here, the authors show that populations of neurons in the ventral visual pathway of macaque monkeys encode orthographic stimuli, indicating that this pathway might be a precursor of orthographic processing abilities.

Working memory capacity can be improved by recoding the memorized information in a condensed form. Here, we tested the theory that human adults encode binary sequences of stimuli in memory using an abstract internal language and a recursive compression algorithm. The theory predicts that the psychological complexity of a given sequence should be proportional to the length of its shortest description in the proposed language, which can capture any nested pattern of repetitions and alternations using a limited number of instructions. Five experiments examine the capacity of the theory to predict human adults' memory for a variety of auditory and visual sequences. We probed memory using a sequence violation paradigm in which participants attempted to detect occasional violations in an otherwise fixed sequence. Both subjective complexity ratings and objective violation detection performance were well predicted by our theoretical measure of complexity, which simply reflects a weighted sum of the number of elementary instructions and digits in the shortest formula that captures the sequence in our language. While a simpler transition probability model, when tested as a single predictor in the statistical analyses, accounted for significant variance in the data, the goodness-of-fit with the data significantly improved when the language-based complexity measure was included in the statistical model, while the variance explained by the transition probability model largely decreased. Model comparison also showed that shortest description length in a recursive language provides a better fit than six alternative previously proposed models of sequence encoding. The data support the hypothesis that, beyond the extraction of statistical knowledge, human sequence coding relies on an internal compression using language-like nested structures.

Numeracy is of critical importance for scholastic success and modern-day living, but the precise mechanisms that drive its development are poorly understood. Here we used novel experimental training methods to begin to investigate the role of symbols in the development of numeracy in preschool-aged children. We assigned pre-school children in the U.S. and Italy (N = 215; Mean age = 49.15 months) to play one of five versions of a computer-based numerical comparison game for two weeks. The different versions of the game were equated on basic features of gameplay and demands but systematically varied in numerical content. Critically, some versions included non-symbolic numerical comparisons only, while others combined non-symbolic numerical comparison with symbolic aids of various types. Before and after training we assessed four components of early numeracy: counting proficiency, non-symbolic numerical comparison, one-to-one correspondence, and arithmetic set transformation. We found that overall children showed improvement in most of these components after completing these short trainings. However, children trained on numerical comparisons with symbolic aids made larger gains on assessments of one-to-one correspondence and arithmetic transformation compared to children whose training involved non-symbolic numerical comparison only. Further exploratory analyses suggested that, although there were no major differences between children trained with verbal symbols (e.g., verbal counting) and non-verbal visuo-spatial symbols (i.e., abacus counting), the gains in one-to-one correspondence may have been driven by abacus training, while the gains in non-verbal arithmetic transformations may have been driven by verbal training. These results provide initial evidence that the introduction of symbols may contribute to the emergence of numeracy by enhancing the capacity for thinking about exact equality and the numerical effects of set transformations. More broadly, this study provides an empirical basis to motivate further focused study of the processes by which children’s mastery of symbols influences children’s developing mastery of numeracy.

Are the brain mechanisms of reading acquisition similar across writing systems? And do similar brain anomalies underlie reading difficulties in alphabetic and ideographic reading systems? In a cross-cultural paradigm, we measured the fMRI responses to words, faces, and houses in 96 Chinese and French 10-year-old children, half of whom were struggling with reading. We observed a reading circuit which was strikingly similar across languages and consisting of the left fusiform gyrus, superior temporal gyrus/sulcus, precentral and middle frontal gyri. Activations in some of these areas were modulated either by language or by reading ability, but without interaction between those factors. In various regions previously associated with dyslexia, reading difficulty affected activation similarly in Chinese and French readers, including the middle frontal gyrus, a region previously described as specifically altered in Chinese. Our analyses reveal a large degree of cross-cultural invariance in the neural correlates of reading acquisition and reading impairment.

Learning to read leads to functional and structural changes in cortical brain areas related to vision and language. Previous evidence suggests that the Visual Word Form Area (VWFA), a region devoted to the recognition of letter strings in literate persons, acts as an interface between both systems. While different studies have performed univariate analyses to study the effects of literacy on brain function, little is known about its impact on whole functional networks, especially when literacy is acquired during adulthood. We investigated functional connectivity in three groups of adults with different literacy status: illiterates, ex-illiterates (i.e., who learned to read during adulthood), and literates (i.e., who learned to read in childhood). We used a data-driven, multivariate whole brain approach (Independent Component Analysis [ICA]) combined with a region of interest (ROI) analysis in order to explore the functional connectivity of the VWFA with four ICA networks related to vision and language functions. ICA allowed for the identification of four networks of interest: left fronto-parietal, auditory, medial visual and lateral visual functional networks, plus a control right fronto-parietal network. We explored the effects literacy on the connectivity between the VWFA and these networks, trying furthermore to disentangle the roles of reading proficiency and age of acquisition (i.e., literacy status) in these changes. Results showed that functional connectivity between the VWFA and the left fronto-parietal and lateral visual networks increased and decreased, respectively, with literacy. Moreover, the functional coupling of the VWFA and the auditory network decreased with literacy. This study provides novel insights in the mechanisms of reading acquisition and brain plasticity, putting to light the emergence of the VWFA as a bridge between language and vision. Further studies are required to characterize the interplay of proficiency and age of reading acquisition, and its relevance to models of brain plasticity across lifespan.

Advanced mathematical reasoning, regardless of domain or difficulty, activates a reproducible set of bilateral brain areas including intraparietal, inferior temporal and dorsal prefrontal cortex. The respective roles of genetics, experience and education in the development of this math-responsive network, however, remain unresolved. Here, we investigate the role of visual experience by studying the exceptional case of three professional mathematicians who were blind from birth (n = 1) or became blind during childhood (n = 2). Subjects were scanned with fMRI while they judged the truth value of spoken mathematical and nonmathematical statements. Blind mathematicians activated the classical network of math-related areas during mathematical reflection, similar to that found in a group of sighted professional mathematicians. Thus, brain networks for advanced mathematical reasoning can develop in the absence of visual experience. Additional activations were found in occipital cortex, even in individuals who became blind during childhood, suggesting that either mental imagery or a more radical repurposing of visual cortex may occur in blind mathematicians. Keywords: Advanced mathematical development, Blindness, Functional MRI

Humans can identify a target picture even when presented within a rapid stream of stimuli. Here the authors report that the neural activity initially supports parallel processing of multiple stimuli around the target in ventral visual areas followed later by isolated activation of reported images in parietal areas.

We introduce a novel method capable of dissecting the succession of processing stages underlying mental arithmetic, thus revealing how two numbers are transformed into a third. We asked adults to point to the result of single-digit additions and subtractions on a number line, while their finger trajectory was constantly monitored. We found that the two operands are processed serially: the finger first points toward the larger operand, then slowly veers toward the correct result. This slow deviation unfolds proportionally to the size of the smaller operand, in both additions and subtractions. We also observed a transient operator effect: a plus sign attracted the finger to the right and a minus sign to the left and a transient activation of the absolute value of the subtrahend. These findings support a model whereby addition and subtraction are computed by a stepwise displacement on the mental number line, starting with the larger number and incrementally adding or subtracting the smaller number.

Humans and other animals base important decisions on estimates of number, and intraparietal cortex is thought to provide a crucial substrate of this ability. However, it remains debated whether an independent neuronal processing mechanism underlies this ‘number sense’, or whether number is instead judged indirectly on the basis of other quantitative features. We performed high-resolution 7 Tesla fMRI while adult human volunteers attended either to the numerosity or an orthogonal dimension (average item size) of visual dot arrays. Along the dorsal visual stream, numerosity explained a significant amount of variance in activation patterns, above and beyond non-numerical dimensions. Its representation was selectively amplified and progressively enhanced across the hierarchy when task relevant. Our results reveal a sensory extraction mechanism yielding information on numerosity separable from other dimensions already at early visual stages and suggest that later regions along the dorsal stream are most important for explicit manipulation of numerical quantity.

Extracting the temporal structure of sequences of events is crucial for perception, decision-making, and language processing. Here, we investigate the mechanisms by which the brain acquires knowledge of sequences and the possibility that successive brain responses reflect the progressive extraction of sequence statistics at different timescales. We measured brain activity using magnetoencephalography in humans exposed to auditory sequences with various statistical regularities, and we modeled this activity as theoretical surprise levels using several learning models. Successive brain waves related to different types of statistical inferences. Early post-stimulus brain waves denoted a sensitivity to a simple statistic, the frequency of items estimated over a long timescale (habituation). Mid-latency and late brain waves conformed qualitatively and quantitatively to the computational properties of a more complex inference: the learning of recent transition probabilities. Our findings thus support the existence of multiple computational systems for sequence processing involving statistical inferences at multiple scales.

The simultaneous multi-slice EPI (SMS-EPI, a.k.a. MB-EPI) sequence has met immense popularity recently in functional neuroimaging. A still less common alternative is the use of 3D-EPI, which offers similar acceleration capabilities. The aim of this work was to compare the SMS-EPI and the 3D-EPI sequences in terms of sampling strategies for the detection of task-evoked activations at 7T using detection theory. To this end, the spatial and temporal resolutions of the sequences were matched (1.6 mm isotropic resolution, TR = 1200 ms) and their excitation profiles were homogenized by means of calibration-free parallel-transmission (Universal Pulses). We used a fast-event "localizer" paradigm of 5:20 min in order to probe sensorimotor functions (visual, auditory and motor tasks) as well as higher level functions (language comprehension, mental calculation), where results from a previous large-scale study at 3T (N = 81) served as ground-truth reference for the brain areas implicated in each cognitive function. In the current study, ten subjects were scanned while their activation maps were generated for each cognitive function with the GLM analysis. The SMS-EPI and 3D-EPI sequences were compared in terms of raw tSNR, t-score testing for the mean signal, activation strength and accuracy of the robust sensorimotor functions. To this end, the sensitivity and specificity of these contrasts were computed by comparing their activation maps to the reference brain areas obtained in the 3T study. Estimated flip angle distributions in the brain reported a normalized root mean square deviation from the target value below 10% for both sequences. The analysis of the t-score testing for the mean signal revealed temporal noise correlations, suggesting the use of this metric instead of the traditional tSNR for testing fMRI sequences. The SMS-EPI and 3D-EPI thereby yielded similar performance from a detection theory perspective.

Entrevista de Renaud Persiaux a Stanislas Dehaene Tomado de Jean-François Dortier (dir.). El cerebro y el pensamiento. La nueva edad de las ciencias cognitivas. Auxerre: Sciences Humaines éditions, 2014 ‹ed. revisada y aumentada del libro de 2012›. pp. 53-58. Traducción del francés al español de Luis Alfonso Palau Castaño, Medellín, noviembre 15 de 2016. Su lección inaugural en el Colegio de Francia se tituló “Hacia una ciencia de la vida mental”. ¿Por qué? Primero, para inscribir mi proceder en la (ya) larga historia de la psicología; es la definición propuesta en el siglo XIX por William James, uno de sus padres fundadores. Segundo, porque yo creo que la psicología será uno de los nudos esenciales de una futura ciencia de la vida mental. Pluridisciplinaria, tendrá por objetivo explicar cómo pensamos por medio de series de leyes sucesivas, que tienen en cuenta diferentes aspectos de la biología del cerebro a la dimensión cultural. El reto es llegar a establecer leyes de la psicología tan universales como las de la física. Para mí, el pensamiento, aunque sea subjetivo e íntimo, puede ser estudiado de manera científica, especialmente porque sus características son ampliamente compartidas a través del mundo. Creo que cada una de nuestras representaciones mentales es también un objeto neuronal, incluso si las leyes de enlace entre los dos niveles todavía están por establecer. En el laboratorio, nuestras investigaciones se articulan ya entre comportamiento, desarrollo del niño, neuropsicología, imagenografía cerebral…

We report the effectiveness of using the tablet-game Kalulu Phonics immediately after intervention in kindergarten and on national evaluations the year after. In a previous intervention testing the software with 1st graders, fluency and comprehension were boosted, but only when used in concert with reading instruction at the start of the year. Here, we asked whether a similar intervention would be more efficient if it started a year earlier, in kindergarten. Forty classes (1092 = children) were randomized into playing Kalulu Phonics or the matched Kalulu Numbers control game for the first half of the year, with reversed assignments in the second half. Ten non-randomized business-as-usual classes also participated. In a cross-over effect, children who used the phonics version improved in letter naming, grapheme-phoneme correspondence (GPC) matching and fluency. Students with the number version improved in number knowledge. In a longitudinal follow-up, all intervention participants maintained an advantage in phoneme awareness and GPC matching at the start of 1st grade, but this advantage failed to translate into school literacy gains by mid-year. No longitudinal benefits were found for numbers. Our results support using tablet-based aids in spurring early reading skills but question the possibility that a short-term intervention may address the challenges of long-term educational goals.

Sentence comprehension requires inferring, from a sequence of words, the structure of syntactic relationships that bind these words into a semantic representation. Our limited ability to build some specific syntactic structures, such as nested center-embedded clauses (e.g., “The dog that the cat that the mouse bit chased ran away”), suggests a striking capacity limitation of sentence processing, and thus offers a window to understand how the human brain processes sentences. Here, we review the main hypotheses proposed in psycholinguistics to explain such capacity limitation. We then introduce an alternative approach, derived from our recent work on artificial neural networks optimized for language modeling, and predict that capacity limitation derives from the emergence of sparse and feature-specific syntactic units. Unlike psycholinguistic theories, our neural network-based framework provides precise capacity-limit predictions without making any a priori assumptions about the form of the grammar or parser. Finally, we discuss how our framework may clarify the mechanistic underpinning of language processing and its limitations in the human brain.

How does education affect cortical organization? All literate adults possess a region specialized for letter strings, the visual word form area (VWFA), within the mosaic of ventral regions involved in processing other visual categories such as objects, places, faces, or body parts. Therefore, the acquisition of literacy may induce a reorientation of cortical maps towards letters at the expense of other categories such as faces. To test this cortical recycling hypothesis, we studied how the visual cortex of individual children changes during the first months of reading acquisition. Ten 6-year-old children were scanned longitudinally 6 or 7 times with functional magnetic resonance imaging (fMRI) before and throughout the first year of school. Subjects were exposed to a variety of pictures (words, numbers, tools, houses, faces, and bodies) while performing an unrelated target-detection task. Behavioral assessment indicated a sharp rise in grapheme-phoneme knowledge and reading speed in the first trimester of school. Concurrently, voxels specific to written words and digits emerged at the VWFA location. The responses to other categories remained largely stable, although right-hemispheric face-related activity increased in proportion to reading scores. Retrospective examination of the VWFA voxels prior to reading acquisition showed that reading encroaches on voxels that are initially weakly specialized for tools and close to but distinct from those responsive to faces. Remarkably, those voxels appear to keep their initial category selectivity while acquiring an additional and stronger responsivity to words. We propose a revised model of the neuronal recycling process in which new visual categories invade weakly specified cortex while leaving previously stabilized cortical responses unchanged.

Dyscalculia, a specific learning disability that impacts arithmetical skills, has previously been associated to a deficit in the precision of the system that estimates the approximate number of objects in visual scenes (the so called 'number sense' system). However, because in tasks involving numerosity comparisons dyscalculics' judgements appears disproportionally affected by continuous quantitative dimensions (such as the size of the items), an alternative view linked dyscalculia to a domain-general difficulty in inhibiting task-irrelevant responses. To arbitrate between these views, we evaluated the degree of reciprocal interference between numerical and non-numerical quantitative dimensions in adult dyscalculics and matched controls. We used a novel stimulus set orthogonally varying in mean item size and numerosity, putting particular attention into matching both features' perceptual discriminability. Participants compared those stimuli based on each of the two dimensions. While control subjects showed no significant size interference when judging numerosity, dyscalculics' numerosity judgments were strongly biased by the unattended size dimension. Importantly however, both groups showed the same degree of interference from the unattended dimension when judging mean size. Moreover, only the ability to discard the irrelevant size information when comparing numerosity (but not the reverse) significantly predicted calculation ability across subjects. Overall, our results show that numerosity discrimination is less prone to interference than discrimination of another quantitative feature (mean item size) when the perceptual discriminability of these features is matched, as here in control subjects. By quantifying, for the first time, dyscalculic subjects' degree of interference on another orthogonal dimension of the same stimuli, we are able to exclude a domain-general inhibition deficit as explanation for their poor / biased numerical judgement. We suggest that enhanced reliance on non-numerical cues during numerosity discrimination can represent a strategy to cope with a less precise number sense.

Probabilistic proposals of Language of Thoughts (LoTs) can explain learning across different domains as statistical inference over a compositionally structured hypothesis space. While frameworks may differ on how a LoT may be implemented computationally, they all share the property that they are built from a set of atomic symbols and rules by which these symbols can be combined. In this work we propose an extra validation step for the set of atomic productions defined by the experimenter. It starts by expanding the defined LoT grammar for the cognitive domain with a broader set of arbitrary productions and then uses Bayesian inference to prune the productions from the experimental data. The result allows the researcher to validate that the resulting grammar still matches the intuitive grammar chosen for the domain. We then test this method in the language of geometry, a specific LoT model for geometrical sequence learning. Finally, despite the fact of the geometrical LoT not being a universal (i.e. Turing-complete) language, we show an empirical relation between a sequence's probability and its complexity consistent with the theoretical relationship for universal languages described by Levin's Coding Theorem.

Working memory and conscious perception are thought to share similar brain mechanisms, yet recent reports of non-conscious working memory challenge this view. Combining visual masking with magnetoencephalography, we investigate the reality of non-conscious working memory and dissect its neural mechanisms. In a spatial delayed-response task, participants reported the location of a subjectively unseen target above chance-level after several seconds. Conscious perception and conscious working memory were characterized by similar signatures: a sustained desynchronization in the alpha/beta band over frontal cortex, and a decodable representation of target location in posterior sensors. During non-conscious working memory, such activity vanished. Our findings contradict models that identify working memory with sustained neural firing, but are compatible with recent proposals of ‘activity-silent’ working memory. We present a theoretical framework and simulations showing how slowly decaying synaptic changes allow cell assemblies to go dormant during the delay, yet be retrieved above chance-level after several seconds.

During language processing, humans form complex embedded representations from sequential inputs. Here, we ask whether a "geometrical language" with recursive embedding also underlies the human ability to encode sequences of spatial locations. We introduce a novel paradigm in which subjects are exposed to a sequence of spatial locations on an octagon, and are asked to predict future locations. The sequences vary in complexity according to a well-defined language comprising elementary primitives and recursive rules. A detailed analysis of error patterns indicates that primitives of symmetry and rotation are spontaneously detected and used by adults, preschoolers, and adult members of an indigene group in the Amazon, the Munduruku, who have a restricted numerical and geometrical lexicon and limited access to schooling. Furthermore, subjects readily combine these geometrical primitives into hierarchically organized expressions. By evaluating a large set of such combinations, we obtained a first view of the language needed to account for the representation of visuospatial sequences in humans, and conclude that they encode visuospatial sequences by minimizing the complexity of the structured expressions that capture them.

The brain constantly infers the causes of the inputs it receives and uses these inferences to generate statistical expectations about future observations. Experimental evidence for these expectations and their violations include explicit reports, sequential effects on reaction times, and mismatch or surprise signals recorded in electrophysiology and functional MRI. Here, we explore the hypothesis that the brain acts as a near-optimal inference device that constantly attempts to infer the time-varying matrix of transition probabilities between the stimuli it receives, even when those stimuli are in fact fully unpredictable. This parsimonious Bayesian model, with a single free parameter, accounts for a broad range of findings on surprise signals, sequential effects and the perception of randomness. Notably, it explains the pervasive asymmetry between repetitions and alternations encountered in those studies. Our analysis suggests that a neural machinery for inferring transition probabilities lies at the core of human sequence knowledge.

We present the results of a gamified mobile device arithmetic application which allowed us to collect vast amount of data in simple arithmetic operations. Our results confirm and replicate, on a large sample, six of the main principles derived in a long tradition of investigation: size effect, tie effect, size-tie interaction effect, five-effect, RTs and error rates correlation effect, and most common error effect. Our dataset allowed us to perform a robust analysis of order effects for each individual problem, for which there is controversy both in experimental findings and in the predictions of theoretical models. For addition problems, the order effect was dominated by a max-then-min structure (i.e 7+4 is easier than 4+7). This result is predicted by models in which additions are performed as a translation starting from the first addend, with a distance given by the second addend. In multiplication, we observed a dominance of two effects: (1) a max-then-min pattern that can be accounted by the fact that it is easier to perform fewer additions of the largest number (i.e. 8x3 is easier to compute as 8+8+8 than as 3+3+…+3) and (2) a phonological effect by which problems for which there is a rhyme (i.e. "seis por cuatro es veinticuatro") are performed faster. Above and beyond these results, our study bares an important practical conclusion, as proof of concept, that participants can be motivated to perform substantial arithmetic training simply by presenting it in a gamified format.

Learning in a stochastic environment consists of estimating a model from a limited amount of noisy data, and is therefore inherently uncertain. However, many classical models reduce the learning process to the updating of parameter estimates and neglect the fact that learning is also frequently accompanied by a variable "feeling of knowing" or confidence. The characteristics and the origin of these subjective confidence estimates thus remain largely unknown. Here we investigate whether, during learning, humans not only infer a model of their environment, but also derive an accurate sense of confidence from their inferences. In our experiment, humans estimated the transition probabilities between two visual or auditory stimuli in a changing environment, and reported their mean estimate and their confidence in this report. To formalize the link between both kinds of estimate and assess their accuracy in comparison to a normative reference, we derive the optimal inference strategy for our task. Our results indicate that subjects accurately track the likelihood that their inferences are correct. Learning and estimating confidence in what has been learned appear to be two intimately related abilities, suggesting that they arise from a single inference process. We show that human performance matches several properties of the optimal probabilistic inference. In particular, subjective confidence is impacted by environmental uncertainty, both at the first level (uncertainty in stimulus occurrence given the inferred stochastic characteristics) and at the second level (uncertainty due to unexpected changes in these stochastic characteristics). Confidence also increases appropriately with the number of observations within stable periods. Our results support the idea that humans possess a quantitative sense of confidence in their inferences about abstract non-sensory parameters of the environment. This ability cannot be reduced to simple heuristics, it seems instead a core property of the learning process.

The neural correlates of consciousness are typically sought by comparing the overall brain responses to perceived and unperceived stimuli. However, this comparison may be contaminated by non-specific attention, alerting, performance, and reporting confounds. Here, we pursue a novel approach, tracking the neuronal coding of consciously and unconsciously perceived contents while keeping behavior identical (blindsight). EEG and MEG were recorded while participants reported the spatial location and visibility of a briefly presented target. Multivariate pattern analysis demonstrated that considerable information about spatial location traverses the cortex on blindsight trials, but that starting ≈270 ms post-onset, information unique to consciously perceived stimuli, emerges in superior parietal and superior frontal regions. Conscious access appears characterized by the entry of the perceived stimulus into a series of additional brain processes, each restricted in time, while the failure of conscious access results in the breaking of this chain and a subsequent slow decay of the lingering unconscious activity.

The brain response to auditory novelty comprises two main eeg components: an early mismatch negativity and a late P300. Whereas the former has been proposed to reflect a prediction error, the latter is often associated with working memory updating. Interestingly, these two proposals predict fundamentally different dynamics: prediction errors are thought to propagate serially through several distinct brain areas, while working memory supposes that activity is sustained over time within a stable set of brain areas. Here we test this temporal dissociation by showing how the generalization of brain activity patterns across time can characterize the dynamics of the underlying neural processes. This method is applied to magnetoencephalography (MEG) recordings acquired from healthy participants who were presented with two types of auditory novelty. Following our predictions, the results show that the mismatch evoked by a local novelty leads to the sequential recruitment of distinct and short-lived patterns of brain activity. In sharp contrast, the global novelty evoked by an unexpected sequence of five sounds elicits a sustained state of brain activity that lasts for several hundreds of milliseconds. The present results highlight how MEG combined with multivariate pattern analyses can characterize the dynamics of human cortical processes.

How does the human brain extract regularities from its environment? There is evidence that short range or 'local' regularities (within seconds) are automatically detected by the brain while long range or 'global' regularities (over tens of seconds or more) require conscious awareness. In the present experiment, we asked whether participants' attention was needed to acquire such auditory regularities, to detect their violation or both. We designed a paradigm in which participants listened to predictable sounds. Subjects could be distracted by a visual task at two moments: when they were first exposed to a regularity or when they detected violations of this regularity. MEG recordings revealed that early brain responses (100-130 ms) to violations of short range regularities were unaffected by visual distraction and driven essentially by local transitional probabilities. Based on global workspace theory and prior results, we expected that visual distraction would eliminate the long range global effect, but unexpectedly, we found the contrary, i.e. late brain responses (300-600 ms) to violations of long range regularities on audio-visual trials but not on auditory only trials. Further analyses showed that, in fact, visual distraction was incomplete and that auditory and visual stimuli interfered in both directions. Our results show that conscious, attentive subjects can learn the long range dependencies present in auditory stimuli even while performing a visual task on synchronous visual stimuli. Furthermore, they acquire a complex regularity and end up making different predictions for the very same stimulus depending on the context (i.e. absence or presence of visual stimuli). These results suggest that while short-range regularity detection is driven by local transitional probabilities between stimuli, the human brain detects and stores long-range regularities in a highly flexible, context dependent manner.

Human decisions are based on accumulating evidence over time for different options. Here we ask a simple question: How is the accumulation of evidence affected by the level of awareness of the information? We examined the influence of awareness on decision-making using combined behavioral methods and magneto-encephalography (MEG). Participants were required to make decisions by accumulating evidence over a series of visually presented arrow stimuli whose visibility was modulated by masking. Behavioral results showed that participants could accumulate evidence under both high and low visibility. However, a top-down strategic modulation of the flow of incoming evidence was only present for stimuli with high visibility: once enough evidence had been accrued, participants strategically reduced the impact of new incoming stimuli. Also, decision-making speed and confidence were strongly modulated by the strength of the evidence for high-visible but not low-visible evidence, even though direct priming effects were identical for both types of stimuli. Neural recordings revealed that, while initial perceptual processing was independent of visibility, there was stronger top-down amplification for stimuli with high visibility than low visibility. Furthermore, neural markers of evidence accumulation over occipito-parietal cortex showed a strategic bias only for highly visible sensory information, speeding up processing and reducing neural computations related to the decision process. Our results indicate that the level of awareness of information changes decision-making: while accumulation of evidence already exists under low visibility conditions, high visibility allows evidence to be accumulated up to a higher level, leading to important strategical top-down changes in decision-making. Our results therefore suggest a potential role of awareness in deploying flexible strategies for biasing information acquisition in line with one's expectations and goals.

The human brain efficiently solves certain operations such as object recognition and categorization through a massively parallel network of dedicated processors. However, human cognition also relies on the ability to perform an arbitrarily large set of tasks by flexibly recombining different processors into a novel chain. This flexibility comes at the cost of a severe slowing down and a seriality of operations (100-500 ms per step). A limit on parallel processing is demonstrated in experimental setups such as the psychological refractory period (PRP) and the attentional blink (AB) in which the processing of an element either significantly delays (PRP) or impedes conscious access (AB) of a second, rapidly presented element. Here we present a spiking-neuron implementation of a cognitive architecture where a large number of local parallel processors assemble together to produce goal-driven behavior. The precise mapping of incoming sensory stimuli onto motor representations relies on a "router" network capable of flexibly interconnecting processors and rapidly changing its configuration from one task to another. Simulations show that, when presented with dual-task stimuli, the network exhibits parallel processing at peripheral sensory levels, a memory buffer capable of keeping the result of sensory processing on hold, and a slow serial performance at the router stage, resulting in a performance bottleneck. The network captures the detailed dynamics of human behavior during dual-task-performance, including both mean RTs and RT distributions, and establishes concrete predictions on neuronal dynamics during dual-task experiments in humans and non-human primates.

We compared conscious and nonconscious processing of briefly flashed words using a visual masking procedure while recording intracranial electroencephalogram (iEEG) in ten patients. Nonconscious processing of masked words was observed in multiple cortical areas, mostly within an early time window (

Behavioral observations suggest that multiple sensory elements can be maintained for a short time, forming a perceptual buffer which fades after a few hundred milliseconds. Only a subset of this perceptual buffer can be accessed under top-down control and broadcasted to working memory and consciousness. In turn, single-cell studies in awake-behaving monkeys have identified two distinct waves of response to a sensory stimulus: a first transient response largely determined by stimulus properties and a second wave dependent on behavioral relevance, context and learning. Here we propose a simple biophysical scheme which bridges these observations and establishes concrete predictions for neurophsyiological experiments in which the temporal interval between stimulus presentation and top-down allocation is controlled experimentally. Inspired in single-cell observations, the model involves a first transient response and a second stage of amplification and retrieval, which are implemented biophysically by distinct operational modes of the same circuit, regulated by external currents. We explicitly investigated the neuronal dynamics, the memory trace of a presented stimulus and the probability of correct retrieval, when these two stages were bracketed by a temporal gap. The model predicts correctly the dependence of performance with response times in interference experiments suggesting that sensory buffering does not require a specific dedicated mechanism and establishing a direct link between biophysical manipulations and behavioral observations leading to concrete predictions.

All humans, regardless of their culture and education, possess an intuitive understanding of number. Behavioural evidence suggests that numerical competence may be present early on in infancy. Here, we present brain-imaging evidence for distinct cerebral coding of number and object identity in 3-mo-old infants. We compared the visual event-related potentials evoked by unforeseen changes either in the identity of objects forming a set, or in the cardinal of this set. In adults and 4-y-old children, number sense relies on a dorsal system of bilateral intraparietal areas, different from the ventral occipitotemporal system sensitive to object identity. Scalp voltage topographies and cortical source modelling revealed a similar distinction in 3-mo-olds, with changes in object identity activating ventral temporal areas, whereas changes in number involved an additional right parietoprefrontal network. These results underscore the developmental continuity of number sense by pointing to early functional biases in brain organization that may channel subsequent learning to restricted brain areas.

When a flashed stimulus is followed by a backward mask, subjects fail to perceive it unless the target-mask interval exceeds a threshold duration of about 50 ms. Models of conscious access postulate that this threshold is associated with the time needed to establish sustained activity in recurrent cortical loops, but the brain areas involved and their timing remain debated. We used high-density recordings of event-related potentials (ERPs) and cortical source reconstruction to assess the time course of human brain activity evoked by masked stimuli and to determine neural events during which brain activity correlates with conscious reports. Target-mask stimulus onset asynchrony (SOA) was varied in small steps, allowing us to ask which ERP events show the characteristic nonlinear dependence with SOA seen in subjective and objective reports. The results separate distinct stages in mask-target interactions, indicating that a considerable amount of subliminal processing can occur early on in the occipito-temporal pathway (270 ms) and highly distributed fronto-parieto-temporal activation as a correlate of conscious reportability.

Why is the human brain fundamentally limited when attempting to execute two tasks at the same time or in close succession? Two classical paradigms, psychological refractory period (PRP) and task switching, have independently approached this issue, making significant advances in our understanding of the architecture of cognition. Yet, there is an apparent contradiction between the conclusions derived from these two paradigms. The PRP paradigm, on the one hand, suggests that the simultaneous execution of two tasks is limited solely by a passive structural bottleneck in which the tasks are executed on a first-come, first-served basis. The task-switching paradigm, on the other hand, argues that switching back and forth between task configurations must be actively controlled by a central executive system (the system controlling voluntary, planned, and flexible action). Here we have explicitly designed an experiment mixing the essential ingredients of both paradigms: task uncertainty and task simultaneity. In addition to a central bottleneck, we obtain evidence for active processes of task setting (planning of the appropriate sequence of actions) and task disengaging (suppression of the plan set for the first task in order to proceed with the next one). Our results clarify the chronometric relations between these central components of dual-task processing, and in particular whether they operate serially or in parallel. On this basis, we propose a hierarchical model of cognitive architecture that provides a synthesis of task-switching and PRP paradigms.

Even in the absence of sensory inputs, cortical and thalamic neurons can show structured patterns of ongoing spontaneous activity, whose origins and functional significance are not well understood. We use computer simulations to explore the conditions under which spontaneous activity emerges from a simplified model of multiple interconnected thalamocortical columns linked by long-range, top-down excitatory axons, and to examine its interactions with stimulus-induced activation. Simulations help characterize two main states of activity. First, spontaneous gamma-band oscillations emerge at a precise threshold controlled by ascending neuromodulator systems. Second, within a spontaneously active network, we observe the sudden "ignition" of one out of many possible coherent states of high-level activity amidst cortical neurons with long-distance projections. During such an ignited state, spontaneous activity can block external sensory processing. We relate those properties to experimental observations on the neural bases of endogenous states of consciousness, and particularly the blocking of access to consciousness that occurs in the psychophysical phenomenon of "inattentional blindness," in which normal subjects intensely engaged in mental activity fail to notice salient but irrelevant sensory stimuli. Although highly simplified, the generic properties of a minimal network may help clarify some of the basic cerebral phenomena underlying the autonomy of consciousness.

Parsing a mental operation into components, characterizing the parallel or serial nature of this flow, and understanding what each process ultimately contributes to response time are fundamental questions in cognitive neuroscience. Here we show how a simple theoretical model leads to an extended set of predictions concerning the distribution of response time and its alteration by simultaneous performance of another task. The model provides a synthesis of psychological refractory period and random-walk models of response time. It merely assumes that a task consists of three consecutive stages-perception, decision based on noisy integration of evidence, and response-and that the perceptual and motor stages can operate simultaneously with stages of another task, while the central decision process constitutes a bottleneck. We designed a number-comparison task that provided a thorough test of the model by allowing independent variations in number notation, numerical distance, response complexity, and temporal asynchrony relative to an interfering probe task of tone discrimination. The results revealed a parsing of the comparison task in which each variable affects only one stage. Numerical distance affects the integration process, which is the only step that cannot proceed in parallel and has a major contribution to response time variability. The other stages, mapping the numeral to an internal quantity and executing the motor response, can be carried out in parallel with another task. Changing the duration of these processes has no significant effect on the variance.

We describe the operation of a neuronal device which embodies the computational principles of the `paper-and-pencil' machine envisioned by Alan Turing. The network is based on principles of cortical organization. We develop a plausible solution to implement pointers and investigate how neuronal circuits may instantiate the basic operations involved in assigning a value to a variable (i.e., x=5), in determining whether two variables have the same value and in retrieving the value of a given variable to be accessible to other nodes of the network. We exemplify the collective function of the network in simplified arithmetic and problem solving (blocks-world) tasks. Received: 14 June 2013, Accepted: 9 July 2013; Edited by: G. B. Mindlin; DOI: http://dx.doi.org/10.4279/PIP.050006Cite as: A Zylberberg, L Paz, P R Roelfsema, S Dehaene, M Sigman, Papers in Physics 5, 050006 (2013)