Search

When we use language, we draw on a finite stock of lexical and functional meanings and grammatical structures to assign meanings to expressions of arbitrary complexity. According to the Principle of Compositionality, the meanings of complex expressions are a function of constituent meanings and syntax, and are generated by the recursive application of one or more composition operations. Given their central role in explanatory accounts of human language, it is surprising that relatively little is known about how the brain implements these composition operations in real time. In recent years, neurolinguistics has seen a surge of experiments investigating when and where in the brain meanings are composed. To date, however, neural correlates of composition have not been firmly established. In this article, we focus on studies that set out to find the correlates of linguistic composition. We critically examine the paradigms they employed, laying out the rationale behind each, their strengths and weaknesses. We argue that the still blurry picture of composition in the brain may be partly due to limitations of current experimental designs. We suggest that novel and improved paradigms are needed, and we discuss possible next steps in this direction. At the same time, rethinking the linguistic notion of composition, as based on a tight correspondence between syntax and semantics, might be in order.

The intergenerational stability of auditory symbolic systems, such as music, is thought to rely on brain processes that allow the faithful transmission of complex sounds. Little is known about the functional and structural aspects of the human brain which support this ability, with a few studies pointing to the bilateral organization of auditory networks as a putative neural substrate. Here, we further tested this hypothesis by examining the role of left–right neuroanatomical asymmetries between auditory cortices. We collected neuroanatomical images from a large sample of participants (nonmusicians) and analyzed them with Freesurfer’s surface-based morphometry method. Weeks after scanning, the same individuals participated in a laboratory experiment that simulated music transmission: the signaling games. We found that high accuracy in the intergenerational transmission of an artificial tone system was associated with reduced rightward asymmetry of cortical thickness in Heschl’s sulcus. Our study suggests that the high-fidelity copying of melodic material may rely on the extent to which computational neuronal resources are distributed across hemispheres. Our data further support the role of interhemispheric brain organization in the cultural transmission and evolution of auditory symbolic systems.

A central question in neurolinguistics is how the brain computes the meaning of complex expressions from the meanings of the parts. We investigate adjective–noun composition using EEG, focusing on ...

Different classes of quantifiers provably require different verification algorithms with different complexity profiles. The algorithm for proportional quantifiers, like 'most', is more complex than that for nonproportional quantifiers, like 'all' and 'three'. We tested the hypothesis that different complexity profiles affect ERP responses during sentence verification, but not during sentence comprehension. In experiment 1, participants had to determine the truth value of a sentence relative to a previously presented array of geometric objects. We observed a sentence-final negative effect of truth value, modulated by quantifier class. Proportional quantifiers elicited a sentence-internal positivity compared to nonproportional quantifiers, in line with their different verification profiles. In experiment 2, the same stimuli were shown, followed by comprehension questions instead of verification. ERP responses specific to proportional quantifiers disappeared in experiment 2, suggesting that they are only evoked in a verification task and thus reflect the verification procedure itself. Our findings demonstrate that algorithmic aspects of human language processing are subjected to the same formal constraints applicable to abstract machines.

According to traditional linguistic theories, the construction of complex meanings relies firmly on syntactic structure-building operations. Recently, however, new models have been proposed in which semantics is viewed as being partly autonomous from syntax. In this paper, we discuss some of the developmental implications of syntax-based and autonomous models of semantics. We review event-related brain potential (ERP) studies on semantic processing in infants and toddlers, focusing on experiments reporting modulations of N400 amplitudes using visual or auditory stimuli and different temporal structures of trials. Our review suggests that infants can relate or integrate semantic information from temporally overlapping stimuli across modalities by 6 months of age. The ability to relate or integrate semantic information over time, within and across modalities, emerges by 9 months. The capacity to relate or integrate information from spoken words in sequences and sentences appears by 18 months. We also review behavioral and ERP studies showing that grammatical and syntactic processing skills develop only later, between 18 and 32 months. These results provide preliminary evidence for the availability of some semantic processes prior to the full developmental emergence of syntax: non-syntactic meaning-building operations are available to infants, albeit in restricted ways, months before the abstract machinery of grammar is in place. We discuss this hypothesis in light of research on early language acquisition and human brain development.

2020 The Author(s). Published with license by Taylor & Francis Group, LLC. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Syntactic and semantic information processing can interact selectively during language comprehension. However, the nature and extent of the interactions, in particular of semantic effects on syntax, remain to some extent elusive. We revisit an influential ERP result by Kim and Osterhout (2005), later replicated by Kim and Sikos (2011), that the verb in sentences such as ‘The hearty meal was devouring … ’ evokes a P600 effect—a signature of syntactic processing difficulty—even though all stimuli were grammatically well-formed. We view this effect as a manifestation of a conflict in the assignment of grammatical subject and object roles to the verb's arguments as performed independently by a semantic system (predicting that meal should be the object) and by a syntactic system (labeling meal as the subject). More specifically, we develop an explicit algorithmic implementation of a parallel processing architecture that supports (i) meaning-based prediction of grammatical role labels, using either a probabilistic label guesser or a neural network, and (ii) comparison of the predicted labels with labels assigned by a state-of-the-art dependency parser. We demonstrate that the system can classify sentences from the Kim and Osterhout (2005) corpus with adequate accuracy, and can detect labeling conflicts as intended. Some implications of our results for models of prediction in language processing are discussed.

The cultural transmission of spoken language and music relies on human capacities for encoding and recalling auditory patterns. In this experiment, we show that interindividual differences in this ability are associated with variation in the organization of cross-callosal white matter pathways. First, high-angular resolution diffusion MRI (dMRI) data were analyzed in a large participant sample (N = 51). Subsequently, these participants underwent a behavioral test that models in the laboratory the cultural transmission of auditory symbolic systems: the signaling game. Cross-callosal and intrahemispheric (arcuate fasciculus) pathways were reconstructed and analyzed using conventional diffusion tensor imaging (DTI) as well as a more advanced dMRI technique: fixel-based analysis (FBA). The DTI metric of fractional anisotropy (FA) in auditory callosal pathways predicted-weeks after scanning-the fidelity of transmission of an artificial tone system. The ability to coherently transmit auditory signals in one signaling game, irrespective of the signals learned during the previous game, was predicted by morphological properties of the fiber bundles in the most anterior portions of the corpus callosum. The current study is the first application of dMRI in the field of cultural transmission, and the first to connect individual characteristics of callosal pathways to core behaviors in the transmission of auditory symbolic systems.

Compositionality is a hallmark of human language and other symbolic systems: a finite set of meaningful elements can be systematically combined to convey an open-ended array of ideas. Compositionality is not uniformly distributed over expressions in a language or over individuals’ communicative behavior: at both levels, variation is observed. Here, we investigate the neural bases of interindividual variability by probing the relationship between intrinsic characteristics of brain networks and compositional behavior. We first collected functional resting-state and diffusion magnetic resonance imaging data from a large participant sample (N = 51). Subsequently, participants took part in two signaling games. They were instructed to learn and reproduce an auditory symbolic system of signals (tone sequences) associated with affective meanings (human faces expressing emotions). Signal-meaning mappings were artificial and had to be learned via repeated signaling interactions. We identified a temporoparietal network in which connection length was related to the degree of compositionality introduced in a signaling system by each player. Graph-theoretic analysis of resting-state functional connectivity revealed that, within that network, compositional behavior was associated with integration measures in 2 semantic hubs: the left posterior cingulate cortex and the left angular gyrus. Our findings link individual variability in compositional biases to variation in the anatomy of semantic networks and in the functional topology of their constituent units.

Drawing on the philosophy of psychological explanation, we suggest that psychological science, by focusing on effects, may lose sight of its primary explananda: psychological capacities. We revisit Marr’s levels-of-analysis framework, which has been remarkably productive and useful for cognitive psychological explanation. We discuss ways in which Marr’s framework may be extended to other areas of psychology, such as social, developmental, and evolutionary psychology, bringing new benefits to these fields. We then show how theoretical analyses can endow a theory with minimal plausibility even before contact with empirical data: We call this the theoretical cycle. Finally, we explain how our proposal may contribute to addressing critical issues in psychological science, including how to leverage effects to understand capacities better. https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).

Formal semantics states that the meanings of phrases are composed from the meanings of constituent parts and syntax. Little is known about how composition is neurally implemented. We studied ERP and behavioural responses to determiner-adjective-noun phrases. We assessed the effects of typicality and denotation, using intersective (typical: “A green turtle”, atypical: “An orange turtle”) or subsective adjectives (typical: “A slow turtle”, atypical: “A fast turtle”). After each phrase, participants responded to two questions (e.g., for “A fast turtle”: “Is it a common turtle?”; “Is it a fast animal?”). We contrasted these 4 semantic conditions, requiring composition, to 2 nonsemantic conditions, where the adjective was replaced with a pseudoword or a nonword. This contrast revealed a larger P600, if participants performed the task without instructions and feedback (experiment 1), or a larger sustained negativity, if they were nudged to pay attention to meaning by instructions and feedback (experiment 2). Typicality or denotation had an impact only on behavioural responses. We discuss implications for theories of language processing and compositional semantics.

The argument by Mehr et al. that music emerged and evolved culturally as a credible signal is convincing, but it lacks one essential ingredient: a model of signaling behavior that supports the main hypothesis theoretically and empirically. We argue that signaling games can help us explain how musical structures emerge as population-level phenomena, through sender–receiver signaling interactions.

Up until 2019, `psychological reform' mostly meant methodological and statistical reform of empirical research practices in psychology. Since then, however, we have seen a surge of proposals for theoretical reform. While those calling for theoretical reform may agree on many things, they also do not form a monolith. One aim of the present commentary is to highlight some of this diversity by commenting on Fried's target article in this broader context.

This chapter analyzes instances of successful, partial, and failed unidirectional epistemic transfer between theoretical linguistics and neuroscience. I distinguish three types of transfer, depending on the nature of the linguistic knowledge involved: type-A knowledge, about language as such, essentially invariant across theories or formalisms; type-B knowledge, about alternative formal analyses of basic structures and operations in language; type-C knowledge, about the application of various computational methods to analyzing or modeling behavioral or neural data. I conclude that successful epistemic transfer may be achieved, under certain conditions, with type-A and type-C knowledge, and I present some examples of the strengths and limitations of each approach. Type-B transfer, however, in particular from theories of syntactic and semantic composition, so far has not led to new knowledge of the neural correlates and mechanisms of linguistic computation. I suggest that greater theoretical emphasis on algorithmic-level analyses, via a revised notion of linguistic competence and a new model of epistemic transfer, can bring formal linguistics and neuroscience closer together. Finally, I discuss the possible role of a computationalist psycholinguistics as a semi-autonomous ‘bridge science’, that could serve the aim of linking linguistics and neuroscience through algorithmic models of linguistic functions, aided by emerging methods and results in areas of computational linguistics, computer science, and AI.

Human thought and language have extraordinary expressive power because meaningful parts can be assembled into more complex semantic structures. This partly underlies our ability to compose meanings into endlessly novel configurations, and sets us apart from other species and current computing devices. Crucially, human behaviour, including language use and linguistic data, indicates that composing parts into complex structures does not threaten the existence of constituent parts as independent units in the system: parts and wholes exist simultaneously yet independently from one another in the mind and brain. This independence is evident in human behaviour, but it seems at odds with what is known about the brain's exquisite sensitivity to statistical patterns: everyday language use is productive and expressive precisely because it can go beyond statistical regularities. Formal theories in philosophy and linguistics explain this fact by assuming that language and thought are compositional : systems of representations that separate a variable (or role ) from its values ( fillers ), such that the meaning of a complex expression is a function of the values assigned to the variables. The debate on whether and how compositional systems could be implemented in minds, brains and machines remains vigorous. However, it has not yet resulted in mechanistic models of semantic composition: how, then, are the constituents of thoughts and sentences put and held together? We review and discuss current efforts at understanding this problem, and we chart possible routes for future research. This article is part of the theme issue ‘Towards mechanistic models of meaning composition’.

Music producers, whether original composers or performers, vary in their ability to acquire and faithfully transmit music. This form of variation may serve as a mechanism for the emergence of new traits in musical systems. In this study, we aim to investigate whether individual differences in the social learning and transmission of music relate to intrinsic neural dynamics of auditory processing systems. We combined auditory and resting-state functional magnetic resonance imaging (fMRI) with an interactive laboratory model of cultural transmission, the signaling game, in an experiment with a large cohort of participants (N=51). We found that the degree of interhemispheric rs-FC within fronto-temporal auditory networks predicts—weeks after scanning—learning, transmission, and structural modification of an artificial tone system. Our study introduces neuroimaging in cultural transmission research and points to specific neural auditory processing mechanisms that constrain and drive variation in the cultural transmission and regularization of musical systems. Open Access CC-BY

The experimental study of language change may provide novel insights into the nature of language, in particular on the role of cognitive biases and social processes in shaping grammatical and semantic structures. Here, we introduce multigenerational signaling games (MGSGs) as a new experimental paradigm for investigating how simple compositional languages emerge and change during transmission across generations in a diffusion chain, where each transmission step requires coordination between sender and receiver in a signaling game. We obtained three main results. First, we replicate and extend earlier findings by Moreno and Baggio suggesting that, in signaling games with fixed roles, mappings of signals to meanings tend to be transmitted from senders to receivers. We show that this holds for signaling games played in diffusion chains too, in which the receiver in one game becomes the sender in the next game. Second, we provide an experimental proof of concept that MGSGs are a viable laboratory model of cultural language change. Players consistently agreed upon a common signaling system after repeated signaling rounds, and the resulting code was effectively transmitted and gradually modified over generations. Third, we establish a baseline of results for further research using MGSGs. We found that the order of elements initially imposed on signals is largely maintained by successive generations. Moreover, the degree of coordination among players and the fidelity of inter-generational transmission exhibit a cumulative increase across generations. Finally, replicating a seminal result by Esper, we observed that morphological marking of semantic categories such as agent, action, and patient emerged gradually in the course of transmission.

Converging evidence in neuroscience suggests that syntax and semantics are dissociable in brain space and time. However, it is possible that partly disjoint cortical networks, operating in successive time frames, still perform similar types of neural computations. To test the alternative hypothesis, we collected EEG data while participants read sentences containing lexical semantic or morphosyntactic anomalies, resulting in N400 and P600 effects, respectively. Next, we reconstructed phase space trajectories from EEG time series, and we measured the complexity of the resulting dynamical orbits using sample entropy an index of the rate at which the system generates or loses information over time. Disrupting morphosyntactic or lexical semantic processing had opposite effects on sample entropy: it increased in the N400 window for semantic anomalies, and it decreased in the P600 window for morphosyntactic anomalies. These findings point to a fundamental divergence in the neural computations supporting meaning and grammar in language. (C) 2015 Elsevier B.V. All rights reserved.

A core design feature of human communication systems and expressive behaviours is their temporal organization. The cultural evolutionary origins of this feature remain unclear. Here, we test the hypothesis that regularities in the temporal organization of signalling sequences arise in the course of cultural transmission as adaptations to aspects of cortical function. We conducted two experiments on the transmission of rhythms associated with affective meanings, focusing on one of the most widespread forms of regularity in language and music: isochronicity. In the first experiment, we investigated how isochronous rhythmic regularities emerge and change in multigenerational signalling games, where the receiver (learner) in a game becomes the sender (transmitter) in the next game. We show that signalling sequences tend to become rhythmically more isochronous as they are transmitted across generations. In the second experiment, we combined electroencephalography (EEG) and two-player signalling games over 2 successive days. We show that rhythmic regularization of sequences can be predicted based on the latencies of the mismatch negativity response in a temporal oddball paradigm. These results suggest that forms of isochronicity in communication systems originate in neural constraints on information processing, which may be expressed and amplified in the course of cultural transmission. © The Author(s) (2018). Published by Oxford University Press. This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/ licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com

How do comprehenders track dependencies between the plausibility of embedded clauses and of the sentences in which they occur? We investigated processing of Norwegian propositional attitude sentences with plausible or implausible complement clauses (‘Magnus {knows/believes/dreams/doubts/imagines} that mosquitos live off {blood/vodka}’). Using ERPs, we tested the hypothesis that the amplitude of the N400 component is sensitive to the plausibility of the attitude sentence as a whole, as opposed to that of the complement clause. If the hypothesis is correct, the N400 should be larger for implausible clauses (vodka > blood) under know and believe, it should be canceled (vodka ~ blood) under dream, and it should be reversed (vodka blood), except for imagine (‘innbille’ in Norwegian has a counterfactual sense), where the effect was suppressed, but not reversed. Moreover, we observed modulations of late ERP components for implausible clauses (vodka > blood) under doubt and imagine, i.e., when the plausibility of the attitude sentence requires an implausible complement clause. We propose that (a) the N400, in general, reflects processing of semantic relations in phrasal and clausal contexts, and it is not necessarily sensitive to sentence plausibility, and (b) later components index integration of information from embedded clauses into a sentence model.

The digital age is changing our children’s lives and childhood dramatically. New technologies transform the way people interact with each other, the way stories are shared and distributed, and the way reality is presented and perceived. Parents experience that toddlers can handle tablets and apps with a level of sophistication the children’s grandparents can only envy. The question of how the ecology of the child affects the acquisition of competencies and skills has been approached from different angles in different disciplines. In linguistics, psychology and neuroscience, the central question addressed concerns the specific role of exposure to language. Two influential types of theory have been proposed. On one view the capacity to learn language is hard-wired in the human brain: linguistic input is merely a trigger for language to develop. On an alternative view, language acquisition depends on the linguistic environment of the child, and specifically on language input provided through child-adult communication and interaction. The latter view further specifies that factors in situated interaction are crucial for language learning to take place. In the fields of information technology, artificial intelligence and robotics a current theme is to create robots that develop, as children do, and to establish how embodiment and interaction support language learning in these machines. In the field of human-machine interaction, research is investigating whether using a physical robot, rather than a virtual agent or a computer-based video, has a positive effect on language development. The Research Topic will address the following issues:- What are the methodological challenges faced by research on language acquisition in the digital age?- How should traditional theories and models of language acquisition be revised to account for the multimodal and multichannel nature of language learning in the digital age?- How should existing and future technologies be developed and transformed so as to be most beneficial for child language learning and cognition?- Can new technologies be tailored to support child growth, and most importantly, can they be designed in order to enhance specifically vulnerable children’s language learning environment and opportunities?- What kind of learning mechanisms are involved?- How can artificial intelligence and robotics technologies, as robot tutors, support language development? These questions and issues can only be addressed by means of an interdisciplinary approach that aims at developing new methods of data collection and analysis in cross-sectional and longitudinal perspectives. We welcome contributions addressing these questions from an interdisciplinary perspective both theoretically and empirically.