Search

Alfred Hitchcock, film director and "Master of Suspense," observed that terror is not driven by a negative event, but "only in the anticipation of it." This observation is not restricted to the movies: Anxiety builds when we anticipate uncertain negative events, and heightened reactivity during uncertain threat anticipation is a transdiagnostic marker of anxiety (Grupe & Nitschke, 2013; Holley & Fox, 2022; Hur et al., 2020; Krain et al., 2008; Simmons et al., 2008; Yassa et al., 2012). Here, we manipulate the temporal dynamics of an uncertain threat to demonstrate how the evolving expectation of threat can lead people to forgo rewards and experience fear/anxiety. Specifically, we show that increased "hazard rate," which can build during periods of uncertainty, promotes a tendency to avoid threatening contexts while increasing fear/anxiety. These results provide insight into why the anticipation of temporally uncertain threats elicits fear/anxiety, and reframe the underlying causes of related psychopathology.

Recent work in cognitive and systems neuroscience has suggested that the hippocampus might support planning, imagination, and navigation by forming cognitive maps that capture the abstract structure of physical spaces, tasks, and situations. Navigation involves disambiguating similar contexts, and the planning and execution of a sequence of decisions to reach a goal. Here, we examine hippocampal activity patterns in humans during a goal-directed navigation task to investigate how contextual and goal information are incorporated in the construction and execution of navigational plans. During planning, hippocampal pattern similarity is enhanced across routes that share a context and a goal. During navigation, we observe prospective activation in the hippocampus that reflects the retrieval of pattern information related to a key-decision point. These results suggest that, rather than simply representing overlapping associations or state transitions, hippocampal activity patterns are shaped by context and goals.

Recent work has shown that the brain organizes abstract, non-spatial relationships between entities into map-like representations. However, an animal’s objectives often depend on only a subset of the features of the environment. Under these circumstances, cognitive control – the capacity to flexibly select the features most relevant in the current context – becomes paramount. Here, we explore the relationship between cognitive control and the geometry of map-like representations by combining fMRI with neural network modeling. We find that brain areas including hippocampus and entorhinal cortex spontaneously organize pairwise relationships into 2D map-like representations, and that this 2D structure was controlled by compressing task-irrelevant dimensions in areas of prefrontal and parietal cortex. Our neural network model reproduced these findings and additionally predicted warping in the geometry along a context-invariant axis. This prediction was confirmed with fMRI, which showed that the degree of warping was correlated with individual differences in cognitive control.

Neural networks struggle in continual learning settings from catastrophic forgetting: when trials are blocked, new learning can overwrite the learning from previous blocks. Humans learn effectively in these settings, in some cases even showing an advantage of blocking, suggesting the brain contains mechanisms to overcome this problem. Here, we build on previous work and show that neural networks equipped with a mechanism for cognitive control do not exhibit catastrophic forgetting when trials are blocked. We further show an advantage of blocking over interleaving when there is a bias for active maintenance in the control signal, implying a tradeoff between maintenance and the strength of control. Analyses of map-like representations learned by the networks provided additional insights into these mechanisms. Our work highlights the potential of cognitive control to aid continual learning in neural networks, and offers an explanation for the advantage of blocking that has been observed in humans.

The hippocampus, well known for its role in episodic memory, might also be an important brain region for extracting structure from our experiences in order to guide future decisions. Recent evidence in rodents suggests that the hippocampus supports decision making by representing task structure in cooperation with the orbitofrontal cortex (OFC). Here, we examine how the human hippocampus and OFC represent task structure during an associative learning task that required learning of both context-determined and context-invariant probabilistic associations. We find that after learning, hippocampal and lateral OFC representations differentiated between context-determined and context-invariant task structures. The degree of this differentiation within the hippocampus and lateral OFC is highly correlated. These results advance our understanding of the hippocampus and suggest that the hippocampus and OFC support goal-directed behavior by representing information that guides the selection of appropriate decision strategies.

Generalizing experiences to guide decision-making in novel situations is a hallmark of flexible behavior. Cognitive maps of an environment or task can theoretically afford such flexibility, but direct evidence has proven elusive. In this study, we found that discretely sampled abstract relationships between entities in an unseen two-dimensional social hierarchy are reconstructed into a unitary two-dimensional cognitive map in the hippocampus and entorhinal cortex. We further show that humans use a grid-like code in entorhinal cortex and medial prefrontal cortex for inferred direct trajectories between entities in the reconstructed abstract space during discrete decisions. These grid-like representations in the entorhinal cortex are associated with decision value computations in the medial prefrontal cortex and temporoparietal junction. Collectively, these findings show that grid-like representations are used by the human brain to infer novel solutions, even in abstract and discrete problems, and suggest a general mechanism underpinning flexible decision-making and generalization.

Humans are adept at learning the latent structure of the relationship between abstract concepts and can build a cognitive map from limited experiences. However, examining internal representations of the cognitive map is challenging because they are unobservable and differ across individuals. Here, we introduce a behavioral training protocol designed for human participants to implicitly build a map of two-dimensional social hierarchies while making a series of binary choices and analytic tools for measuring the internal representation of this structural knowledge. For complete details on the use and execution of this protocol, please refer to Park et al. (2020a, 2020b).

The neural mechanisms supporting flexible relational inferences, especially in novel situations, are a major focus of current research. In the complementary learning systems framework, pattern separation in the hippocampus allows rapid learning in novel environments, while slower learning in neocortex accumulates small weight changes to extract systematic structure from well-learned environments. In this work, we adapt this framework to a task from a recent fMRI experiment where novel transitive inferences must be made according to implicit relational structure. We show that computational models capturing the basic cognitive properties of these two systems can explain relational transitive inferences in both familiar and novel environments, and reproduce key phenomena observed in the fMRI experiment.

Cognitive maps enable efficient inferences from limited experience that can guide novel decisions. We tested whether the hippocampus (HC), entorhinal cortex (EC), and ventromedial prefrontal cortex (vmPFC)/medial orbitofrontal cortex (mOFC) organize abstract and discrete relational information into a cognitive map to guide novel inferences. Subjects learned the status of people in two unseen 2D social hierarchies, with each dimension learned on a separate day. Although one dimension was behaviorally relevant, multivariate activity patterns in HC, EC, and vmPFC/mOFC were linearly related to the Euclidean distance between people in the mentally reconstructed 2D space. Hubs created unique comparisons between the hierarchies, enabling inferences between novel pairs. We found that both behavior and neural activity in EC and vmPFC/mOFC reflected the Euclidean distance to the retrieved hub, which was reinstated in HC. These findings reveal how abstract and discrete relational structures are represented, are combined, and enable novel inferences in the human brain.

When making decisions in groups, the outcome of one's decision often depends on the decisions of others, and there is a tradeoff between short-term incentives for an individual and long-term incentives for the groups. Yet, little is known about the neurocomputational mechanisms at play when weighing different utilities during repeated social interactions. Here, using model-based fMRI and Public-good-games, we find that the ventromedial prefrontal cortex encodes immediate expected rewards as individual utility while the lateral frontopolar cortex encodes group utility (i.e., pending rewards of alternative strategies beneficial for the group). When it is required to change one's strategy, these brain regions exhibited changes in functional interactions with brain regions engaged in switching strategies. Moreover, the anterior cingulate cortex and the temporoparietal junction updated beliefs about the decision of others during interactions. Together, our findings provide a neurocomputational account of how the brain dynamically computes effective strategies to make adaptive collective decisions.

Dorsal anterior cingulate cortex (dACC) carries a wealth of value-related information necessary for regulating behavioral flexibility and persistence. It signals error and reward events informing decisions about switching or staying with current behavior. During decision-making, it encodes the average value of exploring alternative choices (search value), even after controlling for response selection difficulty, and during learning, it encodes the degree to which internal models of the environment and current task must be updated. dACC value signals are derived in part from the history of recent reward integrated simultaneously over multiple time scales, thereby enabling comparison of experience over the recent and extended past. Such ACC signals may instigate attentionally demanding and difficult processes such as behavioral change via interactions with prefrontal cortex. However, the signal in dACC that instigates behavioral change need not itself be a conflict or difficulty signal.

Complex cognitive processes require sophisticated local processing but also interactions between distant brain regions. It is therefore critical to be able to study distant interactions between local computations and the neural representations they act on. Here we report two anatomically and computationally distinct learning signals in lateral orbitofrontal cortex (lOFC) and the dopaminergic ventral midbrain (VM) that predict trial-by-trial changes to a basic internal model in hippocampus. To measure local computations during learning and their interaction with neural representations, we coupled computational fMRI with trial-by-trial fMRI suppression. We find that suppression in a medial temporal lobe network changes trial-by-trial in proportion to stimulus-outcome associations. During interleaved choice trials, we identify learning signals that relate to outcome type in lOFC and to reward value in VM. These intervening choice feedback signals predicted the subsequent change to hippocampal suppression, suggesting a convergence of signals that update the flexible representation of stimulus-outcome associations.

When learning from direct experience, neurons in the primate brain have been shown to encode a teaching signal used by algorithms in artificial intelligence: the reward prediction error (PE)-the difference between how rewarding an event is, and how rewarding it was expected to be. However, in humans and other species learning often takes place by observing other individuals. Here, we show that, when humans observe other players in a card game, neurons in their rostral anterior cingulate cortex (rACC) encode both the expected value of an observed choice, and the PE after the outcome was revealed. Notably, during the same task neurons recorded in the amygdala (AMY) and the rostromedial prefrontal cortex (rmPFC) do not exhibit this type of encoding. Our results suggest that humans learn by observing others, at least in part through the encoding of observational PEs in single neurons in the rACC.

The medial frontal cortex (MFC) is critical for cost-benefit decision-making. Generally, cognitive and reward-based behaviour in rodents is not thought to be lateralised within the brain. In this study, however, we demonstrate that rats with unilateral MFC lesions show a profound change in decision-making on an effort-based decision-making task. Furthermore, unilateral MFC lesions have a greater effect when the rat has to choose to put in more effort for a higher reward when it is on the contralateral side of space to the lesion. Importantly, this could not be explained by motor impairments as these animals did not show a turning bias in separate experiments. In contrast, rats with unilateral dopaminergic midbrain lesions did exhibit a motoric turning bias, but were unimpaired on the effort-based decision-making task. This rare example of a cognitive deficit caused by a unilateral cortical lesion in the rat brain indicates that the MFC may have a specialised and lateralised role in evaluating the costs and benefits of actions directed to specific spatial locations.

Evaluating the abilities of others is fundamental for successful economic and social behavior. We investigated the computational and neurobiological basis of ability tracking by designing an fMRI task that required participants to use and update estimates of both people and algorithms' expertise through observation of their predictions. Behaviorally, we find a model-based algorithm characterized subject predictions better than several alternative models. Notably, when the agent's prediction was concordant rather than discordant with the subject's own likely prediction, participants credited people more than algorithms for correct predictions and penalized them less for incorrect predictions. Neurally, many components of the mentalizing network-medial prefrontal cortex, anterior cingulate gyrus, temporoparietal junction, and precuneus-represented or updated expertise beliefs about both people and algorithms. Moreover, activity in lateral orbitofrontal and medial prefrontal cortex reflected behavioral differences in learning about people and algorithms. These findings provide basic insights into the neural basis of social learning.

Humans construct cognitive maps of the physical, imagined, and abstract world around us based on visually sampled information. A new study shows how the human brain can also use olfactory cues to form and use cognitive maps. [ABSTRACT FROM AUTHOR]

Ventral premotor cortex (PMv) is widely accepted to exert an important influence over primary motor cortex (M1) when hand movements are made. Although study of these interactions has typically focused on their excitatory nature, given its strong connections with both ventral and opercular frontal regions, one feature of the influence of PMv over M1 may be inhibitory. Paired-pulse transcranial magnetic stimulation (ppTMS) was used to examine functional interactions between human PMv and M1 during the selection and reprogramming of a naturalistic goal-directed action. One of two cylinders was illuminated on each trial. It was then grasped and picked up. On some trials, however, subjects had to reprogram the action as the illuminated cylinder was switched off and the other illuminated simultaneously with reach initiation. At a neurophysiological level, the PMv paired-pulse effect (PPE) on M1 corticospinal activity was facilitatory after the initial target presentation and during movement initiation. When reprogramming was required, however, the PPE became strongly inhibitory. This context-dependent change from facilitation to inhibition occurred within 75 ms of the change of target. Behaviorally, PMv-M1 ppTMS disrupted reprogramming. Diffusion-weighted magnetic resonance image scans were taken of each subject. Intersubject differences in the facilitation-inhibition contrast of PMv-M1 interactions were correlated with fractional anisotropy of white-matter in ventral prefrontal, premotor, and intraparietal brain areas. These results suggest that a network of brain areas centered on PMv inhibits M1 corticospinal activity associated with undesired movements when action plans change. [ABSTRACT FROM AUTHOR]

Medial frontal cortex (MFC) is crucial when actions have to be inhibited, reprogrammed, or selected under conflict, but the precise mechanism by which it operates is unclear. Importantly, how and when the MFC influences the primary motor cortex (M1) during action selection is unknown. Using paired-pulse transcranial magnetic stimulation, we investigated functional connectivity between the presupplementary motor area (pre-SMA) part of MFC and M1. We found that functional connectivity increased in a manner dependent on cognitive context: pre-SMA facilitated the motor evoked-potential elicited by M1 stimulation only during action reprogramming, but not when otherwise identical actions were made in the absence of conflict. The effect was anatomically specific to pre-SMA; it was not seen when adjacent brain regions were stimulated. We discuss implications for the anatomical pathways mediating the observed effects. [ABSTRACT FROM AUTHOR]

The article compares the significance of mean-risk approach and termed prospect theory on human brain research in the field of neuroeconomics. Researchers highlighted the application of functional Magnetic Resonance Imaging (fMRI) to provide evidence on the theories. Further investigations had led the researchers to two different analyses: an overlap method and a conjunction analysis.

Adaptive behavior in complex environments critically relies on the ability to appropriately link specific choices or actions to their outcomes. However, the neural mechanisms that support the ability to credit only those past choices believed to have caused the observed outcomes remain unclear. Here, we leverage multivariate pattern analyses of functional magnetic resonance imaging (fMRI) data and an adaptive learning task to shed light on the underlying neural mechanisms of such specific credit assignment. We find that the lateral orbitofrontal cortex (lOFC) and hippocampus (HC) code for the causal choice identity when credit needs to be assigned for choices that are separated from outcomes by a long delay, even when this delayed transition is punctuated by interim decisions. Further, we show when interim decisions must be made, learning is additionally supported by lateral frontopolar cortex (FPl). Our results indicate that FPl holds previous causal choices in a "pending" state until a relevant outcome is observed, and the fidelity of these representations predicts the fidelity of subsequent causal choice representations in lOFC and HC during credit assignment. Together, these results highlight the importance of the timely reinstatement of specific causes in lOFC and HC in learning choice-outcome relationships when delays and choices intervene, a critical component of real-world learning and decision making., Competing Interests: Declaration of Interests The authors declare no competing interests.