Search

Emotional states provide an ever-present source of contextual information that should inform behavioral goals. Despite the ubiquity of emotional signals in our environment, the neural mechanisms underlying their influence on goal-directed action remains unclear. Prior work suggests that the lateral frontal pole (FPl) is uniquely positioned to integrate affective information into cognitive control representations. We used pattern similarity analysis to examine the content of representations in FPl and interconnected mid-lateral prefrontal and amygdala circuitry. Healthy participants (n = 37; n = 21 females) were scanned while undergoing an event-related Affective Go/No-Go task, which requires goal-oriented action selection during emotional processing. We found that FPl contained conjunctive emotion-action goal representations that were related to successful cognitive control during emotional processing. These representations differed from conjunctive emotion-action goal representations found in the basolateral amygdala. While robust action goal representations were present in mid-lateral prefrontal cortex, they were not modulated by emotional valence. Finally, converging results from functional connectivity and multivoxel pattern analyses indicated that FPl emotional valence signals likely originated from interconnected subgenual anterior cingulate cortex (ACC) (BA25), which was in turn functionally coupled with the amygdala. Thus, our results identify a key pathway by which internal emotional states influence goal-directed behavior.SIGNIFICANCE STATEMENT Optimal functioning in everyday life requires behavioral regulation that flexibly adapts to dynamically changing emotional states. However, precisely how emotional states influence goal-directed action remains unclear. Unveiling the neural architecture that supports emotion-goal integration is critical for our understanding of disorders such as psychopathy, which is characterized by deficits in incorporating emotional cues into goals, as well as mood and anxiety disorders, which are characterized by impaired goal-based emotion regulation. Our study identifies a key circuit through which emotional states influence goal-directed behavior. This circuitry comprised the lateral frontal pole (FPl), which represented integrated emotion-goal information, as well as interconnected amygdala and subgenual ACC, which conveyed emotional signals to FPl.

People often learn from the outcomes of their actions, even when these outcomes do not involve material rewards or punishments. How does our brain provide this flexibility? We combined behavior, computational modeling, and functional neuroimaging to probe whether learning from abstract novel outcomes harnesses the same circuitry that supports learning from familiar secondary reinforcers. Behavior and neuroimaging revealed that novel images can act as a substitute for rewards during instrumental learning, producing reliable reward-like signals in dopaminergic circuits. Moreover, we found evidence that prefrontal correlates of executive control may play a role in shaping flexible responses in reward circuits. These results suggest that learning from novel outcomes is supported by an interplay between high-level representations in prefrontal cortex and low-level responses in subcortical reward circuits. This interaction may allow for human reinforcement learning over arbitrarily abstract reward functions.

Humans actively seek information to reduce uncertainty, providing insight on how our decisions causally affect the world. While we know that episodic memories can help support future goal-oriented behaviors, little is known about how hypothesis testing during exploration influences episodic memory. To investigate this question, we designed a hypothesis testing paradigm, in which participants figured out rules to unlock treasure chests. Using this paradigm, we characterized how hypothesis testing during exploration influenced memory for the contents of the treasure chests. We found that there was an inverted U-shaped relationship between decision uncertainty and memory, such that memory was best when decision uncertainty was moderate. An exploratory analysis also showed that surprising outcomes lead to lower memory confidence independent of accuracy. These findings support a model in which moderate decision uncertainty during hypothesis testing enhances incidental information encoding.

Recent work has identified a critical role for the hippocampus in reward‐sensitive behaviors, including motivated memory, reinforcement learning, and decision‐making. Animal histology and human functional neuroimaging have shown that brain regions involved in reward processing and motivation are more interconnected with the ventral/anterior hippocampus. However, direct evidence examining gradients of structural connectivity between reward regions and the hippocampus in humans is lacking. The present study used diffusion MRI (dMRI) and probabilistic tractography to quantify the structural connectivity of the hippocampus with key reward processing regions in vivo. Using a large sample of subjects (N = 628) from the human connectome dMRI data release, we found that connectivity profiles with the hippocampus varied widely between different regions of the reward circuit. While the dopaminergic midbrain (ventral tegmental area) showed stronger connectivity with the anterior versus posterior hippocampus, the ventromedial prefrontal cortex showed stronger connectivity with the posterior hippocampus. The limbic (ventral) striatum demonstrated a more homogeneous connectivity profile along the hippocampal long axis. This is the first study to generate a probabilistic atlas of the hippocampal structural connectivity with reward‐related networks, which is essential to investigating how these circuits contribute to normative adaptive behavior and maladaptive behaviors in psychiatric illness. These findings describe nuanced structural connectivity that sets the foundation to better understand how the hippocampus influences reward‐guided behavior in humans. [ABSTRACT FROM AUTHOR]

Novelty detection, a critical computation within the medial temporal lobe (MTL) memory system, necessarily depends on prior experience. The current study used functional magnetic resonance imaging (fMRI) in humans to investigate dynamic changes in MTL activation and functional connectivity as experience with novelty accumulates. fMRI data were collected during a target detection task: Participants monitored a series of trial-unique novel and familiar scene images to detect a repeating target scene. Even though novel images themselves did not repeat, we found that fMRI activations in the hippocampus and surrounding cortical MTL showed a specific, decrementing response with accumulating exposure to novelty. The significant linear decrement occurred for the novel but not the familiar images, and behavioral measures ruled out a corresponding decline in vigilance. Additionally, early in the series, the hippocampus was inversely coupled with the dorsal striatum, lateral and medial prefrontal cortex, and posterior visual processing regions; this inverse coupling also habituated as novelty accumulated. This novel demonstration of a dynamic adjustment in neural responses to novelty suggests a similarly dynamic allocation of neural resources based on recent experience.

Howdoes the brain translate information signaling potential rewards into motivation to get them? Motivation to obtain reward is thought to depend on the midbrain [particularly the ventral tegmental area (VTA)], the nucleus accumbens (NAcc), and the dorsolateral prefrontal cortex (dlPFC), but it is not clear how the interactions among these regions relate to reward-motivated behavior. To study the influence of motivation on these reward-responsive regions and on their interactions, we used dynamic causal modeling to analyze functional magnetic resonance imaging (fMRI) data from humans performing a simple task designed to isolate reward anticipation. The use of fMRI permitted the simultaneous measurement of multiple brain regions while human participants anticipated and prepared for opportunities to obtain reward, thus allowing characterization of how information about reward changes physiology underlying motivational drive. Furthermore, we modeled the impact of external reward cues on causal relationships within this network, thus elaborating a link between physiology, connectivity, and motivation. Specifically, our results indicated that dlPFC was the exclusive entry point of information about reward in this network, and that anticipated reward availability caused VTA activation only via its effect on the dlPFC. Anticipated reward thus increased dlPFC activation directly, whereas it influenced VTA and NAcc only indirectly, by enhancing intrinsically weak or inactive pathways from the dlPFC. Our findings of a directional prefrontal influence on dopaminergic regions during reward anticipation suggest a model in which the dlPFC integrates and transmits representations of reward to the mesolimbic and mesocortical dopamine systems, thereby initiating motivated behavior. [ABSTRACT FROM AUTHOR]

Both goal-directed and automatic processes shape human behavior, but these processes often conflict. Behavioral control is the decision about which process guides behavior. Despite the importance of behavioral control for adaptive decision-making, its neural mechanisms remain unclear. Critically, it is unknown if there are mechanisms for behavioral control that are distinct from those supporting the formation of goal-relevant knowledge. We performed deep phenotyping of individual dopamine system function by combining multiple PET scans, fMRI, and dopaminergic drug administration in a within-subject, double-blind, placebo-controlled design. Subjects performed a rule-based response time task, with goal-directed and automatic decision-making operationalized as model-based and model-free influences on behavior. We found a double dissociation between two aspects of ventral striatal dopamine physiology: D2/3 receptor availability and dopamine synthesis capacity. Convergent and causal evidence indicated that D2/3 receptors regulate behavioral control by enhancing model-based and blunting model-free influences on behavior but do not affect model-based knowledge formation. In contrast, dopamine synthesis capacity was linked to the formation of model-based knowledge but not behavioral control. D2/3 receptors also modulated frontostriatal functional connectivity, suggesting they regulate behavioral control by gating prefrontal inputs to the striatum. These results identify central mechanisms underlying individual and state differences in behavioral control and point to striatal D2/3 receptors as targets for interventions for improving goal-directed behavior.

Stimulus-response habits benefit behavior by automatizing the selection of rewarding actions. However, this automaticity can come at the cost of reduced flexibility to adapt behavior when circumstances change. The goal-directed system is thought to counteract the habit system by providing the flexibility to pursue context-appropriate behaviors. The dichotomy between habitual action selection and flexible goal-directed behavior has recently been challenged by findings showing that rewards bias both action and goal selection. Here, we test whether reward reinforcement can give rise to habitual goal selection much as it gives rise to habitual action selection. We designed a rewarded, context-based perceptual discrimination task in which performance on one rule was reinforced. Using drift-diffusion models and psychometric analyses, we found that reward facilitates the initiation and execution of rules. Strikingly, we found that these biases persisted in a test phase in which rewards were no longer available. Although this facilitation is consistent with the habitual goal selection hypothesis, we did not find evidence that reward reinforcement reduced cognitive flexibility to implement alternative rules. Together, the findings suggest that reward creates a lasting impact on the selection and execution of goals but may not lead to the inflexibility characteristic of habits. Our findings demonstrate the role of the reward learning system in influencing how the goal-directed system selects and implements goals., (© 2024 Massachusetts Institute of Technology.)