Search

Risk/reward decision-making is a dynamic process that includes periods of deliberation before action selection and evaluation of the action outcomes that bias subsequent choices. Inactivation of the prelimbic (PL) cortex has revealed its integral role in updating decision biases in the face of changes in probabilistic reward contingencies, yet how phasic PL signals during different phases of the decision process influence choice remains unclear. We used temporally specific optogenetic inhibition to selectively disrupt PL activity coinciding with action selection and outcome phases to examine how these signals influence choice. Male rats expressing the inhibitory opsin eArchT within PL excitatory neurons were well trained on a probabilistic discounting task, entailing choice between small/certain versus large/risky rewards, the probability of which varied over a session (50–12.5%). During testing, brief light pulses suppressed PL activity before choice or after different outcomes. Prechoice suppression reduced bias toward more preferred/higher utility options and disrupted how recent outcomes influenced subsequent choice. Inhibition during risky losses induced a similar profile, but here, the impact of reward omissions were either amplified or diminished, relative to the context of the estimated profitability of the risky option. Inhibition during large or small reward receipt reduced risky choice when this option was more profitable, suggesting these signals can both reinforce rewarded risky choices and also act as a relative value comparator signal that augments incentive for larger rewards. These findings reveal multifaceted contributions by the PL in implementing decisions and integrating action–outcome feedback to assign context to the decision space.SIGNIFICANCE STATEMENTThe PL prefrontal cortex plays an integral role in guiding risk/reward decisions, but how activity in this region during different phases of the decision process influences choice is unclear. By using temporally specific optogenetic manipulations of this activity, the present study unveiled previously uncharacterized and differential contributions by PL in implementing decision policies and how evaluation of decision outcomes shape subsequent choice. These findings provide novel insight into the dynamic processes engaged by the PL that underlie action selection in situations involving reward uncertainty that may aid in understanding the mechanism underlying normal and aberrant decision-making processes.

Psychostimulant use and engagement with probabilistic schedules of reward both sensitize the mesocorticolimbic dopamine system. Such behaviours may act synergistically to explain the high comorbidity between stimulant use and gambling disorder. The salient audiovisual stimuli of modern electronic gambling may exacerbate the situation. To probe these interactions, we sensitized ventral tegmental area (VTA) dopamine neurons via chronic chemogenetic stimulation while rats learned the rat gambling task in the presence or absence of casino-like cues. The same rats then learned to self-administer cocaine. In a separate cohort, we confirmed that our chemogenetic methods sensitized the locomotor response to cocaine, and potentiated phasic excitability of VTA dopamine neurons through in vivo electrophysiological recordings. In the absence of cues, sensitization promoted risk-taking in both sexes. When rewards were cued, sensitization expedited the development of a risk-preferring phenotype in males, while attenuating cue-induced risk-taking in females. While these results provide further confirmation that VTA dopamine neurons critically modulate risky decision making, they also reveal stark sex differences in the decisional impact which dopaminergic signals exert when winning outcomes are cued. As previously observed, risky decision-making on the cued rGT increased as both males and females learned to self-administer cocaine. The combination of dopamine sensitization and win-paired cues while gambling lead to significantly greater cocaine-taking, but these rats did not show any increase in risky choice as a result. Cocaine and heavily-cued gambles may therefore partially substitute for each other once the dopamine system is rendered labile through sensitization, compounding addiction risk across modalities.

Neuroimaging has revealed robust interactions between the prefrontal cortex and the hippocampus when people stop memory retrieval. Efforts to stop retrieval can arise when people encounter reminders to unpleasant thoughts they prefer not to think about. Retrieval stopping suppresses hippocampal and amygdala activity, especially when cues elicit aversive memory intrusions, via a broad inhibitory control capacity enabling prepotent response suppression. Repeated retrieval stopping reduces intrusions of unpleasant memories and diminishes their affective tone, outcomes resembling those achieved by the extinction of conditioned emotional responses. Despite this resemblance, the role of inhibitory fronto-hippocampal interactions and retrieval stopping broadly in extinction has received little attention. Here we integrate human and animal research on extinction and retrieval stopping. We argue that reconceptualising extinction to integrate mnemonic inhibitory control with learning would yield a greater understanding of extinction’s relevance to mental health. We hypothesize that fear extinction spontaneously engages retrieval stopping across species, and that controlled suppression of hippocampal and amygdala activity by the prefrontal cortex reduces fearful thoughts. Moreover, we argue that retrieval stopping recruits extinction circuitry to achieve affect regulation, linking extinction to how humans cope with intrusive thoughts. We discuss novel hypotheses derived from this theoretical synthesis.

Drugs of abuse including cannabis and inhalants impair risk/reward decision making. Cannabis use is often concurrent with inhalant intoxication; yet, preclinical studies investigating the role of endocannabinoids in inhalant misuse are limited. To address this gap in the literature, we used the well-validated probabilistic discounting task to assess risk/reward decision making in rodents following combinations of toluene vapor (a common inhalant) and manipulations of cannabinoid receptor type 1 (CB1R) signaling. As reported previously, acute exposure to toluene vapor disrupted behavioral flexibility during probabilistic discounting. Systemic administration of the CB1R inverse agonist AM281 did not prevent toluene-induced alterations in risky choices, but did independently reduce win-stay behavior, increase choice latency, and increase omissions. Toluene-induced deficits in probabilistic discounting are thought to involve impaired medial prefrontal cortex (mPFC) activity. As we previously reported that some of toluene's inhibitory effects on glutamatergic signaling in the mPFC are endocannabinoid-dependent, we tested the hypothesis that mPFC CB1R activity mediates toluene-induced deficits in discounting. However, bilateral injection of the CB1R inverse agonist AM251 prior to toluene vapor exposure had no effect on toluene-induced changes in risk behavior. In a final set of experiments, we injected the CB1R inverse agonist AM251 (5 and 50 ng), the CB1R agonist WIN55,212-2 (50 ng and 500 ng), or vehicle into the mPFC prior to testing. While mPFC CB1R stimulation did not affect any of the measures tested, the CB1R inverse agonist caused a dose-dependent reduction in win-stay behavior without altering any other measures. Together, these studies indicate that toluene-induced deficits in probabilistic discounting are largely distinct from CB1R-dependent effects that include decreased effectiveness of positive reinforcement (mPFC CB1Rs), decision making speed, and task engagement (non-mPFC CB1Rs).

A fundamental trait of depression is low motivation. Hippocampal neurogenesis has been associated with motivational deficits but detailed evidence on how it regulates human-relevant behavioral traits is still missing. We used the hGFAP-TK rat model to deplete actively dividing neural stem cells in the rat hippocampus. Use of the effort-discounting operant task allowed us to identify specific and detailed deficits in motivation behavior. In this task, rats are given a choice between small and large food rewards, where 2-20 lever presses are required to obtain the large reward (four sugar pellets) versus one press to receive the smaller reward (two sugar pellets). We found that depleting adult neurogenesis did not affect effort-based choice or general motivation to complete the task. However, lack of adult neurogenesis reduced the pressing rate and thus increased time to complete the required presses to obtain a reward. In summary, the present study finds that adult hippocampal neurogenesis specifically reduces response vigor to obtain rewards and thus deepens our understanding in how neurogenesis shapes depression.

Adult hippocampal neurogenesis has been implicated in a number of disorders where reward processing is disrupted but whether new neurons regulate specific aspects of reward-related decision making remains unclear. Given the role of the hippocampus in future-oriented cognition, here we tested whether adult neurogenesis regulates preference for future, advantageous rewards in a delay discounting paradigm for rats. Indeed, blocking neurogenesis caused a profound aversion for delayed rewards, and biased choice behavior toward immediately available, but smaller, rewards. Consistent with a role for the ventral hippocampus in impulsive decision making and future-thinking, neurogenesis-deficient animals displayed reduced activity in the ventral hippocampus. In intact animals, delay-based decision making restructured dendrites and spines in adult-born neurons and specifically activated adult-born neurons in the ventral dentate gyrus, relative to dorsal activation in rats that chose between immediately-available rewards. Putative developmentally-born cells, located in the superficial granule cell layer, did not display task-specific activity. These findings identify a novel and specific role for neurogenesis in decisions about future rewards, thereby implicating newborn neurons in disorders where short-sighted gains are preferred at the expense of long-term health.

Efficient decision-making involves weighing the costs and benefits associated with different actions and outcomes to maximize long-term utility. The medial orbitofrontal cortex (mOFC) has been implicated in guiding choice in situations involving reward uncertainty, as inactivation in rats alters choice involving probabilistic rewards. The mOFC receives considerable dopaminergic input, yet how dopamine (DA) modulates mOFC function has been virtually unexplored. Here, we assessed how mOFC D1 and D2 receptors modulate two forms of reward seeking mediated by this region, probabilistic reversal learning and probabilistic discounting. Separate groups of well-trained rats received intra-mOFC microinfusions of selective D1 or D2 antagonists or agonists prior to task performance. mOFC D1 and D2 blockade had opposing effects on performance during probabilistic reversal learning and probabilistic discounting. D1 blockade impaired, while D2 blockade increased the number of reversals completed, both mediated by changes in errors and negative feedback sensitivity apparent during the initial discrimination of the task, which suggests changes in probabilistic reinforcement learning rather than flexibility. Similarly, D1 blockade reduced, while D2 blockade increased preference for larger/risky rewards. Excess D1 stimulation had no effect on either task, while excessive D2 stimulation impaired probabilistic reversal performance, and reduced both profitable risky choice and overall task engagement. These findings highlight a previously uncharacterized role for mOFC DA, showing that D1 and D2 receptors play dissociable and opposing roles in different forms of reward-related action selection. Elucidating how DA biases behavior in these situations will expand our understanding of the mechanisms regulating optimal and aberrant decision-making.

There is an urgent need for novel drugs for treating cognitive deficits that are defining features of schizophrenia. The individual d- and l-enantiomers of the tetrahydroprotoberberine (THPB) d,l-govadine have been proposed for the treatment of cognitive deficiencies and positive symptoms of schizophrenia, respectively. We examined the effects of d-, l-, or d,l-govadine on two distinct forms of cognitive flexibility perturbed in schizophrenia and compared them to those induced by a selective D1 receptor agonist and D2 receptor antagonist. Male rats received d-, l-, or d,l-govadine (0.3, 0.5, and 1.0 mg/kg), D1 agonist SKF81297(0.1, 0.3, and 1.0 mg/kg), or D2 antagonist haloperidol (0.1–0.2 mg/kg). Experiment 1 used a strategy set-shifting task (between-subjects). In experiment 2, well-trained rats were tested on a probabilistic reversal task (within-subjects). d-Govadine improved set-shifting across all doses, whereas higher doses of l-govadine impaired set-shifting. SKF81297 reduced perseverative errors at the lowest dose. Low/high doses of haloperidol increased/decreased set-shifting errors, the latter “improvement” attributable to impaired retrieval of a previous acquired rule. Probabilistic reversal performance was less affected by these drugs, but d-govadine reduced errors during the first reversal, whereas l-govadine impaired initial discrimination learning. d,l-Govadine had no reliable cognitive effects but caused psychomotor slowing like l-govadine and haloperidol. These findings further highlight differences between two enantiomers of d,l-govadine that may reflect differential modulation of D1 and D2 receptors. These preclinical findings give further impetus to formal clinical evaluation of d-govadine as a treatment for cognitive deficiencies related to schizophrenia.

Behavioural flexibility is essential to adapt to a changing environment and depends on the medial prefrontal cortex (mPFC). Testosterone administration decreases behavioural flexibility. It is well known that testosterone is produced in the gonads, but testosterone is also produced in the brain, including the mPFC and other nodes of the mesocorticolimbic system. It is unclear how testosterone produced in the brain versus the gonads influences behavioural flexibility. Here, in adult male rats, we assessed the effects of the androgen synthesis inhibitor abiraterone acetate (ABI) and long-term gonadectomy (GDX) on behavioural flexibility in two paradigms. In Experiment 1, ABI but not GDX reduced the number of errors to criterion and perseverative errors in a strategy set-shifting task. In Experiment 2, with a separate cohort of rats, ABI but not GDX reduced perseverative errors in a reversal learning task. In Experiment 1, we also examined tyrosine hydroxylase immunoreactivity (TH-ir), and ABI but not GDX increased TH-ir in the mPFC. Our findings suggest that neurally-produced androgens modulate behavioural flexibility via modification of dopamine signalling in the mesocorticolimbic system. These results indicate that neurosteroids regulate executive functions and that ABI treatment for prostate cancer might affect cognition.

Fear can potently inhibit ongoing behavior, including reward-seeking, yet the neural circuits that underlie such suppression remain to be clarified. Prior studies have demonstrated that distinct subregions of the rodent medial prefrontal cortex (mPFC) differentially affect fear behavior, whereby fear expression is promoted by the more dorsal prelimbic cortex (PL) and inhibited by the more ventral infralimbic cortex (IL). These mPFC regions project to subregions of the nucleus accumbens, the core (NAcC) and shell (NAcS), that differentially contribute to reward-seeking as well as affective processes that may be relevant to fear expression. Here, we investigated how these mPFC and NAc subregions contribute to discriminative fear conditioning, assessed by conditioned suppression of reward-seeking. Bilateral inactivation of the NAcS or PL reduced the expression of conditioned suppression to a shock-associated CS+, whereas NAcC inactivation reduced reward-seeking without affecting suppression. IL inactivation caused a general reduction in conditioned suppression following discriminative conditioning, but not when using a single-stimulus design. Pharmacological disconnection of the PL → NAcS pathway revealed that this projection mediates conditioned suppression. These data add to a growing literature implicating discrete cortico-striatal pathways in the suppression of reward-seeking in response to aversive stimuli. Dysfunction within related structures may contribute to aberrant patterns of behavior in psychiatric illnesses including substance use disorders.

The medial orbitofrontal cortex (mOFC) regulates a variety of cognitive functions, including refining action selection involving reward uncertainty. This region sends projections to numerous subcortical targets, including the ventral and dorsal striatum, yet how these corticostriatal circuits differentially regulate risk/reward decision-making is unknown. The present study examined the contribution of mOFC circuits linking the nucleus accumbens (NAc) and dorsomedial striatum (DMS) to risk/reward decision-making using pharmacological disconnections. Male rats were well trained on a probabilistic discounting task involving choice between small/certain or large/risky rewards, with the probability of obtaining the larger reward decreasing or increasing over a session. Disconnection of mOFC-striatal pathways was achieved using infusions of GABA agonists inactivating the mOFC in one hemisphere, combined with NAc or DMS inactivation in the contralateral or ipsilateral hemisphere. Perturbing mOFC → NAc circuits induced suboptimal, near-random patterns of choice that manifested as a flattening of the discounting curve. Animals were equally likely to stay or shift following rewarded/nonrewarded choices, suggesting this pathway mediates use of information about reward history to stabilize decision biases. In contrast, mOFC → DMS disconnection impaired adjustments in decision biases, causing opposing changes in risky choice depending on how probabilities varied over time. This was driven by alterations in lose-shift behavior, suggesting mOFC → DMS circuits track volatility in nonrewarded actions to adjust choice in accordance with changes in profitability. Thus, separate mOFC-striatal projection pathways regulate dissociable processes underlying decision-making, with mOFC → NAc circuits aiding in establishing and stabilizing tasks states and mOFC → DMS circuits facilitating transitions across states to promote flexible reward seeking.SIGNIFICANCE STATEMENTThe medial orbitofrontal cortex regulates a variety of goal-directed behaviors, yet the functional circuits through which it mediates higher order decision-making functions are unclear. The present study revealed that different mOFC projection pathways facilitate diverse aspects of decision-making involving risks and rewards by engaging separate networks of neurons that interface with distinct ventral and dorsal striatal targets. These findings clarify some of the normal functions of these corticostriatal pathways and may have implications for understanding how dysfunction in these circuits relate to certain psychiatric disorders.

Maternal diets can have dramatic effects on the physiology, metabolism, and behaviour of offspring that persist into adulthood. However, the effects of maternal sucrose consumption on offspring remain unclear. Here, female rats were fed either a sucrose diet with a human-relevant level of sucrose (25% of kcal) or a macronutrient-matched, isocaloric control diet before, during, and after pregnancy. After weaning, all offspring were fed a standard low-sucrose rodent chow. We measured indicators of metabolism (weight, adipose, glucose tolerance, and liver lipids) during development and adulthood (16–24 weeks). We also measured food preference and motivation for sugar rewards in adulthood. Finally, in brain regions regulating these behaviours, we measured steroids and transcripts for steroidogenic enzymes, steroid receptors, and dopamine receptors. In male offspring, maternal sucrose intake decreased body mass and visceral adipose tissue, increased preference for high-sucrose and high-fat diets, increased motivation for sugar rewards, and decreased mRNA levels of Cyp17a1 (an androgenic enzyme) in the nucleus accumbens. In female offspring, maternal sucrose intake increased basal corticosterone levels. These data demonstrate the enduring, diverse, and sex-specific effects of maternal sucrose consumption on offspring phenotype.

Androgens regulate behavioural flexibility, which is essential to adapt to a changing environment and depends on the medial prefrontal cortex (mPFC). Testosterone (T) administration decreases behavioural flexibility. It is well known that T is produced in the gonads, but T is also produced in the mesocorticolimbic system, which modulates behavioural flexibility. It is unclear how T produced in the brain versus the gonads influences behavioural flexibility. Here, we assess the effects of the androgen synthesis inhibitor abiraterone acetate (ABI) and long-term gonadectomy (GDX) on behavioural flexibility in two paradigms. In Experiment 1, ABI independent of GDX reduced the number of trials to criterion and perseverative errors in a strategy set-shifting task. Similarly, in Experiment 2, ABI but not GDX reduced perseverative errors in a reversal learning task. In subjects from Experiment 1, we also examined tyrosine hydroxylase immunoreactivity (TH-ir), and ABI but not GDX increased TH-ir in the mPFC. Our findings suggest that neurally-produced androgens modulate behavioural flexibility via modification of dopamine signalling in the mesocorticolimbic system. These results suggest novel roles for neurosteroids and possible side effects of ABI treatment for prostate cancer.

Despite being an intensive area of research, the function of the anterior cingulate cortex (ACC) remains somewhat of a mystery. Human imaging studies implicate the ACC in various cognitive functions, yet surgical ACC lesions used to treat emotional disorders have minimal lasting effects on cognition. An alternative view is that ACC regulates autonomic states, consistent with its interconnectivity with autonomic control regions and that stimulation evokes changes in autonomic/emotional states. At the cellular level, ACC neurons are highly multi-modal and promiscuous, and can represent a staggering array of task events. These neurons nevertheless combine to produce highly event-specific ensemble patterns that likely alter activity in downstream regions controlling emotional and autonomic tone. Since neuromodulators regulate the strength of the ensemble activity patterns, they would regulate the impact these patterns have on downstream targets. Through these mechanisms, the ACC may determine how strongly to react to the very events its ensembles represent. Pathologies arise when specific event-related representations gain excessive control over autonomic/emotional states.

Appropriate modification of behavior in response to our dynamic environment is essential for adaptation and survival. This adaptability allows organisms to maximize the utility of behavior-related energy expenditure. Modern theories of locus coeruleus (LC) function implicate a pivotal role for the noradrenergic nucleus in mediating switches between focused behavior during periods of high utility (exploit) versus disengagement of behavior and exploration of other, more rewarding opportunities. Two modes of activity in LC neurons have been characterized as elements in an Adaptive Gain Theory (AGT) of LC function. In this theory, during periods of accurate and focused behavior, LC neurons exhibit task-related phasic bursts. However, as behavioral utility wanes, phasic activity is suppressed and baseline (tonic) impulse activity increases to facilitate exploration. Our experiments sought to exogenously induce an elevated pattern of activity in LC neurons and their medial prefrontal cortical (mPFC) targets to test the tenets of the AGT. This theory posits that tonic activation immediately following a rule change should increase exploration and thereby improve performance on a set-shifting task. Indeed, DREADD mediated stimulation of LC terminals within mPFC decreased trials to reach criterion. However, this effect resulted from improved application of the new rule once the original rule is jettisoned rather than earlier disengagement from the old, ineffective strategy. Such improvements were not seen with global manipulation of LC, consistent with the view that LC-mediated exploration involves specific sub-circuits targeting mPFC. These findings extend our understanding of the role of LC in PFC and flexible behavior.

Nucleus accumbens (NAc) dopamine (DA) plays an integral role in overcoming effort costs, as blockade of D1 and D2 receptors reduces the choice of larger, more-costly rewards. Similarly, the stress neuropeptide corticotropin-releasing factor (CRF) modulates DA transmission and mediates stress-induced alterations in effort-related choice. The current study explored how excessive stimulation of different DA receptors within the NAc core and shell alters effort-related decision-making and compared these effects to those induced by CRF stimulation. Male Long Evans rats were well-trained on an effort-discounting task wherein they choose between a low-effort/low-reward and a high-effort/high-reward lever where the effort requirement increased over blocks (2–20 presses). Dopamine D1 (SKF 81297, 0.2–2 μg), D2/3 (quinpirole, 1–10 μg), or D3 (PD 128,907, 1.5–3 μg) receptor agonists, or CRF (0.5 μg), were infused into the NAc core or shell prior to testing. Stimulation of D2/3 receptors with quinpirole in the NAc core or shell markedly reduced the choice of high-effort option and increase choice latencies, without altering preference for larger vs smaller rewards. Stimulation of D1 or D3 receptors did not alter choice, although SKF 81297 infusions into the shell reduced response vigor. In comparison, core infusions of CRF flattened the discounting curve, reducing effortful choice when costs were low and increasing it when costs were high. Excessive stimulation of NAc D2 receptors has detrimental effects on effort-related decision-making. Furthermore, CRF stimulation induces dissociable effects on decision-making compared with those induced the effects of stimulation of different DA receptors.

Adolescent binge drinking renders young drinkers vulnerable to alcohol use disorders in adulthood; therefore, understanding alcohol-induced brain damage and associated cognitive dysfunctions is of paramount importance. Here we investigated the effects of binge-like adolescent intermittent ethanol (AIE) exposure on nonspatial working memory, behavioral flexibility and cholinergic alterations in the nucleus accumbens (NAc) in male and female rats. On postnatal days P25–57 rats were intubated with water or ethanol (at a dose of 5 g/kg) on a 2-day-on/2-day-off cycle and were then tested in adulthood on social recognition and probabilistic reversal learning tasks. During the social recognition task AIE-treated rats spent similar amounts of time interacting with familiar and novel juveniles, indicating an impaired ability to sustain memory of the familiar juvenile. During probabilistic reversal learning, AIE-treated male and female rats showed behavioral inflexibility as indicated by a higher number of trials needed to complete three reversals within a session, longer response latencies for lever selection, and for males, a higher number of errors as compared to water-treated rats. AIE exposure also reduced the number of cholinergic interneurons in the NAc in males and females. These findings indicate AIE-related pathologies of accumbal cholinergic interneurons and long lasting cognitive-behavioral deficits, which may be associated with cortico-striatal hypofunction.

Experiencing some early life adversity can have an "inoculating" effect that promotes resilience in adulthood. However, the mechanisms underlying stress inoculation are unknown, and animal models are lacking. Here we used the limited bedding and nesting (LBN) model of adversity to evaluate stress inoculation of addiction-related phenotypes. In LBN, pups from postnatal days 2 to 9 and their dams were exposed to a low-resource environment. In adulthood, they were tested for addiction-like phenotypes and compared to rats raised in standard housing conditions. High levels of impulsivity are associated with substance abuse, but in males, LBN reduced impulsive choice compared to controls. LBN males also self-administered less morphine and had a lower breakpoint on a progressive ratio reinforcement schedule than controls. These effects of LBN on addiction-related behaviors were not found in females. Because the nucleus accumbens (NAc) mediates these behaviors, we tested whether LBN altered NAc physiology in drug-naive and morphine-exposed rats. LBN reduced the frequency of spontaneous excitatory postsynaptic currents in males, but a similar effect was not observed in females. Only in males did LBN prevent a morphine-induced increase in the AMPA/NMDA ratio. RNA sequencing was performed to delineate the molecular signature in the NAc associated with LBN-derived phenotypes. LBN produced sex-specific changes in transcription, including in genes related to glutamate transmission. Collectively, these studies reveal that LBN causes a male-specific stress inoculation effect against addiction-related phenotypes. Identifying factors that promote resilience to addiction may reveal novel treatment options for patients.

Hippocampal synaptic plasticity includes both long-term potentiation (LTP) and long-term depression (LTD) of synaptic strength, and has been implicated in shaping place field representations that form upon initial exposure to a novel environment. However, direct evidence causally linking either LTP or LTD to place fields remains limited. Here, we show that hippocampal LTD regulates the acute formation and maintenance of place fields using electrophysiology and blocking specifically LTD in freely-moving rats. We also show that exploration of a novel environment produces a widespread and pathway specific de novo synaptic depression in the dorsal hippocampus. Furthermore, disruption of this pathway-specific synaptic depression alters both the dynamics of place field formation and the stability of the newly formed place fields, affecting spatial memory in rats. These results suggest that activity-dependent synaptic depression is required for the acquisition and maintenance of novel spatial information., LTP and LTD are involved in shaping hippocampal place field representations. Here, the authors show that de novo pathway-specific hippocampal LTD changes dynamics and stability of newly formed place fields, regulating acquisition and maintenance of novel spatial information in adult rats.

There is an urgent need for novel drugs for treating cognitive deficits that are defining features of schizophrenia. The individual d- and l-enantiomers of the tetrahydroprotoberberine (THPB) d,l-govadine have been proposed for the treatment of cognitive deficiencies and positive symptoms of schizophrenia, respectively.We examined the effects of d-, l-, or d,l-govadine on two distinct forms of cognitive flexibility perturbed in schizophrenia and compared them to those induced by a selective D1 receptor agonist and D2 receptor antagonist.Male rats received d-, l-, or d,l-govadine (0.3, 0.5, and 1.0 mg/kg), D1 agonist SKF81297(0.1, 0.3, and 1.0 mg/kg), or D2 antagonist haloperidol (0.1-0.2 mg/kg). Experiment 1 used a strategy set-shifting task (between-subjects). In experiment 2, well-trained rats were tested on a probabilistic reversal task (within-subjects).d-Govadine improved set-shifting across all doses, whereas higher doses of l-govadine impaired set-shifting. SKF81297 reduced perseverative errors at the lowest dose. Low/high doses of haloperidol increased/decreased set-shifting errors, the latter "improvement" attributable to impaired retrieval of a previous acquired rule. Probabilistic reversal performance was less affected by these drugs, but d-govadine reduced errors during the first reversal, whereas l-govadine impaired initial discrimination learning. d,l-Govadine had no reliable cognitive effects but caused psychomotor slowing like l-govadine and haloperidol.These findings further highlight differences between two enantiomers of d,l-govadine that may reflect differential modulation of D1 and D2 receptors. These preclinical findings give further impetus to formal clinical evaluation of d-govadine as a treatment for cognitive deficiencies related to schizophrenia.

Acute stress can have variable and sometimes sex-dependent effects on different executive functions, including cognitive flexibility, some of which may be mediated by increased corticotropin releasing factor (CRF). Previous studies on the effects of stress and CRF on cognitive flexibility have used procedures entailing deterministic rewards, yet how they may alter behavior when outcomes are probabilistic is unclear. The present study examined how acute stress and increased CRF activity alters probabilistic reversal learning (PRL) in male and female rats. Rats learned to discriminate between a ‘correct’ lever rewarded on 80 % of trials, and an “incorrect” lever delivering reward on 20 % of trials, with reward contingencies reversed after 8 consecutive correct choices. Separate groups received either intracerebroventricular infusions of CRF (3 μg) or restraint stress prior to a PRL session. Experiments examined how these manipulations affected learning when given prior to a one-day acquisition test or during performance in well-trained rats. Exogenous CRF, and to a lesser extent acute stress, impaired motivation across sexes, slowing deliberation times and increasing the number of trials omitted, particularly following a switch in reward contingencies. Neither manipulation significantly altered errors or reversal performance. However, increased CRF activity reduced negative feedback sensitivity. Across manipulations, females showed increased omissions and choice latencies, and were less sensitive to feedback than males. These results reveal the complexity with which stress, CRF, sex, and experience interact to alter aspects of motivation and probabilistic reinforcement learning and provide insight into how CRF activity may contribute to symptoms of stress-related disorders.

Pursuing rewards while avoiding danger is an essential function of any nervous system. Here, we examine a new mechanism helping rats negotiate the balance between risk and reward when making high-stakes decisions. Specifically, we focus on GABA neurons within an emerging mesolimbic circuit nexus—the ventral pallidum (VP). These neurons play a distinct role from other VP neurons in simple motivated behaviors in mice, but their roles in more complex motivated behaviors is unknown. Here, we interrogate the behavioral functions of VPGABA neurons in male and female transgenic GAD1:Cre rats (and wildtype littermates), using a reversible chemogenetic inhibition approach. Employing a behavioral assay of risky decision making, and of the food-seeking and shock-avoidance components of this task, we show that engaging inhibitory Gi/o signaling specifically in VPGABA neurons suppresses motivation to pursue highly salient palatable foods, and possibly also motivation to avoid being shocked. In contrast, inhibiting these neurons did not affect seeking of low-value food, free consumption of palatable food, or unconditioned affective responses to shock. Accordingly, when rats considered whether to pursue food despite potential for shock in a risky decision-making task, inhibiting VPGABA neurons caused them to more readily select a small but safe reward over a large but dangerous one—an effect not seen in the absence of shock threat. Together, results indicate that VPGABA neurons are critical for high-stakes adaptive responding that is necessary for survival, but which may also malfunction in psychiatric disorders.Significance StatementIn a dynamic world, it is essential to implement appropriate behaviors under circumstances involving rewards, threats, or both. Here, we demonstrate a crucial role for VPGABA neurons in high-stakes motivated behavior of several types. We show that this VPGABA role in motivation impacts decision making, as inhibiting these neurons yields a conservative, risk-averse strategy not seen when the task is performed without threat of shock. These new roles for VPGABA neurons in behavior may inform future strategies for treating addiction, and other disorders of maladaptive decision making.

Efficient decision-making involves weighing the costs and benefits associated with different actions and outcomes to maximize long-term utility. The medial orbitofrontal cortex (mOFC) has been implicated in guiding choice in situations involving reward uncertainty, as inactivation in rats alters choice involving probabilistic rewards. The mOFC receives considerable dopaminergic input, yet how dopamine (DA) modulates mOFC function has been virtually unexplored. Here, we assessed how mOFC D(1) and D(2) receptors modulate two forms of reward seeking mediated by this region, probabilistic reversal learning and probabilistic discounting. Separate groups of well-trained rats received intra-mOFC microinfusions of selective D(1) or D(2) antagonists or agonists prior to task performance. mOFC D(1) and D(2) blockade had opposing effects on performance during probabilistic reversal learning and probabilistic discounting. D(1) blockade impaired, while D(2) blockade increased the number of reversals completed, both mediated by changes in errors and negative feedback sensitivity apparent during the initial discrimination of the task, which suggests changes in probabilistic reinforcement learning rather than flexibility. Similarly, D(1) blockade reduced, while D(2) blockade increased preference for larger/risky rewards. Excess D(1) stimulation had no effect on either task, while excessive D(2) stimulation impaired probabilistic reversal performance, and reduced both profitable risky choice and overall task engagement. These findings highlight a previously uncharacterized role for mOFC DA, showing that D(1) and D(2) receptors play dissociable and opposing roles in different forms of reward-related action selection. Elucidating how DA biases behavior in these situations will expand our understanding of the mechanisms regulating optimal and aberrant decision-making.

Rewards are often unreliable and optimal choice requires behavioral flexibility and learning about the probabilistic nature of uncertain rewards. Probabilistic learning occurs over multiple trials, often without conscious knowledge, and is traditionally associated with striatal function. While the hippocampus is classically recognized for its role in memory for individual experiences, recent work indicates that it is also involved in probabilistic forms of learning but little is known about the features that support such learning. We hypothesized that adult neurogenesis may be involved, because adult-born neurons contribute to both learning and reward-related behaviors. To test this, we used an appetitive probabilistic reversal learning task where a correct lever is rewarded with 80% probability and an incorrect lever is rewarded with 20% probability. Behavioral flexibility was assessed by switching correct-incorrect lever identities after 8 consecutive correct choices. Transgenic male rats that lacked adult neurogenesis displayed an initial deficit in discriminating the correct and incorrect levers, but they were not impaired at reversing behavior when the reward contingencies switched. When reward was withheld after a correct lever choice, neurogenesis-deficient rats were more likely to choose the incorrect lever on the subsequent trial. Also, rats with intact neurogenesis were more sensitive to reward at the incorrect lever. Differences were not observed in control transgenic rats that had intact neurogenesis. These results identify a novel role for neurogenesis in learning about uncertain, probabilistic rewards. Altered sensitivity to reward and negative feedback furthermore implicates neurogenesis in cognitive phenotypes associated with mood disorders such as depression. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The lateral orbitofrontal cortex (lOFC) receives sensory information about food and integrates these signals with expected outcomes to guide future actions, and thus may play a key role in a distributed network of neural circuits that regulate feeding behaviour. Here, we reveal a novel role for the lOFC in the cognitive control of behaviour in obesity. Food-seeking behaviour is biased in obesity such that in male obese mice, behaviours are less flexible to changes in the perceived value of the outcome. Obesity is associated with reduced lOFC inhibitory drive, and chemogenetic reduction in GABAergic neurotransmission in the lOFC induces obesity-like impairments in goal-directed behaviour. Conversely, pharmacological or optogenetic restoration of inhibitory neurotransmission in the lOFC of obese mice reinstates flexible behaviour. Our results indicate that obesity-induced disinhibition of the lOFC leads to a failure to update changes in the value of food with satiety, which in turn may influence how individuals make decisions in an obesogenic environment.

Decision-making is a complex process essential to daily adaptation in many species. Risk is an inherent aspect of decision-making and it is influenced by gonadal hormones. Testosterone and 17β-estradiol may modulate decision making and impact the mesocorticolimbic dopamine pathway. Here, we explored sex differences, the effect of gonadal hormones and the dopamine agonist amphetamine on risk-based decision making. Intact or gonadectomised (GDX) male and female rats underwent to a probabilistic discounting task. High and low doses of testosterone propionate (1.0 or 0.2 mg) and 17β-estradiol benzoate (0.3 μg) were administered to assess acute effects on risk-based decision making. After 3-days of washout period, intact and GDX rats received high or low (0.5 or 0.125 mg/kg) doses of amphetamine and re-tested in the probabilistic discounting task. Under baseline conditions, males made more risky choices during probability discounting compared to female rats, particularly in the lower probability blocks, but GDX did not influence risky choice. The high, but not the low dose, of testosterone modestly reduced risky decision making in GDX male rats. Conversely, 17β-estradiol had no significant effect on risky choice regardless of GDX status in either sex. Lastly, a higher dose of amphetamine increased risky decision making in both intact males and females, but had no effect in GDX rats. These findings demonstrated sex differences in risk-based decision making, with males showing a stronger bias towards larger, uncertain rewards. GDX status influenced the effects of amphetamine, suggesting different dopaminergic regulation in risk-based choices among males and females.

Synaptodendritic pruning is a common cause of cognitive decline in neurological disorders, including HIV-associated neurocognitive disorders (HAND). HAND persists in treated patients as a result of chronic inflammation and low-level expression of viral proteins, though the mechanisms involved in synaptic damage are unclear. Here, we report that the chemokine CXCL12 recoups both cognitive performance and synaptodendritic health in a rodent model of HAND, which recapitulates the neuroinflammatory state of virally controlled individuals and the associated structural/functional deficiencies. CXCL12 preferentially regulates plastic thin spines on layer II/III pyramidal neurons of the medial prefrontal cortex via CXCR4-dependent stimulation of the Rac1/PAK actin polymerization pathway, leading to increased spine density and improved flexible behavior. Our studies unveil a critical role of CXCL12/CXCR4 signaling in spine dynamics and cognitive flexibility, suggesting that HAND - or other diseases driven by spine loss - may be reversible and upturned by targeting Rac1-dependent processes in cortical neurons.

The flexible implementation of active and passive strategies to avoid danger is critical to survival. Conversely, the inappropriate allocation of these behaviors may underlie pathological avoidance in neuropsychiatric illnesses. The present study investigated whether these two poles of avoidance may be differentially regulated by subdivsions of the nucleus accumbens, the core (NAcC) and shell (NAcS), which are known to bi-directionally control flexible action selection during reward-seeking. In so doing, we developed a novel cued active/inhibitory avoidance task conducted in operant chambers that entailed presentations of two distinct, 15 s auditory cues. One cue indicated that impending foot-shocks could be avoided by pressing a lever (active avoidance), whereas another cue signaled that shocks could be avoided by withholding presses (inhibitory avoidance). In well-trained rats, pharmacological inactivation of either the NAcC or NAcS impaired active avoidance. In contrast, inhibitory avoidance was disrupted by inactivation of the NAcS, but not NAcC, reflecting a deficit in response-inhibition that manifested as more inhibitory avoidance failures and lever-presses, as well as increased locomotion. Foot-shock sensitivity was unaffected by inactivation of either subregion. In a subsequent experiment, treatment with the monoamine releaser d -amphetamine (1 mg/kg) did not affect active avoidance, but disinhibited lever pressing during inhibitory avoidance trials. These results provide novel insight into the ventral striatal and monoaminergic regulation of flexible response allocation and inhibition that facilitates avoidance behavior and highlight the importance of different subregions of the NAc in action selection during aversively-motivated behaviors.

Acute stress and corticotropin-releasing factor (CRF) have been show to perturb cost/benefit decision making involving effort costs. However, previous studies on how stress manipulations affect decisions involving reward uncertainty have yielded variable results. To provide additional insight into this issue, the current study investigated how central CRF infusion and acute restraint stress alter different forms of risk/reward decision-making guided by internal representations of risk/reward contingencies or external informative cues. Male rats were well-trained on one of two tasks that required choice between a small/certain or a large/risky reward. On a probabilistic discounting task, the probability of obtaining the larger reward increased or decreased systematically over blocks of trials (100–6.25%). On a cue-guided Blackjack task, reward probabilities (50% or 12.5%) were signaled by discriminative auditory cues. CRF (1 or 3 μg) was infused intracerebroventricularly (ICV) or one-hour of restraint stress was administered prior to behavioral testing. Neither CRF nor acute stress altered risky choice on probabilistic discounting, but did increase trial omissions in the latter part of the session. Conversely on the Blackjack task, CRF reduced risky choice on good-odds trials (50%), whereas acute stress increased reward sensitivity. CRF but not acute stress also slowed decision latencies across tasks. These data reveal complex and differential manners in which increased CRF activity and acute stress alter distinct forms of risk/reward decision-making, particularly those guided by external cues.

Many psychiatric disorders are associated with cognitive dysfunction that is ineffectively treated by existing pharmacotherapies and which may contribute to poor real-world functioning. D-cycloserine (DCS) is a partial N-methyl- D -aspartate (NMDA) agonist that has attracted attention because of its cognitive enhancing properties, including in people with post-traumatic stress disorder (PTSD). Here, we examined the effect of DCS on reversal learning - a type of cognitive flexibility – following exposure to single prolonged stress (SPS), a rodent model of PTSD . Male Sprague Dawley rats ( n = 64) were trained to press levers in an operant chamber, matched for performance and assigned to SPS or control (unstressed) groups. Following SPS, rats received three additional lever press sessions, followed by a side bias test on day three. One day later they learned a response discrimination rule (press left or right lever, opposite to side bias) and on a subsequent day were trained (and tested) for reversal to the opposite lever. DCS (15 mg/kg) or vehicle was administered 30 minutes prior to the reversal session. No between-group differences were found in acquisition or retrieval of the initial rule, but a significant drug x stress interaction on response discrimination reversal indicated that DCS had a greater beneficial effect on SPS rats’ cognitive flexibility than it did on performance in controls. These findings add to a growing literature on the beneficial effects of DCS for treating a wide variety of deficits that develop following exposure to extreme stress and may have implications for the development of novel pharmacotherapies for PTSD.

While the psychoactive inhalant toluene causes behavioral effects similar to those produced by other drugs of abuse, the persistent behavioral and anatomical abnormalities induced by toluene exposure are not well known. To mimic human “binge-like” inhalant intoxication, adolescent, male Sprague-Dawley rats were exposed to toluene vapor (5700 ppm) twice daily for five consecutive days. These rats remained in their home cages until adulthood (P60), when they were trained in operant boxes to respond to a palatable food reward and then challenged with several different cognitive tasks. Rats that experienced chronic exposure to toluene plus abstinence (“CTA”) showed enhanced performance in a strategy set-shifting task using a between-session, but not a within-session test design. CTA also blunted operant and classical conditioning without affecting responding during a progressive ratio task. While CTA rats displayed normal latent inhibition, previous exposure to a non-reinforced cue enhanced extinction of classically conditioned approach behavior of these animals compared to air controls. To determine whether CTA alters the structural plasticity of brain areas involved in set-shifting and appetitive behaviors, we quantified basal dendritic spine morphology in DiI-labeled pyramidal neurons in layer 5 of the medial prefrontal cortex (mPFC) and medium spiny neurons in the nucleus accumbens (NAc). There were no changes in dendritic spine density or subtype in the mPFC of CTA rats while NAc spine density was significantly increased due to an enhanced prevalence of long-thin spines. Together, these findings suggest that the persistent effects of CTA on cognition are related to learning and memory consolidation/recall, but not mPFC-dependent behavioral flexibility.

By probing the dependence on learning history or motivational significance of stimuli, Sharpe and colleagues reveal previously uncharacterized contributions of lateral hypothalamus GABA neurons to associative learning.

Both prefrontal cortex (PFC) GABAA and NMDA transmission regulate attentional processes, yet how they may differentially regulate signal detection or other aspects of attention is unclear. We examined PFC GABAA and NMDA receptor regulation of attention using a sustained attention task (SAT) permitting identification of distinct forms of impairments. As this task requires implementation of conditional rules, we also investigated how reducing PFC GABA transmission affected performance of visual and auditory conditional discriminations. Male rats were well-trained on the SAT that required identifying whether a brief visual stimulus (500–50 ms) was present/absent by pressing one of two levers. They then received intra-PFC infusions of the GABAA antagonist bicuculline (12.5–50 ng), the NMDA antagonist MK-801 (6 μg), and i.p. injections of MK-801 (0.1–0.3 mg/kg) prior to testing. Separate groups were trained either on a similar task where the visual stimulus was presented for 2.5 s, or a task where presentation of one of two auditory cues required responding on a left or right lever. Both doses of bicuculline impaired vigilance, selectively increasing errors during nonsignal trials. Intra-PFC MK-801 induced subtle impairments at short signal durations. Systemic MK-801 impaired performance and increased response latencies. Visual and auditory conditional discrimination was impaired by 50 ng, but not 12.5 ng of bicuculline. These findings highlight a key role for PFC GABA transmission in reducing sensitivity to distractors during attentional performance. Furthermore, they reveal that disruption of GABA signaling can interfere with the ability to implement conditional rules.

Mesocortical dopamine (DA) regulates a variety of cognitive functions via actions on D1 and/or D2 receptors. For example, risk/reward decision making is modulated differentially by these two receptors within the prefrontal cortex (PFC), with D2 receptors enabling flexible decision making and D1 receptors promoting persistence in choice biases. However, it is unclear how DA mediates opposing patterns of behavior by acting on different receptors within the same terminal region. We explored the possibility that DA may act on separate networks of PFC neurons that are modulated by D1 or D2 receptors and in turn interface with divergent downstream structures such as the basolateral amygdala (BLA) or nucleus accumbens (NAc). Decision making was assessed using a probabilistic discounting task in which well trained male rats chose between small/certain or large/risky rewards, with the odds of obtaining the larger reward changing systematically within a session. Selective disruption of D1 or D2 modulation of separate PFC output pathways was achieved using unilateral intra-PFC infusions of DA antagonists combined with contralateral inactivation of the BLA or NAc. Disrupting D2 (but not D1) modulation of PFC→BLA circuitry impaired adjustments in decision biases in response to changes in reward probabilities. In contrast, disrupting D1 modulation of PFC→NAc networks reduced risky choice, attenuating reward sensitivity and increasing sensitivity to reward omissions. These findings reveal that mesocortical DA can facilitate dissociable components of reward seeking and action selection by acting on different functional networks of PFC neurons that can be distinguished by the subcortical projection targets with which they interface.SIGNIFICANCE STATEMENT Prefrontal cortical dopamine regulates a variety of executive functions governed by the frontal lobes via actions on D1 and D2 receptors. These receptors can in some instances mediate different patterns of behavior, but the mechanisms underlying these dissociable actions are unclear. Using a selective disconnection approach, we reveal that D1 and D2 receptors can facilitate diverse aspects of decision making by acting on separate networks of prefrontal neurons that interface with distinct striatal or amygdalar targets. These findings reveal an additional level of complexity in how mesocortical DA regulates different forms of cognition via actions on different receptors, highlighting how it may act upon distinct cortical microcircuits to drive different patterns of behavior.

The involvement of different nodes within meso-cortico-limbic-striatal circuitry in mediating reward-seeking has been well described, yet comparatively less is known about how such circuitry may regulate appetitively-motivated behaviors that may be punished. The basolateral amygdala (BLA) is one nucleus that has been implicated in suppressing punished reward-seeking, and this structure can modulate goal-directed behavior via projections to subregions of the nucleus accumbens (NAc). Here, we examined the effects of reversible inactivations of the BLA, NAc Shell (NAcS), and core (NAcC) on performance of a "Conflict" task where rats pressed a lever for sucrose reinforcement during three distinct 5min phases. During the first and last phases of a session, rats lever-pressed for food reward delivered on a VI-15/FR5 schedule. In between these phases was a signaled "Conflict" period, where each lever-press yielded food, but 50% of presses were also punished with foot-shock. Under control conditions, well-trained rats responded vigorously during the two "safe" VI-15/FR5 periods, but reduced responding during the punished Conflict period. Inactivation of either the BLA or the NAcS via infusions of baclofen/muscimol disinhibited punished seeking, increasing lever-pressing during the conflict period, while attenuating pressing during VI-15/FR5 phases. In contrast, NAcC inactivation markedly decreased responding across all three phases. Similar inactivation of the BLA or NAcS did not alter responding in a separate control experiment where rats pressed for food on schedules identical to the Conflict task in the absence of any punishment, while NAcC inactivation again suppressed responding. These results imply that BLA and NAcS are part of a circuit that suppresses reward-seeking in the face of danger, which in turn may have implications for disorders characterized by punishment resistance, including substance abuse and obsessive-compulsive disorder.

As males age, systemic testosterone (T) levels decline. T regulates executive function, a collection of cognitive processes that are mediated by the mesocorticolimbic system. Here, we examined young adult (5 months) and aged (22 months) male Fischer 344 × Brown Norway rats, and measured systemic T levels in serum and local T levels in microdissected nodes of the mesocorticolimbic system (ventral tegmental area (VTA), nucleus accumbens (NAc), medial prefrontal cortex (mPFC), and orbitofrontal cortex (OFC)). We also measured androgen receptor (AR) immunoreactivity (-ir) in the mesocorticolimbic system. As expected, systemic T levels decreased with age. Local T levels in mesocorticolimbic regions – except the VTA – also decreased with age. Mesocorticolimbic T levels were higher than serum T levels at both ages. AR-ir was present in the VTA, NAc, mPFC, and OFC and decreased with age in the mPFC. Taken together with previous results, the data suggest that changes in androgen signaling may contribute to changes in executive function during aging.

Deficits in prefrontal cortex (PFC) GABAergic neurotransmission are linked to cognitive impairments seen in schizophrenia and other disorders, and pharmacological reduction of PFC GABA

Nucleus accumbens (NAc) dopamine (DA) plays an integral role in overcoming effort costs, as blockade of DThe current study explored how excessive stimulation of different DA receptors within the NAc core and shell alters effort-related decision-making and compared these effects to those induced by CRF stimulation.Male Long Evans rats were well-trained on an effort-discounting task wherein they choose between a low-effort/low-reward and a high-effort/high-reward lever where the effort requirement increased over blocks (2-20 presses). Dopamine DStimulation of DExcessive stimulation of NAc D

The neuropeptide, corticotropin-releasing factor (CRF), is a key modulator of physiological, endocrine, and behavioral responses during stress. Dysfunction of the CRF system has been observed in stress-related affective disorders including post-traumatic stress disorder, depression, and anxiety. Beyond affective symptoms, these disorders are also characterized by impaired cognition, for which current pharmacological treatments are lacking. Thus, there is a need for pro-cognitive treatments to improve quality of life for individuals suffering from mental illness. In this review, we highlight research demonstrating that CRF elicits potent modulatory effects on higher-order cognition via actions within the prefrontal cortex and subcortical monoaminergic and cholinergic systems. Additionally, we identify questions for future preclinical research on this topic, such as the need to investigate sex differences in the cognitive and microcircuit actions of CRF, and whether CRF may represent a pharmacological target to treat cognitive dysfunction. Addressing these questions will provide new insight into pathophysiology underlying cognitive dysfunction and may lead to improved treatments for neuropsychiatric disorders.

Decision making often requires weighing costs and benefits of different options that vary in terms of reward magnitude and uncertainty. Previous studies using pharmacological inactivations have shown that the basolateral amygdala (BLA) to nucleus accumbens (NAc) pathway promotes choice towards larger/riskier rewards. Neural activity in BLA and NAc shows distinct, phasic changes in firing prior to choice and following action outcomes, yet, how these temporally-discrete patterns of activity within BLA→NAc circuitry influence choice is unclear. We assessed how optogenetic silencing of BLA terminals in the NAc altered action selection during probabilistic decision making. Rats received intra-BLA infusions of viruses encoding the inhibitory opsin eArchT and were well trained on a probabilistic discounting task, where they chose between smaller/certain rewards and larger rewards delivered in a probabilistic manner, with the odds of obtaining the larger reward changing over a session (50–12.5%). During testing, activity of BLA→NAc inputs were suppressed with 4- to 7-s pulses of light delivered via optic fibers into the NAc during discrete task events: prior to choice or after choice outcomes. Inhibition prior to choice reduced selection of the preferred option, suggesting that during deliberation, BLA→NAc activity biases choice towards preferred rewards. Inhibition during reward omissions increased risky choice during the low-probability block, indicating that activity after non-rewarded actions serves to modify subsequent choice. In contrast, silencing during rewarded outcomes did not reliably affect choice. These data demonstrate how patterns of activity in BLA→NAc circuitry convey different types of information that guide action selection in situations involving reward uncertainty.

Optimal decision making involving reward uncertainty is integral to adaptive goal-directed behavior. In some instances, these decisions are guided by internal representations of reward history, whereas in other situations, external cues inform a decision maker about how likely certain actions are to yield reward. Different regions of the frontal lobe form distributed networks with striatal and amygdalar regions that facilitate different types of risk/reward decision making. The dorsal medial striatum (DMS) is one key output region of the prefrontal cortex, yet there have been few preclinical studies investigating the involvement of the DMS in different forms of risk/reward decision making. The present study addressed this issue, wherein separate groups of male rats were trained on one of two tasks where they chose between a small/certain or a large/risky reward. In a probabilistic discounting task, reward probabilities changed systematically over blocks of trials (100-6.25% or 6.25-100%), requiring rats to use internal representations of reward history to guide choice. Cue-guided decision-making was assessed with a "Blackjack" task, where different auditory cues indicated the odds associated with the large/risky option (50 or 12.5%). Inactivation of the DMS with GABA agonists impaired adjustments in choice biases during probabilistic discounting, resulting in either increases or decreases in risky choice as the probabilities associated with the large/risky reward decreased or increased over a session. In comparison, DMS inactivation increased risky choices on poor-odds trials on the Blackjack task, which was associated with a reduced impact that non-rewarded choices had on subsequent choices. DMS inactivation also impaired performance of an auditory conditional discrimination. These findings highlight a previously uncharacterized role for the DMS in facilitating flexible action selection during multiple forms of risk/reward decision making.

Repeated binge-like exposure to alcohol during adolescence has been reported to perturb prefrontal cortical development, yet the mechanisms underlying these effects are unknown. Here we report that adolescent intermittent ethanol exposure induces cellular and dopaminergic abnormalities in the adult prelimbic cortex (PrL-C). Exposing rats to alcohol during early-mid adolescence (PD28–42) increased the density of long/thin dendritic spines of layer 5 pyramidal neurons in the adult PrL-C. Interestingly, although AIE exposure did not alter the expression of glutamatergic proteins in the adult PrL-C, there was a pronounced reduction in dopamine (DA) D1 receptor modulation of both intrinsic firing and evoked NMDA currents in pyramidal cells, whereas D2 receptor function was unaltered. Recordings from fast-spiking interneurons also revealed that AIE reduced intrinsic excitability, glutamatergic signaling, and D1 receptor modulation of these cells. Analysis of PrL-C tissue of AIE-exposed rats further revealed persistent changes in the expression of DA-related proteins, including reductions in the expression of tyrosine hydroxylase and catechol-O-methyltransferase (COMT). AIE exposure was associated with hypermethylation of the COMT promoter at a conserved CpG site in exon II. Taken together, these findings demonstrate that AIE exposure disrupts DA and GABAergic transmission in the adult medial prefrontal cortex (mPFC). As DA and GABA work in concert to shape and synchronize neuronal ensembles in the PFC, these alterations could contribute to deficits in behavioral control and decision-making in adults who abused alcohol during adolescence.