Search

Maladaptive decision-making is a hallmark of substance use disorders (SUDs), though how drugs of abuse alter neural representations supporting adaptive behavior remains poorly understood. Past studies show that the orbitofrontal (OFC) and prelimbic (PL) cortices are important for decision-making, tracking both task-relevant and latent information. However, previous studies have focused on how drugs of abuse impact the firing rates of individual units. More work at the ensemble level is necessary to accurately characterize potential drug-induced changes. Using single-unit recordings in rats during a multidimensional decision-making task and then applying population- and ensemble-level analyses, we show that prior use of cocaine altered the strength and structure of task-relevant and latent representations in the OFC, changes relatable to suboptimal decision-making in this and perhaps other settings. These data expand our understanding of the neuropathological underpinnings of maladaptive decision-making in SUDs, potentially enabling enhanced future treatment strategies., Competing Interests: Declaration of interests The authors declare no competing interests., (Published by Elsevier Inc.)

The orbitofrontal cortex (OFC) and hippocampus (HC) both contribute to the cognitive maps that support flexible behavior. Previously, we used the dopamine neurons to measure the functional role of OFC. We recorded midbrain dopamine neurons as rats performed an odor-based choice task, in which expected rewards were manipulated across blocks. We found that ipsilateral OFC lesions degraded dopaminergic prediction errors, consistent with reduced resolution of the task states. Here we have repeated this experiment in male rats with ipsilateral HC lesions. The results show HC also shapes the task states, however unlike OFC, which provides information local to the trial, the HC is necessary for estimating upper-level hidden states that distinguish blocks. The results contrast the roles of the OFC and HC in cognitive mapping and suggest that the dopamine neurons access rich information from distributed regions regarding the environment's structure, potentially enabling this teaching signal to support complex behaviors., (© 2024. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

Recent work across species has shown that midbrain dopamine neurons signal not only errors in the prediction of reward value but also in the prediction of value-neutral sensory features. To support learning of associative structures in downstream areas, identity prediction errors (iPEs) should signal specific information about the mis-predicted outcome. Here, we used pattern-based analysis of functional magnetic resonance imaging (fMRI) data acquired during reversal learning to characterize the information content of iPE responses in the human midbrain. We find that fMRI responses to value-neutral identity errors contain information about the identity of the unexpectedly received reward (positive iPE+) but not about the identity of the omitted reward (negative iPE-). Exploratory analyses revealed representations of iPE- in the dorsomedial prefrontal cortex. These results demonstrate that ensemble midbrain responses to value-neutral identity errors convey information about the identity of unexpectedly received outcomes, which could shape the formation of novel stimulus-outcome associations that constitute cognitive maps., Competing Interests: Declaration of interests The authors declare no competing interests., (Published by Elsevier Inc.)

The orbitofrontal cortex (OFC) is crucial for tracking various aspects of expected outcomes, thereby helping to guide choices and support learning. Our previous study showed that the effects of reward timing and size on the activity of single units in OFC were dissociable when these attributes were manipulated independently ( Roesch et al., 2006). However, in real-life decision-making scenarios, outcome features often change simultaneously, so here we investigated how OFC neurons in male rats integrate information about the timing and identity (flavor) of reward and respond to changes in these features, according to whether they were changed simultaneously or separately. We found that a substantial number of OFC neurons fired differentially to immediate versus delayed reward and to the different reward flavors. However, contrary to the previous study, selectivity for timing was strongly correlated with selectivity for identity. Taken together with the previous research, these results suggest that when reward features are correlated, OFC tends to "pack" them into unitary constructs, whereas when they are independent, OFC tends to "crack" them into separate constructs. Furthermore, we found that when both reward timing and flavor were changed, reward-responsive OFC neurons showed unique activity patterns preceding and during the omission of an expected reward. Interestingly, this OFC activity is similar and slightly preceded the ventral tegmental area dopamine (VTA DA) activity observed in a previous study ( Takahashi et al., 2023), consistent with the role of OFC in providing predictive information to VTA DA neurons., Competing Interests: The authors declare no competing financial interests., (Copyright © 2024 the authors.)

Chronic psychostimulant use causes long-lasting changes to neural and cognitive function that persist after long periods of abstinence. As cocaine users transition from drug use to abstinence, a parallel transition from hyperactivity to hypoactivity has been found in orbitofrontal-striatal glucose metabolism and striatal D 2 /D 3 -receptor activity. Targeting these changes pharmacologically, using highly selective dopamine D 3 -receptor (D 3 R) antagonists and partial agonists, has shown promise in reducing drug-taking, and attenuating relapse in animal models of cocaine and opioid use disorder. However, much less attention has been paid to treating the loss of insight, operationalized as the inability to infer likely outcomes, associated with chronic psychostimulant use. Here we tested the selective D 3 R antagonist VK4-116 as a treatment for this loss in rats with a prior history of cocaine use. Male and female rats were first trained to self-administer cocaine or a sucrose liquid for 2 weeks. After 4 weeks of abstinence, performance was assessed using a sensory preconditioning (SPC) learning paradigm. Rats were given VK4-116 (15 mg/kg, i.p.) or vehicle 30 min prior to each SPC training session, thus creating four drug-treatment groups: sucrose-vehicle, sucrose-VK4-116, cocaine-vehicle, cocaine-VK4-116. The control groups (sucrose-vehicle, sucrose-VK4-116) showed normal sensory preconditioning, whereas cocaine use (cocaine-vehicle) selectively disrupted responding to the preconditioned cue, an effect that was reversed in the cocaine-VK4-116 group, which demonstrating responding to the preconditioned cue at levels comparable to controls. These preclinical findings demonstrate that highly selective dopamine D 3 R antagonists, particularly VK4-116, can reverse the long-term negative behavioral consequences of cocaine use., (© 2024. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

Impaired insight in substance use disorder has been argued to reflect a global deficit in using cognitive models to mentally simulate possible future outcomes. The process of mentally simulating outcomes allows us to understand our beliefs about their causes, that is, to have insight and thereby avoid potentially negative outcomes. However, work in humans cannot address whether impaired insight and its neural/neurochemical sequalae are present prior to the development of a substance use disorder, a consequence of substance use, or a combination of both. This is because baseline measurements prior to drug use are not possible in humans. However, if these changes can be directly caused by drug use, then in animal models, a history of drug use should cause impairments in behavioral tasks designed to assess such inferences. Focusing on cocaine use, here we will review several lines of research from our laboratory that have tested this question using learning-theory tasks designed to isolate insight. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Cue reactivity is the maladaptive neurobiological and behavioral response upon exposure to drug cues and is a major driver of relapse. The leading hypothesis is that dopamine release by addictive drugs represents a persistently positive reward prediction error that causes runaway enhancement of dopamine responses to drug cues, leading to their pathological overvaluation compared to non-drug reward alternatives. However, this hypothesis has not been directly tested. Here we developed Pavlovian and operant procedures to measure firing responses, within the same dopamine neurons, to drug versus natural reward cues, which we found to be similarly enhanced compared to cues predicting natural rewards in drug-naïve controls. This enhancement was associated with increased behavioral reactivity to the drug cue, suggesting that dopamine release is still critical to cue reactivity, albeit not as previously hypothesized. These results challenge the prevailing hypothesis of cue reactivity, warranting new models of dopaminergic function in drug addiction, and provide critical insights into the neurobiology of cue reactivity with potential implications for relapse prevention.

When rats are given discrete choices between social interactions with a peer and opioid or psychostimulant drugs, they choose social interaction, even after extensive drug self-administration experience. Studies show that like drug and nondrug food reinforcers, social interaction is an operant reinforcer and induces dopamine release. However, these studies were conducted with same-sex peers. We examined if peer sex influences operant social interaction and the role of estrous cycle and striatal dopamine in same- versus opposite-sex social interaction. We trained male and female rats ( n  = 13 responders/12 peers) to lever-press (fixed-ratio 1 [FR1] schedule) for 15 s access to a same- or opposite-sex peer for 16 d (8 d/sex) while tracking females' estrous cycle. Next, we transfected GRAB-DA2m and implanted optic fibers into nucleus accumbens (NAc) core and dorsomedial striatum (DMS). We then retrained the rats for 15 s social interaction (FR1 schedule) for 16 d (8 d/sex) and recorded striatal dopamine during operant responding for a peer for 8 d (4 d/sex). Finally, we assessed economic demand by manipulating FR requirements for a peer (10 d/sex). In male, but not female rats, operant responding was higher for the opposite-sex peer. Female's estrous cycle fluctuations had no effect on operant social interaction. Striatal dopamine signals for operant social interaction were dependent on the peer's sex and striatal region (NAc core vs DMS). Results indicate that estrous cycle fluctuations did not influence operant social interaction and that NAc core and DMS dopamine activity reflect sex-dependent features of volitional social interaction., Competing Interests: The authors declare no competing financial interests., (Copyright © 2024 the authors.)

Outcome-guided behavior requires knowledge about the identity of future rewards. Previous work across species has shown that the dopaminergic midbrain responds to violations in expected reward identity and that the lateral orbitofrontal cortex (OFC) represents reward identity expectations. Here we used network-targeted transcranial magnetic stimulation (TMS) and functional magnetic resonance imaging (fMRI) during a trans-reinforcer reversal learning task to test the hypothesis that outcome expectations in the lateral OFC contribute to the computation of identity prediction errors (iPE) in the midbrain. Network-targeted TMS aiming at lateral OFC reduced the global connectedness of the lateral OFC and impaired reward identity learning in the first block of trials. Critically, TMS disrupted neural representations of expected reward identity in the OFC and modulated iPE responses in the midbrain. These results support the idea that iPE signals in the dopaminergic midbrain are computed based on outcome expectations represented in the lateral OFC., (© 2024. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

The orbitofrontal cortex (OFC) is often proposed to function as a value integrator; however, alternative accounts focus on its role in representing associative structures that specify the probability and sensory identity of future outcomes. These two accounts make different predictions about how this area should respond to conditioned inhibitors of reward, since in the former, neural activity should reflect the negative value of the inhibitor, whereas in the latter, it should track the estimated probability of a future reward based on all cues present. Here, we assessed these predictions by recording from small groups of neurons in the lateral OFC of rats during training in a conditioned inhibition design. Rats showed negative summation when the inhibitor was compounded with a novel excitor, suggesting that they learned to respond to the conditioned inhibitor appropriately. Against this backdrop, we found unit and population responses that scaled with expected reward value on excitor + inhibitor compound trials. However, the responses of these neurons did not differentiate between the conditioned inhibitor and a neutral cue when both were presented in isolation. Further, when the ensemble patterns were analyzed, activity to the conditioned inhibitor did not classify according to putative negative value. Instead, it classified with a same-modality neutral cue when presented alone and as a unique item when presented in compound with a novel excitor. This pattern of results supports the notion that OFC encodes a model of the causal structure of the environment rather than either the modality or the value of cues., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Published by Elsevier Inc.)

Individuals are often faced with multiple cues that concurrently predict the same outcome, and combining these predictions may benefit behavior. Previous work has studied the neural basis of decision-making, predominantly using isolated sensory stimuli, and so the mechanisms that allow us to leverage multiple cues remain unclear. In two experiments, we used neuroimaging and network-targeted brain stimulation to probe how the brain integrates outcome predictions to guide adaptive behavior. We identified neural signatures of outcome integration in the lateral orbitofrontal cortex (OFC), where concurrently presented cues evoke stronger pattern-based representations of expected outcomes. Moreover, perturbing lateral OFC network activity impairs subjects' ability to leverage predictions from multiple cues to facilitate responding. Intriguingly, we found similar behavioral and brain mechanisms for reward-predicting cues and for cues predicting the absence of reward. These findings highlight a causal role for the lateral OFC in utilizing outcome predictions from multiple cues to guide behavior., Competing Interests: Declaration of interests The authors declare no competing interests., (Published by Elsevier Inc.)

Dopamine neuron activity is tied to the prediction error in temporal difference reinforcement learning models. These models make significant simplifying assumptions, particularly with regard to the structure of the predictions fed into the dopamine neurons, which consist of a single chain of timepoint states. Although this predictive structure can explain error signals observed in many studies, it cannot cope with settings where subjects might infer multiple independent events and outcomes. In the present study, we recorded dopamine neurons in the ventral tegmental area in such a setting to test the validity of the single-stream assumption. Rats were trained in an odor-based choice task, in which the timing and identity of one of several rewards delivered in each trial changed across trial blocks. This design revealed an error signaling pattern that requires the dopamine neurons to access and update multiple independent predictive streams reflecting the subject's belief about timing and potentially unique identities of expected rewards., (© 2023. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

We use mental models of the world-cognitive maps-to guide behavior. The lateral orbitofrontal cortex (lOFC) is typically thought to support behavior by deploying these maps to simulate outcomes, but recent evidence suggests that it may instead support behavior by underlying map creation. We tested between these two alternatives using outcome-specific devaluation and a high-potency chemogenetic approach. Selectively inactivating lOFC principal neurons when male rats learned distinct cue-outcome associations, but before outcome devaluation, disrupted subsequent inference, confirming a role for the lOFC in creating new maps. However, lOFC inactivation surprisingly led to generalized devaluation, a result that is inconsistent with a complete mapping failure. Using a reinforcement learning framework, we show that this effect is best explained by a circumscribed deficit in credit assignment precision during map construction, suggesting that the lOFC has a selective role in defining the specificity of associations that comprise cognitive maps., (© 2022. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

Recording action potentials extracellularly during behavior has led to fundamental discoveries regarding neural function-hippocampal neurons respond to locations in space, 1 motor cortex neurons encode movement direction, 2 and dopamine neurons signal reward prediction errors 3 -observations undergirding current theories of cognition, 4 movement, 5 and learning. 6 Recently it has become possible to measure calcium flux, an internal cellular signal related to spiking. The ability to image calcium flux in anatomically 7 , 8 or genetically 9 identified neurons can extend our knowledge of neural circuit function by allowing activity to be monitored in specific cell types or projections, or in the same neurons across many days. However, while initial studies were grounded in prior unit recording work, it has become fashionable to assume that calcium is identical to spiking, even though the spike-to-fluorescence transformation is nonlinear, noisy, and unpredictable under real-world conditions. 10 It remains an open question whether calcium provides a high-fidelity representation of single-unit activity in awake, behaving subjects. Here, we have addressed this question by recording both signals in the lateral orbitofrontal cortex (OFC) of rats during olfactory discrimination learning. Activity in the OFC during olfactory learning has been well-studied in humans, 11 , 12 , 13 , 14 nonhuman primates, 15 , 16 and rats, 17 , 18 , 19 , 20 , 21 where it has been shown to signal information about both the sensory properties of odor cues and the rewards they predict. Our single-unit results replicated prior findings, whereas the calcium signal provided only a degraded estimate of the information available in the single-unit spiking, reflecting primarily reward value., Competing Interests: Declaration of interests The authors declare no competing interests., (Published by Elsevier Inc.)

Dopamine was first described by George Barger, James Ewens, and Henry Dale in 1910 as an epinephrine-like monoamine compound. Initially believed to be a mere precursor of norepinephrine, it was mostly ignored for the next four decades (Figure 1A). However, in the 1950s Kathleen Montagu showed that dopamine occurred in the brain by itself, and a series of studies by Arvid Carlsson and collaborators demonstrated that dopamine is a bona fide neurotransmitter, a finding that would earn Carlsson the 2000 Nobel Prize in Physiology and Medicine. In a landmark experiment, he pharmacologically blocked all dopamine neurotransmission in rabbits, which rendered them completely paralyzed, and then fully recovered their behavior with an injection of the dopamine precursor L-DOPA, demonstrating that dopamine was essential for self-initiated movement (Figure 1B). A similar effect was quickly reproduced by Oleg Hornykiewicz and collaborators in human Parkinsonian patients. Within a few years, dopamine jumped from relative obscurity to being critical for life as we know it., Competing Interests: Declaration of interests The authors declare no competing interests., (Published by Elsevier Inc.)

Studies investigating the neural mechanisms by which associations between cues and predicted outcomes control behavior often use associative learning frameworks to understand the neural control of behavior. These frameworks do not always account for the full range of effects that novelty can have on behavior and future associative learning. Here, in mice, we show that dopamine in the nucleus accumbens core is evoked by novel, neutral stimuli, and the trajectory of this response over time tracked habituation to these stimuli. Habituation to novel cues before associative learning reduced future associative learning, a phenomenon known as latent inhibition. Crucially, trial-by-trial dopamine response patterns tracked this phenomenon. Optogenetic manipulation of dopamine responses to the cue during the habituation period bidirectionally influenced future associative learning. Thus, dopamine signaling in the nucleus accumbens core has a causal role in novelty-based learning in a way that cannot be predicted based on purely associative factors., (© 2022. The Author(s), under exclusive licence to Springer Nature America, Inc.)

There is no single way to represent a task. Indeed, despite experiencing the same task events and contingencies, different subjects may form distinct task representations. As experimenters, we often assume that subjects represent the task as we envision it. However, such a representation cannot be taken for granted, especially in animal experiments where we cannot deliver explicit instruction regarding the structure of the task. Here, we tested how rats represent an odor-guided choice task in which two odor cues indicated which of two responses would lead to reward, whereas a third odor indicated free choice among the two responses. A parsimonious task representation would allow animals to learn from the forced trials what is the better option to choose in the free-choice trials. However, animals may not necessarily generalize across odors in this way. We fit reinforcement-learning models that use different task representations to trial-by-trial choice behavior of individual rats performing this task, and quantified the degree to which each animal used the more parsimonious representation, generalizing across trial types. Model comparison revealed that most rats did not acquire this representation despite extensive experience. Our results demonstrate the importance of formally testing possible task representations that can afford the observed behavior, rather than assuming that animals' task representations abide by the generative task structure that governs the experimental design., Competing Interests: The authors have declared that no competing interests exist.