Search

Beliefs-attitudes toward some state of the environment-guide action selection and should be robust to variability but sensitive to meaningful change. Beliefs about volatility (expectation of change) are associated with paranoia in humans, but the brain regions responsible for volatility beliefs remain unknown. The orbitofrontal cortex (OFC) is central to adaptive behavior, whereas the magnocellular mediodorsal thalamus (MDmc) is essential for arbitrating between perceptions and action policies. We assessed belief updating in a three-choice probabilistic reversal learning task following excitotoxic lesions of the MDmc (n = 3) or OFC (n = 3) and compared performance with that of unoperated monkeys (n = 14). Computational analyses indicated a double dissociation: MDmc, but not OFC, lesions were associated with erratic switching behavior and heightened volatility belief (as in paranoia in humans), whereas OFC, but not MDmc, lesions were associated with increased lose-stay behavior and reward learning rates. Given the consilience across species and models, these results have implications for understanding paranoia., Competing Interests: Declaration of interests P.R.C. is a cofounder of Tetricus Labs Inc., which did not fund this work., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

Clinical investigations suggest involvement of the metabotropic glutamate receptor 5 (mGluR5) in the pathophysiology of fear learning that underlies trauma-related disorders. Here, we utilized a 4-day fear learning paradigm combined with positron emission tomography (PET) to examine the relationship between mGluR5 availability and differences in the response of rats to repeated footshock exposure (FE). Specifically, on day 1, male (n = 16) and female (n = 12) rats received 15 footshocks and were compared with control rats who did not receive footshocks (n = 7 male; n = 4 female). FE rats were classified as low responders (LR) or high responders (HR) based on freezing to the context the following day (day 2). PET with [ 18 F]FPEB was used to calculate regional mGluR5 binding potential (BP ND ) at two timepoints: prior to FE (i.e., baseline), and post-behavioral testing. Additionally, we used an unbiased proteomics approach to assess group and sex differences in prefrontal cortex (PFC) protein expression. Post-behavioral testing we observed decreased BP ND in LR females, but increased BP ND in HR males relative to baseline. Further, individuals displaying the greatest freezing during the FE context memory test had the largest increases in PFC BP ND . Males and females displayed unique post-test molecular profiles: in males, the greatest differences were between FE and CON, including upregulation of mGluR5 and related molecular networks in FE, whereas the greatest differences among females were between the LR and HR groups. These findings suggest greater mGluR5 availability increases following footshock exposure may be related to greater contextual fear memory. Results additionally reveal sex differences in the molecular response to footshock, including differential involvement of mGluR5-related molecular networks., (© 2022. The Author(s), under exclusive licence to American College of Neuropsychopharmacology.)

Model-free and model-based computations are argued to distinctly update action values that guide decision-making processes. It is not known, however, if these model-free and model-based reinforcement learning mechanisms recruited in operationally based instrumental tasks parallel those engaged by pavlovian-based behavioral procedures. Recently, computational work has suggested that individual differences in the attribution of incentive salience to reward predictive cues, that is, sign- and goal-tracking behaviors, are also governed by variations in model-free and model-based value representations that guide behavior. Moreover, it is not appreciated if these systems that are characterized computationally using model-free and model-based algorithms are conserved across tasks for individual animals. In the current study, we used a within-subject design to assess sign-tracking and goal-tracking behaviors using a pavlovian conditioned approach task and then characterized behavior using an instrumental multistage decision-making (MSDM) task in male rats. We hypothesized that both pavlovian and instrumental learning processes may be driven by common reinforcement-learning mechanisms. Our data confirm that sign-tracking behavior was associated with greater reward-mediated, model-free reinforcement learning and that it was also linked to model-free reinforcement learning in the MSDM task. Computational analyses revealed that pavlovian model-free updating was correlated with model-free reinforcement learning in the MSDM task. These data provide key insights into the computational mechanisms mediating associative learning that could have important implications for normal and abnormal states. SIGNIFICANCE STATEMENT Model-free and model-based computations that guide instrumental decision-making processes may also be recruited in pavlovian-based behavioral procedures. Here, we used a within-subject design to test the hypothesis that both pavlovian and instrumental learning processes were driven by common reinforcement-learning mechanisms. Sign-tracking and goal-tracking behaviors were assessed in rats using a pavlovian conditioned approach task, and then instrumental behavior was characterized using an MSDM task. We report that sign-tracking behavior was associated with greater model-free, but not model-based, learning in the MSDM task. These data suggest that pavlovian and instrumental behaviors may be driven by conserved reinforcement-learning mechanisms., (Copyright © 2023 the authors.)

The anatomical, structural, and functional adaptations that occur in the brain during adolescence are thought to facilitate improvements in decision-making functions that are known to occur during this stage of development. The mechanisms that underlie these neural adaptations are not known, but deviations in developmental trajectories have been proposed to contribute to the emergence of mental illness, including addiction. Direct evidence supporting this hypothesis, however, has been limited. Here, we used a recently developed reversal-learning protocol to investigate the predictive relationship between adolescent decision-making trajectories and cocaine-taking behaviors in adulthood. Decision-making functions in the reversal-learning task were assessed throughout adolescence and into adulthood in male and female Long-Evans rats. Trial-by-trial choice data was fitted with a reinforcement-learning model to quantify the degree to which choice behavior of individual rats was influenced by rewarded (e.g., ∆ + parameter) and unrewarded (e.g., ∆ 0 parameter) outcomes. We report that reversal-learning performance improved during adolescence and that this was due to an increase in value updating for rewarded outcomes (e.g., ∆ + parameter). Furthermore, the rate of change in the ∆ + parameter predicted individual differences in the ∆ + parameter and, notably, cocaine-taking behaviors in adulthood: Rats that had a shallower adolescent trajectory were found to have a lower ∆ + parameter and greater cocaine self-administration in adulthood. These data indicate that adolescent development plays a critical role in drug use susceptibility. Future studies aimed at understanding the neurobiological mechanisms that underlie these age-related changes in decision-making could provide new insights into the biobehavioral mechanisms mediating addiction susceptibility., (© 2022. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.)

Despite increased survivability for people living with HIV (PLWH), HIV-related cognitive deficits persist. Determining biological mechanism(s) underlying abnormalities is critical to minimize the long-term impact of HIV. Positron emission tomography (PET) studies reveal that PLWH exhibit elevated neuroinflammation, potentially contributing to these problems. PLWH are hypersensitive to environmental insults that drive elevated inflammatory profiles. Gp120 is an envelope glycoprotein exposed on the surface of the HIV envelope which enables HIV entry into a cell contributing to HIV-related neurotoxicity. In vivo evidence for mice overexpressing gp120 (transgenic) mice exhibiting neuroinflammation remains unclear. Here, we conducted microPET imaging in gp120 transgenic and wildtype mice, using the radiotracer [(18)F]FEPPA (binds to the translocator protein expressed by activated microglial serving as a neuroinflammatory marker). Imaging was performed at baseline and 24 h after lipopolysaccharide (LPS; 5 mg/kg) treatment (endotoxin that triggers an immune response). Gp120 transgenic mice exhibited elevated [(18F)]FEPPA in response to LPS vs. wildtype mice throughout the brain including dorsal and ventral striata, hypothalamus, and hippocampus. Gp120 transgenic mice are hypersensitive to environmental inflammatory insults, consistent with PLWH, measurable in vivo. It remains to-be-determined whether this heightened sensitivity is connected to the behavioral abnormalities of these mice or sensitive to any treatments., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Emerging data indicate that endocannabinoid signaling is critical to the formation of habitual behavior. Previous work demonstrated that antagonism of cannabinoid receptor type 1 (CB1R) with AM251 during operant training impairs habit formation, but it is not known if this behavioral effect is specific to disrupted signaling of the endocannabinoid ligands anandamide or 2-arachidonoyl glycerol (2-AG). Here, we used selective pharmacological compounds during operant training to determine the impact of fatty acid amide hydrolase (FAAH) inhibition to increase anandamide (and other n-acylethanolamines) or monoacylglycerol lipase (MAGL) inhibition to increase 2-AG levels on the formation of habitual behaviors in mice using a food-reinforced contingency degradation procedure. We found, contrary to our hypothesis, that inhibition of FAAH and of MAGL disrupted the formation of habits. Next, AM251 was administered during training to verify that impaired habit formation could be assessed using contingency degradation. AM251-exposed mice responded at lower rates during training and at higher rates in the test. To understand the inconsistency with published data, we performed a proof-of-principle dose-response experiment to compare AM251 in our vehicle-solution to the published vehicle-suspension on response rates. We found consistent reductions in response rate with increasing doses of AM251 in solution and an inconsistent dose-response relationship with AM251 in suspension. Together, our data suggest that further characterization of the role of CB1R signaling in the formation of habitual responding is warranted and that augmenting endocannabinoids may have clinical utility for prophylactically preventing aberrant habit formation such as that hypothesized to occur in substance use disorders., (© 2021 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Suboptimal decision-making strategies have been proposed to contribute to the pathophysiology of addiction. Decision-making, however, arises from a collection of computational components that can independently influence behavior. Disruptions in these different components can lead to decision-making deficits that appear similar behaviorally, but differ at the computational, and likely the neurobiological, level. Here, we discuss recent studies that have used computational approaches to investigate the decision-making processes underlying addiction. Studies in animal models have found that value updating following positive, but not negative, outcomes is predictive of drug use, whereas value updating following negative, but not positive, outcomes is disrupted following drug self-administration. We contextualize these findings with studies on the circuit and biological mechanisms of decision-making to develop a framework for revealing the biobehavioral mechanisms of addiction., Competing Interests: Declaration of interests The authors declare no competing interests in relation to this work., (Copyright © 2021 Elsevier Ltd. All rights reserved.)

The COVID-19 pandemic has made the world seem less predictable. Such crises can lead people to feel that others are a threat. Here, we show that the initial phase of the pandemic in 2020 increased individuals' paranoia and made their belief updating more erratic. A proactive lockdown made people's belief updating less capricious. However, state-mandated mask-wearing increased paranoia and induced more erratic behaviour. This was most evident in states where adherence to mask-wearing rules was poor but where rule following is typically more common. Computational analyses of participant behaviour suggested that people with higher paranoia expected the task to be more unstable. People who were more paranoid endorsed conspiracies about mask-wearing and potential vaccines and the QAnon conspiracy theories. These beliefs were associated with erratic task behaviour and changed priors. Taken together, we found that real-world uncertainty increases paranoia and influences laboratory task behaviour., (© 2021. The Author(s), under exclusive licence to Springer Nature Limited.)

Neuroimaging studies have consistently identified the orbitofrontal cortex (OFC) as being affected in individuals with neuropsychiatric disorders. OFC dysfunction has been proposed to be a key mechanism by which decision-making impairments emerge in diverse clinical populations, and recent studies employing computational approaches have revealed that distinct reinforcement-learning mechanisms of decision-making differ among diagnoses. In this perspective, we propose that these computational differences may be linked to select OFC circuits and present our recent work that has used a neurocomputational approach to understand the biobehavioral mechanisms of addiction pathology in rodent models. We describe how combining translationally analogous behavioral paradigms with reinforcement-learning algorithms and sophisticated neuroscience techniques in animals can provide critical insights into OFC pathology in biobehavioral disorders. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Background: Compulsive patterns of drug use are thought to be the consequence of drug-induced adaptations in the neural mechanisms that enable behavior to be flexible. Neuroimaging studies have found evidence of robust alterations in glutamate and dopamine receptors within brain regions that are known to be critical for decision-making processes in cocaine-dependent individuals, and these changes have been argued to be the consequence of persistent drug use. The causal relationships among drug-induced alterations, cocaine taking, and maladaptive decision-making processes, however, are difficult to establish in humans., Methods: We assessed decision making in adult male rats using a probabilistic reversal learning task and used positron emission tomography with the [ 11 C]-(+)-PHNO and [ 18 F]FPEB radioligands to quantify regional dopamine D 2/3 and metabotropic glutamate 5 (mGlu5) receptor availability, respectively, before and after 21 days of cocaine or saline self-administration. Tests of motivation and relapse-like behaviors were also conducted., Results: We found that self-administration of cocaine, but not of saline, disrupted behavior in the probabilistic reversal learning task measured by selective impairments in negative-outcome updating and also increased cortical mGlu5 receptor availability following 2 weeks of forced abstinence. D 2/3 and, importantly, midbrain D 3 receptor availability was not altered following 2 weeks of abstinence from cocaine. Notably, the degree of the cocaine-induced increase in cortical mGlu5 receptor availability was related to the degree of disruption in negative-outcome updating., Conclusions: These findings suggest that cocaine-induced changes in mGlu5 signaling may be a mechanism by which disruptions in negative-outcome updating emerge in cocaine-dependent individuals., (Copyright © 2020 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.)

Background: Results from neuroimaging studies suggest that disruptions in flexible decision-making functions in substance-dependent individuals are a consequence of drug-induced neural adaptations. In addicted populations, however, the causal relationship between biobehavioral phenotypes of susceptibility and addiction consequence is difficult to dissociate. Indeed, evidence from animals suggests that poor decision making due to preexisting biological factors can independently enhance the risk for developing addiction-like behaviors. Neuroimaging studies in animals provide a unique translational approach for the identification of the neurobiological mechanisms that mediate susceptibility to addiction., Methods: We used positron emission tomography in rats to quantify regional dopamine D 2/3 receptors and metabotropic glutamate receptor 5 (mGluR5) and assessed decision making using a probabilistic reversal learning task. Susceptibility to self-administer cocaine was then quantified for 21 days followed by tests of motivation and relapse-like behaviors., Results: We found that deficits specifically in reward-guided choice behavior on the probabilistic reversal learning task predicted greater escalation of cocaine self-administration behavior and greater motivation for cocaine and, critically, were associated with higher midbrain D 3 receptor availability. Additionally, individual differences in midbrain D 3 receptor availability independently predicted the rate of escalation in cocaine-taking behaviors. No differences in mGluR5 availability, responses during tests of extinction, or cue-induced reinstatement were observed between the groups., Conclusions: These findings indicate that our identified D 3 -mediated decision-making phenotype can be used as a behavioral biomarker for assessment of cocaine use susceptibility in human populations., (Copyright © 2020 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.)

The survival of an organism depends on the ability to make adaptive decisions to achieve the needs of the organism: where to get food, who to mate with, and how to evade predators. Decision-making is a term used to describe a collection of behavioral and/or computational functions that guide the selection of an option amongst a set of alternatives. Some of these functions may include calculating the costs and benefits of a particular action, evaluating differences in value of each of the alternative outcomes and the likelihood of receiving a particular outcome, using past experiences to generate predictions or expectations about action-outcome associations, and/or integration of past experiences to make novel inferences that can be used in new environments. There is considerable interest in understanding the neurobiological mechanisms that mediate these decision-making functions and recent advances in behavioral approaches, neuroscience techniques, and neuroimaging measures have begun to develop mechanistic links between biology, reward, and decision making. This multidisciplinary work holds great promise for elucidating the biological mechanisms mediating decision-making deficits in normal and abnormal states. The multidisciplinary studies included in this Collection provide new insights into the neuroscience of decision making and reward., Competing Interests: The authors have declared that no competing interests exist.

The most dynamic period of postnatal brain development occurs during adolescence, the period between childhood and adulthood. Neuroimaging studies have observed morphologic and functional changes during adolescence, and it is believed that these changes serve to improve the functions of circuits that underlie decision-making. Direct evidence in support of this hypothesis, however, has been limited because most preclinical decision-making paradigms are not readily translated to humans. Here, we developed a reversal-learning protocol for the rapid assessment of adaptive choice behavior in dynamic environments in rats as young as postnatal day 30. A computational framework was used to elucidate the reinforcement-learning mechanisms that change in adolescence and into adulthood. Using a cross-sectional and longitudinal design, we provide the first evidence that value-based choice behavior in a reversal-learning task improves during adolescence in male and female Long-Evans rats and demonstrate that the increase in reversal performance is due to alterations in value updating for positive outcomes. Furthermore, we report that reversal-learning trajectories in adolescence reliably predicted reversal performance in adulthood. This novel behavioral protocol provides a unique platform for conducting biological and systems-level analyses of the neurodevelopmental mechanisms of decision-making. SIGNIFICANCE STATEMENT The neurodevelopmental adaptations that occur during adolescence are hypothesized to underlie age-related improvements in decision-making, but evidence to support this hypothesis has been limited. Here, we describe a novel behavioral protocol for rapidly assessing adaptive choice behavior in adolescent rats with a reversal-learning paradigm. Using a computational approach, we demonstrate that age-related changes in reversal-learning performance in male and female Long-Evans rats are linked to specific reinforcement-learning mechanisms and are predictive of reversal-learning performance in adulthood. Our behavioral protocol provides a unique platform for elucidating key components of adolescent brain function., (Copyright © 2020 the authors.)

Decades of research have shown that the NAc is a critical region influencing addiction, mood, and food consumption through its effects on reinforcement learning, motivation, and hedonic experience. Pharmacological studies have demonstrated that inhibition of the NAc shell induces voracious feeding, leading to the hypothesis that the inhibitory projections that emerge from the NAc normally act to restrict feeding. While much of this work has focused on projections to the lateral hypothalamus, the role of NAc projections to the VTA in the control food intake has been largely unexplored. Using a retrograde viral labeling technique and real-time monitoring of neural activity with fiber photometry, we find that medial NAc shell projections to the VTA (mNAc→VTA) are inhibited during food-seeking and food consumption in male mice. We also demonstrate that this circuit bidirectionally controls feeding: optogenetic activation of NAc projections to the VTA inhibits food-seeking and food intake (in both sexes), while optogenetic inhibition of this circuit potentiates food-seeking behavior. Additionally, we show that activity of the NAc to VTA pathway is necessary for adaptive inhibition of food intake in response to external cues. These data provide new insight into NAc control over feeding in mice, and contribute to an emerging literature elucidating the role of inhibitory midbrain feedback within the mesolimbic circuit. SIGNIFICANCE STATEMENT The medial NAc has long been known to control consummatory behavior, with particular focus on accumbens projections to the lateral hypothalamus. Conversely, NAc projections to the VTA have mainly been studied in the context of drug reward. We show that NAc projections to the VTA bidirectionally control food intake, consistent with a permissive role in feeding. Additionally, we show that this circuit is normally inactivated during consumption and food-seeking. Together, these findings elucidate how mesolimbic circuits control food consumption., (Copyright © 2020 the authors.)

Paranoia is the belief that harm is intended by others. It may arise from selective pressures to infer and avoid social threats, particularly in ambiguous or changing circumstances. We propose that uncertainty may be sufficient to elicit learning differences in paranoid individuals, without social threat. We used reversal learning behavior and computational modeling to estimate belief updating across individuals with and without mental illness, online participants, and rats chronically exposed to methamphetamine, an elicitor of paranoia in humans. Paranoia is associated with a stronger prior on volatility, accompanied by elevated sensitivity to perceived changes in the task environment. Methamphetamine exposure in rats recapitulates this impaired uncertainty-driven belief updating and rigid anticipation of a volatile environment. Our work provides evidence of fundamental, domain-general learning differences in paranoid individuals. This paradigm enables further assessment of the interplay between uncertainty and belief-updating across individuals and species., Competing Interests: ER, SU, PS, CM, JT, SG, PC No competing interests declared, (© 2020, Reed et al.)

Individuals with alcohol use disorder exhibit compulsive habitual behaviors that are thought to be, in part, a consequence of chronic and persistent use of alcohol. The endocannabinoid system plays a critical role in habit learning and in ethanol self-administration, but the role of this neuromodulatory system in the expression of habitual alcohol seeking is unknown. Here, we investigated the role of the endocannabinoid system in established alcohol habits using contingency degradation in male C57BL/6 mice. We found that administration of the novel diacyl glycerol lipase inhibitor DO34, which decreases the biosynthesis of the endocannabinoid 2-arachidonoyl glycerol (2-AG), reduced habitual responding for ethanol and ethanol approach behaviors. Moreover, administration of the endocannabinoid transport inhibitor AM404 or the cannabinoid receptor type 1 antagonist AM251 produced similar reductions in habitual responding for ethanol and ethanol approach behaviors. Notably, AM404 was also able to reduce ethanol seeking and consumption in mice that were insensitive to lithium chloride-induced devaluation of ethanol. Conversely, administration of JZL184, a monoacyl glycerol lipase inhibitor that increases levels of 2-AG, increased motivation to respond for ethanol on a progressive ratio schedule of reinforcement. These results demonstrate an important role for endocannabinoid signaling in the motivation to seek ethanol, in ethanol-motivated habits, and suggest that pharmacological manipulations of endocannabinoid signaling could be effective therapeutics for treating alcohol use disorder., (© 2019 Society for the Study of Addiction.)

Impulsive decisions are those that favor immediate over delayed rewards, involve the acceptance of undue risk or uncertainty, or fail to adapt to environmental changes. Pathological levels of impulsive decision-making have been observed in individuals with mental illness, but there may be substantial heterogeneity in the processes that drive impulsive choices. Understanding this behavioral heterogeneity may be critical for understanding associated diverseness in the neural mechanisms that give rise to impulsivity. The application of reinforcement learning algorithms in the deconstruction of impulsive decision-making phenotypes can help bridge the gap between biology and behavior and provide insights into the biobehavioral heterogeneity of impulsive choice. This chapter will review the literature on the neurobiological mechanisms of impulsive decision-making in nonhuman animals; specifically, the role of the amine neuromodulatory systems (dopamine, serotonin, norepinephrine, and acetylcholine) in impulsive decision-making and reinforcement learning processes is discussed. Ultimately, the integration of reinforcement learning algorithms with sophisticated behavioral and neuroscience techniques may be critical for advancing the understanding of the neurochemical basis of impulsive decision-making.

Adaptive decision making in dynamic environments requires multiple reinforcement-learning steps that may be implemented by dissociable neural circuits. Here, we used a novel directionally specific viral ablation approach to investigate the function of several anatomically defined orbitofrontal cortex (OFC) circuits during adaptive, flexible decision making in rats trained on a probabilistic reversal learning task. Ablation of OFC neurons projecting to the nucleus accumbens selectively disrupted performance following a reversal, by disrupting the use of negative outcomes to guide subsequent choices. Ablation of amygdala neurons projecting to the OFC also impaired reversal performance, but due to disruptions in the use of positive outcomes to guide subsequent choices. Ablation of OFC neurons projecting to the amygdala, by contrast, enhanced reversal performance by destabilizing action values. Our data are inconsistent with a unitary function of the OFC in decision making. Rather, distinct OFC-amygdala-striatal circuits mediate distinct components of the action-value updating and maintenance necessary for decision making., (Copyright © 2019 Elsevier Inc. All rights reserved.)

The compulsive, habitual behaviors that have been observed in individuals diagnosed with substance use disorders may be due to disruptions in the neural circuits that mediate goal-directed actions. The endocannabinoid system has been shown to play a critical role in habit learning, but the role of this neuromodulatory system in habit expression is unclear. Here, we investigated the role of the endocannabinoid system in established habitual actions using contingency degradation in male C57BL/6 mice. We found that administration of the endocannabinoid transport inhibitor AM404 reduced habitual responding for food and that antagonism of cannabinoid receptor type 1 (CB1), but not transient receptor potential cation subfamily V (TRPV1), receptors produced a similar reduction in habitual responding. Moreover, pharmacological stimulation of CB1 receptors increased habitual responding for food. Co-administration of an enzyme inhibitor that selectively increases the endocannabinoid 2-arachidonoyl glycerol (2-AG) with AM404 partially restored habitual responding for food. Together, these findings demonstrate an important role for the endocannabinoid system in the expression of habits and provide novel insights into potential pharmacological strategies for reducing habitual behaviors in mental disorders., (© 2018 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Background: Disruptions in the decision-making processes that guide action selection are a core feature of many psychiatric disorders, including addiction. Decision making is influenced by the goal-directed and habitual systems that can be computationally characterized using model-based and model-free reinforcement learning algorithms, respectively. Recent evidence suggests an imbalance in the influence of these reinforcement learning systems on behavior in individuals with substance dependence, but it is unknown whether these disruptions are a manifestation of chronic drug use and/or are a preexisting risk factor for addiction., Methods: We trained adult male rats on a multistage decision-making task to quantify model-free and model-based processes before and after self-administration of methamphetamine or saline., Results: Individual differences in model-free, but not model-based, learning prior to any drug use predicted subsequent methamphetamine self-administration; rats with lower model-free behavior took more methamphetamine than rats with higher model-free behavior. This relationship was selective to model-free updating following a rewarded, but not unrewarded, choice. Both model-free and model-based learning were reduced in rats following methamphetamine self-administration, which was due to a decrement in the ability of rats to use unrewarded outcomes appropriately. Moreover, the magnitude of drug-induced disruptions in model-free learning was not correlated with disruptions in model-based behavior, indicating that drug self-administration independently altered both reinforcement learning strategies., Conclusions: These findings provide direct evidence that model-free and model-based learning mechanisms are involved in select aspects of addiction vulnerability and pathology, and they provide a unique behavioral platform for conducting systems-level analyses of decision making in preclinical models of mental illness., (Copyright © 2019 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.)

Flexible decision-making in dynamic environments requires both retrospective appraisal of reinforced actions and prospective reasoning about the consequences of actions. These complementary reinforcement-learning systems can be characterized computationally with model-free and model-based algorithms, but how these processes interact at a neurobehavioral level in normal and pathological states is unknown. Here, we developed a translationally analogous multistage decision-making (MSDM) task to independently quantify model-free and model-based behavioral mechanisms in rats. We provide the first direct evidence that male rats, similar to humans, use both model-free and model-based learning when making value-based choices in the MSDM task and provide novel analytic approaches for independently quantifying these reinforcement-learning strategies. Furthermore, we report that ex vivo dopamine tone in the ventral striatum and orbitofrontal cortex correlate with model-based, but not model-free, strategies, indicating that the biological mechanisms mediating decision-making in the multistage task are conserved in rats and humans. This new multistage task provides a unique behavioral platform for conducting systems-level analyses of decision-making in normal and pathological states. SIGNIFICANCE STATEMENT Decision-making is influenced by both a retrospective "model-free" system and a prospective "model-based" system in humans, but the biobehavioral mechanisms mediating these learning systems in normal and disease states are unknown. Here, we describe a translationally analogous multistage decision-making task to provide a behavioral platform for conducting neuroscience studies of decision-making in rats. We provide the first evidence that choice behavior in rats is influenced by model-free and model-based systems and demonstrate that model-based, but not model-free, learning is associated with corticostriatal dopamine tone. This novel behavioral paradigm has the potential to yield critical insights into the mechanisms mediating decision-making alterations in mental disorders., (Copyright © 2019 the authors 0270-6474/19/390295-12$15.00/0.)

The persistent use of psychostimulant drugs, despite the detrimental outcomes associated with continued drug use, may be because of disruptions in reinforcement-learning processes that enable behavior to remain flexible and goal directed in dynamic environments. To identify the reinforcement-learning processes that are affected by chronic exposure to the psychostimulant methamphetamine (MA), the current study sought to use computational and biochemical analyses to characterize decision-making processes, assessed by probabilistic reversal learning, in rats before and after they were exposed to an escalating dose regimen of MA (or saline control). The ability of rats to use flexible and adaptive decision-making strategies following changes in stimulus-reward contingencies was significantly impaired following exposure to MA. Computational analyses of parameters that track choice and outcome behavior indicated that exposure to MA significantly impaired the ability of rats to use negative outcomes effectively. These MA-induced changes in decision making were similar to those observed in rats following administration of a dopamine D2/3 receptor antagonist. These data use computational models to provide insight into drug-induced maladaptive decision making that may ultimately identify novel targets for the treatment of psychostimulant addiction. We suggest that the disruption in utilization of negative outcomes to adaptively guide dynamic decision making is a new behavioral mechanism by which MA rigidly biases choice behavior.

Background: Interneuronal pathology is implicated in many neuropsychiatric disorders, including autism spectrum disorder (ASD) and Tourette syndrome (TS). Interneurons of the striatum, including the parvalbumin-expressing fast-spiking interneurons (FSIs) and the large cholinergic interneurons (CINs), are affected in patients with TS and in preclinical models of both ASD and TS., Methods: To test the causal importance of these neuronal abnormalities, we recapitulated them in vivo in developmentally normal mice using a combination transgenic-viral strategy for targeted toxin-mediated ablation., Results: We found that conjoint ~50% depletion of FSIs and CINs in the dorsal striatum of male mice produces spontaneous stereotypy and marked deficits in social interaction. Strikingly, these behavioral effects are not seen in female mice; because ASD and TS have a marked male predominance, this observation reinforces the potential relevance of the finding to human disease. Neither of these effects is seen when only one or the other interneuronal population is depleted; ablation of both is required. Depletion of FSIs, but not of CINs, also produces anxiety-like behavior, as has been described previously. Behavioral pathology in male mice after conjoint FSI and CIN depletion is accompanied by increases in activity-dependent signaling in the dorsal striatum; these alterations were not observed after disruption of only one interneuron type or in doubly depleted female mice., Conclusions: These data indicate that disruption of CIN and FSI interneurons in the dorsal striatum is sufficient to produce network and behavioral changes of potential relevance to ASD, in a sexually dimorphic manner., (Copyright © 2017 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.)

Background: Schizophrenia is a debilitating neuropsychiatric disorder typically diagnosed from late adolescence to adulthood. Subthreshold behavioral symptoms (e.g., cognitive deficits and substance abuse) often precede the clinical diagnosis of schizophrenia. However, these prodromal symptoms have not been consistently associated with structural and functional brain biomarkers, limiting the chance of early diagnosis of schizophrenia., Methods: Using an extensively multimodal range of magnetic resonance methods (for anatomy, metabolism, and function), we screened early biomarkers in a methylazoxymethanol acetate (MAM) rat model of schizophrenia and saline-treated control (SHAM) rats, in conjunction with immunohistochemistry, myelin staining, and a novel three-choice, reversal-learning task to identify early behavioral markers corresponding the subthreshold symptoms., Results: MAM (vs. SHAM) rats had lower/higher structural connectivity in anterior/posterior corpus callosum. The orbitofrontal cortex of MAM rats showed lower resting-state functional magnetic resonance imaging functional connectivity in conjunction with lower neuronal density, lower glucose oxidation, and attenuated neurotransmission (hypofrontality). In contrast, these measures were all higher in visual cortex of MAM rats (posterior hyperactivity), which might parallel perceptual problems in schizophrenia. In behavioral studies, MAM (vs. SHAM) rats displayed abnormal orbitofrontal cortex-mediated decision-making processes, resulting in a novel reward-sensitive hyperflexible phenotype, which might reflect vulnerability of prodromal patients to substance abuse., Conclusions: We identified two novel biomarkers of early schizophrenia in a preclinical rat model: hypofrontality associated with the hyperflexible phenotype, and posterior hyperactivity. Because each of these magnetic resonance methods is clinically translatable, these markers could contribute to early diagnosis and the development of novel therapies of schizophrenia., (Copyright © 2016 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.)

Delusions, the fixed false beliefs characteristic of psychotic illness, have long defied understanding despite their response to pharmacological treatments (e.g., D2 receptor antagonists). However, it can be challenging to discern what makes beliefs delusional compared with other unusual or erroneous beliefs. We suggest mapping the putative biology to clinical phenomenology with a cognitive psychology of belief, culminating in a teleological approach to beliefs and brain function supported by animal and computational models. We argue that organisms strive to minimize uncertainty about their future states by forming and maintaining a set of beliefs (about the organism and the world) that are robust, but flexible. If uncertainty is generated endogenously, beliefs begin to depart from consensual reality and can manifest into delusions. Central to this scheme is the notion that formal associative learning theory can provide an explanation for the development and persistence of delusions. Beliefs, in animals and humans, may be associations between representations (e.g., of cause and effect) that are formed by minimizing uncertainty via new learning and attentional allocation. Animal research has equipped us with a deep mechanistic basis of these processes, which is now being applied to delusions. This work offers the exciting possibility of completing revolutions of translation, from the bedside to the bench and back again. The more we learn about animal beliefs, the more we may be able to apply to human beliefs and their aberrations, enabling a deeper mechanistic understanding., (© The Author 2017. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.)

Unlabelled: Dopamine D2/3 receptor signaling is critical for flexible adaptive behavior; however, it is unclear whether D2, D3, or both receptor subtypes modulate precise signals of feedback and reward history that underlie optimal decision making. Here, PET with the radioligand [(11)C]-(+)-PHNO was used to quantify individual differences in putative D3 receptor availability in rodents trained on a novel three-choice spatial acquisition and reversal-learning task with probabilistic reinforcement. Binding of [(11)C]-(+)-PHNO in the midbrain was negatively related to the ability of rats to adapt to changes in rewarded locations, but not to the initial learning. Computational modeling of choice behavior in the reversal phase indicated that [(11)C]-(+)-PHNO binding in the midbrain was related to the learning rate and sensitivity to positive, but not negative, feedback. Administration of a D3-preferring agonist likewise impaired reversal performance by reducing the learning rate and sensitivity to positive feedback. These results demonstrate a previously unrecognized role for D3 receptors in select aspects of reinforcement learning and suggest that individual variation in midbrain D3 receptors influences flexible behavior. Our combined neuroimaging, behavioral, pharmacological, and computational approach implicates the dopamine D3 receptor in decision-making processes that are altered in psychiatric disorders., Significance Statement: Flexible decision-making behavior is dependent upon dopamine D2/3 signaling in corticostriatal brain regions. However, the role of D3 receptors in adaptive, goal-directed behavior has not been thoroughly investigated. By combining PET imaging with the D3-preferring radioligand [(11)C]-(+)-PHNO, pharmacology, a novel three-choice probabilistic discrimination and reversal task and computational modeling of behavior in rats, we report that naturally occurring variation in [(11)C]-(+)-PHNO receptor availability relates to specific aspects of flexible decision making. We confirm these relationships using a D3-preferring agonist, thus identifying a unique role of midbrain D3 receptors in decision-making processes., (Copyright © 2016 the authors 0270-6474/16/366732-10$15.00/0.)

Bisphenol-A (BPA) is widely used in the manufacture of plastics, epoxy resins, and certain paper products. A majority of the population in the developed world is routinely exposed to BPA from multiple sources and has significant circulating levels of BPA. Although BPA is categorized as an endocrine disruptor with a growing literature on adverse effects, it is uncertain whether cognitive dysfunction is induced in humans by exposure to BPA. The present study examined the impact of BPA in primate brain by exposing adult male vervet monkeys for 4 weeks continuously to circulating levels of BPA that were in the range measured in studies of humans environmentally exposed to BPA. This regimen of exposure to BPA decreased both working memory accuracy and the number of excitatory synaptic inputs on dendritic spines of pyramidal neurons in two brain regions that are necessary for working memory (prefrontal cortex and hippocampus). These observed behavioral and synaptic effects were ameliorated following withdrawal from BPA. As Old World monkeys (e.g., vervets) and humans share some uniquely primate morphological, endocrine, and cognitive traits, this study indicates the potential for significant cognitive disruption following exposure of humans to BPA., (© 2015 Wiley Periodicals, Inc.)

Background: Cognitive deficits are a core symptom of schizophrenia, yet they remain particularly resistant to treatment. The model provided by repeatedly exposing adult nonhuman primates to phencyclidine has generated important insights into the neurobiology of these deficits, but it remains possible that administration of this psychotomimetic agent during the pre-adult period, when the dorsolateral prefrontal cortex in human and nonhuman primates is still undergoing significant maturation, may provide a greater understanding of schizophrenia-related cognitive deficits., Methods: The effects of repeated phencyclidine treatment on spine synapse number, dopamine turnover and BDNF expression in dorsolateral prefrontal cortex, and working memory accuracy were examined in pre-adult monkeys., Results: One week following phencyclidine treatment, juvenile and adolescent male monkeys demonstrated a greater loss of spine synapses in dorsolateral prefrontal cortex than adult male monkeys. Further studies indicated that in juvenile males, a cognitive deficit existed at 4 weeks following phencyclidine treatment, and this impairment was associated with decreased dopamine turnover, decreased brain derived neurotrophic factor messenger RNA, and a loss of dendritic spine synapses in dorsolateral prefrontal cortex. In contrast, female juvenile monkeys displayed no cognitive deficit at 4 weeks after phencyclidine treatment and no alteration in dopamine turnover or brain derived neurotrophic factor messenger RNA or spine synapse number in dorsolateral prefrontal cortex. In the combined group of male and female juvenile monkeys, significant linear correlations were detected between dopamine turnover, spine synapse number, and cognitive performance., Conclusions: As the incidence of schizophrenia is greater in males than females, these findings support the validity of the juvenile primate phencyclidine model and highlight its potential usefulness in understanding the deficits in dorsolateral prefrontal cortex in schizophrenia and developing novel treatments for the cognitive deficits associated with schizophrenia., (© The Author 2015. Published by Oxford University Press on behalf of CINP.)

For >30 years, positron emission tomography (PET) has proven to be a powerful approach for measuring aspects of dopaminergic transmission in the living human brain; this technique has revealed important relationships between dopamine D2-like receptors and dimensions of normal behavior, such as human impulsivity, and psychopathology, particularly behavioral addictions. Nevertheless, PET is an indirect estimate that lacks cellular and functional resolution and, in some cases, is not entirely pharmacologically specific. To identify the relationships between PET estimates of D2-like receptor availability and direct in vitro measures of receptor number, affinity, and function, we conducted neuroimaging and behavioral and molecular pharmacological assessments in a group of adult male vervet monkeys. Data gathered from these studies indicate that variation in D2-like receptor PET measurements is related to reversal-learning performance and sensitivity to positive feedback and is associated with in vitro estimates of the density of functional dopamine D2-like receptors. Furthermore, we report that a simple behavioral measure, eyeblink rate, reveals novel and crucial links between neuroimaging assessments and in vitro measures of dopamine D2 receptors., (Copyright © 2014 the authors 0270-6474/14/3414443-12$15.00/0.)

Addictions are often characterized as forms of impulsive behavior. That said, it is often noted that impulsivity is a multidimensional construct, spanning several psychological domains. This review describes the relationship between varieties of impulsivity and addiction-related behaviors, the nature of the causal relationship between the two, and the underlying neurobiological mechanisms that promote impulsive behaviors. We conclude that the available data strongly support the notion that impulsivity is both a risk factor for, and a consequence of, drug and alcohol consumption. While the evidence indicating that subtypes of impulsive behavior are uniquely informative--either biologically or with respect to their relationships to addictions--is convincing, multiple lines of study link distinct subtypes of impulsivity to low dopamine D2 receptor function and perturbed serotonergic transmission, revealing shared mechanisms between the subtypes. Therefore, a common biological framework involving monoaminergic transmitters in key frontostriatal circuits may link multiple forms of impulsivity to drug self-administration and addiction-related behaviors. Further dissection of these relationships is needed before the next phase of genetic and genomic discovery will be able to reveal the biological sources of the vulnerability for addiction indexed by impulsivity., (© 2014 New York Academy of Sciences.)

The procurement and consumption of palatable, calorie-dense foods is influenced by the nutritional and hedonic value of foods. Although many factors can influence the control over behavior by foods rich in sugar and fat, emerging evidence indicates that biological sex may play a particularly crucial role in the types of foods individuals seek out, as well as the level of motivation individuals will exert to obtain those foods. However, a systematic investigation of food-seeking and consumption that disentangles the effects of the major sex-biasing factors, including sex chromosome complement and organizational and activational effects of sex hormones, has yet to be conducted. Using the four core genotypes mouse model system, we separated and quantified the effects of sex chromosome complement and gonadal sex on consumption of and motivation to obtain a highly palatable solution [sweetened condensed milk (SCM)]. Gonadectomized mice with an XY sex chromosome complement, compared with those with two X chromosomes, independent of gonadal sex, appeared to be more sensitive to the reward value of the SCM solution and were more motivated to expend effort to obtain it, as evidenced by their dramatically greater expended effort in an instrumental task with progressively larger response-to-reward ratios. Gonadal sex independently affected free consumption of the solution but not motivation to obtain it. These data indicate that gonadal and chromosomal sex effects independently influence reward-related behaviors, contributing to sexually dimorphic patterns of behavior related to the pursuit and consumption of rewards., (© 2014 John Wiley & Sons Ltd and International Behavioural and Neural Genetics Society.)

Rationale: Problematic drug use is associated with difficulty in exerting self-control over behaviors, and this difficulty may be a consequence of atypical morphometric characteristics that are exhibited by drug-experienced individuals. The extent to which these structural abnormalities result from drug use or reflect neurobiological risk factors that predate drug use, however, is unknown., Objectives: The purpose of this study is to determine how methamphetamine affects corticostriatal structure and how drug-induced changes relate to alterations in inhibitory control., Methods: Structural magnetic resonance images and positron emission tomography (PET) scans, assessing dopamine D₂-like receptor and transporter availability, were acquired in monkeys trained to acquire, retain, and reverse three-choice visual discrimination problems before and after exposure to an escalating dose regimen of methamphetamine (or saline, as a control). Voxel-based morphometry was used to compare changes in corticostriatal gray matter between methamphetamine- and saline-exposed monkeys. The change in gray matter before and after the dosing regimen was compared to the change in the behavioral performance and in dopaminergic markers measured with PET., Results: Methamphetamine exposure, compared to saline, increased gray matter within the right putamen. These changes were positively correlated with changes in performance of methamphetamine-exposed monkeys in the reversal phase, and were negatively correlated with alterations in D₂-like receptor and DAT availability., Conclusions: The results provide the first evidence that exposure to a methamphetamine dosing regimen that resembles human use alters the structural integrity of the striatum and that gray-matter abnormalities detected in human methamphetamine users are due, at least in part, to the pharmacological effects of drug experience.

Deep insights into the structural, molecular and functional phenotypes underlying addiction have been made possible through in vivo neuroimaging techniques implemented in non-human and human primates. In addition to providing evidence that many of the neural alterations detected in stimulant-dependent individuals can emerge solely through experience with drugs, these studies have identified potential biological phenotypes that influence addiction liability. Here, we review recent advances that have been made in understanding the pathophysiology of stimulant addiction using neuroimaging techniques in non-human primates. Evidence indicates that dysfunction of the dopamine system can be both a cause and consequence of stimulant use and that this bi-directional relationship may be mediated by the ability of individuals to exert inhibitory control over behaviors. Further, recent data has demonstrated an involvement of the serotonin system in addiction-related behaviors and neurobiology, suggesting that the relationship between dopamine and serotonin systems may be altered in addiction. This approach aids in the development of novel targets that can be used in the treatment of addiction., (Copyright © 2013 Elsevier Ltd. All rights reserved.)

Central sensitization and dysregulation of peripheral substance P and neurokinin-1 receptor (NK-1R) signaling are associated with chronic abdominal pain in inflammatory bowel disease (IBD) and irritable bowel syndrome (IBS). Although positron emission tomography (PET) has demonstrated that patients with injury-related chronic pain have diminished NK-1R availability in the brain, it is unknown whether these deficits are present in IBD and IBS patients, who have etiologically distinct forms of non-injury-related chronic pain. This study's aim was to determine if patients with IBD or IBS exhibit deficits in brain expression of NK-1Rs relative to healthy controls (HCs), the extent to which expression patterns differ across patient populations, and if these patterns differentially relate to clinical parameters. PET with [(18)F]SPA-RQ was used to measure NK-1R availability by quantifying binding potential (BP) in the 3 groups. Exploratory correlation analyses were performed to detect associations between NK-1R BP and physical symptoms. Compared to HCs, IBD patients had NK-1R BP deficits across a widespread network of cortical and subcortical regions. IBS patients had similar, but less pronounced deficits. BP in a subset of these regions was robustly related to discrete clinical parameters in each patient population. Widespread deficits in NK-1R BP occur in IBD and, to a lesser extent, IBS; however, discrete clinical parameters relate to NK-1R BP in each patient population. This suggests that potential pharmacological interventions that target NK-1R signaling may be most effective for treating distinct symptoms in IBD and IBS., (Copyright © 2013 International Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.)

Background: The compulsive and inflexible behaviors that are present in many psychiatric disorders, particularly behavioral addictions and obsessive-compulsive disorder, may be due to neurochemical dysfunction within the circuitry that enables goal-directed behaviors. Experimental removal of serotonin or dopamine within the orbitofrontal cortex or dorsal striatum, respectively, impairs flexible responding in a reversal learning test, suggesting that these neurochemical systems exert important modulatory influences on goal-directed behaviors. Nevertheless, the behavioral impairments present in psychiatric disorders are likely due to subtle neurochemical differences, and it remains unknown whether naturally occurring variation in neurochemical levels associate with individual differences in flexible, reward-directed behaviors., Methods: The current study assessed the ability of 24 individual juvenile monkeys to acquire, retain, and reverse discrimination problems and examined whether monoamine levels in the orbitofrontal cortex, caudate nucleus, and putamen could explain variance in behavior., Results: The interaction between dopamine levels in the putamen and serotonin levels in the orbitofrontal cortex explained 61% of the variance in a measure of behavioral flexibility but not measures of associative learning or memory. The interaction mirrored that of a hyperbolic function, with reversal learning performance being poorest in either monkeys with relatively low levels of orbitofrontal serotonin and putamen dopamine or in monkeys with relatively high levels of orbitofrontal serotonin and putamen dopamine levels., Conclusions: These results support the hypothesis that subcortical and cortical neuromodulatory systems interact to guide aspects of goal-directed behavior, providing insight into the neurochemical dysfunction that may underlie the inflexible and compulsive behaviors present in psychiatric disorders., (Copyright © 2013 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.)

Methamphetamine (MA) is one of the most commonly abused illicit substances worldwide. Among other problems, abuse of the drug has been associated with reduced cognitive function across several domains. However, much of the literature has not attempted to differentiate cognitive difficulties caused by MA abuse from preexisting cognitive difficulties that are likely caused by other factors. Here, we address this question, evaluating evidence for a priori hypotheses pertaining to six lines of research: (a) animal studies; (b) cross-sectional human studies; (c) a twin study; (d) studies of changes in cognition with abstinence from MA; (e) studies of changes in brain structure and function with abstinence from MA; and (f) studies of the relationship between the severity of MA abuse and the extent of cognitive deficits observed. Overall the findings were mixed, with some support for a causal relationship between MA abuse and cognitive decline, and other findings suggesting that there is no relationship. The preponderance of the data, however, does support the possibility that MA abuse causes cognitive decline, of unknown duration, in at least some users of the drug. When averaged across individuals, this decline is likely to be mild in early-to-middle adulthood. However, moderator variables are likely to contribute to the presence and/or severity of cognitive decline exhibited by a given individual.

Compulsive drug-seeking and drug-taking are important substance-abuse behaviors that have been linked to alterations in dopaminergic neurotransmission and to impaired inhibitory control. Evidence supports the notions that abnormal D₂ receptor-mediated dopamine transmission and inhibitory control may be heritable risk factors for addictions, and that they also reflect drug-induced neuroadaptations. To provide a mechanistic explanation for the drug-induced emergence of inhibitory-control deficits, this study examined how a chronic, escalating-dose regimen of methamphetamine administration affected dopaminergic neurochemistry and cognition in monkeys. Dopamine D₂-like receptor and dopamine transporter (DAT) availability and reversal-learning performance were measured before and after exposure to methamphetamine (or saline), and brain dopamine levels were assayed at the conclusion of the study. Exposure to methamphetamine reduced dopamine D₂-like receptor and DAT availability and produced transient, selective impairments in the reversal of a stimulus-outcome association. Furthermore, individual differences in the change in D₂-like receptor availability in the striatum were related to the change in response to positive feedback. These data provide evidence that chronic, escalating-dose methamphetamine administration alters the dopamine system in a manner similar to that observed in methamphetamine-dependent humans. They also implicate alterations in positive-feedback sensitivity associated with D₂-like receptor dysfunction as the mechanism by which inhibitory control deficits emerge in stimulant-dependent individuals. Finally, a significant degree of neurochemical and behavioral variation in response to methamphetamine was detected, indicating that individual differences affect the degree to which drugs of abuse alter these processes. Identification of these factors ultimately may assist in the development of individualized treatments for substance dependence.

The phenotypic complexity of psychiatric conditions is revealed by the dimensional nature of these disorders, which consist of multiple behavioral, affective, and cognitive dysfunctions that can result in substantial psychosocial impairment. The high degree of heterogeneity in symptomatology and comorbidity suggests that simple categorical diagnoses of "affected" or "unaffected" may fail to capture the true characteristics of the disorder in a manner relevant to individualized treatment. A particular dimension of interest is cognitive control ability because impairments in the capacity to control thoughts, feelings, and actions are key to several psychiatric disorders. Here, we describe evidence suggesting that cognitive control over behavior is a crucial dimension of function relevant to addictions. Moreover, dopamine (DA) D(2)-receptor transmission is increasingly being identified as a point of convergence for these behavioral and cognitive processes. Consequently, we argue that measures of cognitive control and D(2) DA receptor function may be particularly informative markers of individual function and treatment response in addictions., (© 2011 Wiley Periodicals, Inc.)

Purpose: Repeated, intermittent administration of the psychotropic NMDA antagonist phencyclidine (PCP) to laboratory animals causes impairment in cognitive and executive functions, modeling important sequelae of schizophrenia; these effects are thought to be due to a dysregulation of neurotransmission within the prefrontal cortex. Atypical antipsychotic drugs have been reported to have measurable, if incomplete, effects on cognitive dysfunction in this model, and these effects may be due to their ability to normalize a subset of the physiological deficits occurring within the prefrontal cortex. Asenapine is an atypical antipsychotic approved in the US for the treatment of schizophrenia and for the treatment, as monotherapy or adjunctive therapy to lithium or valproate, of acute manic or mixed episodes associated bipolar I disorder. To understand its cognitive and neurochemical actions more fully, we explored the effects of short- and long-term dosing with asenapine on measures of cognitive and motor function in normal monkeys and in those previously exposed for 2 weeks to PCP; we further studied the impact of treatment with asenapine on dopamine and serotonin turnover in discrete brain regions from the same cohort., Methods: Monkeys were trained to perform reversal learning and object retrieval procedures before twice daily administration of PCP (0.3 mg/kg intra-muscular) or saline for 14 days. Tests confirmed cognitive deficits in PCP-exposed animals before beginning twice daily administration of saline (control) or asenapine (50, 100, or 150 μg/kg, intra-muscular). Dopamine and serotonin turnover were assessed in 15 specific brain regions by high-pressure liquid chromatography measures of the ratio of parent amine to its major metabolite., Results: On average, PCP-treated monkeys made twice as many errors in the reversal task as did control monkeys. Asenapine facilitated reversal learning performance in PCP-exposed monkeys, with improvements at trend level after 1 week of administration and reaching significance after 2-4 weeks of dosing. In week 4, the improvement with asenapine 150 μg/kg (p = 0.01) rendered the performance of PCP-exposed monkeys indistinguishable from that of normal monkeys without compromising fine motor function. Asenapine administration (150 μg/kg twice daily) produced an increase in dopamine and serotonin turnover in most brain regions of control monkeys and asenapine (50-150 μg/kg) increased dopamine and serotonin turnover in several brain regions of subchronic PCP-treated monkeys. No significant changes in the steady-state levels of dopamine or serotonin were observed in any brain region except for the central amygdala, in which a significant depletion of dopamine was observed in PCP-treated control monkeys; asenapine treatment reversed this dopamine depletion. A significant decrease in serotonin utilization was observed in the orbitofrontal cortex and nucleus accumbens in PCP monkeys, which may underlie poor reversal learning. In the same brain regions, dopamine utilization was not affected. Asenapine ameliorated this serotonin deficit in a dose-related manner that matched its efficacy for reversing the cognitive deficit., Conclusions: In this model of cognitive dysfunction, asenapine produced substantial gains in executive functions that were maintained with long-term administration. The cognition-enhancing effects of asenapine and the neurochemical changes in serotonin and dopamine turnover seen in this study are hypothesized to be primarily related to its potent serotonergic and noradrenergic receptor binding properties, and support the potential for asenapine to reduce cognitive dysfunction in patients with schizophrenia and bipolar disorder., (Copyright © 2011. Published by Elsevier Ltd.)

Deviations in reward sensitivity and behavioral flexibility, particularly in the ability to change or stop behaviors in response to changing environmental contingencies, are important phenotypic dimensions of several neuropsychiatric disorders. Neuroimaging evidence suggests that variation in dopamine signaling through dopamine D(2)-like receptors may influence these phenotypes, as well as associated psychiatric conditions, but the specific neurocognitive mechanisms through which this influence is exerted are unknown. To address this question, we examined the relationship between behavioral sensitivity to reinforcement during discrimination learning and D(2)-like receptor availability in vervet monkeys. Monkeys were assessed for their ability to acquire, retain, and reverse three-choice, visual-discrimination problems, and once behavioral performance had stabilized, they received positron emission tomography (PET) scans. D(2)-like receptor availability in dorsal aspects of the striatum was not related to individual differences in the ability to acquire or retain visual discriminations but did relate to the number of trials required to reach criterion in the reversal phase of the task. D(2)-like receptor availability was also strongly correlated with behavioral sensitivity to positive, but not negative, feedback during learning. These results go beyond electrophysiological findings by demonstrating the involvement of a striatal dopaminergic marker in individual differences in feedback sensitivity and behavioral flexibility, providing insight into the neural mechanisms that are affected in neuropsychiatric disorders that feature these deficits.

The tendency for some individuals to partake in high-risk behaviors (eg, substance abuse, gambling, risky sexual activities) is a matter of great public health concern, yet the characteristics and neural bases of this vulnerability are largely unknown. Recent work shows that this susceptibility can be partially predicted by laboratory measures of reward seeking under risk, including the Balloon Analog Risk Task. Rats were trained to respond on two levers: one of which (the 'add lever') increased the size of a potential food reward and a second (the 'cash-out lever') that led to delivery of accrued reward. Crucially, each add-lever response was also associated with a risk that the trial would fail and no reward would be delivered. The relative probabilities that each add-lever press would lead to an addition food pellet or to trial failure (risk) were orthogonally varied. Rats exhibited a pattern of responding characteristic of incentive motivation and risk aversion, with a subset of rats showing traits of high-risk taking and/or suboptimal responding. Neural inactivation studies suggest that the orbitofrontal cortex supports greater reward seeking in the presence or absence of risk, whereas the medial prefrontal cortex is required for optimization of patterns of responding. These findings provide new information about the neural circuitry of decision making under risk and reveal new insights into the biological determinants of risk-taking behaviors that may be useful in developing biomarkers of vulnerability.

The co-morbidity between attention deficit hyperactivity disorder (ADHD) and substance abuse and dependence disorders may have multiple causes and consequences. In this review, we will describe neurobehavioral, genetic and animal model studies that support the notion that a common, genetically determined failure of response inhibition function is an endophenotype for both disorders. Through an impairment in the ability to cognitively control pre-potent behaviors, subjects can exhibit a collection of ADHD-like traits (impulsivity and hyperactivity), as well as susceptibility for the initiation of drug taking and its ultimate progression to an inflexible, uncontrollable form. At the neural level, dysfunction within circuitry that includes the ventrolateral frontal and cingulate cortices, as well as in associated basal ganglia zones, contributes to a common pattern of behavioral impairment, explaining aspects of co-morbidity. Animal models of substance abuse/dependence and ADHD that exhibit deficits in response inhibition have substantiated the role of this endophenotype in both disorders and their co-morbidity and should provide a testing ground for interventions targeting it. New directions for research that will further explore this hypothesis and begin to reveal the underlying biological mechanisms will be proposed.

Impulsive behavior and novelty seeking are dimensions of temperament that are behavioral determinants of risk for attention deficit/hyperactivity disorder and its neurocognitive endophenotypes, and variation in the dopamine D4 receptor gene (DRD4) explains at least a portion of the variance in the traits. To further characterize the dimensional phenotype associated with impulsiveness, adolescent male monkeys were evaluated using ecologically valid tests of impulsive approach and aggression in response to social or nonsocial stimuli; subsequently, a delayed response task was implemented to assess spatial working memory performance. Subjects were selected into this study based on their response to the social challenge task or by DRD4 genotype, resulting in three groups: low-impulsivity/common DRD4 allele, high-impulsivity/common DRD4 allele, or rare DRD4 allele. All animals acquired the delayed response task and could perform at near ceiling levels when a approximately 0 s delay version was imposed, but as delays were lengthened, high-impulsive animals, regardless of DRD4 genotype, made fewer correct responses than did low-impulsive subjects; an inverse relationship existed for working memory and impulsivity. Notably, impulsive behavior evoked by social and nonsocial stimuli explained overlapping and independent portions of the variance in working memory performance. CSF levels of monoamine metabolites did not significantly differentiate the high- and low-impulsive animals, although monkeys carrying the DRD4 rare allele tended to exhibit higher monoamine turnover. These data indicate that dimensions of impulsivity may impact on working memory performance in qualitatively similar ways but through different mechanisms.