Search

Rationale: The use of illicit opioids has arguably never been more risky; street drug potency can be dangerously high, is often unknown to the consumer, and results in multiple daily fatalities worldwide. Furthermore, substance use disorder (SUD) is associated with increased maladaptive, risky decisions in laboratory-based gambling tasks. Animal studies can help determine whether this decision-making deficit is a cause or consequence of drug use. However, most experiments have only assessed psychostimulant drugs., Objectives: To assess differences in decision-making strategies both before, during, and after self-administration of fentanyl in male and female Long Evans rats., Methods: Male and female Long Evans rats were trained to perform the rat gambling task (rGT), loosely based on the Iowa Gambling Task (IGT) used clinically, and/or self-administer fentanyl. We used the cued version of the rGT, in which sound and light stimuli signal sugar pellet rewards, as cocaine self-administration has the greatest effects on decision making in this task variant., Results: After training on the cued rGT, female rats self-administered fentanyl more readily, an effect that was most apparent in optimal decision-makers. Contrary to previous reports using cocaine self-administration, decision-making was unaffected during fentanyl self-administration training in either sex. However, risky decision-making increased throughout forced abstinence from fentanyl in males., Conclusions: These findings complement those from human subjects, in whom preference for uncertain outcomes increased before relapse. These data highlight an abstinence-induced change in cognition that is unique to opiates as compared to psychostimulants, and which may critically contribute to the maintenance of addiction and relapse., (© 2024. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.)

We must often decide whether the effort required for a task is worth the reward. Past rodent work suggests that willingness to deploy cognitive effort can be driven by individual differences in perceived reward value, depression, or chronic stress. However, many factors driving cognitive effort deployment-such as short-term memory ability-cannot easily be captured in rodents. Furthermore, we do not fully understand how individual differences in short-term memory ability, depression, chronic stress, and reward anticipation impact cognitive effort deployment for reward. Here, we examined whether these factors predict cognitive effort deployment for higher reward in an online visual short-term memory task. Undergraduate participants were grouped into high and low effort groups ( n HighEffort  = 348, n LowEffort  = 81; n Female  = 332, n Male  = 92, M Age  = 20.37, Range Age  = 16-42) based on decisions in this task. After completing a monetary incentive task to measure reward anticipation, participants completed short-term memory task trials where they could choose to encode either fewer (low effort/reward) or more (high effort/reward) squares before reporting whether or not the color of a target square matched the square previously in that location. We found that only greater short-term memory ability predicted whether participants chose a much higher proportion of high versus low effort trials. Drift diffusion modeling showed that high effort group participants were more biased than low effort group participants toward selecting high effort trials. Our findings highlight the role of individual differences in cognitive effort ability in explaining cognitive effort deployment choices., Competing Interests: The authors declare no competing financial interests., (Copyright © 2024 Forys et al.)

Rationale: The rat cognitive effort task (rCET), a rodent model of cognitive rather than physical effort, requires animals to choose between an easy or hard visuospatial discrimination, with a correct hard choice more highly rewarded. Like in humans, there is stable individual variation in choice behavior. In previous reports, animals were divided into two groups-workers and slackers-based on their mean preference for the harder option. Although these groups differed in their response to pharmacological challenges, the rationale for using this criterion for grouping was not robust., Methods: We collated experimental data from multiple cohorts of male and female rats performing the rCET and used a model-based framework combining drift diffusion modeling with cluster analysis to identify the decision-making processes underlying variation in choice behavior., Results: We verified that workers and slackers are statistically different groups but also found distinct intra-group profiles. These subgroups exhibited dissociable performance during the attentional phase, linked to distinct decision-making profiles during choice. Reanalysis of previous pharmacology data using this model-based framework showed that serotonergic drug effects were explained by changes in decision boundaries and non-decision times, while scopolamine's effects were driven by changes in decision starting points and rates of evidence accumulation., Conclusions: Modeling revealed the decision-making processes that are associated with cognitive effort costs, and how these differ across individuals. Reanalysis of drug data provided insight into the mechanisms through which different neurotransmitter systems impact cognitively effortful attention and decision-making processes, with relevance to multiple psychiatric disorders., (© 2024. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.)

Rationale: Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding., Objective: The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance., Results: When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine., Conclusions: These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues., (© 2023. The Author(s).)

Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system., (© 2024 The Authors. European Journal of Neuroscience published by Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Animal research suggests trait-like individual variation in the degree of incentive salience attribution to reward-predictive cues, defined phenotypically as sign-tracking (high) and goal-tracking (low incentive salience attribution). While these phenotypes have been linked to addiction features in rodents, their translational validity is less clear. Here, we examined whether sign- and goal-tracking in healthy human volunteers modulates the effects of reward-paired cues on decision making. Sign-tracking was measured in a Pavlovian conditioning paradigm as the amount of eye gaze fixation on the reward-predictive cue versus the location of impending reward delivery. In Study 1 (Cherkasova et al., 2018), participants were randomly assigned to perform a binary choice task in which rewards were either accompanied (cued, n = 63) or unaccompanied (uncued, n = 68) by money images and casino jingles. In Study 2, participants (n = 58) performed cued and uncued versions of the task in a within-subjects design. Across both studies, cues promoted riskier choice. Sign-tracking was not associated with risky choice in either study. Goal-tracking rather than sign-tracking was significantly associated with greater risk-promoting effects of cues in Study 1 but not in Study 2, although the direction of findings was consistent across both studies. These findings are at odds with the notion of sign-trackers being preferentially susceptible to the influence of reward cues on behavior and point to the role of mechanisms besides incentive salience in mediating such influences., (Copyright © 2024 Elsevier B.V. All rights reserved.)

Background: Both psychostimulant use and engagement with probabilistic schedules of reward sensitize the mesocorticolimbic dopamine (DA) system. Such behaviors may act synergistically to explain the high comorbidity between stimulant use and gambling disorder. The salient audiovisual stimuli of modern electronic gambling may exacerbate the situation., Methods: To probe these interactions, we sensitized ventral tegmental area DA neurons via chronic chemogenetic stimulation while rats (n = 134) learned a rat gambling task in the presence or absence of casino-like cues. The same rats then learned to self-administer cocaine. In a separate cohort (n = 25), we confirmed that our chemogenetic methods sensitized the locomotor response to cocaine and potentiated phasic excitability of ventral tegmental area DA neurons through in vivo electrophysiological recordings., Results: In the absence of cues, sensitization promoted risk taking in both sexes. When rewards were cued, sensitization expedited the development of a risk-preferring phenotype in males while attenuating cue-induced risk taking in females., Conclusions: While these results provide further confirmation that ventral tegmental area DA neurons critically modulate risky decision making, they also reveal stark sex differences in the decisional impact that dopaminergic signals exert when winning outcomes are cued. As previously observed, risky decision making on the cued rat gambling task increased as both males and females learned to self-administer cocaine. The combination of DA sensitization and win-paired cues while gambling led to significantly greater cocaine taking, but these rats did not show any increase in risky choice as a result. Therefore, cocaine and heavily cued gambles may partially substitute for each other once the DA system has been rendered labile through sensitization, thereby compounding addiction risk across modalities., (Copyright © 2023 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.)

Computational modeling has become an important tool in neuroscience and psychiatry research to provide insight into the cognitive processes underlying normal and pathological behavior. There are two modeling frameworks, reinforcement learning (RL) and drift diffusion modeling (DDM), that are well-developed in cognitive science, and have begun to be applied to Gambling Disorder. RL models focus on explaining how an agent uses reward to learn about the environment and make decisions based on outcomes. The DDM is a binary choice framework that breaks down decision making into psychologically meaningful components based on choice reaction time analyses. Both approaches have begun to yield insight into aspects of cognition that are important for, but not unique to, gambling, and thus relevant to the development of Gambling Disorder. However, these approaches also oversimplify or neglect various aspects of decision making seen in real-world gambling behavior. Gambling Disorder presents an opportunity for 'bespoke' modeling approaches to consider these neglected components. In this review, we discuss studies that have used RL and DDM frameworks to investigate some of the key cognitive components in gambling and Gambling Disorder. We also include an overview of Bayesian models, a methodology that could be useful for more tailored modeling approaches. We highlight areas in which computational modeling could enable progression in the investigation of the cognitive mechanisms relevant to gambling., Competing Interests: Conflicts of interest LC is the Director of the Centre for Gambling Research at UBC, which is supported by funding from the Province of British Columbia and the British Columbia Lottery Corporation (BCLC), a Canadian Crown Corporation. The Province of BC government and the BCLC had no role in the preparation of this manuscript, and impose no constraints on publishing. LC has received a speaker/travel honorarium from the National Association for Gambling Studies (Australia) and the International Center for Responsible Gaming (US), and has received fees for academic services from the International Center for Responsible Gaming (US), GambleAware (UK) and Gambling Research Exchange Ontario (Canada). He has not received any further direct or indirect payments from the gambling industry or groups substantially funded by gambling. He has received royalties from Cambridge Cognition Ltd. relating to neurocognitive testing. CAW has received research funding and fees for academic services from the International Center for Responsible Gaming (US). CAH reports no disclosures., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

Impulse control and/or gambling disorders can be triggered by dopamine agonist therapies used to treat Parkinson's disease, but the cognitive and neurobiological mechanisms underlying these adverse effects are unknown. Recent data show that adding win-paired sound and light cues to the rat gambling task (rGT) potentiates risky decision-making and impulsivity via the dopamine system, and that changing dopaminergic tone has a greater influence on behavior while subjects are learning task contingencies. Dopamine agonist therapy may therefore be potentiating risk-taking by amplifying the behavioral impact of gambling-related cues on novel behavior. Here, we show that ropinirole treatment in male rats transiently increased motor impulsivity but robustly and progressively increased choice of the high-risk/high-reward options when administered during acquisition of the cued but not uncued rGT. Early in training, ropinirole increased win-stay behavior after large unlikely wins on the cued rGT, indicative of enhanced model-free learning, which mediated the drug's effect on later risk preference. Ex vivo cFos imaging showed that both chronic ropinirole and the addition of win-paired cues suppressed the activity of dopaminergic midbrain neurons. The ratio of midbrain:prefrontal cFos + neurons was lower in animals with suboptimal choice patterns and tended to predict risk preference across all rats. Network analyses further suggested that ropinirole induced decoupling of the dopaminergic cells of the VTA and nucleus accumbens but only when win-paired cues were present. Frontostriatal activity uninformed by the endogenous dopaminergic teaching signal therefore appeared to perpetuate risky choice, and ropinirole exaggerated this disconnect in synergy with reward-paired cues. SIGNIFICANCE STATEMENT D 2/3 receptor agonists, used to treat Parkinson's disease, can cause gambling disorder through an unknown mechanism. Ropinirole increased risky decision-making in rats, but only when wins were paired with casino-inspired sounds and lights. This was mediated by increased win-stay behavior after large unlikely wins early in learning, indicating enhanced model-free learning. cFos imaging showed that ropinirole suppressed activity of midbrain dopamine neurons, an effect that was mimicked by the addition of win-paired cues. The degree of risky choice rats exhibited was uniquely predicted by the ratio of midbrain dopamine:PFC activity. Depriving the PFC of the endogenous dopaminergic teaching signal may therefore drive risky decision-making on-task, and ropinirole acts synergistically with win-paired cues to amplify this., (Copyright © 2023 the authors.)

The main psychoactive compound within the cannabis plant, Δ9-tetrahydrocannabinol (THC), is thought to drive both the sensation of "high" and the cognitive impairments associated with cannabis consumption. Researchers keen to understand how cannabis impairs cognition have, therefore, studied the behavioral effects of systemic injections of THC in animal models. However, cannabis contains multiple other cannabinoids which may critically modulate the resulting cognitive effects. Users also typically eat or smoke cannabis, leading to concern over the translational validity of pure THC injections. We, therefore, tested whether acute oral administration of two different commercially available cannabis extracts, marketed as C. indica or C. sativa , decreased male Long-Evans rats' willingness to exert greater cognitive effort in order to maximize reward earned, as expected from previous experiments using injected THC. Both oils were matched for THC and cannabidiol content. While both cannabis products slowed response times at higher doses, only C. indica oil at the highest dose administered (10 mg/kg THC) decreased the number of trials on which rats chose to complete high-effort/high-reward trials. Repeated dosing with a medium dose of either cannabinoid product (3 mg/kg THC) did not influence choice. Ex vivo analyses confirmed comparable levels of brain THC after C. indica or C. sativa administration. Although controversial in the field, these results support the suggestion that products marketed as different cannabis cultivars have dissociable cognitive effects that may not resemble pure THC and emphasize the importance of the route of administration in experimental design. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Importance: Although perceived as relatively harmless and nonaddictive, adolescent cannabis use significantly increases the likelihood of developing cannabis use disorder in adulthood, especially for high-potency cannabis. Risky decision-making is associated with chronic cannabis use, but given confounds of human studies, it remains unclear whether adolescent cannabis exposure and Δ9-tetrahydrocannabinol (THC) potency specifically predicts risky decision-making or influences cognitive response to the drug later in life., Objective: To leverage a human data set of cannabis users and a rat model to evaluate the long-term outcomes of adolescent THC exposure on adult decision-making and impulse control., Design, Setting, and Participants: This translational rat study tested the link between adolescent THC exposure and adulthood decision-making. A reanalysis of a previously published dataset of human chronic cannabis users was conducted to evaluate decision-making phenotypes. Computational modeling assessed the human and animal results in a single framework. Data were collected from 2017 to 2020 and analyzed from 2020 to 2022., Main Outcomes and Measures: Decision-making was measured by the Iowa Gambling Task (IGT) and Rat Gambling Task (rGT). Impulse control was assessed in the rat model. Computational modeling was used to determine reward and punishment learning rates and learning strategy used by cannabis users and THC-exposed rats. Cell-specific molecular measures were conducted in the prefrontal cortex and amygdala., Results: Of 37 participants, 24 (65%) were male, and the mean (SD) age was 33.0 (8.3) years. Chronic cannabis users (n = 22; mean [SE] IGT score, -5.182 [1.262]) showed disadvantageous decision-making compared with controls (n = 15; mean [SE] IGT score, 7.133 [2.687]; Cohen d = 1.436). Risky choice was associated with increased reward learning (mean [SE] IGT score: cannabis user, 0.170 [0.018]; control, 0.046 [0.008]; Cohen d = 1.895) and a strategy favoring exploration vs long-term gains (mean [SE] IGT score: cannabis user, 0.088 [0.012]; control, 0.020 [0.002]; Cohen d = 2.218). Rats exposed to high-dose THC but not low-dose THC during adolescence also showed increased risky decision-making (mean [SE] rGT score: vehicle, 46.17 [7.02]; low-dose THC, 69.45 [6.01]; high-dose THC, 21.97 [11.98]; Cohen d = 0.433) and elevated reward learning rates (mean [SE] rGT score: vehicle, 0.17 [0.01]; low-dose THC, 0.10 [0.01]; high-dose THC, 0.24 [0.06]; Cohen d = 1.541) during task acquisition. These animals were also uniquely susceptible to increased cognitive impairments after reexposure to THC in adulthood, which was correlated with even greater reward learning (r = -0.525; P < .001) and a shift in strategy (r = 0.502; P < .001), similar to results seen in human cannabis users. Molecular studies revealed that adolescent THC dose differentially affected cannabinoid-1 receptor messenger RNA expression in the prelimbic cortex and basolateral amygdala in a layer- and cell-specific manner. Further, astrocyte glial fibrillary acidic protein messenger RNA expression associated with cognitive deficits apparent with adult THC reexposure., Conclusions and Relevance: In this translational study, high-dose adolescent THC exposure was associated with cognitive vulnerability in adulthood, especially with THC re-exposure. These data also suggest a link between astrocytes and cognition that altogether provides important insights regarding the neurobiological genesis of risky cannabis use that may help promote prevention and treatment efforts.

Sex differences in motivation for food rewards, gambling, and drugs of abuse are modulated by multiple factors, including sensory stimuli, gonadal hormones, and cognitive bias. Cues, drugs of abuse, and a high-fat diet can significantly impact neural signaling in the reward system and functioning of neural systems that regulate executive functions differentially in males and females. Additionally, sex differences in risky decision-making, cognitive bias, and motivation for food and drugs of abuse are mediated by gonadal hormones in both sexes. As neuroscientists analyze data from both sexes, it is becoming apparent that these differences are not simply mediated by hormones in females, but involve sex differences in the specific neural responses to stimuli, including both external stimuli and internal hormonal signals. Understanding sex differences in the mechanisms underlying reward-seeking behaviors and the development of substance use disorders will help uncover potential therapies and treatments that will benefit both men and women. Based on these observations, it is essential that females are included in neuroscience research., (Copyright © 2022 the authors.)

Social isolation is an established risk factor for mental illness and impaired immune function. Evidence suggests that neuroinflammatory processes contribute to mental illness, possibly via cytokine-induced modulation of neural activity. We examined the effects of lipopolysaccharide (LPS) administration and social home cage environment on cognitive performance in the 5-Choice Serial Reaction Time Task (5CSRTT), and their effects on corticosterone and cytokines in serum and brain tissue. Male Long-Evans rats were reared in pairs or in isolation before training on the 5CSRTT. The effects of saline and LPS (150 µg/kg i.p.) administration on sickness behaviour and task performance were then assessed. LPS-induced sickness behaviour was augmented in socially-isolated rats, translating to increased omissions and slower response times in the 5CSRTT. Both social isolation and LPS administration reduced impulsive responding, while discriminative accuracy remained unaffected. With the exception of reduced impulsivity in isolated rats, these effects were not observed following a second administration of LPS, revealing behavioural tolerance to repeated LPS injections. In a separate cohort of animals, social isolation potentiated the ability of LPS to increase serum corticosterone and IL-6, which corresponded to increased IL-6 in the orbitofrontal and medial prefrontal cortices and the nucleus accumbens. Basal IL-4 levels in the nucleus accumbens were reduced in socially-isolated rats. These findings are consistent with the adaptive response of reduced motivational drive following immune challenge, and identify social isolation as an exacerbating factor. Enhanced IL-6 signalling may play a role in mediating the potentiated behavioural response to LPS administration in isolated animals., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Previous research has indicated that reward-paired cues can enhance disadvantageous risky choice in both humans and rodents. Systemic administration of a serotonin 2C receptor antagonist can attenuate this cue-induced risk preference in rats. However, the neurocognitive mechanisms mediating this effect are currently unknown. We therefore assessed whether the serotonin 2C receptor antagonist RS 102221 is able to attenuate cue-enhanced risk preference via its actions in the lateral orbitofrontal cortex (lOFC) or prelimbic (PrL) area of the medial prefrontal cortex (mPFC). A total of 32 male Long-Evans rats were trained on the cued version of the rat gambling task (rGT), a rodent analog of the human Iowa gambling task, and bilateral guide cannulae were implanted into the lOFC or PrL. Intra-lOFC infusions of the 5-HT 2C antagonist RS 102221 reduced risky choice in animals that showed a preference for the risky options of the rGT at baseline. This effect was not observed in optimal decision-makers, nor those that received infusions targeting the PrL. Given prior data showing that 5-HT 2C antagonists also improve reversal learning through the same neural locus, we hypothesized that reward-concurrent cues may amplify risky decision-making through cognitive inflexibility. We therefore devalued the sugar pellet rewards used in the cued rGT (crGT) through satiation and observed that decision-making patterns did not shift unless animals also received intra-lOFC RS 102221. Collectively, these data suggest that the lOFC is one critical site through which reward-concurrent cues promote risky choice patterns that are insensitive to reinforcer devaluation, and that 5-HT 2C antagonism may optimize choice by facilitating exploration., (Copyright © 2021 Hathaway et al.)

Gambling and substance use disorders are highly comorbid. Both clinical populations are impulsive and exhibit risky decision-making. Drug-associated cues have long been known to facilitate habitual drug-seeking, and the salient audiovisual cues embedded within modern gambling products may likewise encourage problem gambling. The dopamine neurons of the ventral tegmental area (VTA) are exquisitely sensitive to drugs of abuse, uncertain rewards, and reward-paired cues and may therefore be the common neural substrate mediating synergistic features of both disorders. To test this hypothesis, we first gained specific inhibitory control over VTA dopamine neurons by transducing a floxed inhibitory DREADD (AAV5-hSyn-DIO-hM4D(Gi)-mCherry) in rats expressing Cre recombinase in tyrosine hydroxylase neurons. We then trained rats in our cued rat gambling task (crGT), inhibiting dopamine neurons throughout task acquisition and performance, before allowing them to self-administer cocaine in the same diurnal period as crGT sessions. The trajectories of addiction differ in women and men, and the dopamine system may differ functionally across the sexes; therefore, we used male and female rats here. We found that inhibition of VTA dopamine neurons decreased cue-induced risky choice and reduced motor impulsivity in males, but surprisingly, enhanced risky decision making in females. Inhibiting VTA dopamine neurons also prevented cocaine-induced changes in decision making in both sexes, but nevertheless drove all animals to consume more cocaine. These findings show that chronic dampening of dopamine signalling can have both protective and deleterious effects on addiction-relevant behaviours, depending on biological sex and dependent variable of interest., (© 2021 Society for the Study of Addiction.)

Rationale: The flashing lights and sounds of modern casinos are alluring and may contribute to the addictive nature of gambling. Such cues can have a profound impact on the noradrenaline (NA) system, which could therefore be a viable therapeutic target for gambling disorder (GD). While there is substantial evidence to support the involvement of NA in the impulsive symptoms of GD, its function in mediating the "pro-addictive" impact of cues is less understood., Objective: We wished to investigate the role of NA in our rodent assay of decision making and impulsivity, the cued rat gambling task (crGT). Given that sex differences are prominent in addiction disorders, and increasingly reported in the monoaminergic regulation of behaviour, we also prioritised evaluating noradrenergic drugs in both sexes., Methods: Female and male rats were trained to stability on the crGT and then given intraperitoneal injections of the noradrenaline reuptake inhibitor atomoxetine, the α 2A receptor agonist guanfacine, the beta receptor antagonist propranolol, and the α 2 receptor antagonist yohimbine., Results: Atomoxetine dose-dependently improved decision-making score. Guanfacine selectively enhanced decision making in risk-preferring males and optimal performing females. Propranolol and yohimbine did not influence decision making. Atomoxetine and guanfacine reduced premature responses, while yohimbine bi-phasically affected this index of motor impulsivity., Conclusions: These results support the hypothesis that NA is an important neuromodulator of the cue-induced deficits in decision making observed in laboratory-based gambling paradigms, and suggest that NAergic drugs like atomoxetine and guanfacine may be useful in treating GD.

Background: Pairing rewards with sensory stimulation, in the form of auditory and visual cues, increases risky decision-making in both rats and humans. Understanding the neurobiological basis of this effect could help explain why electronic gambling machines are so addictive, and inform treatment development for compulsive gambling and gaming. Numerous studies implicate the dopamine system in mediating the motivational influence of reward-paired cues; recent data suggest the cholinergic system also plays a critical role. Previous work also indicates that cholinergic drugs alter decision-making under uncertainty., Aims: We investigated whether the addition of reward-concurrent cues to the rat gambling task (crGT) altered the effects of peripherally administered cholinergic compounds., Methods: Muscarinic and nicotinic agonists and antagonists were administered to 16 male, Long-Evans rats trained on the crGT. Measures of optimal/risky decision-making and motor impulsivity were the main dependent variables of interest., Results: The muscarinic receptor antagonist scopolamine improved decision-making overall, decreasing selection of one of the risky options while increasing choice of the more advantageous options. The muscarinic agonist oxotremorine increased choice latency but did not significantly affect option preference. Neither the nicotinic antagonist mecamylamine nor the agonist nicotine affected choice patterns, but mecamylamine decreased premature responding, an index of motor impulsivity., Conclusions: These results contrast sharply from those obtained previously using the uncued rGT, and suggest that the deleterious effects of win-paired cues on decision-making and impulse control may result from elevated cholinergic tone.

The subthalamic nucleus (STN) is known to play a role in the control of impulsivity of action and in impulsivity of choice under certain conditions. In order to assess its influence on decision-making under uncertainty, we have tested here the effects of bilateral STN lesions in rats performing a probability discounting task (PDT) and a "loss-chasing" task, both tasks assessing risky decision under uncertainty, but one in a positive context (probability to obtain a larger reward) and the other in a negative context (risk for a larger loss). The PDT measures the choice between a small certain and a large uncertain reward. Conversely, in the "loss-chasing" task, animals choose between accepting a small certain loss versus risking a larger but uncertain penalty. The results show that STN lesions reduce risk-taking in both the PDT and the loss-chasing task, suggesting that STN inactivation could decrease risky decision-making whatever the nature of the outcome in an ambiguous context. Interestingly, opposite results were found in a small number of animals for which the lesions extended to the area dorsal to the STN (in the zona incerta), such that these animals increased choice of the uncertain option in the PDT. These results confirm the specificity of STN involvement in these processes and may provide explanations for some side-effects reported in patients when STN manipulations extend to the Zona Incerta. They also support the choice of the STN as a target for the treatment of impulse control disorders in Parkinson's disease and in obsessive compulsive disorders., (© 2020 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Parkinson's disease (PD) is a neurodegenerative disorder that is characterized by symptoms that impact both motor and non-motor domains. Outside of motor impairments, PD patients are at risk for impulse control disorders (ICDs), which include excessively disabling impulsive and compulsive behaviors. ICD symptoms in PD (PD + ICD) can be broadly conceptualized as a synergistic interaction between dopamine agonist therapy and the many molecular and circuit-level changes intrinsic to PD. Aside from discontinuing dopamine agonist treatment, there remains a lack of consensus on how to best address ICD symptoms in PD. In this review, we explore recent advances in the molecular and neuroanatomical mechanisms underlying ICD symptoms in PD by summarizing a rapidly accumulating body of clinical and preclinical studies, with a special focus on the utility of rodent models in gaining new insights into the neurochemical basis of PD + ICD. We also discuss the relevance of these findings to the broader problem of impulsive and compulsive behaviors that impact a range of neuropsychiatric syndromes., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2021 Augustine, Winstanley and Krishnan.)

Dopamine D 2/3 receptor agonists are less likely to trigger dyskinesias than L-dopa while still offering relief from the motor symptoms of Parkinson's disease (PD). However, these drugs can cause serious impulse control problems and gambling disorders. Adjunctive therapies capable of blocking these side effects without impacting the antiparkinsonian effect would be clinically useful. G-protein-coupled receptor 52 (GPR52) is an orphan Gs-protein-coupled receptor that is coexpressed with striatal D₂ receptors. Activating GPR52 attenuates behaviors associated with increased striatal dopamine release without altering basal function. Iatrogenic gambling disorder may be mediated, at least partly, by striatal dopamine signaling. We therefore investigated whether 2 potent small-molecule GPR52 agonists (BD442618, BD502657) could block the increase in preference for uncertain outcomes caused by acute d-amphetamine and chronic ropinirole, without altering baseline choice patterns. In the rat betting task (rBT), subjects choose between a guaranteed reward (the "wager") versus the 50:50 chance of double the wager or nothing. Although wager size varies across trial blocks, both options are constantly matched for expected value. The effects of BD442618 on the rBT were acutely assessed alone or in combination with d-amphetamine and subsequently in combination with chronic ropinirole. The latter experiment was then repeated with BD502657. BD442618 did not alter baseline decision making but attenuated the increase in preference for uncertainty caused by both acute amphetamine and chronic ropinirole administration. Similarly, BD502657 abrogated chronic ropinirole's effects. These data provide the first evidence that GPR52 agonists may be useful in treating iatrogenic gambling disorder or other conditions hallmarked by hyperdopaminergic states. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Impairments in decision making under uncertainty, as measured by the Iowa Gambling Task (IGT), are observed in persons suffering from temporal lobe epilepsy (TLE), in which seizures originate in the amygdala and hippocampal formations. Gambling disorder is also more prevalent in this population. Individuals with amygdala damage show similar deficits in decision-making, as do rats with lesions restricted to the basolateral amygdala (BLA) performing an analogous rat gambling task (rGT), yet whether hyperstimulation of the BLA impacts risky decision-making has yet to be demonstrated. We therefore investigated whether kindling of the BLA affected rGT performance. In this task, sugar pellet profits are maximised through consistent selection of options associated with smaller per-trial gains but shorter punishing time-outs. Just as in the IGT, subjects must avoid the risky options, as penalties are disproportionately high despite the higher reward available. Most rats adopt the optimal strategy, but some instead make high numbers of risky, disadvantageous choices. Once stable choice preferences had been established on-task, sixteen male Long Evans rats were implanted unilaterally with a bipolar electrode targeting the BLA and stimulated twice daily until three stage five seizures had been elicited. The electrodes revealed to be nearly evenly places in the BLA and the Central Nucleus of the Amygdala (CeA). Kindling transiently increased choice of the option paired with the smallest reward but also the lowest level of punishment- a risk-averse, but suboptimal, choice. Risk-preferring rats also made more premature responses, a marker of motor impulsivity, and were faster to make a choice, whereas these variables were unaffected in optimal decision-makers. These data suggest epileptiform activity originating within the amygdala can impair choice and promote impulsivity, at least in some individuals., (Copyright © 2020. Published by Elsevier B.V.)

Organisms must frequently evaluate the amount of effort to invest in pursuing future rewards. Despite explicit awareness of the potential benefits of cognitive work, individuals vary in their willingness to attempt cognitively demanding tasks, regardless of intellectual ability. Such differences may suggest that the degree to which cognitive effort degrades perceived outcome value is a subjective, rather than objective, process, similar to risk and delay discounting. Although numerous studies suggest the orbitofrontal cortex (OFC) is important for allowing subjective value estimates to be updated and/or used in cost/benefit decision-making, the causal role of the OFC in valuations of mental effort has received scant investigation. We therefore trained 24 female Long-Evans rats on the rodent cognitive effort task (rCET) and assessed performance following temporary bilateral inactivation of the ventrolateral OFC (vlOFC). In the rCET, rats decide at trial outset whether to perform an easy or hard attentional challenge, namely to localize a brief visual stimulus to one of five possible locations. The difficulty of the challenge is determined by the stimulus duration (1.0 vs. 0.2s for easy vs. hard trials respectively), and success on hard trials results in double the sugar pellet rewards. Somewhat surprisingly, inactivations of the vlOFC did not affect rats' willingness or ability to exert cognitive effort for larger rewards, despite increasing omissions and motor impulsivity on-task. When considered with previous work, it appears the vlOFC plays a minimal role in cognitive effort allocation specifically, and in valuations of effort more generally., (© 2020 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Current methods using a single PET scan to detect voxel-level transient dopamine release-using F-test (significance) and cluster size thresholding-have limited detection sensitivity for clusters of release small in size and/or having low release levels. Specifically, simulations show that voxels with release near the peripheries of such clusters are often rejected-becoming false negatives and ultimately distorting the F-distribution of rejected voxels. We suggest a Monte Carlo method that incorporates these two observations into a cost function, allowing erroneously rejected voxels to be accepted under specified criteria. In simulations, the proposed method improves detection sensitivity by up to 50% while preserving the cluster size threshold, or up to 180% when optimizing for sensitivity. A further parametric-based voxelwise thresholding is then suggested to better estimate the release dynamics in detected clusters. We apply the Monte Carlo method to a pilot scan from a human gambling study, where additional parametrically unique clusters are detected as compared to the current best methods-results consistent with our simulations.

Lithium's efficacy in reducing both symptom severity in bipolar disorder (BD) and suicide risk across clinical populations may reflect its ability to reduce impulsivity. Changes in immune markers are associated with BD and suicidality yet their exact role in symptom expression remains unknown. Evidence also suggests that lithium may decrease levels of pro-inflammatory cytokines in the periphery and central nervous system, and that such changes are related to its therapeutic efficacy. However, issues of cause and effect are hard to infer from clinical data alone. Here, we investigated the effects of chronic dietary lithium treatment on rats' performance of the 5-Choice Serial Reaction Time Task (5CSRTT), a well-validated operant behavioural task measuring aspects of impulsivity, attention and motivation. Male Long-Evans rats received a diet supplemented with 0.3% LiCl (n = 13), or the equivalent control diet (n = 16), during behavioural testing. Blood and brain tissue samples were assayed for a wide range of cytokines once any changes in impulsivity became significant. After 12 weeks, chronic lithium treatment reduced levels of motor impulsivity, as indexed by premature responses in the 5CSRTT; measures of sustained attention and motivation were unaffected. Plasma levels of IL-1β, IL-10 and RANTES (CCL-5) were reduced in lithium-treated rats at this time point. IL-1β, IL-6 and RANTES were also reduced selectively within the orbitofrontal cortex of lithium-treated rats, whereas cytokine levels in the medial prefrontal cortex and nucleus accumbens were comparable with control subjects. These results are consistent with the hypothesis that lithium may improve impulse control deficits in clinical populations by minimising the effects of pro-inflammatory signalling on neuronal activity, particularly within the orbitofrontal cortex., (Copyright © 2020. Published by Elsevier Inc.)

Women and men can differ in their propensity to take risks and develop impulse control and addiction disorders. Sexual dimorphisms in behavioral control by the mesolimbic dopaminergic reward system may underlie these phenomena, given its sensitivity to gonadal hormones. However, this is hard to test experimentally using humans. Using the rat gambling task (rGT), we investigated what impact acute inhibition of accumbal dopamine had on decision-making and impulsivity in animals of both sexes. We expressed an inhibitory designer receptor exclusively activated by designer drugs (hM4D[Gi]) in the accumbal dopaminergic efferents of female and male transgenic (Tg) rats, engineered to selectively express cre recombinase in neurons synthesizing tyrosine hydroxylase. We then trained the rats to perform the rGT and assessed the effect of an acute clozapine-n-oxide (0-3 mg/kg) challenge. Chemogenetic inhibition of dopaminergic projections to the accumbens did not affect choice in females, perhaps due to low levels of risky choice in Tg+ animals at baseline, but induced a switch from risky to optimal decision-making in males performing the cued rGT. This manipulation also decreased motor impulsivity but only in females. These data support the hypothesis that cue-driven risky choice is mediated, at least in males, by activity of accumbal dopaminergic neurons. However, motor impulsivity is more sensitive to inhibition of accumbal dopamine neurons in female rats. These data may help explain differences in the manifestation of addictions across gender and reinforce the importance of examining both sexes when seeking to attribute control of behavior to specific monoaminergic pathways. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Rationale: Problematic patterns of gambling are characterised by loss of control and persistent gambling often to recover losses. However, little is known about the mechanisms that mediate initial choices to begin gambling and then continue to gamble in the face of losing outcomes., Objectives: These experiments first assessed gambling and loss-chasing performance under different win/lose probabilities in C57Bl/6 mice, and then investigated the effects of antagonism of 5-HT 2C R with SB242084, 5-HT 1A R agonism with 8-OH-DPAT and modafinil, a putative cognitive enhancer., Results: As seen in humans and other species, mice demonstrated the expected patterns of behaviour as the odds for winning were altered increasing gambling and loss-chasing when winning was more likely. SB242084 decreased the likelihood to initially gamble, but had no effects on subsequent gambling choices in the face of repeated losses. In contrast, 8-OH-DPAT had no effects on choosing to gamble in the first place, but once started 8-OH-DPAT increased gambling choices in a dose-sensitive manner. Modafinil effects were different to the serotonergic drugs in both decreasing the propensity to initiate gambling and chase losses., Conclusions: We present evidence for dissociable effects of systemic drug administration on different aspects of gambling behaviour. These data extend and reinforce the importance of serotonergic mechanisms in mediating discrete components of gambling behaviour. They further demonstrate the ability of modafinil to reduce gambling behaviour. Our work using a novel mouse paradigm may be of utility in modelling the complex psychological and neurobiological underpinnings of gambling problems, including the analysis of genetic and environmental factors.

Background: Individuals must frequently evaluate whether it is worth allocating cognitive effort for desired outcomes. Motivational deficits are a common feature of psychiatric illness such as major depression. Selective serotonin reuptake inhibitors are commonly used to treat this disorder, yet some data suggest these compounds are ineffective at treating amotivation, and may even exacerbate it., Aims: Here we used the rodent Cognitive Effort Task (rCET) to assess serotonergic (5-hydroxytryptamine, 5-HT) contributions to decision-making with cognitive effort costs., Methods: The rCET is a modified version of the 5-choice serial reaction time task, a well-validated test of visuospatial attention and impulse control. At the start of each rCET trial, rats chose one of two levers, which set the difficulty of an attentional challenge, namely the localization of a visual stimulus illuminated for 0.2 or 1 s on hard versus easy trials. Successful completion of hard trials was rewarded with double the sugar pellets. Twenty-four female Long-Evans rats were trained on the rCET and systemically administered the 5-HT 1A agonist 8-OH-DPAT, the 5-HT 2A antagonist M100907, the 5-HT 2C agonist Ro-60-0175, as well as the 5-HT 2C antagonist SB 242, 084., Results: 5-HT 2A antagonism dose-dependently reduced premature responding, while 5-HT 2C antagonism had the opposite effect. 8-OH-DPAT impaired accuracy of target detection at higher doses, while Ro-60-0175 dose-dependently improved accuracy on difficult trials. However, none of the drugs affected the rats' choice of the harder option., Conclusion: When considered with existing work evaluating decision-making with physical effort costs, it appears that serotonergic signalling plays a minor role in guiding effort allocation.

Primary Objective : Traumatic brain injury (TBI) is associated with numerous psychiatric comorbidities, and subclinical psychiatric symptoms. While many symptoms have been replicated in animal models of brain injury, a vast majority of studies utilize naïve rats as subjects, which fail to mimic the complex learning history of human patients. Methods and Procedures : In the current study, we evaluated the effects of a brain injury in animals with early exposure to uncertainty on post-injury decision-making in a probabilistic task, the rodent gambling task (RGT). Main Outcomes and Results : Exposure to uncertainty resulted in a heterogeneous sample relative to prior publications, and brain-injured rats showed no deficits in choice behavior compared to shams which contrasts with large, pervasive deficits in previously published work. However, TBI increased impulsivity and caused transient changes in behavioral variables indicative of initial motivational deficits (pellets earned, omitted responses). Notably, effects of amphetamine were similar on this heterogeneous sample of rats relative to a number of other published reports, suggesting consistent effects of gross monoaminergic manipulations on choice behavior, independent of experience. Conclusions : Going forward, translational studies need to consider the heterogeneity that exists at the clinical level and account for these problems when modeling diseases in animals.

Previous work has shown that chronic administration of the dopamine D 2/3 receptor agonist ropinirole invigorates performance on a rodent slot machine task (rSMT). This behavioural change appears superficially similar to the iatrogenic gambling disorder (GD) observed in a sub-set of patients with Parkinson's disease (PD), and has been associated with increased activation of the intra-cellular signalling proteins GSK3β and CREB in the striatum. Here, we wanted to determine whether this response to ropinirole could be attenuated by targeting these signalling proteins, and if the loss of dopaminergic innervation characteristic of PD would alter ropinirole's effects on the rSMT. Male Long Evans rats were trained on the rSMT. Dopaminergic terminals innervating the dorsolateral striatum were then lesioned bilaterally using the neurotoxin 6-hydroxydopamine hydrochloride (6-OHDA). Subsequently animals were implanted with osmotic mini-pumps delivering ropinirole. Lastly, animals were given dietary lithium (Li + ), to inhibit the activation of GSK3β, or injections of the ß-adrenoceptor antagonist propranolol, which potently inhibits CREB as a secondary mechanism of action, and any changes in ropinirole-induced increases in compulsive-like engagement in the rSMT evaluated. Chronic ropinirole increased the number of trials animals completed, reproducing our original finding. This increase in task engagement was not altered in animals with 6-OHDA lesions, a putative model of early PD. In addition, the effects of ropinirole were not attenuated by administration of Li + , but were ameliorated by propranolol. These data suggest that propranolol may represent a potential pharmacotherapy for the treatment of iatrogenic gambling., (© 2018 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Traumatic brain injury (TBI) has been linked to the development of numerous psychiatric diseases, including substance use disorder. However, it can be difficult to ascertain from clinical data whether the TBI is cause or consequence of increased addiction vulnerability. Surprisingly few studies have taken advantage of animal models to investigate the causal nature of this relationship. In terms of a plausible neurobiological mechanism through which TBI could magnify the risk of substance dependence, numerous studies indicate that TBI can cause widespread disruption to monoaminergic signaling in striatal regions, and also increases neuroinflammation. In the current study, male Long-Evans rats received either a mild or severe TBI centered over the frontal cortex via controlled cortical impact, and were subsequently trained to self-administer cocaine over 10 6-hour sessions. At the end of the study, markers of striatal dopaminergic function, and levels of inflammatory cytokine levels in the frontal lobes, were assessed via western blot and multiplex ELISA, respectively. There was significantly higher cocaine intake in a subset of animals with either mild or severe TBI. However, many animals within both TBI groups failed to acquire self-administration. Principal components analysis suggested that both dopaminergic and neuroinflammatory proteins were associated with overall cocaine intake, yet only an inflammatory component was associated with acquisition of self-administration, suggesting neuroinflammation may make a more substantial contribution to the likelihood of drug-taking. Should neuroinflammation play a causal role in mediating TBI-induced addiction risk, anti-inflammatory therapy may reduce the likelihood of substance abuse in TBI populations., (© 2018 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Rationale: Pairing rewarding outcomes with audiovisual cues in simulated gambling games increases risky choice in both humans and rats. However, the cognitive mechanism through which this sensory enhancement biases decision-making is unknown., Objectives: To assess the computational mechanisms that promote risky choice during gambling, we applied a series of reinforcement learning models to a large dataset of choices acquired from rats as they each performed one of two variants of a rat gambling task (rGT), in which rewards on "win" trials were delivered either with or without salient audiovisual cues., Methods: We used a sampling technique based on Markov chain Monte Carlo to obtain posterior estimates of model parameters for a series of RL models of increasing complexity, in order to assess the relative contribution of learning about positive and negative outcomes to the latent valuation of each choice option on the cued and uncued rGT., Results: Rats which develop a preference for the risky options on the rGT substantially down-weight the equivalent cost of the time-out punishments during these tasks. For each model tested, the reduction in learning from the negative time-outs correlated with the degree of risk preference in individual rats. We found no apparent relationship between risk preference and the parameters that govern learning from the positive rewards., Conclusions: The emergence of risk-preferring choice on the rGT derives from a relative insensitivity to the cost of the time-out punishments, as opposed to a relative hypersensitivity to rewards. This hyposensitivity to punishment is more likely to be induced in individual rats by the addition of salient audiovisual cues to rewards delivered on win trials.

Traumatic brain injury (TBI) affects at least 3 M people annually. In humans, repetitive mild TBI (rmTBI) can lead to increased impulsivity and may be associated with chronic traumatic encephalopathy. To better understand the relationship between repetitive TBI (rTBI), impulsivity and neuropathology, we used CHIMERA (Closed-Head Injury Model of Engineered Rotational Acceleration) to deliver five TBIs to rats, which were continuously assessed for trait impulsivity using the delay discounting task and for neuropathology at endpoint. Compared to sham controls, rats with rTBI displayed progressive impairment in impulsive choice. Histological analyses revealed reduced dopaminergic innervation from the ventral tegmental area to the olfactory tubercle, consistent with altered impulsivity neurocircuitry. Consistent with diffuse axonal injury generated by CHIMERA, white matter inflammation, tau immunoreactivity and degeneration were observed in the optic tract and corpus callosum. Finally, pronounced grey matter microgliosis was observed in the olfactory tubercle. Our results provide insight into the mechanisms by which rTBI leads to post-traumatic psychiatric-like symptoms in a novel rat TBI platform., (Copyright © 2019. Published by Elsevier Inc.)

Rationale: Chronic administration of D 2/3 receptor agonists ropinirole or pramipexole can increase the choice of uncertain rewards in rats, theoretically approximating iatrogenic gambling disorder (iGD)., Objectives: We aimed to assess the effect of chronic ropinirole in animal models that attempt to capture critical aspects of commercial gambling, including the risk of losing rather than failing to gain, and the use of win-paired sensory stimuli heavily featured in electronic gambling machines (EGMs)., Methods: Male Long-Evans rats learned the rat gambling task (rGT; n = 24), in which animals sample between four options that differ in the magnitude and probability of rewards and time-out punishments. In the cued rGT (n = 40), reward-concurrent audiovisual cues were added that scaled in complexity with win size. Rats were then implanted with an osmotic pump delivering ropinirole (5 mg/kg/day) or saline for 28 days., Results: Chronic ropinirole did not unequivocally increase preference for more uncertain outcomes in either the cued or uncued rGT. Ropinirole transiently increased premature responses, a measure of motor impulsivity, and this change was larger and more long-lasting in the cued task., Conclusions: These data suggest that explicitly signaling loss prevents the increase in preference for uncertain rewards caused by D 2/3 receptor agonists observed previously. The ability of win-paired cues to amplify ropinirole-induced increases in motor impulsivity may explain why compulsive use of EGMs is particularly common in iGD. These data offer valuable insight into the cognitive-behavioral mechanisms through which chronic dopamine agonist treatments may induce iGD and related impulse control disorders.

Rats trained to perform a version of the rat gambling task (rGT) in which salient audiovisual cues accompany reward delivery, similar to commercial gambling products, show greater preference for risky options. Given previous demonstrations that probabilistic reinforcement schedules can enhance psychostimulant-induced increases in accumbal DA and locomotor activity, we theorized that performing this cued task could perpetuate a proaddiction phenotype. Significantly more rats developed a preference for the risky options in the cued versus uncued rGT at baseline, and this bias was further exacerbated by cocaine self-administration, whereas the choice pattern of optimal decision-makers was unaffected. The addition of reward-paired cues therefore increased the proportion of rats exhibiting a maladaptive cognitive response to cocaine self-administration. Risky choice was not associated with responding for conditioned reinforcement or a marker of goal/sign-tracking, suggesting that reward-concurrent cues precipitate maladaptive choice via a unique mechanism unrelated to simple approach toward, or responding for, conditioned stimuli. Although "protected" from any resulting decision-making impairment, optimal decision-makers trained on the cued rGT nevertheless self-administered more cocaine than those trained on the uncued task. Collectively, these data suggest that repeated engagement with heavily cued probabilistic reward schedules can drive addiction vulnerability through multiple behavioral mechanisms. Rats trained on the cued rGT also exhibited blunted locomotor sensitization and lower basal accumbal DA levels, yet greater cocaine-induced increases in accumbal DA efflux. Gambling in the presence of salient cues may therefore result in an adaptive downregulation of the mesolimbic DA system, rendering individuals more sensitive to the deleterious effects of taking cocaine. SIGNIFICANCE STATEMENT Impaired cost/benefit decision making, exemplified by preference for the risky, disadvantageous options on the Iowa Gambling Task, is associated with greater risk of relapse and treatment failure in substance use disorder. Understanding factors that enhance preference for risk may help elucidate the neurobiological mechanisms underlying maladaptive decision making in addiction, thereby improving treatment outcomes. Problem gambling is also highly comorbid with substance use disorder, and many commercial gambling products incorporate salient win-paired cues. Here we show that adding reward-concurrent cues to a rat analog of the IGT precipitates a hypodopaminergic state, characterized by blunted accumbal DA efflux and attenuated locomotor sensitization, which may contribute to the enhanced responsivity to uncertain rewards or the reinforcing effects of cocaine we observed., (Copyright © 2019 the authors 0270-6474/19/391843-13$15.00/0.)

Our willingness to take risks, our ability to wait or the speed with which to make decisions are central features of our personality. However, it is now recognized that impulsive and risk-taking behaviours are not a unitary construct, and different aspects can be both psychologically and neurally dissociated. The range of neurochemicals and brain systems that govern these behaviours is extensive, and this may be a contributing factor to the phenotypic range seen in the human population. However, this variety can also be pathological as extremes in risk-taking and impulsive behaviours are characteristics of many neuropsychiatric and indeed neurodegenerative disorders. This spans obsessive-compulsive disorder, where behaviour becomes ridged and non-spontaneous, to the nonsensical risk-taking seen in gambling and drug taking. This article is part of the theme issue 'Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications'.

Multiline slot machines encourage continued play through 'losses disguised as wins' (LDWs), outcomes in which the money returned is less than that wagered. Individuals with gambling problems may be susceptible to this game feature. The cognitive and neurobiological mechanisms through which LDWs act are unknown. In a novel rat operant task, animals chose between a 'certain' lever, which always delivered two sugar pellets, or an 'uncertain' lever, resulting in four sugar pellets on 50% of trials. LDWs were then introduced as a return of three sugar pellets on 30-40% of uncertain rewarded trials. For half the rats, winning outcomes were paired with audiovisual feedback (cues). In a second study, the basolateral amygdala (BLA) was inactivated during initial presentation of LDWs. While LDWs shifted most rats' choice toward the certain lever, a subgroup of LDW vulnerable rats continued to choose the uncertain option, when the reward rate diminished. This profile of LDW vulnerability was reproduced after inactivating the BLA. Persistent choice of uncertain outcomes despite lower reward rates may reflect impaired functioning within the BLA. Future work using this model may provide insight into the neurobiological mechanisms contributing to the motivational properties of LDWs and their contribution to problematic gambling.

Reward-related stimuli can potently influence behavior; for example, exposure to drug-paired cues can trigger drug use and relapse in people with addictions. Psychological mechanisms that generate such outcomes likely include cue-induced cravings and attentional biases. Recent animal data suggest another candidate mechanism: reward-paired cues can enhance risky decision making, yet whether this translates to humans is unknown. Here, we examined whether sensory reward-paired cues alter decision making under uncertainty and risk, as measured respectively by the Iowa Gambling Task and a two-choice lottery task. In the cued versions of both tasks, gain feedback was augmented with reward-concurrent audiovisual stimuli. Healthy human volunteers (53 males, 78 females) performed each task once, one with and the other without cues (cued Iowa Gambling Task/uncued Vancouver Gambling Task: n = 63; uncued Iowa Gambling Task/cued Vancouver Gambling Task: n = 68), with concurrent eye-tracking. Reward-paired cues did not affect choice on the Iowa Gambling Task. On the two-choice lottery task, the cued group displayed riskier choice and reduced sensitivity to probability information. The cued condition was associated with reduced eye fixations on probability information shown on the screen and greater pupil dilation related to decision and reward anticipation. This pupil effect was unrelated to the risk-promoting effects of cues: the degree of pupil dilation for risky versus risk-averse choices did not differ as a function of cues. Together, our data show that sensory reward cues can promote riskier decisions and have additional and distinct effects on arousal. SIGNIFICANCE STATEMENT Animal data suggest that reward-paired cues can promote maladaptive reward-seeking by biasing cost-benefit decision making. Whether this finding translates to humans is unknown. We examined the effects of salient reward-paired audiovisual cues on decision making under risk and uncertainty in human volunteers. Cues had risk-promoting effects on a risky choice task and independently increased task-related arousal as measured by pupil dilation. By demonstrating risk-promoting effects of cues in human participants, our data identify a mechanism whereby cue reactivity could translate into maladaptive behavioral outcomes in people with addictions., (Copyright © 2018 the authors 0270-6474/18/3810362-09$15.00/0.)

Background: Deficits in impulse control feature in many psychiatric conditions including bipolar disorder, suicidality and addictions. Lithium lowers impulsivity in clinical populations and decreases pathological gambling in experimental medicine studies, but suffers from adverse effects, poor compliance and a low therapeutic index., Aims: Recently we identified that the neuroprotective agent ebselen, which is reportedly safe in humans, inhibited inositol monophosphatase (IMPase), a candidate lithium mechanism. Ebselen also reduced 5-HT receptor (5-HT 2A ) function which predicts impulsivity lowering properties. Here we investigated the effect of ebselen in rat models of impulsive behaviour., Methods: Ebselen was tested in two models of impulsivity with human analogues: the five-choice serial reaction time task (5-CSRTT) and rodent gambling task (rGT). The main outcome measures were premature responses (5-CSRTT and rGT) and choice behaviour (rGT), which model motor impulsivity and choice impulsivity, respectively., Results: At doses that decreased 5-HT 2A receptor function (DOI-induced wet dog shakes), ebselen decreased premature responding in the 5-CSRTT both in the absence and presence of cocaine. The 5-HT 2A receptor antagonist MDL 100,907 also reduced premature responding in the 5-CSRTT although not in the presence of cocaine. In the rGT ebselen showed a tendency to reduce premature responding but had no effect on choice behaviour., Conclusions: These findings suggest that ebselen preferentially reduces motor impulsivity over choice impulsivity, and that inhibition of 5-HT 2A receptor function is a contributing mechanism. Collectively, these data support the repurposing of ebselen as an anti-impulsive treatment and fast-tracking to clinical trials in patient groups characterised by poor impulse control.

Obesity is a world-wide crisis with profound healthcare and socio-economic implications and it is now clear that the central nervous system (CNS) is a target for the complications of metabolic disorders like obesity. In addition to decreases in physical activity and sedentary lifestyles, diet is proposed to be an important contributor to the etiology and progression of obesity. Unfortunately, there are gaps in our knowledge base related to how dietary choices impact the structural and functional integrity of the CNS. For example, while chronic consumption of hypercaloric diets (increased sugars and fat) contribute to increases in body weight and adiposity characteristic of metabolic disorders, the mechanistic basis for neurocognitive deficits in obesity remains to be determined. In addition, studies indicate that acute consumption of hypercaloric diets impairs performance in a wide variety of cognitive domains, even in normal non-obese control subjects. These results from the clinical and basic science literature indicate that diet can have rapid, as well as long lasting effects on cognitive function. This review summarizes our symposium at the 2017 Society for the Study of Ingestive Behavior (SSIB) meeting that discussed these effects of diet on cognition. Collectively, this review highlights the need for integrated and comprehensive approaches to more fully determine how diet impacts behavior and cognition under physiological conditions and in metabolic disorders like type 2 diabetes mellitus (T2DM) and obesity., (Crown Copyright © 2018. Published by Elsevier Inc. All rights reserved.)

Evidence suggests that impulse control deficits contribute to excessive food intake in some individuals with obesity. In addition to its known role in regulating appetite and glucose metabolism, the hormone leptin also directly modulates the activity of central dopamine systems. Although dopamine is involved in regulating impulsivity, the influence of leptin per se on this cognitive domain remains unclear. This study explored the performance of male leptin knockout (KO) and wild type (WT) rats in the 5-Choice Serial Reaction Time task (5CSRTT) of motor impulsivity and visuospatial attention. Behavioural performance was assessed under baseline conditions, following 4 weeks high-fat diet (HFD; 60 kcal%) consumption, and after acute pharmacological challenge with the indirect dopamine agonist, amphetamine. Subjects were also tested for glucose tolerance and insulin sensitivity, and dorsal and ventral striatal tissue was assayed ex vivo for markers of dopaminergic transmission. Obese KO rats learned the 5CSRTT at a slower rate compared to WT rats, in a manner suggestive of mild attentional impairment. However, task performance at baseline and after HFD intake was similar to that of WT controls. HFD intake reduced omissions across all subjects, whereas amphetamine challenge revealed a prominent genotype effect on 5CSRTT performance, with potentiated levels of impulsive responding and faster response times in KO rats compared to WT animals. Effects of amphetamine on other variables were similar between genotypes. Notably, the expression of striatal dopaminergic markers was unchanged in KO rats, and neither chronic food restriction nor HFD intake altered the impairments in glucose or insulin metabolism previously reported in these animals. These data suggest that leptin deficiency enhances impulsive action under conditions of dopaminergic challenge, yet this seems independent of overt changes in the expression of post-synaptic markers of dopamine signalling in striatal regions., (Copyright © 2018. Published by Elsevier Inc.)

Cognitive effort is a ubiquitous process, yet surprisingly little is known about the brain mechanisms responsible for evaluating it. Here, we utilize the rat Cognitive Effort Task (rCET) to probe the striatum's role in deciding between options that vary in the amount of cognitive effort required for success. In the rCET, animals choose to perform either an easy trial, in which the attentional demand is low but the potential reward is small, or a difficult trial which is more attentionally demanding but can yield twice the sugar pellets. Twenty-six male Long Evans rats were trained on the rCET and the effects of pharmacologically inactivating the dorsomedial striatum (DMS) and core region of the nucleus accumbens were determined. Temporary inactivation of the DMS decreased all animals' choice of the high-effort, high-reward option, impaired attentional accuracy, and robustly increased premature responding without impairing general indices of motor ability. The DMS therefore appears necessary for the integration of cognitive signals required for optimal performance. In stark contrast, following temporary inactivation of the ventral striatum, subjects were fundamentally unable to perform the task, as reflected by a drastic decrease in the number of trials initiated and an increase in omitted responses. Together, these data suggest the striatum is likely part of a larger cortico-limbic-striatal network whose function is to optimize decisions requiring cognitive effort costs, at least in the attentional domain, and that striatal subregions have dissociable roles in the adjudication and application of this form of cognitive effort., (Copyright © 2018 Elsevier Ltd. All rights reserved.)

Although exposure to delta-9-tetrahydrocannabinol (THC) is perceived to be relatively harmless, mounting evidence has begun to show that it is associated with a variety of cognitive deficits, including poor decision making. THC-induced impairments in decision making are thought to be the result of cannabinoid CB1 receptor activation, and although clinical literature suggests that chronic activation via THC contributes to perturbations in decision making, acute CB1 receptor modulation has yielded mixed results. Using an animal model to examine how CB1-specific ligands impact choice biases would provide significant insight as to how recruitment of the endocannabinoid system may influence decision making. Here, we used the rat gambling task (rGT), a validated analogue of the human Iowa Gambling Task, to assess baseline decision making preferences in male Wistar rats. After acquisition rGT performance was measured. Animals were challenged with the CB1 receptor antagonist rimonabant, the partial agonist THC, and the synthetic agonist WIN55,212-2. Animals were also treated acutely with the fatty acid amide hydrolase (FAAH) inhibitor URB597 to selectively upregulate the endocannabinoid anandamide. Blockade of the CB1 receptor produced a trend improvement in decision making in animals who preferred the advantageous task options, yet left choice unaffected in risk-prone rats. Neither CB1 receptor agonist had strong effects on decision making, but a high dose THC decreased premature responses, whereas WIN55,212-2 did the opposite. URB597 did not affect task performance. These results indicate that although chronic CB1 receptor activation may be associated with impaired decision making, acute modulation has modest effects on choice and instead may play a substantive role in regulating impulsive responding., (Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.)

Traumatic brain injury (TBI) is associated with the development of numerous psychiatric diseases. Of particular concern for TBI patients is the impact of chronic impulsivity on daily functioning. Despite the scope of the human problem, little has been done to address impulsivity in animal models of brain injury. In the current study, we examined the effects of either a severe or a milder bilateral frontal controlled cortical impact injury on impulsivity using the Delay Discounting Task (DDT), in which preference for smaller-sooner over larger-later rewards is indicative of greater impulsive choice. Both milder and severe TBI caused a significant, chronic increase in impulsive decision making. Despite these pronounced changes in performance of the DDT, memory function, as assessed by the Morris Water Maze, was not impaired in more mildly injured rats and only transiently impacted in the severe TBI group. Whereas a significant lesion was only evident in severely injured rats, analysis of cytokine levels within the frontal cortex revealed a selective increase in interleukin (IL)-12 that was associated with the magnitude of the change in impulsive choice caused by both milder and severe TBI. These findings suggest that tissue loss alone cannot explain the increased impulsivity observed, and that inflammatory pathways mediated by IL-12 may be a contributing factor. The findings from this study highlight the sensitivity of sophisticated behavioral measures designed to assess neuropsychiatric dysfunction in the detection of TBI-induced cognitive impairments and their utility in identifying potential mechanistic pathways and therapeutic targets.

Rationale: Adding reward-concurrent cues to a rat gambling task (rGT) increases risky choice. This cued version of the task may reflect an "addiction-like" cognitive process, more similar to human gambling than the uncued task. Serotonergic drugs that target 5-HT 2 receptors alter mechanisms linked to impulse control. However, relatively little is known regarding the impact of such agents on either risky decision making, or the ability of conditioned stimuli to bias the choice process, despite potential relevance to addiction development and treatment., Objectives: The aim of this study was to determine the effects of SB 242,084 and M100907, selective antagonists at the 5-HT 2C and 5-HT 2A receptors respectively, as well as the selective 5-HT 2C receptor agonist Ro-60-0175, on performance of both cued and uncued versions of the rGT., Results: SB 242,084 significantly and dose-dependently increased choice of the most optimal option in the cued rGT only, despite concurrently increasing impulsive responses made prematurely on both the cued and uncued rGT. M100907 and Ro-60-0175 did not alter risky decision making, but nevertheless produced the expected decrease in premature responses on both task variants., Conclusions: These findings demonstrate that the 5-HT 2 receptor-mediated regulation of risky decision making and motor impulsivity can be pharmacologically dissociated and further show that the presence of highly salient reward-paired cues critically alters the neurochemical regulation of the choice process. Importantly, these results suggest that 5-HT 2C receptor antagonists may be of use in disrupting maladaptive patterns of decision making.

Deep brain stimulation of the subthalamic nucleus (STN-DBS) can improve the motor symptoms of Parkinson's disease (PD) and negate the problematic side effects of dopamine replacement therapy. Although there is concern that STN-DBS may enhance the development of gambling disorder and other impulse control disorders in this patient group, recent data suggest that STN-DBS may actually reduce iatrogenic impulse control disorders, and alleviate obsessive-compulsive disorder (OCD). Here, we sought to determine whether STN-DBS was beneficial or detrimental to performance of the rat gambling task (rGT), a rodent analogue of the Iowa Gambling Task (IGT) used to assess risky decision making clinically. Rats chose between four options associated with different amounts and probabilities of sugar pellet rewards versus timeout punishments. As in the IGT, the optimal approach was to favor options associated with smaller per-trial gains but lower timeout penalties. Once a stable behavioral baseline was established, electrodes were implanted bilaterally into the STN, and the effects of STN-DBS assessed on-task over 10 consecutive sessions using an A-B-A design. STN-DBS did not affect choice in optimal decision makers that correctly favored options associated with smaller per-trial gains but also lower penalties. However, a minority (∼25%) preferred the maladaptive "high-risk, high-reward" options at baseline. STN-DBS significantly and progressively improved choice in these risk-preferring rats. These data support the hypothesis that STN-DBS may be beneficial in ameliorating maladaptive decision making associated with compulsive and addiction disorders.

Maladaptive decision-making may play an integral role in the development and maintenance of an addiction. Substance-dependent individuals make riskier choices on the Iowa Gambling Task, and these deficits persist during withdrawal and are predictive of relapse. However, it is unclear from clinical studies whether this cognitive impairment is a cause or consequence of drug use. We trained male Long-Evans rats on the rat Gambling Task, a rodent analogue of the Iowa Gambling Task, to determine how choice preference influenced, and was influenced by, cocaine self-administration, withdrawal and incubation of craving. Rats that exhibited a preference for the risky, disadvantageous options at baseline were uniquely and adversely affected by cocaine self-administration. Risky choice was exacerbated in these rats when decision-making was assessed during the same diurnal period as cocaine self-administration, whereas the choice pattern of optimal decision-makers was unaffected. This decision-making deficit was maintained during 30 days of withdrawal and correlated with greater cue-induced incubation of craving. Risk-preferring rats also made more drug-seeking responses during cocaine self-administration. These data demonstrate that poor decision-making prior to contact with addictive drugs is associated with a pro-addictive behavioural phenotype, characterized by further increased risky choice and heightened responding for drug both during cocaine self-administration and withdrawal. Such findings indicate that the elevated risky decision-making observed in substance-dependent populations is not merely circumstantial, but makes an important contribution to addiction vulnerability and severity that can now be effectively modelled in laboratory rats., (© 2016 Society for the Study of Addiction.)

The α 2 -adrenoceptor antagonist, yohimbine, is commonly used as a pharmacological stressor. Its behavioural effects are typically attributed to elevated noradrenaline release via blockade of central, inhibitory autoreceptors. We have previously reported that yohimbine increases motor impulsivity in rats on the five-choice serial reaction time task (5CSRTT), a cognitive behavioural assessment which measures motor impulsivity and visuospatial attention. Furthermore, this effect depended on cyclic adenomonophosphate (cAMP) signalling via cAMP response element binding (CREB) protein in the orbitofrontal cortex (OFC). However, the role of specific adrenoceptors in this effect is not well-characterised. We therefore investigated whether the pro-impulsive effects of systemic yohimbine could be reproduced by direct administration into the OFC, or attenuated by intra-OFC or systemic administration of prazosin and propranolol-antagonists at the α 1 - and β-adrenoceptor, respectively. Male Long-Evans rats were trained on the 5CSRTT and implanted with guide cannulae aimed at the OFC. Systemically administered α 1 - or β-adrenoceptor antagonists attenuated yohimbine-induced increases in premature responding. In contrast, local infusion of yohimbine into the OFC reduced such impulsive responding, while blockade of α 1 - or β-adrenoceptors within the OFC had no effect on either basal or yohimbine-stimulated motor impulsivity. Direct administration of selective antagonists at the α 1 -, α 2 - or β-adrenoceptor into the OFC therefore produce clearly dissociable effects from systemic administration. Collectively, these data suggest that the pro-impulsivity effect of yohimbine can be modulated by adrenergic signalling in brain areas outside of the OFC, in addition to non-adrenergic signalling pathways within the OFC., (Copyright © 2017 Elsevier B.V. All rights reserved.)

For decades, the nosology of mental illness has been based largely upon the descriptions in the Diagnostic and Statistical Manual of the American Psychiatric Association (DSM). A recent challenge to the DSM approach to psychiatric nosology from the National Institute on Mental Health (USA) defines Research Domain Criteria (RDoC) as an alternative. For RDoC, psychiatric illnesses are not defined as discrete categories, but instead as specific behavioral dysfunctions irrespective of DSM diagnostic categories. This approach was driven by two primary weaknesses noted in the DSM: (1) the same symptoms occur in very different disease states; and (2) DSM criteria lack grounding in the underlying biological causes of mental illness. RDoC intends to ground psychiatric nosology in those underlying mechanisms. This review addresses the suitability of RDoC vs. DSM from the view of modeling mental illness in animals. A consideration of all types of psychiatric dysfunction is beyond the scope of this review, which will focus on models of conditions associated with frontostriatal dysfunction., (Copyright © 2016. Published by Elsevier Ltd.)

Cognitive biases may play a significant role in disorders of decision making such as pathological gambling and addiction. Understanding the neurobiology of these biases could lead to more effective pharmacological and therapeutic treatments for disorders in which aberrant decision making is prominent. The rodent Betting Task (rBT) was designed to measure one commonly observed decision-making heuristic in rodents, namely "escalation of commitment" in which subjects become more risk averse as the stakes increase, even if the odds of success remain constant. In the rodent task, the animal is presented with a choice between two options of equivalent expected value, such that reward on one option is guaranteed while the other has a 50% chance of double the prize or nothing. Past work has shown that a subset of animals (termed wager sensitive) adopt an irrationally risk-averse choice preference in which they shift their choice away from the uncertain option as the bet size grows larger. In the current study, the orbitofrontal (OFC), prelimbic (PrL), and infralimbic cortex (IL) were inactivated to evaluate the contributions made by these regions to choice behavior on the rBT. Inactivation of the OFC (but not the IL or the PrL) selectively ameliorated the risk-averse choice pattern characteristic of wager-sensitive animals. This finding suggests that the OFC may have a relatively unique role in promoting this type of non-normative decision-making under uncertainty, an effect that is potentially related to its role in representing the subjective value of reinforcing outcomes., (Copyright © 2016. Published by Elsevier Ltd.)

Background: Acceptance of cannabis use is growing. However, prolonged use is associated with diminished psychosocial outcomes, potentially mediated by drug-induced cognitive impairments. Δ 9 -Tetrahydrocannabinol (THC) is the main psychoactive ingredient in cannabis, yet other phytocannabinoids in the plant, such as cannabidiol (CBD), have unique properties. Given that CBD can modulate the undesirable effects of THC, therapeutic agents, such as nabiximols, contain higher CBD:THC ratios than illicit marijuana. We tested the hypothesis that THC impairs a relevant cognitive function for long-term success, namely willingness to exert cognitive effort for greater rewards, and that CBD could attenuate such decision-making impairments., Methods: Male Long-Evans rats ( n = 29) performing the rat cognitive effort task (rCET) received acute THC and CBD, independently and concurrently, in addition to other cannabinoids. Rats chose between 2 options differing in reward magnitude, but also in the cognitive effort (attentional load) required to obtain them., Results: We found that THC decreased choice of hard trials without impairing the animals' ability to accurately complete them. Strikingly, this impairment was correlated with CB1 receptor density in the medial prefrontal cortex - an area previously implicated in effortful decision-making. In contrast, CBD did not affect choice. Coadministration of 1:1 CBD:THC matching that in nabiximols modestly attenuated the deleterious effects of THC in "slacker" rats., Limitations: Only male rats were investigated, and the THC/CBD coadministration experiment was carried out in a subset of individuals., Conclusion: These findings confirm that THC, but not CBD, selectively impairs decision-making involving cognitive effort costs. However, coadministration of CBD only partially ameliorates such THC-induced dysfunction.