Search

Rationale: Endocannabinoids (eCBs) are critical gatekeepers of dopaminergic signaling, and disrupting cannabinoid receptor-1 (CB1) signaling alters DA dynamics to attenuate cue-motivated behaviors. Prior studies suggest that dopamine (DA) release plays a critical role in driving sign-tracking.Objectives: Here, we determine whether systemic injections of rimonabant, a CB1 receptor inverse agonist, during Pavlovian lever autoshaping impair the expression of sign-tracking. We next examine whether rimonabant blocks the reinforcing properties of the Pavlovian lever cue in a conditioned reinforcement test.Methods: In Exp. 1, we trained rats in Pavlovian lever autoshaping prior to systemic rimonabant injections (0, 1, 3 mg/kg) during early and late Pavlovian lever autoshaping sessions. In Exp. 2, we trained rats in Pavlovian lever autoshaping prior to systemic rimonabant injections (0, 1 mg/kg) during a conditioned reinforcement test.Results: Rimonabant dose-dependently decreased lever contact and probability, and increased sign-tracker’s latency to approach the lever cue early in Pavlovian training. With extended training, many previously goal-tracking and intermediate rats shifted to lever approach, which remained dose-dependently sensitive to rimonabant. Rimonabant attenuated cue-evoked food cup approach early, but not late, in conditioning, and did not affect pellet retrieval or consumption. The inserted lever cue served as a robust conditioned reinforcer after Pavlovian lever autoshaping, and 1 mg/kg rimonabant blocked conditioned reinforcement.Conclusions: Together, our results suggest that CB1 signaling mediates two critical properties of incentive stimuli; their ability to attract (Exp. 1) and their ability to reinforce (Exp. 2) behavior. [ABSTRACT FROM AUTHOR]

Background: Conditioned stimuli (CS) that predict reward delivery acquire the ability to induce phasic dopamine release in the nucleus accumbens (NAc). This dopamine release may facilitate conditioned approach behavior, which often manifests as approach to the site of reward delivery (called “goal‐tracking”) or to the CS itself (called “sign‐tracking”). Previous research has linked sign‐tracking in particular to impulsivity and drug self‐administration, and addictive drugs may promote the expression of sign‐tracking. Ethanol (EtOH) acutely promotes phasic release of dopamine in the accumbens, but it is unknown whether an alcoholic reward alters dopamine release to a CS. We hypothesized that Pavlovian conditioning with an alcoholic reward would increase dopamine release triggered by the CS and subsequent sign‐tracking behavior. Moreover, we predicted that chronic intermittent EtOH (CIE) exposure would promote sign‐tracking while acute administration of naltrexone (NTX) would reduce it. Methods: Rats received 14 doses of EtOH (3 to 5 g/kg, intragastric) or water followed by 6 days of Pavlovian conditioning training. Rewards were a chocolate solution with or without 10% (w/v) alcohol. We used fast‐scan cyclic voltammetry to measure phasic dopamine release in the NAc core in response to the CS and the rewards. We also determined the effect of NTX (1 mg/kg, subcutaneous) on conditioned approach. Results: Both CIE and alcoholic reward, individually but not together, associated with greater dopamine to the CS than control conditions. However, this increase in dopamine release was not linked to greater sign‐tracking, as both CIE and alcoholic reward shifted conditioned approach from sign‐tracking behavior to goal‐tracking behavior. However, they both also increased sensitivity to NTX, which reduced goal‐tracking behavior. Conclusions: While a history of EtOH exposure or alcoholic reward enhanced dopamine release to a CS, they did not promote sign‐tracking under the current conditions. These findings are consistent with the interpretation that EtOH can stimulate conditioned approach, but indicate that the conditioned response may manifest as goal‐tracking. [ABSTRACT FROM AUTHOR]

Three studies explored the sensitivity of aversive Pavlovian to instrumental transfer (PIT) to Pavlovian extinction in rodents. Rats underwent Pavlovian conditioning prior to avoidance training. The PIT test then involved assessment of the effects of the Pavlovian conditioned stimulus (CS) on the performance of the avoidance response (AR). Conducting extinction prior to avoidance training and transfer testing, allowed spontaneous recovery and shock reinstatement of extinguished motivation, whereas conducting extinction following avoidance training and just prior to PIT testing successfully reduced transfer effects. This was also the case in a design that compared responding to an extinguished CS against a non-extinguished CS rather than comparing extinguished and non-extinguished groups to one another. While extinction treatments in many appetitive PIT studies do not successfully reduce transfer, and can sometimes enhance the effect, the current findings show that an extinction treatment temporally close to transfer testing can reduce the motivational impact of the aversive Pavlovian CS on instrumental avoidance responding.

The nucleus accumbens (NAc) is a key node within corticolimbic circuitry for guiding action selection and cost/benefit decision making in situations involving reward uncertainty. Preclinical studies have typically assessed risk/reward decision making using assays where decisions are guided by internally generated representations of choice-outcome contingencies. Yet, real-life decisions are often influenced by external stimuli that inform about likelihoods of obtaining rewards. How different subregions of the NAc mediate decision making in such situations is unclear. Here, we used a novel assay colloquially termed the "Blackjack" task that models these types of situations. Male Long-Evans rats were trained to choose between one lever that always delivered a one-pellet reward and another that delivered four pellets with different probabilities [either 50% (good-odds) or 12.5% (poor-odds)], which were signaled by one of two auditory cues. Under control conditions, rats selected the large/risky option more often on good-odds versus poor-odds trials. Inactivation of the NAc core caused indiscriminate choice patterns. In contrast, NAc shell inactivation increased risky choice, more prominently on poor-odds trials. Additional experiments revealed that both subregions contribute to auditory conditional discrimination. NAc core or shell inactivation reduced Pavlovian approach elicited by an auditory CS+, yet shell inactivation also increased responding during presentation of a CS+. These data highlight distinct contributions for NAc subregions in decision making and reward seeking guided by discriminative stimuli. The core is crucial for implementation of conditional rules, whereas the shell refines reward seeking by mitigating the allure of larger, unlikely rewards and reducing expression of inappropriate or non-rewarded actions. [ABSTRACT FROM AUTHOR]

Background. Disturbances in Pavlovian valuation systems are reported to follow traumatic stress exposure. However, motivated decisions are also guided by instrumental mechanisms, but to date the effect of traumatic stress on these instrumental systems remain poorly investigated. Here, we examine whether a single episode of severe traumatic stress influences flexible instrumental decisions through an impact on a Pavlovian system. Methods. Twenty-six survivors of the 2011 Norwegian terror attack and 30 matched control subjects performed an instrumental learning task in which Pavlovian and instrumental associations promoted congruent or conflicting responses. We used reinforcement learning models to infer how traumatic stress affected learning and decision-making. Based on the importance of dorsal anterior cingulate cortex (dACC) for cognitive control, we also investigated if individual concentrations of Glx (=glutamate + glutamine) in dACC predicted the Pavlovian bias of choice. Results. Survivors of traumatic stress expressed a greater Pavlovian interference with instrumental action selection and had significantly lower levels of Glx in the dACC. Across subjects, the degree of Pavlovian interference was negatively associated with dACC Glx concentrations. Conclusions. Experiencing traumatic stress appears to render instrumental decisions less flexible by increasing the susceptibility to Pavlovian influences. An observed association between prefrontal glutamatergic levels and this Pavlovian bias provides novel insight into the neurochemical basis of decision-making, and suggests a mechanism by which traumatic stress can impair flexible instrumental behaviours. [ABSTRACT FROM AUTHOR]

Following a Pavlovian pairing procedure, alcohol-paired cues come to elicit behavioral responses that lead to alcohol consumption. Here we used an optogenetic approach to activate basolateral amygdala (BLA) axonal terminals targeting the shell of nucleus accumbens (AcbSh) and investigated a possible influence over cue-conditioned alcohol seeking and alcohol drinking, based on the demonstrated roles of these areas in behavioral responding to Pavlovian cues and in feeding behavior. Rats were trained to anticipate alcohol or sucrose following the onset of a discrete conditioned stimulus (CS). Channelrhodopsin-mediated activation of the BLA-to-AcbSh pathway concurrent with each CS disrupted cued alcohol seeking. Activation of the same pathway caused rapid cessation of alcohol drinking from a sipper tube. Neither effect was accompanied by an overall change in locomotion. Finally, the suppressive effect of photoactivation on cued-triggered seeking was also evidenced in animals trained with sucrose. Together these findings suggest that photoactivation of BLA terminals in the AcbSh can override the conditioned motivational properties of reward-predictive cues as well as unconditioned consummatory responses necessary for alcohol drinking. The findings provide evidence for a limbic-striatal influence over motivated behavior for orally consumed rewards, including alcohol. [ABSTRACT FROM AUTHOR]

Three studies explored the sensitivity of aversive Pavlovian to instrumental transfer (PIT) to Pavlovian extinction in rodents. Rats underwent Pavlovian conditioning prior to avoidance training. The PIT test then involved assessment of the effects of the Pavlovian conditioned stimulus (CS) on the performance of the avoidance response (AR). Conducting extinction prior to avoidance training and transfer testing, allowed spontaneous recovery and shock reinstatement of extinguished motivation, whereas conducting extinction following avoidance training and just prior to PIT testing successfully reduced transfer effects. This was also the case in a design that compared responding to an extinguished CS against a non-extinguished CS rather than comparing extinguished and non-extinguished groups to one another. While extinction treatments in many appetitive PIT studies do not successfully reduce transfer, and can sometimes enhance the effect, the current findings show that an extinction treatment temporally close to transfer testing can reduce the motivational impact of the aversive Pavlovian CS on instrumental avoidance responding. [ABSTRACT FROM AUTHOR]

Summary The dopamine system responds to reward-predictive cues to reflect a prospective estimation of reward value, although its role in encoding retrospective reward-related information is unclear. We report that cue-evoked dopamine release in the nucleus accumbens core encodes the time elapsed since the previous reward or rather the wait time. Specifically, a cue that always follows the preceding reward with a short wait time elicits a greater dopamine response relative to a distinct cue that always follows the preceding reward with a long wait time. Differences in the dopamine response between short wait and long wait cues were evident even when these cues were never experienced together within the same context. Conditioned responding updated accordingly with a change in cue-evoked dopamine release but was unrelated to a difference in the dopamine response between cues. Collectively, these findings illustrate that the cue-evoked dopamine response conveys a subjective estimation of the relative reward rate. [ABSTRACT FROM AUTHOR]

The ability to assign safety to stimuli in the environment is integral to everyday functioning. A key brain region for this evaluation is the ventromedial prefrontal cortex (vmPFC). To investigate the importance of vmPFC safety signaling, we used neuroimaging of Pavlovian fear reversal, a paradigm that involves flexible updating when the contingencies for a threatening (CS+) and safe (CS-) stimulus reverse, in a prototypical disorder of inflexible behavior influenced by anxiety, Obsessive Compulsive Disorder (OCD). Skin conductance responses in OCD patients (n = 43) failed to differentiate during reversal compared with healthy controls (n = 35), although significant differentiation did occur during early conditioning and amygdala BOLD signaling was unaffected in these patients. Increased vmPFC activation (for CS+ > CS-) during early conditioning predicted the degree of generalization in OCD patients during reversal, whereas vmPFC safety signals were absent throughout learning in these patients. Regions of the salience network (dorsal anterior cingulate, insula, and thalamus) showed early learning task-related hyperconnectivity with the vmPFC in OCD, consistent with biased processing of the CS+. Our findings reveal an absence of vmPFC safety signaling in OCD, undermining flexible threat updating and explicit contingency knowledge. Although differential threat learning can occur to some extent in the absence of vmPFC safety signals, effective CS-signaling becomes crucial during conflicting threat and safety cues. These results promote further investigation of vmPFC safety signaling in other anxiety disorders, with potential implications for the development of exposure-based therapies, in which safety signaling is likely to play a key role. [ABSTRACT FROM AUTHOR]

When a Pavlovian cue is presented separately from its associated reward, some animals will acquire a sign tracking (ST) response - approach and/or interaction with the cue - while others will acquire a goal tracking response - approach to the site of reward. We have previously shown that cue-evoked excitations in the nucleus accumbens (NAc) encode the vigor of both behaviors; in contrast, reward-related responses diverge over the course of training, possibly reflecting neurochemical differences between sign tracker and goal tracker individuals. However, a substantial subset of neurons in the NAc exhibit inhibitory, rather than excitatory, cue-evoked responses, and the evolution of their signaling during Pavlovian conditioning remains unknown. Using single-neuron recordings in behaving rats, we show that NAc neurons with cue-evoked inhibitions have distinct coding properties from neurons with cue-evoked excitations. Cue-evoked inhibitions become more numerous over the course of training and, like excitations, may encode the vigor of sign tracking and goal tracking behavior. However, the responses of cue-inhibited neurons do not evolve differently between sign tracker and goal tracker individuals. Moreover, cue-evoked inhibitions, unlike excitations, are insensitive to extinction of the cue-reward relationship. Finally, we show that cue-evoked excitations are greatly diminished by reward devaluation, while inhibitory cue responses are virtually unaffected. Overall, these findings converge with existing evidence that cue-excited neurons in NAc, but not cue-inhibited neurons, are profoundly sensitive to the same behavior variations that are often associated with changes in dopamine release., Competing Interests: The authors declare no competing financial interests., (Copyright © 2023 Duffer et al.)

Recent work suggests complementary roles of the prelimbic and infralimbic regions of the rat medial prefrontal cortex in cognitive control processes, with the prelimbic cortex implicated in top-down modulation of associations and the infralimbic cortex playing a role in the inhibition of inappropriate responses. Following selective lesions made to prelimbic or infralimbic regions (or control sham-surgery) rats received simultaneous training on Pavlovian feature negative (A+, XA−) and feature positive (B−, YB+) discriminations designed to lead to hierarchical occasion-setting control by the features (X, Y) over their respective targets (A, B). Evidence for hierarchical control was assessed in a transfer test in which features and targets were swapped (YA, XB). All groups were able to learn the feature negative and feature positive discriminations. Whilst sham-lesioned animals showed no transfer of control by features to novel targets (a hallmark of hierarchical control), rats with lesions of prelimbic or infralimbic regions showed evidence of transfer from the positive feature (Y) to the negative target (A), and from the negative feature (X) to the positive target (B; although this only achieved significance in infralimbic-lesioned animals). These data indicate that damage to either of these regions disrupts hierarchical occasion-setting control, extending our knowledge of their role in cognitive control to encompass flexible behaviours dictated by discrete cues.

Goal-directed behavior relies on accurate mental representations of the value of expected outcomes. Disruptions to this process are a central feature of several neuropsychiatric disorders, including addiction. Goal-directed behavior is most frequently studied using instrumental paradigms paired with outcome devaluation, but cue-evoked behaviors in Pavlovian settings can also be goal-directed and therefore sensitive to changes in outcome value. Emerging literature suggests that male and female rats may differ in the degree to which their Pavlovian-conditioned responses are goal-directed, but interpretation of these findings is complicated by the tendency of female and male rats to engage in distinct types of Pavlovian responses when trained with localizable cues. Here, we used outcome devaluation via sensory-specific satiety to assess the behavioral responses in male and female Long Evans rats trained to respond to an auditory CS (conditioned stimulus) in a Pavlovian-conditioning paradigm. We found that satiety-induced devaluation led to a decrease in behavioral responding to the reward-predictive CS, with males showing an effect on both port entry latency and probability and females showing an effect only on port entry probability. Overall, our results suggest that outcome devaluation affects Pavlovian-conditioned responses in both male and female rats, but that females may be less sensitive to outcome devaluation.

The lateral orbitofrontal cortex (lOFC) has been described as signaling either outcome expectancies or value. Previously, we used unblocking to show that lOFC neurons respond to a predictive cue signaling a ‘valueless’ change in outcome features (McDannald, 2014). However, many lOFC neurons also fired to a cue that simply signaled more reward. Here, we recorded lOFC neurons in a variant of this task in which rats learned about cues that signaled either more (upshift), less (downshift) or the same (blocked) amount of reward. We found that neurons acquired responses specifically to one of the three cues and did not fire to the other two. These results show that, at least early in learning, lOFC neurons fire to valued cues in a way that is more consistent with signaling of the predicted outcome’s features than with signaling of a general, abstract or cached value that is independent of the outcome.

Two studies explored the role of the amygdala in response modulation by an aversive conditioned stimulus (CS) in rats. Experiment 1 investigated the role of amygdala circuitry in conditioned suppression using a paradigm in which licking for sucrose was inhibited by a tone CS that had been previously paired with footshock. Electrolytic lesions of the lateral amygdala impaired suppression relative to sham-operated animals, and produced the same pattern of results when applied to central amygdala. In addition, disconnection of the lateral and central amygdala, by unilateral lesion of each on opposite sides of the brain, also impaired suppression relative to control subjects that received lesions of both areas on the same side. In each case, lesions were placed following Pavlovian conditioning and instrumental training, but before testing. This procedure produced within-subjects measures of the effects of lesion on freezing and between-group comparisons for the effects on suppression. Experiment 2 extended this analysis to a task where an aversive CS suppressed shuttling responses that had been previously food reinforced and also found effects of bilateral lesions of the central amygdala in a pre-post design. Together, these studies demonstrate that connections between the lateral and central amygdala constitute a serial circuit involved in processing aversive Pavlovian stimuli, and add to a growing body of findings implicating central amygdala in the modulation of instrumental behavior.

Early life adversity increases anxiety in adult rodents and primates, and increases the risk for developing post-traumatic disorder (PTSD) in humans. We hypothesized that early adversity impairs the use of learning signals – negative, aversive prediction errors – to reduce fear in uncertainty. To test this hypothesis, we gave adolescent rats a battery of adverse experiences then assessed adult performance in probabilistic Pavlovian fear conditioning and fear extinction. Rats were confronted with three cues associated with different probabilities of foot shock: one cue never predicted shock, another cue predicted shock with uncertainty, and a final cue always predicted shock. Control rats initially acquired fear to all cues, but rapidly reduced fear to the non-predictive and uncertain cues. Early adversity rats were slower to reduce fear to the non-predictive cue and never fully reduced fear to the uncertain cue. In extinction, all cues were presented in the absence of shock. Fear to the uncertain cue in discrimination, but not early adversity itself, predicted the reduction of fear in extinction. These results demonstrate early adversity impairs the use of negative, aversive prediction errors to reduce fear, especially in situations of uncertainty.

Although prosocial behaviors have been widely studied across disciplines, the mechanisms underlying them are not fully understood. Evidence from psychology, biology and economics suggests that prosocial behaviors can be driven by a variety of seemingly opposing factors: altruism or egoism, intuition or deliberation, inborn instincts or learned dispositions, and utility derived from actions or their outcomes. Here we propose a framework inspired by research on reinforcement learning and decision making that links these processes and explains characteristics of prosocial behaviors in different contexts. More specifically, we suggest that prosocial behaviors inherit features of up to three decision-making systems employed to choose between self- and other- regarding acts: a goal-directed system that selects actions based on their predicted consequences, a habitual system that selects actions based on their reinforcement history, and a Pavlovian system that emits reflexive responses based on evolutionarily prescribed priors. This framework, initially described in the field of cognitive neuroscience and machine learning, provides insight into the potential neural circuits and computations shaping prosocial behaviors. Furthermore, it identifies specific conditions in which each of these three systems should dominate and promote other- or self- regarding behavior.

In this review, we summarize findings supporting the existence of multiple behavioral strategies for controlling reward-related behavior, including a dichotomy between the goal-directed or model-based system and the habitual or model-free system in the domain of instrumental conditioning and a similar dichotomy in the realm of Pavlovian conditioning. We evaluate evidence from neuroscience supporting the existence of at least partly distinct neuronal substrates contributing to the key computations necessary for the function of these different control systems. We consider the nature of the interactions between these systems and show how these interactions can lead to either adaptive or maladaptive behavioral outcomes. We then review evidence that an additional system guides inference concerning the hidden states of other agents, such as their beliefs, preferences, and intentions, in a social context. We also describe emerging evidence for an arbitration mechanism between model-based and model-free reinforcement learning, placing such a mechanism within the broader context of the hierarchical control of behavior. [ABSTRACT FROM AUTHOR]

Alcohol-related stimuli can trigger relapse of alcohol-seeking behaviors even after extended periods of abstinence. Extinction of such stimuli provides a means for reducing their impact on relapse. However, the expression of extinction can be disrupted by exposure to the previous reinforcer as well as the simple passage of time. We investigated whether augmentation of prediction error or of noradrenaline neurotransmission by the reuptake inhibitor atomoxetine would enhance long-term extinction of alcohol-seeking behavior. Rats received Pavlovian conditioning of multiple stimuli signaling the delivery of an alcohol reward before individual extinction was given to each of these stimuli. Further extinction was then given to a target stimulus presented in compound with another alcohol-predictive stimulus intended to augment prediction error (Experiment 1) or after a systemic injection of atomoxetine (1.0 mg/kg; Experiment 2). Experiment 3 examined whether the compound stimulus effect relied on noradrenergic activity by testing the effects of the β-adrenergic antagonist propranolol, given prior to compound stimulus trials. Long-term retention of extinction learning was assessed a week later. Compound stimulus presentations enhanced long-term extinction as the stimulus extinguished in compound elicited less responding than a stimulus receiving equal extinction alone when tested a week later. This effect was mimicked by atomoxetine and blocked by propranolol given during extinction training. Thus, extinction of alcohol-seeking behavior can be improved by extinguishing multiple alcohol-predictive stimuli or enhancing noradrenaline neurotransmission during extinction training. Both behavioral and neurobiological processes could be exploited to enhance the outcome of extinction-based treatments for alcohol use disorders. [ABSTRACT FROM AUTHOR]

Mounting evidence indicates that adolescents exhibit heightened sensitivity to rewards and reward-related cues compared to adults, and that adolescents are often unable to exert behavioral control in the face of such cues. Moreover, differences in reward processing during adolescence have been linked to heightened risk taking and impulsivity. However, little is known about the processes by which adolescents learn about the appetitive properties of environmental stimuli that signal reward. To address this, Pavlovian conditioning procedures were used to test for differences in excitatory conditioning between adult and adolescent rats using various schedules of reinforcement. Specifically, separate cohorts of adult and adolescent rats were trained under conditions of consistent (continuous) or intermittent (partial) reinforcement. We found that the acquisition of anticipatory responding to a continuously-reinforced cue proceeded similarly in adolescents and adults. In contrast, responding increased at a greater rate in adolescents compared to adults during presentations of a partially-reinforced cue. We subsequently compared the ability of adolescent and adult rats to dynamically adjust the representation of a reward-predictive cue during extinction trials, in which a secondary inhibitory representation is acquired for the previously-reinforced stimulus. We observed significant age differences in the ability to flexibly update cue representations during extinction, in that the appetitive properties of cues with a history of either continuous or partial reinforcement persisted to a greater extent in adolescents relative to adults. [ABSTRACT FROM AUTHOR]

Translational assays of cognition that are similarly implemented in both lower and higher-order species, such as rodents and primates, provide a means to reconcile preclinical modeling of psychiatric neuropathology and clinical research. To this end, Pavlovian conditioning has provided a useful tool for investigating cognitive processes in both lab animal models and humans. This review focuses on trace conditioning, a form of Pavlovian conditioning typified by the insertion of a temporal gap (i.e., trace interval) between presentations of a conditioned stimulus (CS) and an unconditioned stimulus (US). This review aims to discuss pre-clinical and clinical work investigating the mnemonic processes recruited for trace conditioning. Much work suggests that trace conditioning involves unique neurocognitive mechanisms to facilitate formation of trace memories in contrast to standard Pavlovian conditioning. For example, the hippocampus and prefrontal cortex (PFC) appear to play critical roles in trace conditioning. Moreover, cognitive mechanistic accounts in human studies suggest that working memory and declarative memory processes are engaged to facilitate formation of trace memories. The aim of this review is to integrate cognitive and neurobiological accounts of trace conditioning from preclinical and clinical studies to examine involvement of working and declarative memory. [ABSTRACT FROM AUTHOR]

The orbitofrontal cortex (OFC) has been broadly implicated in the ability to use the current value of expected outcomes to guide behavior. Although value correlates have been prominently reported in lateral OFC, they are more often associated with more medial areas. Further, recent studies in primates have suggested a dissociation in which the lateral OFC is involved in credit assignment and representation of reward identity and more medial areas are critical to representing value. Previously, we used unblocking to test more specifically what information about outcomes is represented by OFC neurons in rats; consistent with the proposed dichotomy between the lateral and medial OFC, we found relatively little linear value coding in the lateral OFC (Lopatina et al., 2015). Here we have repeated this experiment, recording in the medial OFC, to test whether such value signals might be found there. Neurons were recorded in an unblocking task as rats learned about cues that signaled either more, less, or the same amount of reward. We found that medial OFC neurons acquired responses to these cues; however, these responses did not signal different reward values across cues. Surprisingly, we found that cells developed responses to cues predicting a change, particularly a decrease, in reward value. This is consistent with a special role for medial OFC in representing current value to support devaluation/revaluation sensitive changes in behavior. [ABSTRACT FROM AUTHOR]

Pavlovian conditioned stimuli (CSs) play an important role in the reinforcement and motivation of instrumental active avoidance (AA). Conditioned threats can also invigorate ongoing AA responding (aversive Pavlovian-instrumental transfer or PIT). The neural circuits mediating AA are poorly understood, although lesion studies suggest that lateral, basal and central amygdala nuclei, as well as infralimbic prefrontal cortex, make key, and sometimes opposing, contributions. We recently completed an extensive analysis of brain c-Fos expression in good vs. poor avoiders following an AA test (Martinez et al 2013, Learning and Memory). This analysis identified medial amygdala (MeA) as a potentially important region for Pavlovian motivation of instrumental actions. MeA is known to mediate defensive responding to innate threats as well as social behaviors, but its role in mediating aversive Pavlovian-instrumental interactions is unknown. We evaluated the effect of MeA lesions on Pavlovian conditioning, Sidman two-way AA conditioning (shuttling) and aversive PIT in rats. Mild footshocks served as the unconditioned stimulus in all conditioning phases. MeA lesions had no effect on AA but blocked the expression of aversive PIT and 22 kHz ultrasonic vocalizations in the AA context. Interestingly, MeA lesions failed to affect Pavlovian freezing to discrete threats but reduced freezing to contextual threats when assessed outside of the AA chamber. These findings differentiate MeA from lateral and central amygdala, as lesions of these nuclei disrupt Pavlovian freezing and aversive PIT, but have opposite effects on AA performance. Taken together, these results suggest that MeA plays a selective role in the motivation of instrumental avoidance by general or uncertain Pavlovian threats.

Aversive Pavlovian conditioned stimuli (CSs) elicit defensive reactions (e.g., freezing) and motivate instrumental actions like active avoidance (AA). Pavlovian reactions require connections between the lateral (LA) and central (CeA) nuclei of the amygdala, whereas AA depends on LA and basal amygdala (BA). Thus, the neural circuits mediating conditioned reactions and motivation appear to diverge in the amygdala. However, AA is not ideal for studying conditioned motivation, because Pavlovian and instrumental learning are intermixed. Pavlovian-to-instrumental transfer (PIT) allows for the study of conditioned motivation in isolation. PIT refers to the ability of a Pavlovian CS to modulate a separately-trained instrumental action. The role of the amygdala in aversive PIT is unknown. We designed an aversive PIT procedure in rats and tested the effects of LA, BA and CeA lesions. Rats received Pavlovian tone-shock pairings followed by Sidman shock-avoidance training. PIT was assessed by comparing shuttling rates in the presence and absence of the tone. Tone presentations facilitated instrumental responding. Aversive PIT was abolished by lesions of LA or CeA, but was unaffected by lesions of BA. These results suggest that LA and CeA are essential for aversive conditioned motivation. More specifically, the results are consistent with a model of amygdala processing in which the CS is encoded in the LA and then, via connections to CeA, the motivation to perform the aversive task is enhanced. These findings have implications for understanding the contribution of amygdala circuits to aversive instrumental motivation, but also for the relation of aversive and appetitive behavioral control.

Studying aversive behaviour is critical for understanding negative emotions and associated psychopathologies. However a comprehensive picture of the mechanisms underlying aversion is lacking, with associative learning theories focusing on Pavlovian reactions and decision-making theoretic approaches on prospective functions. We propose a computational model of aversion that combines goal-directed and Pavlovian forms of control into a unifying framework in which their relative importance is regulated by factors such as threat distance and controllability. Using simulations, we test whether the model can reproduce available empirical findings and discuss its relevance to understanding factors underlying negative emotions such as fear and anxiety. Furthermore, the specific method used to construct the model permits a natural mapping from its components to brain structure and function. Our model provides a basis for a unifying account of aversion that can guide empirical and interventional study contexts. [ABSTRACT FROM AUTHOR]

Copyright of Stratum Plus Journal is the property of P.P. Stratum plus and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Two studies explored the role of the amygdala in response modulation by an aversive conditioned stimulus (CS) in rats. Experiment 1 investigated the role of amygdala circuitry in conditioned suppression using a paradigm in which licking for sucrose was inhibited by a tone CS that had been previously paired with footshock. Electrolytic lesions of the lateral amygdala (LA) impaired suppression relative to sham-operated animals, and produced the same pattern of results when applied to central amygdala. In addition, disconnection of the lateral and central amygdala, by unilateral lesion of each on opposite sides of the brain, also impaired suppression relative to control subjects that received lesions of both areas on the same side. In each case, lesions were placed following Pavlovian conditioning and instrumental training, but before testing. This procedure produced within-subjects measures of the effects of lesion on freezing and betweengroup comparisons for the effects on suppression. Experiment 2 extended this analysis to a task where an aversive CS suppressed shuttling responses that had been previously food reinforced and also found effects of bilateral lesions of the central amygdala in a pre-post design. Together, these studies demonstrate that connections between the lateral and central amygdala constitute a serial circuit involved in processing aversive Pavlovian stimuli, and add to a growing body of findings implicating central amygdala in the modulation of instrumental behavior. [ABSTRACT FROM AUTHOR]

The Dolní Věstonice I site is one of the most significant Pavlovian localities known from southern Moravia. Numerous lithic and osseous tools were discovered in different areas, associated with a vast assemblage of animal bones collected from the surface of the entire site. The materials in this study come from the upper part of the site (excavations carried out 1924–28 and 1948–52) where five dwelling structures were described, accompanied by fireplaces and mammoth bone concentrations. This area is located close to a huge mammoth bone accumulation in a natural depression. The faunal composition discovered at Dolní Věstonice I is typical for other Pavlovian localities primarily known from southern Moravia. The percentage of mammoth remains is high, although they do not dominate in this assemblage. Cut marks on mammoth bones discovered during the studies clearly show that the meat of these animals was consumed, but in addition to mammoth, an extremely important role in the subsistence practices was also played by reindeer, horse, and carnivores, which account for around 40% of the complete identifiable assemblage. Cut marks are found on numerous bones of carnivores, especially wolf and wolverine. We conclude that the carnivores, in addition to other taxa commonly discovered at Palaeolithic sites, were an important component of the diet of Pavlovian hunters. [ABSTRACT FROM AUTHOR]

Background Experimental extinction serves as a model for psychiatric treatments based on associative learning. However, the effects of extinction are often transient, as evidenced by postextinction return of defensive behaviors. From a therapeutic perspective, an inherent problem with extinction may be that mere omission of threat is not sufficient to reduce future threat uncertainty. The current study tested an augmented form of extinction that replaced, rather than merely omitted, expected threat outcomes with novel nonthreat outcomes, with the goal of reducing postextinction return of defensive behaviors. Methods Thirty-two healthy male Sprague-Dawley rats and 47 human adults underwent threat conditioning to a conditioned stimulus paired with an electrical shock. Subjects then underwent a standard extinction protocol with shock omitted or an augmented extinction protocol wherein the shock was replaced by a surprising tone. Tests of postextinction recovery occurred 24 hours later in the absence of the tone. Results Replacing the shock with a novel nonthreat outcome, as compared with shock omission, reduced postextinction recovery (freezing in rats and anticipatory skin conductance responses in humans) when tested 24 hours later. Self-reported intolerance of uncertainty was positively correlated with recovery following standard extinction in humans, providing new evidence that postextinction recovery is related to sensitivity to future threat uncertainty. Conclusions These findings provide cross-species evidence of a novel strategy to enhance extinction that may have broad implications for how to override associative learning that has become maladaptive and offer a simple technique that could be straightforwardly adapted and implemented in clinical situations. [ABSTRACT FROM AUTHOR]

Early life adversity increases anxiety in adult rodents and primates, and increases the risk for developing post-traumatic disorder (PTSD) in humans. We hypothesized that early adversity impairs the use of learning signals -negative, aversive prediction errors-to reduce fear in uncertainty. To test this hypothesis, we gave adolescent rats a battery of adverse experiences then assessed adult performance in probabilistic Pavlovian fear conditioning and fear extinction. Rats were confronted with three cues associated with different probabilities of foot shock: one cue never predicted shock, another cue predicted shock with uncertainty, and a final cue always predicted shock. Control rats initially acquired fear to all cues, but rapidly reduced fear to the non-predictive and uncertain cues. Early adversity rats were slower to reduce fear to the non-predictive cue and never fully reduced fear to the uncertain cue. In extinction, all cues were presented in the absence of shock. Fear to the uncertain cue in discrimination, but not early adversity itself, predicted the reduction of fear in extinction. These results demonstrate early adversity impairs the use of negative aversive prediction errors to reduce fear, especially in situations of uncertainty. [ABSTRACT FROM AUTHOR]

Although prosocial behaviors have been widely studied across disciplines, the mechanisms underlying them are not fully understood. Evidence from psychology, biology and economics suggests that prosocial behaviors can be driven by a variety of seemingly opposing factors: altruism or egoism, intuition or deliberation, inborn instincts or learned dispositions, and utility derived from actions or their outcomes. Here we propose a framework inspired by research on reinforcement learning and decision making that links these processes and explains characteristics of prosocial behaviors in different contexts. More specifically, we suggest that prosocial behaviors inherit features of up to three decision-making systems employed to choose between self- and otherregarding acts: a goal-directed system that selects actions based on their predicted consequences, a habitual system that selects actions based on their reinforcement history, and a Pavlovian system that emits reflexive responses based on evolutionarily prescribed priors. This framework, initially described in the field of cognitive neuroscience and machine learning, provides insight into the potential neural circuits and computations shaping prosocial behaviors. Furthermore, it identifies specific conditions in which each of these three systems should dominate and promote other- or self- regarding behavior. [ABSTRACT FROM AUTHOR]

New excavation undertaken in Obłazowa Cave, south Poland, yielded a fossil Conus shell, polished and incised artificially. The shell was found at the very bottom of the pit, beneath the point of the Aurignacian relics recovery. It has a stratigraphic and chronological meaning. The shell, as well as two others which had been found years before in layer VIII of the Obłazowa Cave, can be regarded as another trace of the Pavlovian people. It was probably the Pavolvians who destroyed the older layers of the cave. This raises a question on the relations between the Aurignacian and Pavlovian groups. Conus shells of the same kind were numerously found in the Pavlovian Moravian sites and in Lower Austria, in the vicinity of Grubgraben. Due to the fact that in the Aurignacian the Conus shells have not occurred, one can acknowledge them as a fingerprint of the Pavlovian. [ABSTRACT FROM AUTHOR]

This paper is devoted to the detailed study of three unusual objects discovered in a Pavlovian context (27,500–25,000 BP) at the eponymous site (Pavlov I) which is a large open-air occupation in southern Moravia, and where a large number of spectacular bone tools were recovered. Although stone flaking is a well-known and common activity for the Palaeolithic human groups, antler billets related to this activity are still very rare. Any new discoveries in this domain thus deserve precise documentation. The soft hammer presented here is especially interesting because it is a rare case of a complete billet, well preserved, and it is also the first example which can be related to a left-handed person. The two other antler tools analyzed here appear to have been associated with activities that are poorly known in association with bone tools, such as the grinding/crushing of vegetal and mineral materials (fibers, colorants, etc.). Although such massive tools made from mammoth tusks are already known during the Upper Palaeolithic (but still poorly documented), the existence of such tools made of antler is exceptionally mentioned. This paper presents a description of their manufacturing chaîne opératoire and their specific functional usewear. The objective of this study is primarily methodological, to contribute to a better technical and functional characterization of these special antler tools. These data will also be compared with the remainder of the material culture in order to discuss the interaction between the exploitation of stone and organic resources, and the activities that took place at Pavlov I. [ABSTRACT FROM AUTHOR]

Mammoth bone beds associated with Palaeolithic settlements were reported in the Pavlovian, the Eastern Gravettian, and the Mezinian. Several points of method are posed: - How to identify and differentiate without ambiguity the remains of mammoth bone beds from the remains of dwelling structures built in part from the bones of these bone beds? - How to study the processes that are at the origin of the bone bed deposits and the processes of human exploitation of these deposits? - How to identify the origin of these accumulations, unique, multiple or continuous, either due to geological changes, deaths of natural origin (famine, storm) or human activity (hunting, trapping)? This paper is particularly involved in the study of cases, more systematic than exceptional, of accumulations that are associated with a settlement. It provides a quantitative method to distinguish the mammoth bone beds from the dwelling structures, and to identify and characterize the various processes behind the systems of bone beds and artefacts discovered by the archaeologists. [ABSTRACT FROM AUTHOR]

Neurons activated by learning have been ascribed the unique potential to encode memory, but the functional contribution of discrete cell types remains poorly understood. In particular, it is unclear whether learning engages specific GABAergic interneurons and, if so, whether they differ functionally from interneurons recruited by other experiences. Here, we show that fear conditioning activates a heterogeneous neuronal population in the medial prefrontal cortex (mPFC) that is largely comprised of somatostatin-expressing interneurons (SST-INs). Using intersectional genetic approaches, we demonstrate that fear-learning-activated SST-INs exhibit distinct circuit properties and are selectively reactivated to mediate cue-evoked memory expression. In contrast, an orthogonal population of SST-INs activated by morphine experience exerts opposing control over fear and supports reward-like motivational effects. These results outline an important role for discrete subsets of GABAergic cells in emotional learning and point to an unappreciated capacity for functional specialization among SST-INs. [Display omitted] • A discrete subset of prefrontal SST-INs participates in fear memory encoding • Memory-encoding SST-INs have distinct circuit properties • Morphine activates an orthogonal SST-IN population that opposes cued fear • Fear- and morphine-related SST-INs modulate valence-specific brain networks Cummings et al. demonstrate that discrete populations of prefrontal somatostatin interneurons activated by positive and negative experience exert opposing control over fear memory. This outlines an important role for functional specialization of GABAergic interneurons in emotional learning. [ABSTRACT FROM AUTHOR]

Economic choices are strongly influenced by whether potential outcomes entail gains or losses. We examined this influence of outcome valence in an economic risk task. We employed three experiments based on our task, each of which provided novel findings, and which together better characterise and explain how outcome valence influences risky choice. First, we found that valence perturbed an individual’s choices around that individual’s base-level of risk-taking, a base-level consistent across time and context. Second, this perturbation by valence was highly context dependent, emerging when valence was introduced as a dimension within a decision-making setting, and being reversed by a change in task format (causing more gambling for gains than losses and the reverse). Third, we show this perturbation by valence is explicable by low-level approach-avoidance processes, an hypothesis not previously tested by a causal manipulation. We revealed such an effect, where individuals were less disposed to choose a riskier option with losses when they had to approach (go) as opposed to avoid (nogo) that option. Our data show valence perturbs an individual’s choices independently of the impact of risk, and causally implicate approach-avoidance processes as important in shaping economic choice.

The amygdala has traditionally been associated with fear, mediating the impact of negative emotions on memory. However, this view does not fully encapsulate the function of the amygdala, nor the impact that processing in this structure has on the motivational limbic corticostriatal circuitry of which it is an important structure. Here we discuss the interactions between different amygdala nuclei with cortical and striatal regions involved in motivation; interconnections and parallel circuitries that have become increasingly understood in recent years. We review the evidence that the amygdala stores memories that allow initially motivationally neutral stimuli to become associated through pavlovian conditioning with motivationally relevant outcomes which, importantly, can be either appetitive (e.g. food) or aversive (e.g. electric shock). We also consider how different psychological processes supported by the amygdala such as conditioned reinforcement and punishment, conditioned motivation and suppression, and conditioned approach and avoidance behavior, are not only psychologically but also neurobiologically dissociable, being mediated by distinct yet overlapping neural circuits within the limbic corticostriatal circuitry. Clearly the role of the amygdala goes beyond encoding aversive stimuli to also encode the appetitive, requiring an appreciation of the amygdala’s mediation of both appetitive and fearful behavior through diverse psychological processes.

Pavlovian-to-instrumental transfer (PIT) is an effect whereby a classically conditioned stimulus (CS) enhances ongoing instrumental responding. PIT has been extensively studied with appetitive conditioning but barely at all with aversive conditioning. Although it’s been argued that conditioned suppression is a form of aversive PIT, this effect is fundamentally different from appetitive PIT because the CS suppresses, instead of facilitates, responding. Five experiments investigated the importance of a variety of factors on aversive PIT in a rodent Sidman avoidance paradigm in which ongoing shuttling behavior was facilitated by an aversive CS. Experiment 1 demonstrated a basic PIT effect. Experiment 2 found that a moderate amount of USAA extinction produces the strongest PIT with shuttling rates best at around 2 responses per minute prior to the CS. Experiment 3 tested a protocol in which the USAA behavior was required to reach the 2-response per minute mark in order to trigger the CS presentation and found that this produced robust and reliable PIT. Experiment 4 found that the Pavlovian conditioning US intensity was not a major determinant of PIT strength. Experiment 5 demonstrated that if the CS and US were not explicitly paired during Pavlovian conditioning, PIT did not occur, showing that CS-US learning is required. Together, these studies demonstrate a robust, reliable and stable aversive PIT effect that is amenable to analysis of neural circuitry.

Cue- and reward-evoked phasic dopamine activity during Pavlovian and operant conditioning paradigms is well correlated with reward-prediction errors from formal reinforcement learning models, which feature teaching signals in the form of discrepancies between actual and expected reward outcomes. Additionally, in learning tasks where conditioned cues probabilistically predict rewards, dopamine neurons show sustained cue-evoked responses that are correlated with the variance of reward and are maximal to cues predicting rewards with a probability of 0.5. Therefore, it has been suggested that sustained dopamine activity after cue presentation encodes the uncertainty of impending reward delivery. In the current study we examined the acquisition and maintenance of these neural correlates using fast-scan cyclic voltammetry in rats implanted with carbon fiber electrodes in the nucleus accumbens core during probabilistic Pavlovian conditioning. The advantage of this technique is that we can sample from the same animal and recording location throughout learning with single trial resolution. We report that dopamine release in the nucleus accumbens core contains correlates of both expected value and variance. A quantitative analysis of these signals throughout learning, and during the ongoing updating process after learning in probabilistic conditions, demonstrates that these correlates are dynamically encoded during these phases. Peak CS-evoked responses are correlated with expected value and predominate during early learning while a variance-correlated sustained CS signal develops during the post-asymptotic updating phase. [ABSTRACT FROM AUTHOR]