Search

This study examined the effect of danger on consolidation of neutral information in two regions of the rat (male and female) medial temporal lobe: the perirhinal cortex (PRh) and basolateral amygdala complex (BLA). The neutral information was the association that forms between an auditory stimulus and a visual stimulus (labelled S2 and S1) across their pairings in sensory preconditioning. We show that, when the sensory preconditioning session is followed by a shocked context exposure, the danger shifts consolidation of the S2-S1 association from the PRh to the BLA; and does so by interacting with processes involved in encoding of the S2-S1 pairings. Specifically, we show that the initial S2-S1 pairing in sensory preconditioning is encoded in the BLA and not the PRh; whereas the later S2-S1 pairings are encoded in the PRh and not the BLA. When the sensory preconditioning session is followed by a context alone exposure, the BLA-dependent trace of the early S2-S1 pairings decays and the PRh-dependent trace of the later S2-S1 pairings is consolidated in memory. However, when the sensory preconditioning session is followed by a shocked context exposure, the PRh-dependent trace of the later S2-S1 pairings is suppressed and the BLA-dependent trace of the initial S2-S1 pairing is consolidated in memory. These findings are discussed with respect to mutually inhibitory interactions between the PRh and BLA, and the way that these regions support memory in other protocols, including recognition memory in people.Significance StatementThe perirhinal cortex (PRh) and basolateral amygdala complex (BLA) process the pairings of neutral auditory and visual stimuli in sensory preconditioning. The involvement of each region in this processing is determined by the novelty/familiarity of the stimuli as well as events that occur immediately after the preconditioning session. Novel stimuli are represented in the BLA; however, as these stimuli are repeatedly presented without consequence, they come to be represented in the PRh. Whether the BLA- or PRh-dependent representation is consolidated in memory depends on what happens next. When nothing of significance occurs, the PRh-dependent representation is consolidated and the BLA-dependent representation decays; but when danger is encountered, the PRh-dependent representation is inhibited and the BLA-dependent representation is selected for consolidation.

Interpretations of the role of the infralimbic region of the medial prefrontal cortex in decision making in rats are based on a wide range of tasks, both appetitive and aversive, as well as Pavlovian and instrumental. These range in complexity from what appear to be simple procedures (such as extinction) through to more complicated tasks involving, for example, risk-based decision making and contextual biconditional discriminations. We derive from these tasks a common theme that may stimulate greater analysis of the nature of decision making tasks in order to better understand the function of prefrontal systems. One interpretation is that the infralimbic region may be important in the ability of rats to simultaneously hold competing associations with the same, single cue.

Orbitofrontal cortex (OFC) lesions cause deficits in flexible behavioural control, most notably response inhibition and has historically been linked to theories of response inhibition. This general inhibition hypothesis of OFC function has since been rejected by evidence that inhibitory behavioural control can be expressed following OFC damage, however the functional role of the OFC in the explicit learning of conditioned inhibition remains untested. Here we test whether muscimol disruption of OFC function during the learning stage of a Pavlovian conditioned inhibition procedure disrupted the learning of conditioned inhibitory associations. Muscimol abolished Inhibitory behavioural control during the learning phase, however learning about the conditioned inhibitor was intact when tested drug free in subsequent summation and retardation tests of conditioned inhibition. Muscimol also significantly impaired acquisition to control cues whose cue-outcome relationship did not change. In a second experiment, conditioned inhibition was found not to play a significant role in cue extinction (non-reinforcement), an effect that was disrupted by intra-OFC infusion of muscimol. These results confirm that the OFC is not functionally necessary for the learning of inhibitory associations but is critical to both the enhancement and suppression of responding when environmental contingencies change.

The mesolimbic dopamine system comprises distinct compartments supporting different functions in learning and motivation. Less well understood is how complex addiction-related behaviors emerge from activity patterns across these compartments. Here we show how different forms of relapse to alcohol-seeking in male rats are assembled from activity across the VTA and the nucleus accumbens. First, we used chemogenetic approaches to show a causal role for VTA TH neurons in two forms of relapse to alcohol-seeking: renewal (context-induced reinstatement) and reacquisition. Then, using gCaMP fiber photometry of VTA TH neurons, we identified medial and lateral VTA TH neuron activity profiles during self-administration, renewal, and reacquisition. Next, we used optogenetic inhibition of VTA TH neurons to show distinct causal roles for VTA subregions in distinct forms of relapse. We then used dLight fiber photometry to measure dopamine binding across the ventral striatum (medial accumbens shell, accumbens core, lateral accumbens shell) and showed complex and heterogeneous profiles of dopamine binding during self-administration and relapse. Finally, we used representational similarity analysis to identify mesolimbic dopamine signatures of self-administration, extinction, and relapse. Our results show that signatures of relapse can be identified from heterogeneous activity profiles across the mesolimbic dopamine system and that these signatures are unique for different forms of relapse. SIGNIFICANCE STATEMENT It is axiomatic that the actions of dopamine are critical to drug addiction. Yet how relapse to drug-seeking is assembled from activity across the mesolimbic dopamine system is poorly understood. Here we show how relapse to alcohol-seeking relates to activity in specific VTA and accumbens compartments, how these change for different forms of relapse, and how relapse-associated activity relates to activity during self-administration and extinction. We report the mesolimbic dopamine activity signatures for relapse and show that these signatures are unique for different forms of relapse.

Instrumental actions are initially goal-directed but with repeated performance can become habitual. Habitual actions are adaptive, learned behaviours that are automated in order to reduce cognitive load and to allow for efficient interaction with the environment. Goal-directed and habitual actions are mediated by distinct neurocircuits which centre on the dorsal striatum and involve different cortical and limbic inputs. The lateral hypothalamus (LH) has yet to be considered in this neurocircuitry despite its anatomical connections with these neurocircuits and its established role in motivated behaviour. The aim of the current study was to determine whether the LH has a role in the development of habitual actions in rats by knocking down protein expression in the LH with short hairpin RNAs (shRNA). Two shRNAs were utilised, both of which were shown to reduce the expression of two neuropeptides within the LH, orexin and melanin-concentrating hormone, compared to a saline-vehicle control. This was unexpected given that one shRNA was a control vector (i.e, scrambled sequence), and the other shRNA was supposed to selectively target orexin's precursor protein. Given this lack of specificity and that shRNA's are known to be neurotoxic, the current study examined the impact of non-selective dysfunction of the LH on habitual actions. Adult male Long-Evans rats were trained to press a lever for a food outcome and were tested for goal directed and habitual behaviour following devaluation of the food. The shRNA groups displayed goal-directed actions following moderate instrumental training, but did not develop habitual actions following extended training. That is, control rats developed the expected habitual behaviour where lever-response rates were insensitive to outcome value when tested, whilst the shRNA groups reduced rates of responding on the lever under devalued conditioned and hence remained goal-directed. This failure to demonstrate habitual actions was unlikely to be secondary to changes in motivation or arousal as the shRNA groups did not show altered food consumption, body weight, lever response rates, or motor performance on a rota rod or tapered balance beam. However, locomotor activity was reduced in an open field test, consistent with the proposed role of the LH in spontaneous locomotor activity. Therefore, this study implicates the LH in habitual learning, and adds to the emerging evidence that the LH has a role in associative learning processes. This finding has implications for human conditions where there is dysfunction or neurodegeneration in the LH, as well as altered habitual actions, such as in Parkinson's disease and drug addiction.

The ventral pallidum (VP) is a key node in the neural circuits controlling relapse to drug seeking. How this role relates to different VP cell types and their projections is poorly understood. Using male rats, we show how different forms of relapse to alcohol-seeking are assembled from VP cell types and their projections to lateral hypothalamus (LH) and ventral tegmental area (VTA). Using RNAScopein situhybridization to characterize activity of different VP cell types during relapse to alcohol-seeking provoked by renewal (context-induced reinstatement), we found that VP Gad1 and parvalbumin (PV), but not vGlut2, neurons show relapse-associated changes in c-Fos expression. Next, we used retrograde tracing, chemogenetic, and electrophysiological approaches to study the roles of VPGad1and VPPVneurons in relapse. We show that VPGad1neurons contribute to contextual control over relapse (renewal), but not to relapse during reacquisition, via projections to LH, where they converge with ventral striatal inputs onto LHGad1neurons. This convergence of striatopallidal inputs at the level of individual LHGad1neurons may be critical to balancing propensity for relapse versus abstinence. In contrast, VPPVneurons contribute to relapse during both renewal and reacquisition via projections to VTA. These findings identify a double dissociation in the roles for different VP cell types and their projections in relapse. VPGad1neurons control relapse during renewal via projections to LH. VPPVneurons control relapse during both renewal and reacquisition via projections to VTA. Targeting these different pathways may provide tailored interventions for different forms of relapse.SIGNIFICANCE STATEMENTRelapse to drug or reward seeking after a period of extinction or abstinence remains a key impediment to successful treatment. The ventral pallidum, located in the ventral basal ganglia, has long been recognized as an obligatory node in a 'final common pathway' for relapse. Yet how this role relates to the considerable VP cellular and circuit heterogeneity is not well understood. We studied the cellular and circuit architecture for VP in relapse control. We show that different forms of relapse have complementary VP cellular and circuit architectures, raising the possibility that targeting these different neural architectures may provide tailored interventions for different forms of relapse.

Habits play an important role in physical activity (PA) engagement; however, these associations in older people are not well understood. The present study aimed to investigate the relationship between engagement in types of PA and their automaticity in older people, using an observational, cross-sectional design. Current hours engaged in planned exercise (excluding walking), planned walking, and incidental activities and the automaticity of those PA behaviors were measured in 127 community-dwelling Australians aged 65 years and older via an online questionnaire. After controlling for demographic and health factors (age, gender, education level, body mass index, history of falls, and anxiety and depression symptoms), higher automaticity scores were associated with more hours undertaking planned walking and incidental activity but not planned exercise. Although preliminary, these findings indicate that the role of habit in maintaining PA in older people may, therefore, differ depending on the type of activity.

Our understanding of orbitofrontal cortex (OFC) function has progressed remarkably over the past decades in part due to theoretical advances in associative and reinforcement learning theories. These theoretical accounts of OFC function have implicated the region in progressively more psychologically refined processes from the value and sensory-specific properties of expected outcomes to the representation and inference over latent state representations in cognitive maps of task space. While these accounts have been successful at modeling many of the effects of causal manipulation of OFC function in both rodents and primates, recent findings suggest that further refinement of our current models are still required. Here, we briefly review how our understanding of OFC function has developed to understand two cardinal deficits following OFC dysfunction: Reversal learning and outcome devaluation. We then consider recent findings that OFC dysfunction also significantly affects initial acquisition learning, often assumed to be intact. To account for these findings, we consider a possible role for the OFC in the arbitration and exploration between model-free (MF) and model-based (MB) learning systems, offline updating of MB representations. While the function of the OFC as a whole is still likely to be integral to the formation and use of a cognitive map of task space, these refinements suggest a way in which distinct orbital subregions, such as the rodent lateral OFC, might contribute to this overall function. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The orbitofrontal cortex (OFC) is a critical structure in the flexible control of value-based behaviors. OFC dysfunction is typically only detected when task or environmental contingencies change, against a backdrop of apparently intact initial acquisition and behavior. While intact acquisition following OFC lesions in simple Pavlovian cue-outcome conditioning is often predicted by models of OFC function, this predicted null effect has not been thoroughly investigated. Here, we test the effects of lesions and temporary muscimol inactivation of the rodent lateral OFC on the acquisition of a simple single cue-outcome relationship. Surprisingly, pretraining lesions significantly enhanced acquisition after overtraining, whereas post-training lesions and inactivation significantly impaired acquisition. This impaired acquisition to the cue reflects a disruption of behavioral control and not learning since the cue could also act as an effective blocking stimulus in an associative blocking procedure. These findings suggest that even simple cue-outcome representations acquired in the absence of OFC function are impoverished. Therefore, while OFC function is often associated with flexible behavioral control in complex environments, it is also involved in very simple Pavlovian acquisition where complex cue-outcome relationships are irrelevant to task performance.

Rationale Previous work has identified that different forms of Pavlovian conditioned approach, sign-tracking and goal-tracking, are governed by distinct neurochemical mechanisms when compared in animals predisposed to learning one form vs. the other. Objectives The present study aimed to investigate whether these are also neurochemically distinct processes in a population of animals capable of developing either response when this is manipulated via the use of distinct conditioned stimuli (CS). Methods Rats were trained on one of two Pavlovian conditioning procedures in which the CS was either a lever, which elicits sign-tracking, or an auditory click, which elicits goal-tracking. The differential involvement of dopamine D1- and D2-receptors (D1R; D2R) in the acquisition of approach types was investigated via systemic administration of antagonists selective to one or both receptor subtypes during Pavlovian training. Results Results indicate that dopaminergic signalling is important for the acquisition of both sign-tracking and goal-tracking responses. However, whilst development of sign-tracking to a lever depends on activity at both D1R and D2R, development of goal-tracking in response to a click was shown to depend only on activity at D1R. Conclusions We suggest that the importance of D1R activity in both sign- and goal-tracking acquisition reflects a general role in learning Pavlovian associations, which aligns with data implicating dopamine in prediction error processes. In contrast, the selective involvement of D2R activity in sign-tracking acquisition may reflect its importance in motivational processes such as incentive salience attribution. Electronic supplementary material The online version of this article (10.1007/s00213-019-5169-8) contains supplementary material, which is available to authorized users.

The mesolimbic dopamine system comprises distinct compartments supporting different functions in learning and motivation. Less well understood is how complex addiction-related behaviors emerge from activity patterns across these compartments. Here we show how different forms of relapse to alcohol-seeking are assembled from activity across the ventral tegmental area and the nucleus accumbens. Using gCaMP and dLight fibre photometry, we show that self-administration and two forms of relapse (renewal/context-induced reinstatement and reacquisition) are associated with recruitment across the mesolimbic dopamine system. Using a variety of interventions, we show that this activity is causal to both forms of relapse. Finally, we use dissimilarity matrices to identify mesolimbic dopamine signatures of self-administration, extinction, and relapse. We show that signatures of relapse can be identified from heterogeneous activity profiles across the mesolimbic dopamine system and that these signatures differ for different forms of relapse.

People and animals sometimes associate events that never occurred together. These false memories can have disastrous consequences, yet little is known about the conditions under which they form. In four experiments, we investigated how rats learn to fear a context in which they have never experienced danger (i.e., how they form a false context fear memory). In each experiment, rats were pre-exposed to a context on day 1, shocked in a similar-but-different context on day 2, and tested in the pre-exposed or explicitly-conditioned context on day 3. The results revealed that: (1) the true memory of the explicitly-conditioned context and false memory of the pre-exposed context develop simultaneously and independently; and (2) the conditions of pre-exposure on day 1 and time of shock exposure on day 2 interact to determine the strength of the false memory. These findings are anticipated by a recent computational model, the Bayesian Context Fear Algorithm/Automaton (BACON; Krasne, Cushman, & Fanselow, 2015). They are discussed in relation to this model and more general theories of context learning.

Theories of functioning in the medial prefrontal cortex are distinct across appetitively and aversively motivated procedures. In the appetitive domain, it is argued that the medial prefrontal cortex is important for producing adaptive behavior when circumstances change. This view advocates a role for this region in using higher-order information to bias performance appropriate to that circumstance. Conversely, literature born out of aversive studies has led to the theory that the prelimbic region of the medial prefrontal cortex is necessary for the expression of conditioned fear, whereas the infralimbic region is necessary for a decrease in responding following extinction. Here, the argument is that these regions are primed to increase or decrease fear responses and that this tendency is gated by subcortical inputs. However, we believe the data from aversive studies can be explained by a supraordinate role for the medial prefrontal cortex in behavioral flexibility, in line with the appetitive literature. Using a dichotomy between the voluntary control of behavior and the execution of well-trained responses, we attempt to reconcile these theories. We argue that the prelimbic region exerts voluntary control over behavior via top-down modulation of stimulus-response pathways according to task demands, contextual cues, and how well a stimulus predicts an outcome. Conversely, the infralimbic region promotes responding based on the strength of stimulus-response pathways determined by experience with reinforced contingencies. This system resolves the tension between executing voluntary actions sensitive to recent changes in contingencies, and responses that reflect the animal's experience across the long run. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Punishment involves learning about the relationship between behavior and its adverse consequences. Punishment is fundamental to reinforcement learning, decision-making and choice, and is disrupted in psychiatric disorders such as addiction, depression, and psychopathy. However, little is known about the brain mechanisms of punishment and much of what is known is derived from study of superficially similar, but fundamentally distinct, forms of aversive learning such as fear conditioning and avoidance learning. Here we outline the unique conditions that support punishment, the contents of its learning, and its behavioral consequences. We consider evidence implicating GABA and monoamine neurotransmitter systems, as well as corticostriatal, amygdala, and dopamine circuits in punishment. We show how maladaptive punishment processes are implicated in addictions, impulse control disorders, psychopathy, anxiety, and depression and argue that a better understanding of the cellular, circuit, and cognitive mechanisms of punishment will make important contributions to next generation therapeutic approaches.

Bidirectionally aberrant medial orbitofrontal cortical (mOFC) activity has been consistently linked with compulsion and compulsive disorders. Although rodent studies have established a causal link between mOFC excitation and compulsive-like actions, no such link has been made with mOFC inhibition. Here we use excitotoxic lesions of mOFC to investigate its role in sensitivity to punishment; a core characteristic of many compulsive disorders. In our first experiment, we demonstrated that mOFC lesions prevented instrumental conditioned punishment learning in a manner that could not be attributed to differences in Pavlovian conditioned fear. We then showed that increasing the frequency of punishing outcomes allowed mOFC-lesioned animals to overcome their initial deficit. Our second experiment demonstrated that the retrieval of instrumental punishment is also mOFC-dependent, as mOFC lesions prevented the extended retrieval of punishment contingencies relative to shams. In contrast, mOFC lesions did not prevent the re-acquisition of conditioned punishment that was learned prior to lesions being administered. Together, these results reveal that the mOFC does indeed regulate punishment learning and retrieval in a manner that is disassociated from any role in Pavlovian fear learning. These results imply that aberrant mOFC activity may contribute to the punishment insensitivity that is observed across multiple compulsive disorders.

© 2019, eLife Sciences Publications Ltd. All rights reserved. Our behaviour is shaped by its consequences – we seek rewards and avoid harm. It has been reported that individuals vary markedly in their avoidance of detrimental consequences, i.e. in their sensitivity to punishment. The underpinnings of this variability are poorly understood; they may be driven by differences in aversion sensitivity, motivation for reward, and/or instrumental control. We examined these hypotheses by applying several analysis strategies to the behaviour of rats (n = 48; 18 female) trained in a conditioned punishment task that permitted concurrent assessment of punishment, reward-seeking, and Pavlovian fear. We show that punishment insensitivity is a unique phenotype, unrelated to differences in reward-seeking and Pavlovian fear, and due to a failure of instrumental control. Subjects insensitive to punishment are afraid of aversive events, they are simply unable to change their behaviour to avoid them.

Sufficient physical activity is crucial to maintaining independence, health and wellbeing during ageing, yet physical inactivity is common in older people. Identifying factors associated with physical activity engagement is essential to develop novel approaches to increase activity in older people. Automatic, context-dependent habits may play an important role in physical activity behaviour. The current study aimed to investigate the relationship between physical activity behaviours and their automaticity in older people. 123 community dwelling Australians aged over 65 – 88 years (M=72.2; 81 women), recruited from participant registries, hospital noticeboards and community groups, completed an online questionnaire. Current physical activity levels were measured using the Incidental and Planned Exercise Questionnaire, and automaticity of those physical activity behaviours were measured using the Self-Report Habit Automaticity Index. Participants also reported demographic information, body mass index (BMI), medical history and current mood symptoms. Participants reported an average of 2.28 hours planned walking (SD=2.33), 5.81 hours planned moderate/vigorous exercise (SD=4.02), and 20.5 hours incidental activity (SD=15.52) per week. Multiple regression analyses revealed that after controlling for age, gender, BMI and depression symptoms, higher automaticity scores were associated with more hours per week of planned walking (p=.012), moderate/vigorous exercise (p=.038), and incidental activity (p=.017). Supporting older people to make their physical activity more habitual could therefore be an effective approach to increase levels of physical activity in this population.

Recent work suggests complementary roles of the prelimbic and infralimbic regions of the rat medial prefrontal cortex in cognitive control processes, with the prelimbic cortex implicated in top-down modulation of associations and the infralimbic cortex playing a role in the inhibition of inappropriate responses. Following selective lesions made to prelimbic or infralimbic regions (or control sham-surgery) rats received simultaneous training on Pavlovian feature negative (A+, XA&minus, ) and feature positive (B&minus, YB+) discriminations designed to lead to hierarchical occasion-setting control by the features (X, Y) over their respective targets (A, B). Evidence for hierarchical control was assessed in a transfer test in which features and targets were swapped (YA, XB). All groups were able to learn the feature negative and feature positive discriminations. Whilst sham-lesioned animals showed no transfer of control by features to novel targets (a hallmark of hierarchical control), rats with lesions of prelimbic or infralimbic regions showed evidence of transfer from the positive feature (Y) to the negative target (A), and from the negative feature (X) to the positive target (B, although this only achieved significance in infralimbic-lesioned animals). These data indicate that damage to either of these regions disrupts hierarchical occasion-setting control, extending our knowledge of their role in cognitive control to encompass flexible behaviours dictated by discrete cues.

Ventral pallidum (VP) is a key node in the neural circuits controlling relapse to drug seeking but how this role relates to different VP cell types and their projections is poorly understood. Using male rats, we show how different forms of relapse to alcohol-seeking are assembled from VP cell types and their projections to lateral hypothalamus (LH) and ventral tegmental area (VTA). First, we used RNAScope in situ hybridization to characterize activity of different VP cell types during relapse to alcohol-seeking provoked by renewal (context-induced reinstatement). We found that VP Gad1 and parvalbumin (PV), but not vGlut2, neurons show relapse-associated changes in c-Fos expression. Next, we used retrograde tracing, chemogenetic, optogenetic, and electrophysiological approaches to study the roles of VPGad1 and VPPV neurons in relapse. We show that VPGad1 neurons contribute to contextual control over relapse (renewal), but not to relapse during reacquisition, via projections to LH where they converge with ventral striatal inputs onto LHGad1 neurons. This convergence of striatopallidal inputs at the level of individual LHGad1 neurons may be critical to balancing propensity for relapse versus abstinence. In contrast, VPPV neurons contribute to relapse during both renewal and reacquisition via projections to VTA but not LH. These findings show complementary roles for different VP cell types and their projections in relapse. VPGad1 neurons control relapse during renewal via projections to LH whereas VPPV neurons control relapse during both renewal and reacquisition via projections to VTA. Targeting these different pathways may provide tailored interventions for different forms of relapse.

Making decisions in environments with few choice options is easy. We select the action that results in the most valued outcome. Making decisions in more complex environments, where the same action can produce different outcomes in different conditions, is much harder. In such circumstances, we propose that accurate action selection relies on top-down control from the prelimbic and orbitofrontal cortices over striatal activity through distinct thalamostriatal circuits. We suggest that the prelimbic cortex exerts direct influence over medium spiny neurons in the dorsomedial striatum to represent the state space relevant to the current environment. Conversely, the orbitofrontal cortex is argued to track a subject's position within that state space, likely through modulation of cholinergic interneurons.

The orbitofrontal cortex (OFC) is critical for updating reward-directed behaviours flexibly when outcomes are devalued or when task contingencies are reversed. Failure to update behaviour in outcome devaluation and reversal learning procedures are considered canonical deficits following OFC lesions in non-human primates and rodents. We examined the generality of these findings in rodents using lesions of the rodent lateral OFC (LO) in instrumental action-outcome and Pavlovian cue-outcome devaluation procedures. LO lesions disrupted outcome devaluation in Pavlovian but not instrumental procedures. Furthermore, although both anterior and posterior LO lesions disrupted Pavlovian outcome devaluation, only posterior LO lesions were found to disrupt reversal learning. Posterior but not anterior LO lesions were also found to disrupt the attribution of motivational value to Pavlovian cues in sign-tracking. These novel dissociable task- and subregion-specific effects suggest a way to reconcile contradictory findings between rodent and non-human primate OFC research.

The orbitofrontal cortex (OFC) is critical for updating reward-directed behaviours flexibly when task contingencies are reversed, or when outcomes are devalued. We systematically examined the generality of these findings using lesions of the rodent lateral OFC (LO) in instrumental action-outcome, and Pavlovian cue-outcome, learning using specific satiety and taste aversion methods of outcome devaluation. LO lesions disrupted outcome devaluation in Pavlovian but not instrumental procedures. Furthermore, this effect was only observed when using taste-aversion devaluation. Using a specific Pavlovian-to-Instrumental transfer procedure, we established that LO is not necessary for the representation of specific outcome properties, but rather in using these properties to access the current motivational value of outcomes. The role of LO in outcome devaluation and reversal learning was also dissociable between anterior and posterior subregions. These novel dissociable task- and subregion-specific effects suggest a way to reconcile contradictory findings between rodent and non-human primate OFC research.

Cognitive planning is acknowledged as one of the hallmarks of modern cognition. However, identifying objective evidence of cognitive planning in the archaeological record has been difficult and controversial. While some archaeologists have argued that so-called behaviourally “archaic” Homo sapiens and Homo neanderthalensis were unable to plan, others have proposed that complex material culture could not have been produced without sophisticated planning abilities. There is agreement, however, that evidence for cognitive planning can readily be found in the archaeological record. This review presents an alternative interpretation based on research in psychology, neuropsychology and reinforcement learning. It outlines alternative mechanisms that can drive behaviour including goal-directed actions, habits, hierarchical reinforcement learning and fixed action patterns. We contest current archaeological theory by arguing that: 1) for methodological reasons, evidence for cognitive planning cannot be found in the archaeological record and, 2) basic learning processes, based on contingency and contiguity, are powerful enough to be the building blocks of substantially more complex behaviours including the acquisition and “invention” of technological behaviours. We suggest that cognitive archaeology focus on collaborative projects to empirically test existing theories utilising techniques such as neuroimaging, dual-task paradigms and mathematical modelling. Such experiments would greatly improve the concordance of archaeological theories with those of allied disciplines.

The relationship between learned variations in attention and schizotypy was examined in two experiments. In Experiment 1, participants low on a negative subscale of schizotypy exhibited an explicit bias in overt attention towards stimuli that were established as predictive of a trial outcome, relative to stimuli that were irrelevant. The same participants also showed a bias in learning about these stimuli when they presented in a novel context. Neither of these effects was observed in participants high in schizotypy. In Experiment 2, participants low on the negative subscale of schizotypy exhibited faster reaction times towards a target that was cued by a stimulus that had a history of predictive validity relative to a stimulus that had a history of irrelevance. Again, this effect was not present in participants high in schizotypy. These results imply a disruption in the normal allocation of attention to cues that have predictive significance in schizotypy.

Addiction is characterized by a persistent loss of behavioral control resulting in insensitivity to negative feedback and abnormal decision-making. Here, we investigated the influence of methamphetamine (METH)-paired contextual cues on decision-making in rats. Choice between goal-directed actions was sensitive to outcome devaluation in a saline-paired context but was impaired in the METH-paired context, a deficit that was also found when negative feedback was provided. Reductions in c-Fos-related immunoreactivity were found in dorsomedial striatum (DMS) but not dorsolateral striatum after exposure to the METH context suggesting this effect reflected a loss specifically in goal-directed control in the METH context. This reduction in c-Fos was localized to non-enkephalin-expressing neurons in the DMS, likely dopamine D1-expressing direct pathway neurons, suggesting a relative change in control by the D1-direct versus D2-indirect pathways originating in the DMS may have been induced by METH-context exposure. To test this suggestion, we infused the adenosine 2A receptor antagonist ZM241385 into the DMS prior to test to reduce activity in D2 neurons relative to D1 neurons in the hope of reducing the inhibitory output from this region of the striatum. We found that this treatment fully restored sensitivity to negative feedback in a test conducted in the METH-paired context. These results suggest that drug exposure alters decision-making by downregulation of the circuitry mediating goal-directed action, an effect that can be ameliorated by acute A2A receptor inhibition in this circuit.

In this study we sought to determine the effect of daily sucrose consumption in young rats on their subsequent performance in tasks that involve the prefrontal cortex and hippocampus. High levels of sugar consumption have been associated with the development of obesity, however less is known about how sugar consumption influences behavioral control and high-order cognitive processes. Of particular concern is the fact that sugar intake is greatest in adolescence, an important neurodevelopmental period. We provided sucrose to rats when they were progressing through puberty and adolescence. Cognitive performance was assessed in adulthood on a task related to executive function, a rodent analog of the Stroop task. We found that sucrose-exposed rats failed to show context-appropriate responding during incongruent stimulus compounds presented at test, indicative of impairments in prefrontal cortex function. Sucrose exposed rats also showed deficits in an on object-in-place recognition memory task, indicating that both prefrontal and hippocampal function was impaired. Analysis of brains showed a reduction in expression of parvalbumin-immunoreactive GABAergic interneurons in the hippocampus and prefrontal cortex, indicating that sucrose consumption during adolescence induced long-term pathology, potentially underpinning the cognitive deficits observed. These results suggest that consumption of high levels of sugar-sweetened beverages by adolescents may also impair neurocognitive functions affecting decision-making and memory, potentially rendering them at risk for developing mental health disorders.

The amygdala is a critical substrate for learning about cues that signal danger. Less is known about its role in processing innocuous or background information. The present study addressed this question using a sensory preconditioning protocol in male rats. In each experiment, rats were exposed to pairings of two innocuous stimuli in stage 1, S2 and S1, and then to pairings of S1 and shock in stage 2. As a consequence of this training, control rats displayed defensive reactions (freezing) when tested with both S2 and S1. The freezing to S2 is a product of two associations formed in training: an S2-S1 association in stage 1 and an S1-shock association in stage 2. We examined the roles of two medial temporal lobe (MTL) structures in consolidation of the S2-S1 association: the perirhinal cortex (PRh) and basolateral complex of the amygdala (BLA). When the S2-S1 association formed in a safe context, its consolidation required neuronal activity in the PRh (but not BLA), including activation of AMPA receptors and MAPK signaling. In contrast, when the S2-S1 association formed in a dangerous context, or when the context was rendered dangerous immediately after the association had formed, its consolidation required neuronal activity in the BLA (but not PRh), including activation of AMPA receptors and MAPK signaling. These roles of the PRh and BLA show that danger changes the way the mammalian brain stores information about innocuous events. They are discussed with respect to danger-induced changes in stimulus processing.

Exercise has been demonstrated to have positive effects on both the body and brain. The present study aimed to determine the behavioural and morphological consequence of low-intensity running. Rats were exercised on a treadmill for a total of 30 days, 30 min/day. Social interaction, locomotor activity and behaviour on an elevated plus maze were assessed post-treatment. Exercised animals demonstrated more passive interaction and less time not interacting than control animals that were not exercised. Conversely, locomotor and anxiety measures showed no effect of exercise. Analysis of brains demonstrated an increase in expression of parvalbumin immunoreactive neurons in the hippocampus localised to the CA1 and CA2/3 regions. These results demonstrate that low-intensity exercise leads to changes in social behaviour as well as neuroplastic morphological changes within the hippocampus.

Rats fed high fat diets have been shown to be impaired in hippocampal-dependent behavioral tasks, such as spatial recognition in the Y-maze and reference memory in the Morris water maze (MWM). It is clear from previous studies, however, that motivation and reward factor into the memory deficits associated with obesity and high-fat diet consumption, and that the prefrontal cortex and striatum and neurotransmitter dopamine play important roles in cognitive performance. In this series of studies we extend our research to investigate the effect of a high fat diet on striatal neurochemistry and performance in the delayed spatial win-shift radial arm maze task, a paradigm highly reliant on dopamine-rich brain regions, such as the striatum after high fat diet consumption. Memory performance, neuronal activation and brain dopaminergic levels were compared in rats fed a “Western” (21% fat, 0.15% cholesterol) chow diet compared to normal diet (6% fat, 0.15% cholesterol)-fed controls. Twelve weeks of dietary manipulation produced an increase in weight in western diet-fed rats, but did not affect learning and performance in the delayed spatial win-shift radial arm maze task. Concurrently, there was an observed decrease in dopamine levels in the striatum and a reduction of dopamine turnover in the hippocampus in western diet-fed rats. In a separate cohort of rats Fos levels were measured after rats had been placed in a novel arena and allowed to explore freely. In normal rats, this exposure to a unique environment did not affect neuronal activation. In contrast, rats fed a western diet were found to have significantly increased Fos expression in the striatum, but not prefrontal cortex or hippocampus. Our study demonstrates that while western diet consumption in rats produces weight gain and brain neuronal and neurotransmitter changes, it did not affect performance in the delayed spatial win-shift paradigm in the radial arm maze. We conclude that modeling the cognitive decline-obesity relationship is complex with considerations, of type of memory, behavioral task and dietary intervention (fat, fat and sugar, sugar, and cafeteria diets) all adding to our overall understanding.

Previous research suggests disruption of activity in the prelimbic (PL) cortex produces deficits in tasks requiring preferential attention toward cues that are good predictors of an event. By manipulating cue predictive power, we clarify this role using Pavlovian conditioning. Experiment 1a showed pretraining excitotoxic lesions of the PL cortex disrupted the ability of animals to distribute attention across stimuli conditioned in compound. Experiment 1b demonstrated that these lesions did not affect the ability to block learning about a stimulus when it was presented simultaneously with another stimulus that was previously paired with the outcome. However, in a subsequent test, PL-lesioned animals learnt about this blocked cue faster than sham-lesioned animals when this stimulus alone was paired with reinforcement, suggesting these animals did not down-regulate attention toward the redundant cue during blocking. Experiment 2 tested this hypothesis using an unblocking procedure designed to explicitly reveal a down-regulation of attention during blocking. In this, sham-lesioned animals were shown to down-regulate attention during blocking. PL-lesioned animals did not exhibit this effect. We propose that observed deficits are the result of a specific deficit in down-regulating attention toward redundant cues, indicating the disruption of an attentional process described in Mackintosh's (Mackintosh NJ. 1975. Psychol Review. 82:276) attentional theory.

Learning theory proposes that drug seeking is a synthesis of multiple controllers. Whereas goal-directed drug seeking is determined by the anticipated incentive value of the drug, habitual drug seeking is elicited by stimuli that have formed a direct association with the response. Moreover, drug-paired stimuli can transfer control over separately trained drug seeking responses by retrieving an expectation of the drug's identity (specific transfer) or incentive value (general transfer). This review covers outcome devaluation and transfer of stimulus-control procedures in humans and animals, which isolate the differential governance of drug seeking by these four controllers following various degrees of contingent and noncontingent drug exposure. The neural mechanisms underpinning these four controllers are also reviewed. These studies suggest that although initial drug seeking is goal-directed, chronic drug exposure confers a progressive loss of control over action selection by specific outcome representations (impaired outcome devaluation and specific transfer), and a concomitant increase in control over action selection by antecedent stimuli (enhanced habit and general transfer). The prefrontal cortex and mediodorsal thalamus may play a role in this drug-induced transition to behavioral autonomy.

This article introduces a novel hypothesis regarding amygdala function in psychopathy. The first part of this article introduces the concept of psychopathy and describes the main cognitive and affective impairments demonstrated by this population; that is, a deficit in fear-recognition, lower conditioned fear responses and poor performance in passive avoidance, and response-reversal learning tasks. Evidence for amygdala dysfunction in psychopathy is considered with regard to these deficits; however, the idea of unified amygdala function is untenable. A model of differential amygdala activation in which the basolateral amygdala (BLA) is underactive while the activity of the central amygdala (CeA) is of average to above average levels is proposed to provide a more accurate and up-to-date account for the specific cognitive and emotional deficits found in psychopathy. In addition, the model provides a mechanism by which attentional-based models and emotion-based models of psychopathy can coexist. Data to support the differential amygdala activation model are provided from studies from both human and animal research. Supporting evidence concerning some of the neurochemicals implicated in psychopathy is then reviewed. Implications of the model and areas of future research are discussed.

Neuregulin 1 (Nrg1) has been implicated in the development of schizophrenia and influences key neurodevelopmental processes such as myelination and neuronal migration. The heterozygous transmembrane domain Nrg1 mutant mouse (Nrg1 TM HET) exhibits a sex-specific phenotype relevant for schizophrenia research, which is characterized by the development of locomotor hyperactivity, social withdrawal, and changes to the serotonergic system. Cognitive impairments are characteristic of schizophrenia patients and male Nrg1 TM HET mice exhibit cognitive deficits in novel object recognition and contextual fear conditioning. Thus, we investigated the cognitive performance of female Nrg1 mutants, using a cognitive test battery for a variety of paradigms, including fear conditioning, cheeseboard, Y maze, object exploration and passive avoidance. Female Nrg1 mutant mice displayed impairments in the fear conditioning tasks, including significantly reduced fear conditioning to a context and a strong trend towards a decreased ability for cue fear conditioning. These cognitive deficits were task-specific, as no differences were seen between mutant and control mice in spatial learning of the cheeseboard for reference memory measures, in the Y-maze for working memory measures, or in novel object recognition and passive avoidance paradigms. These findings indicate that neuregulin 1 plays only a minor role in cognition in female test mice. The current study provides a further behavioural validation of this genetic mouse model for the schizophrenia candidate gene neuregulin 1 and confirms the importance of considering female test animals in animal models for schizophrenia.

Previous research suggests the infralimbic cortex is important in situations when there is competition between goal-directed and habitual responding. Here we used a response conflict procedure to further explore the involvement of the infralimbic cortex in this relationship. Rats received training on two instrumental biconditional discriminations, one auditory and one visual, in two distinct contexts. One discrimination was "over-trained" relative to the other, "under-trained," discrimination in the ratio 3:1. At test, animals were presented with incongruent audiovisual stimulus compounds of the training stimuli in the under-trained context. The stimulus elements of these test compounds have previously dictated different lever press responses during training. Rats receiving control infusions into the infralimbic cortex showed a significant interference effect, producing more responses to the over-trained (habitual), but context-inappropriate, stimulus element of the incongruent compound. This interference effect was abolished by inactivation of the infralimbic cortex; animals showed a reduced tendency to produce the habitual but inappropriate response compared with animals receiving control infusions. This finding provides evidence that the infralimbic cortex is involved in attenuating the influence of goal-directed behavior, for example context-appropriate responding.

Antipsychotic drugs are the mainstay of treatment for schizophrenia but they have little effect on core negative symptoms or cognitive impairment. To meet the deficiencies of current treatments, novel potential compounds are emerging from preclinical research but translation to clinical success has been poor. This article evaluates the possibility that cognitive and physiological abnormalities in schizophrenia can be used as central nervous system biomarkers to predict, in healthy volunteers, the likely efficacy of entirely new pharmacological approaches to treatment. Early detection of efficacy would focus resource on rapidly developing, effective drugs. We review the relevance of selected cognitive and physiological abnormalities as biomarkers in schizophrenia and three of its surrogate populations: (i) healthy volunteers with high trait schizotypy; (ii) unaffected relatives of patients; and (iii) healthy volunteers in a state of cortical glutamate disinhibition induced by low-dose ketamine. Several biomarkers are abnormal in these groups and in some instances there has been exploratory work to determine their sensitivity to drug action. They are generally insensitive to current antipsychotics and therefore their predictive validity cannot be established until novel, therapeutically useful drugs are discovered. Until then such biomarker studies can provide evidence of drugs engaging with the mechanism of interest and encouragement of the concept.

It has been proposed that the cognitive dysfunction observed in patients with schizophrenia reflects a failure in cognitive control, in particular an inability to use task-relevant information to guide behavior. Using a prefrontal-dependent task designed to reflect aspects of cue and response conflict seen in human cognitive paradigms, we examined the influence of prefrontal dopamine receptor manipulation on the contextual control of response conflict. Rats were trained on two biconditional discrimination tasks, one auditory and one visual, in two discriminably different contexts. At test, audiovisual compounds of these training stimuli were presented, in extinction, in each of the training contexts. These compounds were formed in such a way that the individual elements previously dictated different responses during training, termed incongruent trials. Studies have shown that rats use contextual information to disambiguate the conflicting information provided by incongruent compounds, responding in manner that is appropriate to the stimulus element that was trained in the test context. Direct infusion of the D1 receptor agonist SKF-38393 into the prelimbic cortex was found to modulate incongruent trial performance in a manner that was dependent upon baseline performance: animals in the low baseline group demonstrated improved incongruent performance following infusion of SKF-38393 into the prelimbic cortex. In contrast, high performers showed a reduction in accuracy during incongruent compounds. This paradigm provides a reliable framework for assessing the efficacy of preclinical agents in treating the cognitive impairments seen in frontal-related disorders such as schizophrenia.

Cognitive impairments in schizophrenia have been characterized as reflecting a core deficit in the maintenance or use of task-setting cues to mediate appropriate ongoing behaviour. This analysis suggests that cognitive deficits in schizophrenia will be particularly evident when different task-setting cues dictate when different responses are required by the same stimuli. One simple task in which task-setting cues are required is a biconditional discrimination. Here we examined the performance of participants with high and low schizotypy scores (Mason, Claridge, & Jackson, 1995) on a biconditional discrimination and an otherwise equivalent, control discrimination that did not require the use of task-setting cues. Participants scoring highly on the Introvertive Anhedonia subscale (which has been allied to the negative and cognitive symptoms of schizophrenia) performed poorly on the biconditional, but not on the control, discrimination. No other subscales demonstrated a significant influence on either biconditional or control performance.

Introduction. Previous research suggests that latent inhibition is reduced in patients with acute schizophrenia and in healthy participants with high levels of schizotypic characteristics. Other evidence indicates the disruption of a related effect (learned irrelevance) in patients with acute schizophrenia. Method. This study used a recently developed latent inhibition procedure, that avoids methodological limitations of previous studies, and a related learned irrelevance procedure to assess the relationship between these phenomena and schizotypic characteristics in undergraduate participants. Results. Participants preexposed to a letter (S) learnt the predictive relationship between that letter and another letter (X) slower than the relationship between a novel letter and X (a latent inhibition effect). Experiment 1 found reduced latent inhibition in the high schizotypy group after 10, but not 20 preexposures. In Experiment 2, participants preexposed to both S and X learnt a subsequent relationship between them slower than the relationship between a novel letter and X (a learned irrelevance effect). This effect was abolished in participants with high levels of schizotypy. Conclusions. These results are both the first demonstration of abolished learned irrelevance and of a significant reduction in latent inhibition without employing an explicit masking task in participants with high levels of positive schizotypy.

An important aspect of decision making is the ability of responses to be controlled by different cues in different situations or contexts, especially when there is conflict between alternative responses or actions.Recently, a context-dependent biconditional task has been developed for rats that mimic some aspects of response conflict seen in human cognitive paradigms, such as the Stroop task. In this task, contextual cues are used to disambiguate conflicting response information provided by audiovisual compound stimuli. Here we review current findings that investigate some of the behavioral, neurobiological, and neurochemical mechanisms that underlie this use of contextual or task-setting information to resolve response conflict, and discuss future ways in which this research can be extended.

A novel, optional-shift procedure was used to assess changes in the attention paid to stimuli that occur over the course of discrimination learning. In Phase 1, rats were trained on a conditional instrumental discrimination using audiovisual stimulus compounds; one stimulus dimension (auditory or visual) was relevant to the solution of the discrimination, the other was irrelevant. In Phase 2, all animals received three sessions of training with novel audiovisual compounds where both dimensions were equally diagnostic. Results from probe test trials indicated that, during Phase 2, animals learnt most about cues belonging to the stimulus dimension that was relevant during Phase 1. These results suggest that over the course of discrimination learning there was an increase in the amount of attention paid to relevant stimuli and/or a decrease in the attention paid to irrelevant stimuli.