Search

The psychogenetically selected Roman high- (RHA) and low-avoidance (RLA) rats are being proposed as a valuable animal model of individual vulnerability to the two distinct neurobiological mechanisms of behavioral sensitization to psychostimulants, namely induction and expression. Most hallmarks of their divergent phenotypes are also found in the inbred RHA (RHA-I) and RLA (RLA-I) strains. For instance, they differ in the expression of sensitization to amphetamine. However, the pattern of spontaneous activity of the inbred rats seems to differ from that of outbred Roman strains. The present work shows the relevance of analyzing spontaneous activity as a covariant in order to determine the significance of day effect in the induction of behavioral sensitization to amphetamine (regime: 11 days, 1 mg/kg, i.p.) in the inbred strains and, for comparison, the standard low activity Sprague-Dawley (SD) strain. Our results also confirm that, in parallel to the outbred strains, only inbred RHA rats showed sensitization during the induction phase, here detectable from day 9 of treatment, while RLA-I and SD strains did not. Inbred RLA rats provide an interesting model to study individual resistance to sensitization, with nuances due to their underlying high spontaneous activity phenotype., (Copyright © 2018 Elsevier B.V. All rights reserved.)

Probabilistic reward learning is characterised by individual differences that become acute in aging. This may be due to age-related dopamine (DA) decline affecting neural processing in striatum, prefrontal cortex, or both. We examined this by administering a probabilistic reward learning task to younger and older adults, and combining computational modelling of behaviour, fMRI and PET measurements of DA D1 availability. We found that anticipatory value signals in ventromedial prefrontal cortex (vmPFC) were attenuated in older adults. The strength of this signal predicted performance beyond age and was modulated by D1 availability in nucleus accumbens. These results uncover that a value-anticipation mechanism in vmPFC declines in aging, and that this mechanism is associated with DA D1 receptor availability.

The hippocampus plays a central role in the approach-avoidance conflict that is central to the genesis of anxiety. However, its exact functional contribution has yet to be identified. We designed a novel gambling task that generated approach-avoidance conflict while controlling for spatial processing. We fit subjects' behavior using a model that quantified the subjective values of choice options, and recorded neural signals using functional magnetic resonance imaging (fMRI). Distinct functional signals were observed in anterior hippocampus, with inferior hippocampus selectively recruited when subjects rejected a gamble, to a degree that covaried with individual differences in anxiety. The superior anterior hippocampus, in contrast, uniquely demonstrated value signals that were potentiated in the context of approach-avoidance conflict. These results implicate the anterior hippocampus in behavioral avoidance and choice monitoring, in a manner relevant to understanding its role in anxiety. Our findings highlight interactions between subregions of the hippocampus as an important focus for future study., (© The Author 2016. Published by Oxford University Press.)

Dopamine (DA) losses are associated with various aging-related cognitive deficits. Typically, higher moment-to-moment brain signal variability in large-scale patterns of voxels in neocortical regions is linked to better cognitive performance and younger adult age, yet the physiological mechanisms regulating brain signal variability are unknown. We explored the relationship among adult age, DA availability, and blood oxygen level-dependent (BOLD) signal variability, while younger and older participants performed a spatial working memory (SWM) task. We quantified striatal and extrastriatal DA D1 receptor density with [(11)C]SCH23390 and positron emission tomography in all participants. We found that BOLD variability in a neocortical region was negatively related to age and positively related to SWM performance. In contrast, BOLD variability in subcortical regions and bilateral hippocampus was positively related to age and slower responses, and negatively related to D1 density in caudate and dorsolateral prefrontal cortex. Furthermore, BOLD variability in neocortical regions was positively associated with task-related disengagement of the default-mode network, a network whose activation needs to be suppressed for efficient SWM processing. Our results show that age-related DA losses contribute to changes in brain signal variability in subcortical regions and suggest a potential mechanism, by which neocortical BOLD variability supports cognitive performance., (© The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.)

The expectation of reward is known to enhance a consolidation of long-term memory for events. We tested whether this effect is driven by positive valence or action requirements tied to expected reward. Using a functional magnetic resonance imaging (fMRI) paradigm in young adults, novel images predicted gain or loss outcomes, which in turn were either obtained or avoided by action or inaction. After 24 h, memory for these images reflected a benefit of action as well as a congruence of action requirements and valence, namely, action for reward and inaction for avoidance. fMRI responses in the hippocampus, a region known to be critical for long-term memory function, reflected the anticipation of inaction. In contrast, activity in the putamen mirrored the congruence of action requirement and valence, whereas other basal ganglia regions mirrored overall action benefits on long-lasting memory. The findings indicate a novel type of functional division between the hippocampus and the basal ganglia in the motivational regulation of long-term memory consolidation, which favors remembering events that are worth acting for., (© The Author 2015. Published by Oxford University Press.)

Deep brain stimulation (DBS) of the subthalamic nucleus (STN) is an effective treatment for motor impairments in Parkinson's disease (PD) but its effect on the motivational regulation of action control is still not fully understood. We investigated whether DBS of the STN influences the ability of PD patients to act for anticipated reward or loss, or whether DBS improves action execution independent of motivational valence. 16 PD patients (12 male, mean age = 58.5 ± 10.17 years) treated with bilateral STN-DBS and an age- and gender-matched group of healthy controls (HC) performed a go/no-go task whose contingencies explicitly decouple valence and action. Patients were tested with (ON) and without (OFF) active STN stimulation. For HC, there was a benefit in performing rewarded actions when compared to actions that avoided punishment. PD patients showed such a benefit reliably only when STN stimulation was ON. In fact, the relative behavioral benefit for go for reward over go to avoid losing was stronger in the PD patients under DBS ON than in HC. In PD patients, rather than generally improving motor functions independent of motivational valence, modulation of the STN by DBS improves action execution specifically when rewards are anticipated. Thus, STN-DBS establishes a reliable congruency between action and reward ("Pavlovian congruency") and remarkably enhances it over the level observed in HC.

Motivational salience plays an important role in shaping human behavior, but recent studies demonstrate that human performance is not uniformly improved by motivation. Instead, action has been shown to dominate valence in motivated tasks, and it is particularly difficult for humans to learn the inhibition of an action to obtain a reward, but the neural mechanism behind this behavioral specificity is yet unclear. In all mammals, including humans, the monoamine neurotransmitter dopamine is particularly important in the neural manifestation of appetitively motivated behavior, and the human dopamine system is subject to considerable genetic variability. The well-studied TaqIA restriction fragment length polymorphism (rs1800497) has previously been shown to affect striatal dopamine metabolism. In this study we investigated a potential effect of this genetic variation on motivated action/inhibition learning. Two independent cohorts consisting of 87 and 95 healthy participants, respectively, were tested using the previously described valenced go/no-go learning paradigm in which participants learned the reward-associated no-go condition significantly worse than all other conditions. This effect was modulated by the TaqIA polymorphism, with carriers of the A1 allele showing a diminished learning-related performance enhancement in the rewarded no-go condition compared to the A2 homozygotes. This result highlights a modulatory role for genetic variability of the dopaminergic system in individual learning differences of action-valence interaction.

Repeated processing of the same information is associated with decreased neuronal responses, termed repetition suppression (RS). Although RS effects (i.e., the difference in activity between novel and repeated stimuli) have been demonstrated within several brain regions, such as the medial temporal lobe, their precise neural mechanisms still remain unclear. Here, we used functional magnetic resonance imaging together with psychopharmacology in 48 healthy human subjects, demonstrating that RS effects within the mesolimbic system are differentially modulated by cholinergic and dopaminergic stimulation. The dopamine precursor levodopa (100 mg) attenuated RS within the hippocampus, parahippocampal cortex, and substantia nigra/ventral tegmental area, and the degree of this reduction correlated with recognition memory performance 24 h later. The acetylcholinesterase inhibitor galantamine (8 mg), in contrast, reversed RS into repetition enhancement, showing no relationship to subsequent recognition memory. This suggests that novelty sensitive neural populations of the mesolimbic system can dynamically shift their responses depending on the balance of cholinergic and dopaminergic neurotransmission, and these shifts can influence memory retention.

The selection of actions, and the vigor with which they are executed, are influenced by the affective valence of predicted outcomes. This interaction between action and valence significantly influences appropriate and inappropriate choices and is implicated in the expression of psychiatric and neurological abnormalities, including impulsivity and addiction. We review a series of recent human behavioral, neuroimaging, and pharmacological studies whose key design feature is an orthogonal manipulation of action and valence. These studies find that the interaction between the two is subject to the critical influence of dopamine. They also challenge existing views that neural representations in the striatum focus on valence, showing instead a dominance of the anticipation of action., (Copyright © 2014 Elsevier Ltd. All rights reserved.)

Rationale: Decision-making involves two fundamental axes of control namely valence, spanning reward and punishment, and action, spanning invigoration and inhibition. We recently exploited a go/no-go task whose contingencies explicitly decouple valence and action to show that these axes are inextricably coupled during learning. This results in a disadvantage in learning to go to avoid punishment and in learning to no-go to obtain a reward. The neuromodulators dopamine and serotonin are likely to play a role in these asymmetries: Dopamine signals anticipation of future rewards and is also involved in an invigoration of motor responses leading to reward, but it also arbitrates between different forms of control. Conversely, serotonin is implicated in motor inhibition and punishment processing., Objective: To investigate the role of dopamine and serotonin in the interaction between action and valence during learning.Methods We combined computational modeling with pharmacological manipulation in 90 healthy human volunteers, using levodopa and citalopram to affect dopamine and serotonin, respectively., Results: We found that, after administration of levodopa,action learning was less affected by outcome valence when compared with the placebo and citalopram groups. This highlights in this context a predominant effect of levodopa in controlling the balance between different forms of control.Citalopram had distinct effects, increasing participants'tendency to perform active responses independent of outcome valence, consistent with a role in decreasing motor inhibition., Conclusions: Our findings highlight the rich complexities of the roles played by dopamine and serotonin during instrumental learning.

Economic choices are strongly influenced by whether potential outcomes entail gains or losses. We examined this influence of outcome valence in an economic risk task. We employed three experiments based on our task, each of which provided novel findings, and which together better characterize and explain how outcome valence influences risky choice. First, we found that valence perturbed an individual's choices around that individual's base-level of risk-taking, a base-level consistent across time, and context. Second, this perturbation by valence was highly context dependent, emerging when valence was introduced as a dimension within a decision-making setting, and being reversed by a change in task format (causing more gambling for gains than losses and the reverse). Third, we show this perturbation by valence is explicable by low-level approach-avoidance processes, an hypothesis not previously tested by a causal manipulation. We revealed such an effect, where individuals were less disposed to choose a riskier option with losses when they had to approach (go) as opposed to avoid (nogo) that option. Our data show valence perturbs an individual's choices independently of the impact of risk, and causally implicate approach-avoidance processes as important in shaping economic choice.

Action inhibition can globally prevent all motor output or selectively cancel specific actions during concurrent motor output. Here we examine the behavioral and neural basis of selective inhibition focusing on the role of preparation. In 18 healthy human participants we manipulated the extent to which they could prepare for selective inhibition by providing or withholding information on what actions might need to be stopped. We show that, on average, information improves both speed and selectivity of inhibition. Functional magnetic resonance imaging data show that preparation for selective inhibition engages the inferior frontal gyrus, supplementary motor area, and striatum. Examining interindividual differences, we find the benefit of proactive control to speed and selectivity of inhibition trade off against each other, such that an improvement in stopping speed leads to a deterioration of selectivity of inhibition, and vice versa. This trade-off is implemented through engagement of the dorsolateral prefrontal cortex and putamen. Our results suggest proactive selective inhibition is implemented within frontostriatal structures, and we provide evidence that a speed-selectivity trade-off might underlie a range of findings reported previously.

Flexible instrumental learning is required to harness the appropriate behaviors to obtain rewards and to avoid punishments. The precise contribution of dopaminergic midbrain regions (substantia nigra/ventral tegmental area [SN/VTA]) to this form of behavioral adaptation remains unclear. Normal aging is associated with a variable loss of dopamine neurons in the SN/VTA. We therefore tested the relationship between flexible instrumental learning and midbrain structural integrity. We compared task performance on a probabilistic monetary go/no-go task, involving trial and error learning of: "go to win," "no-go to win," "go to avoid losing," and "no-go to avoid losing" in 42 healthy older adults to previous behavioral data from 47 younger adults. Quantitative structural magnetization transfer images were obtained to index regional structural integrity. On average, both some younger and some older participants demonstrated a behavioral asymmetry whereby they were better at learning to act for reward ("go to win" > "no-go to win"), but better at learning not to act to avoid punishment ("no-go to avoid losing" > "go to avoid losing"). Older, but not younger, participants with greater structural integrity of the SN/VTA and the adjacent subthalamic nucleus could overcome this asymmetry. We show that interindividual variability among healthy older adults of the structural integrity within the SN/VTA and subthalamic nucleus relates to effective acquisition of competing instrumental responses., (Copyright © 2013 Elsevier Inc. All rights reserved.)

Psychological studies have emphasized that motivation is regulated by the anticipation of the emotional impact from the possible occurrence of unexpected rewarding events. Here, we scrutinized the existence of a corresponding neural signal by means of event-related potentials (ERPs) and computational modeling. In the first experiment, we designed a task that manipulated the probability of gaining a monetary reward and measured ERPs during anticipation and at reward delivery. A sustained frontocentral neural activity (i.e., the stimulus preceding negativity, SPN) was evidenced during the anticipation period. Critically, the SPN was found to increase in amplitude as the reward became more unexpected. Changes in the SPN were found to be predictive of individual differences in risk seeking, suggesting that a greater risk attitude involved a greater motivational state for receiving an improbable reward. In the second experiment, SPN results associated with unexpected monetary gains were replicated in a condition in which participants avoided monetary losses and the occurrence of unexpected rewards was also associated with an increase in the amount of self-reported pleasure. These findings support the existence of a neural ERP signature that encodes the process of tuning our motivation to the possibility of receiving a desirable but improbable rewarding outcome., (Copyright © 2013 Elsevier Inc. All rights reserved.)

A report by Payzan-LeNestour et al. (2013) in this issue of Neuron shows that the human locus coeruleus, a brain stem nucleus containing cell bodies of noradrenergic neurons, dynamically tracks the level of uncertainty about knowledge of the environment while making decisions., (Copyright © 2013 Elsevier Inc. All rights reserved.)

Subjects routinely control the vigor with which they emit motoric responses. However, the bulk of formal treatments of decision-making ignores this dimension of choice. A recent theoretical study suggested that action vigor should be influenced by experienced average reward rate and that this rate is encoded by tonic dopamine in the brain. We previously examined how average reward rate modulates vigor as exemplified by response times and found a measure of agreement with the first suggestion. In the current study, we examined the second suggestion, namely the potential influence of dopamine signaling on vigor. Ninety healthy subjects participated in a double-blind experiment in which they received one of the following: placebo, L-DOPA (which increases dopamine levels in the brain), or citalopram (which has a selective, if complex, effect on serotonin levels). Subjects performed multiple trials of a rewarded odd-ball discrimination task in which we varied the potential reward over time in order to exercise the putative link between vigor and average reward rate. Replicating our previous findings, we found that a significant fraction of the variance in subjects' responses could be explained by our experimentally manipulated changes in average reward rate. Crucially, this relationship was significantly stronger under L-Dopa than under Placebo, suggesting that the impact of average reward levels on action vigor is indeed subject to a dopaminergic influence.

Senescence affects the ability to utilize information about the likelihood of rewards for optimal decision-making. Using functional magnetic resonance imaging in humans, we found that healthy older adults had an abnormal signature of expected value, resulting in an incomplete reward prediction error (RPE) signal in the nucleus accumbens, a brain region that receives rich input projections from substantia nigra/ventral tegmental area (SN/VTA) dopaminergic neurons. Structural connectivity between SN/VTA and striatum, measured by diffusion tensor imaging, was tightly coupled to inter-individual differences in the expression of this expected reward value signal. The dopamine precursor levodopa (L-DOPA) increased the task-based learning rate and task performance in some older adults to the level of young adults. This drug effect was linked to restoration of a canonical neural RPE. Our results identify a neurochemical signature underlying abnormal reward processing in older adults and indicate that this can be modulated by L-DOPA.

Neural representations of the effort deployed in performing actions, and the valence of the outcomes they yield, form the foundation of action choice. To discover whether brain areas represent effort and outcome valence together or if they represent one but not the other, we examined these variables in an explicitly orthogonal way. We did this by asking human subjects to exert one of two levels of effort to improve their chances of either winning or avoiding the loss of money. Subjects responded faster both when exerting greater effort and when exerting effort in anticipation of winning money. Using fMRI, we inspected BOLD responses during anticipation (before any action was executed) and when the outcome was delivered. In this way, we indexed BOLD signals associated with an anticipated need to exert effort and its affective consequences, as well as the effect of executed effort on the representation of outcomes. Anterior cingulate cortex and dorsal striatum (dorsal putamen) signaled the anticipation of effort independently of the prospect of winning or losing. Activity in ventral striatum (ventral putamen) was greater for better-than-expected outcomes compared with worse-than-expected outcomes, an effect attenuated in the context of having exerted greater effort. Our findings provide evidence that neural representations of anticipated actions are sensitive to the expected demands, but not to the expected value of their consequence, whereas representations of outcome value are discounted by exertion, commensurate with an integration of cost and benefit so as to approximate net value.

When predicting financial profits, relationship outcomes, longevity, or professional success, people habitually underestimate the likelihood of future negative events. This well-known bias, termed unrealistic optimism, is observed across age, culture, and species, and has a significant societal impact on domains ranging from financial markets to health and well being. However, it is unknown how neuromodulatory systems impact on the generation of optimistically biased beliefs. This question assumes great importance in light of evidence that common neuropsychiatric disorders, such as depression, are characterized by pessimism. Here, we show that administration of a drug that enhances dopaminergic function (dihydroxy-L-phenylalanine; L-DOPA) increases an optimism bias. This effect is due to L-DOPA impairing the ability to update belief in response to undesirable information about the future. These findings provide the first evidence that the neuromodulator dopamine impacts on belief formation by reducing negative expectations regarding the future., (Copyright © 2012 Elsevier Ltd. All rights reserved.)

Decision-making invokes two fundamental axes of control: affect or valence, spanning reward and punishment, and effect or action, spanning invigoration and inhibition. We studied the acquisition of instrumental responding in healthy human volunteers in a task in which we orthogonalized action requirements and outcome valence. Subjects were much more successful in learning active choices in rewarded conditions, and passive choices in punished conditions. Using computational reinforcement-learning models, we teased apart contributions from putatively instrumental and Pavlovian components in the generation of the observed asymmetry during learning. Moreover, using model-based fMRI, we showed that BOLD signals in striatum and substantia nigra/ventral tegmental area (SN/VTA) correlated with instrumentally learnt action values, but with opposite signs for go and no-go choices. Finally, we showed that successful instrumental learning depends on engagement of bilateral inferior frontal gyrus. Our behavioral and computational data showed that instrumental learning is contingent on overcoming inherent and plastic Pavlovian biases, while our neuronal data showed this learning is linked to unique patterns of brain activity in regions implicated in action and inhibition respectively., (Copyright © 2012 Elsevier Inc. All rights reserved.)

Dopamine is widely observed to signal anticipation of future rewards and thus thought to be a key contributor to affectively charged decision making. However, the experiments supporting this view have not dissociated rewards from the actions that lead to, or are occasioned by, them. Here, we manipulated dopamine pharmacologically and examined the effect on a task that explicitly dissociates action and reward value. We show that dopamine enhanced the neural representation of rewarding actions, without significantly affecting the representation of reward value as such. Thus, increasing dopamine levels with levodopa selectively boosted striatal and substantia nigra/ventral tegmental representations associated with actions leading to reward, but not with actions leading to the avoidance of punishment. These findings highlight a key role for dopamine in the generation of appetitively motivated actions.

Humans bargaining over money tend to reject unfair offers, whilst chimpanzees bargaining over primary rewards of food do not show this same motivation to reject. Whether such reciprocal fairness represents a predominantly human motivation has generated considerable recent interest. We induced either moderate or severe thirst in humans using intravenous saline, and examined responses to unfairness in an Ultimatum Game with water. We ask if humans also reject unfair offers for primary rewards. Despite the induction of even severe thirst, our subjects rejected unfair offers. Further, our data provide tentative evidence that this fairness motivation was traded-off against the value of the primary reward to the individual, a trade-off determined by the subjective value of water rather than by an objective physiological metric of value. Our data demonstrate humans care about fairness during bargaining with primary rewards, but that subjective self-interest may limit this fairness motivation.

Two fundamental questions underlie the expression of behavior, namely what to do and how vigorously to do it. The former is the topic of an overwhelming wealth of theoretical and empirical work particularly in the fields of reinforcement learning and decision-making, with various forms of affective prediction error playing key roles. Although vigor concerns motivation, and so is the subject of many empirical studies in diverse fields, it has suffered a dearth of computational models. Recently, Niv et al. [Niv, Y., Daw, N. D., Joel, D., & Dayan, P. Tonic dopamine: Opportunity costs and the control of response vigor. Psychopharmacology (Berlin), 191, 507-520, 2007] suggested that vigor should be controlled by the opportunity cost of time, which is itself determined by the average rate of reward. This coupling of reward rate and vigor can be shown to be optimal under the theory of average return reinforcement learning for a particular class of tasks but may also be a more general, perhaps hard-wired, characteristic of the architecture of control. We, therefore, tested the hypothesis that healthy human participants would adjust their RTs on the basis of the average rate of reward. We measured RTs in an odd-ball discrimination task for rewards whose magnitudes varied slowly but systematically. Linear regression on the subjects' individual RTs using the time varying average rate of reward as the regressor of interest, and including nuisance regressors such as the immediate reward in a round and in the preceding round, showed that a significant fraction of the variance in subjects' RTs could indeed be explained by the rate of experienced reward. This validates one of the key proposals associated with the model, illuminating an apparently mandatory form of coupling that may involve tonic levels of dopamine.

Motivational theories of choice focus on the influence of goal values and strength of reinforcement to explain behavior. By contrast relatively little is known concerning how the cost of an action, such as effort expended, contributes to a decision to act. Effort-based decision making addresses how we make an action choice based on an integration of action and goal values. Here we review behavioral and neurobiological data regarding the representation of effort as action cost, and how this impacts on decision making. Although organisms expend effort to obtain a desired reward there is a striking sensitivity to the amount of effort required, such that the net preference for an action decreases as effort cost increases. We discuss the contribution of the neurotransmitter dopamine (DA) toward overcoming response costs and in enhancing an animal's motivation toward effortful actions. We also consider the contribution of brain structures, including the basal ganglia and anterior cingulate cortex, in the internal generation of action involving a translation of reward expectation into effortful action.

The acquisition of reward and the avoidance of punishment could logically be contingent on either emitting or withholding particular actions. However, the separate pathways in the striatum for go and no-go appear to violate this independence, instead coupling affect and effect. Respect for this interdependence has biased many studies of reward and punishment, so potential action-outcome valence interactions during anticipatory phases remain unexplored. In a functional magnetic resonance imaging study with healthy human volunteers, we manipulated subjects' requirement to emit or withhold an action independent from subsequent receipt of reward or avoidance of punishment. During anticipation, in the striatum and a lateral region within the substantia nigra/ventral tegmental area (SN/VTA), action representations dominated over valence representations. Moreover, we did not observe any representation associated with different state values through accumulation of outcomes, challenging a conventional and dominant association between these areas and state value representations. In contrast, a more medial sector of the SN/VTA responded preferentially to valence, with opposite signs depending on whether action was anticipated to be emitted or withheld. This dominant influence of action requires an enriched notion of opponency between reward and punishment.

The double, fear-driven "passive avoidance/active avoidance" conflict appearing during acquisition of two-way active avoidance, involves high levels of anxiety and a dominant tendency for freezing responses, which in turn run against the appearance of active escape/avoidance behavior. In the present study, by using a large sample genetically heterogeneous (N/Nih-HS) rats, we have tested the hypothesis that rats showing relatively higher levels of context-conditioned freezing (during the initial trials of that task) should show lower efficiency to acquire two-way avoidance behavior, i.e. the prediction that the initial context-conditioned freezing in the shuttle box would be negatively related to avoidance acquisition efficiency. In agreement with such a hypothesis, the results from the three rat subsamples used show that context-conditioned freezing (during the first 5 inter-trial intervals of the 40-trial two-way avoidance session) is negatively correlated (r=-0.34 to r=-0.64, p<0.001) with two-way avoidance acquisition, in a way that subgroups of rats with extremely high or low levels of freezing markedly differ in their avoidance performance: "high freezer" rats show much worse avoidance acquisition than "low freezers". Moreover, the relationships of conditioned freezing and avoidance acquisition with baseline and fear-potentiated startle, as well as with unconditioned anxiety (in the elevated zero-maze test), have also been studied. Taken collectively, the results indicate that: (i) context conditioned freezing is a reliable (and negative) predictor of two-way avoidance acquisition; (ii) baseline and fear-potentiated startle responses show positive associations with avoidance responding, and (iii) unconditioned anxiety in the elevated zero-maze is also negatively associated with two-way avoidance acquisition. Such patterns of associations are considered to be very informative in regard to the search for (common or differential) neural and genetic mechanisms of different forms of (unlearned or learned) anxious or fear responses., (Copyright © 2011 Elsevier Inc. All rights reserved.)

Humans show substantial deviation from rationality during economic decision making under uncertainty. A computational perspective suggests these deviations arise out of an interaction between distinct valuation systems in the brain. Here, we provide behavioural data showing that the incidental presentation of aversive and appetitive conditioned stimuli can alter subjects' preferences in an economic task, involving a choice between a safe or gamble option. These behavioural effects informed a model-based analysis of a functional magnetic resonance imaging (fMRI) experiment, involving an identical paradigm, where we demonstrate that this conditioned behavioral bias engages the amygdala, a brain structure associated with acquisition and expression of conditioned associations. Our findings suggest that a well known bias in human economic choice can arise from an influence of conditioned associations on goal-directed decision making, consistent with an architecture of choice that invokes distinct decision-making systems., (Copyright 2010 Elsevier Inc. All rights reserved.)

Studies in humans and animals show that dopaminergic neuromodulation originating from the substantia nigra/ventral tegmental area (SN/VTA) of the midbrain enhances hippocampal synaptic plasticity for novel events and has a motivationally energizing effect on actions through striatal mechanisms. In this review, we discuss how these mechanisms of dopaminergic neuromodulation connect to the behavioural and functional consequences that age-related structural degeneration of the SN/VTA exerts on declarative memory. We propose a framework called 'NOvelty-related Motivation of Anticipation and exploration by Dopamine' (NOMAD) which captures existing links between novelty, dopamine, long-term memory, plasticity, energization and their relation to aging. We propose that maximizing the use of this mechanism by maintaining mobility and exploration of novel environments could be a potential mechanism to slow age-related decline of memory., (Copyright 2009 Elsevier Ltd. All rights reserved.)

Reward representation in ventral striatum is boosted by perceptual novelty, although the mechanism of this effect remains elusive. Animal studies indicate a functional loop (Lisman and Grace, 2005) that includes hippocampus, ventral striatum, and midbrain as being important in regulating salience attribution within the context of novel stimuli. According to this model, reward responses in ventral striatum or midbrain should be enhanced in the context of novelty even if reward and novelty constitute unrelated, independent events. Using fMRI, we show that trials with reward-predictive cues and subsequent outcomes elicit higher responses in the striatum if preceded by an unrelated novel picture, indicating that reward representation is enhanced in the context of novelty. Notably, this effect was observed solely when reward occurrence, and hence reward-related salience, was low. These findings support a view that contextual novelty enhances neural responses underlying reward representation in the striatum and concur with the effects of novelty processing as predicted by the model of Lisman and Grace (2005).

A common approach to study neuronal aspects of emotional reactivity of borderline personality disorder (BPD) is to study the brain response to emotional faces with functional magnetic resonance imaging (fMRI). 10 BPD patients and 10 matched controls were submitted to an emotional discrimination task in which subjects had to identify an emotional face from a neutral face while fMRI data was acquired. BPD patients made more mistakes than controls in the discrimination task when negative faces were involved. The emotional discrimination task activated brain areas that are known to participate in processing of emotional faces (fusiform gyrus, insula and amygdala) regardless of the psychiatric condition. Additionally, BPD showed higher activation than controls in the middle and inferior temporal cortical areas, brain areas that participate in the processing of face features that carry emotional value. Furthermore, activity at this site correlated with impulsivity score in the Zuckerman-Kuhlman Personality Questionnaire. Our findings may be related to cognitive impairment that may be characteristic of the disorder.

Anxiety-related behaviors were evaluated across five tests in a sample of 277 rats from a genetically heterogeneous stock (N/Nih-HS rats), derived from an eight-way cross of inbred strains, and compared with the performance of RLA-I (high anxious) and RHA-I (low anxious) rats in the same tests. These tests either evoke unlearned (novel-cage activity (NACT), elevated "zero" maze (ZM), baseline acoustic startle response (BAS)) or learned (fear-potentiated startle (FPS), two-way active-shuttle box-avoidance acquisition (SHAV)) anxious/fearful responses. The results overall showed that unlearned anxiety responses/behaviors were predictive of behavior in learned fear (i.e. fear-potentiated startle) and conflict (i.e. two-way active avoidance acquisition) situations. Moreover, it was found that N/Nih-HS rats either resemble RLA-I rat anxiety/fear scores or fall in between those of the RLA-I (high anxious) and the RHA-I (low anxious) rat strains. An additional regression analysis (of N/Nih-HS rat data) showed significant positive influences of (unlearned) baseline startle response, risk assessment (i.e. stretch-attend) behavior and activity (5min) in a novel cage on SHAV acquisition, while baseline startle and entries into the open section of the elevated 'zero' maze test of anxiety were the main variables influencing FPS. This indicates that startle responses may have a facilitating role in the rat's active responses in the two-way active (shuttlebox) avoidance acquisition. The results of this behavioral evaluation of N/Nih-HS rats show that unconditioned anxiety (e.g. in the ZM test) predicts learned fear-related responses (e.g. FPS and SHAV) to some extent, while a positive association is also observed between BAS and SHAV. These findings are discussed in terms of their potential usefulness for present and future neurobehavioral and genetic studies of fearfulness/anxiety.

Invasive recording of dopamine neurons in the substantia nigra and ventral tegmental area (SN/VTA) of behaving animals suggests a role for these neurons in reward learning and novelty processing. In humans, functional magnetic resonance imaging (fMRI) is currently the only non-invasive event-related method to measure SN/VTA activity, but it is debated to what extent fMRI enables inference about dopaminergic responses within the SN/VTA. We consider the anatomical and functional parcellation of the primate SN/VTA and find that its homogeneity suggests little variation in the regional specificity of fMRI signals for reward-related dopaminergic responses. Hence, these responses seem to be well captured by the compound fMRI signal from the SN/VTA, which seems quantitatively related to dopamine release in positron emission tomography (PET). We outline how systematic investigation of the functional parcellation of the SN/VTA in animals, new developments in fMRI analysis and combined PET-fMRI studies can narrow the gap between fMRI and dopaminergic neurotransmission.

The laboratory rat (Rattus norvegicus) is a key tool for the study of medicine and pharmacology for human health. A large database of phenotypes for integrated fields such as cardiovascular, neuroscience, and exercise physiology exists in the literature. However, the molecular characterization of the genetic loci that give rise to variation in these traits has proven to be difficult. Here we show how one obstacle to progress, the fine-mapping of quantitative trait loci (QTL), can be overcome by using an outbred population of rats. By use of a genetically heterogeneous stock of rats, we map a locus contributing to variation in a fear-related measure (two-way active avoidance in the shuttle box) to a region on chromosome 5 containing nine genes. By establishing a protocol measuring multiple phenotypes including immunology, neuroinflammation, and hematology, as well as cardiovascular, metabolic, and behavioral traits, we establish the rat HS as a new resource for the fine-mapping of QTLs contributing to variation in complex traits of biomedical relevance.

In search for the substrate of naltrexone and acamprosate action on alcohol craving, we investigated the effects of ethanol alone and combined with naltrexone or acamprosate on expression of nerve growth factor-inducible clone A (NGFI-A; zif268). In Experiments 1 and 3, alcohol (2 g/kg) alone or in combination with naltrexone (15 mg/kg) or acamprosate (300 mg/kg) was injected intraperitoneally into mice. In Experiment 2, treatment was nor-BNI (0.5 mg/kg) to investigate whether the effect of naltrexone involved blockade of kappa-opioid receptors. Both ethanol and naltrexone alone induced NGFI-A in the central amygdala, but not in several other areas; these effects were additive. However, acamprosate alone or in combination with ethanol had no effect on NGFI-A mRNA, while nor-BNI induced NGFI-A mRNA in the basolateral amygdala. The central amygdala appears to be an important target of both alcohol and naltrexone. Acamprosate may not share the site of action with naltrexone despite being used for the same therapeutic purpose.

Anxiety-related behaviors were evaluated across various tests in a large sample (n=787, both sexes) of genetically heterogeneous (N/Nih-HS) rats, derived from an eight-way cross of inbred strains. These tests either evoke unlearned (black-white box, BWB-; novel-cage activity, NACT-; elevated "zero" maze, ZM-; baseline acoustic startle response, BAS-) or learned (fear-potentiated startle, FPS-; two-way active-shuttle box-avoidance acquisition, SHAV-) anxious/fearful responses. The results showed that, with the exception of fear-potentiated startle, almost all (unlearned and learned) behaviors assessed fit with a pattern of sex effects characterized by male rats as being more fearful than females. We applied factor analyses (oblique rotation) to each sex, with the final two-factor solution showing: (1) a first factor (labelled as "Timidity") comprising BWB, NACT and ZM variables in both sexes, plus SHAV responding in the case of males, and (2) a second factor (called "Defensive Flight") which grouped BAS, FPS, and SHAV responding in both sexes. An additional regression analysis showed significant influences of (unlearned) risk assessment (i.e. stretch-attendance) behavior on SHAV in males, while FPS was the main variable positively influencing SHAV (in the intermediate and advanced phases of acquisition) in females. This indicates, for the first time, that fear-potentiated startle may have a facilitating role in the rat's active responses (at least in females) to the cue in the intermediate to advanced phases (i.e. when the initial "passive avoidance/active avoidance" begins to fade) of shuttle box avoidance acquisition. The results of this first extensive behavioral evaluation of N/Nih-HS rats are discussed in terms of their potential usefulness for present and future neurobehavioral and genetic studies of fearfulness/anxiety.

Rationale: The inbred Roman high- (RHA-I) and low-avoidance (RLA-I) rats, differing in dopaminergic activity and novelty/substance-seeking profiles, may be a suitable model to study the implication of the dopaminergic system in vulnerability to drug abuse. Differences in D3 receptor binding recently described between the two strains (Guitart-Masip M, Johansson B, Fernández-Teruel A, Cañete T, Tobeña A, Terenius L, Giménez-Llort L, Neuroscience 142:1231-1243, 2006b) may be important in shaping the aforementioned differences in novelty seeking., Objective: The aim of the present work was to study the effect of D3 receptor activation on novelty-induced locomotor activity in these two strains of rats., Materials and Methods: We administered saline and PD-128,907 (0.01 and 0.1 mg/kg), a putative D3 receptor agonist, to the Roman rats and studied the locomotor activity when animals were placed in a novel environment. Thereafter, by means of in situ hybridization, nerve growth factor inducible clone A (NGFI-A) mRNA was measured in the striatum and the Calleja islands of these animals., Results: We found that RLA-I rats showed stronger locomotor inhibition than RHA-I rats after PD-128,907 administration. Moreover, RLA-I rats showed stronger reduction of NGFI-A mRNA in the Calleja islands than RHA-I rats., Conclusions: These results, together with previous findings, suggest that differences in D3 receptor expression in the Calleja islands may contribute to the divergent behavioral effect of PD-128,907 administration in the two strains of Roman rats.

Roman rat strains, genetically selected for high (RHA) or low (RLA) active avoidance acquisition in the two-way shuttle box, differ in dopaminergic activity. These two strains appear to be a valid laboratory model of divergent sensation/novelty and substance-seeking profiles. RHA rats show higher ethanol intake and preference than do RLA rats, and it was suggested that RHA rats are more tolerant than RLA to the effects of alcohol. In the hole-board test, we found that the non-alcohol-preferring RLA rats showed enhanced responsiveness to the stimulatory effects of intraperitoneal administration of 0.25 g/kg ethanol when compared with RHA rats. In situ hybridization analysis showed higher levels of preprodynorphin in the accumbens shell and higher levels of preproenkephalin in the cingulate cortex in RHA rats. RLA rats showed higher levels of enkephalin gene transcripts in restricted areas of the dorsal striatum. Finally, differences in cholecystokinin gene transcript, suggestive of a different arrangement of certain interneurons, were found in different cortical areas. The differences in peptide gene expression found between the two strains might reflect the differences in alcohol preference and sensitivity. RHA rats may have more predictive value than other rodent alcoholism models, as high initial tolerance to ethanol is a risk factor for alcoholism in humans.

Strain differences in spontaneous locomotor activity and the behavioral patterns induced by dopaminergic agonists in rodents can disclose differential genetic susceptibilities to dopaminergic dysfunction (i.e. vulnerability to psychosis). Psychogenetic selection of hypoemotional Roman High-Avoidance (RHA) and hyperemotional Low-Avoidance (RLA) rats leads to divergence in dopaminergic function as well. The present study was designed to characterize their spontaneous activity and their responses to apomorphine (0.067-3 mg/kg, s.c.) as compared to those of the standard Sprague-Dawley (SD) strain. The Roman strains displayed higher spontaneous activity than SD rats and RHA exhibited the higher response to novelty which agrees with a higher sensitivity to apomorphine in this strain. The biphasic effect induced by apomorphine (locomotor inhibition and yawning at low doses but stimulation of locomotion and stereotyped behavior at higher ones) was reproduced in the standard SD strain. Low doses were less effective inducing locomotor inhibition in RHA whereas these animals were much more sensitive to high dose-induced stereotyped behavior. In contrast, RLA was characterized as a high-yawning strain and low doses of apomorphine also induced a striking motor inhibition suggesting functional enhancement of dopamine receptors mediating these behaviors. The detailed and distinctive behavioral profiles described in this work suggest between strain differences both at the presynaptic and postsynaptic dopaminergic function and may serve as paths to better specify functional mechanisms in future studies of risk of developing dopaminergic dysfunctions.