Search

Impulsive behavior during adolescence may stem from developmental imbalances between motivational and cognitive-control systems, producing greater urges to pursue reward and weakened capacities to inhibit such actions. Here, we developed a Pavlovian-instrumental transfer (PIT) protocol to assay rats' ability to suppress cue-motivated reward seeking based on changes in reward expectancy. Traditionally, PIT studies focus on how reward-predictive cues motivate instrumental reward-seeking behavior (lever pressing). However, cues signaling imminent reward delivery also elicit countervailing focal-search responses (food-port entry). We first examined how reward expectancy (cue-reward probability) influences expression of these competing behaviors. Adult male rats increased rates of lever pressing when presented with cues signaling lower probabilities of reward but focused their activity at the food cup on trials with cues that signaled higher probabilities of reward. We then compared adolescent and adult male rats in their responsivity to cues signaling different reward probabilities. In contrast to adults, adolescent rats did not flexibly adjust patterns of responding based on the expected likelihood of reward delivery but increased their rate of lever pressing for both weak and strong cues. These findings indicate that control over cue-motivated behavior is fundamentally dysregulated during adolescence, providing a model for studying neurobiological mechanisms of adolescent impulsivity.

A multifunctional chemical neural probe fabrication process exploiting PDMS thin-film transfer to incorporate a microfluidic channel onto a silicon-based microelectrode array (MEA) platform, and enzyme microstamping to provide multi-analyte detection is described. The Si/PDMS hybrid chemtrode, modified with a nano-based on-probe IrOx reference electrode, was validated in brain phantoms and in rat brain.

Flexible neural probes have been pursued previously to minimize the mechanical mismatch between soft neural tissues and implants and thereby improve long-term performance. However, difficulties with insertion of such probes deep into the brain severely restricts their utility. We describe a solution to this problem using gallium (Ga) in probe construction, taking advantage of the solid-to-liquid phase change of the metal at body temperature and probe shape deformation to provide temperature-dependent control of stiffness over 5 orders of magnitude. Probes in the stiff state were successfully inserted 2 cm-deep into agarose gel "brain phantoms" and into rat brains under cooled conditions where, upon Ga melting, they became ultra soft, flexible, and stretchable in all directions. The current 30 μm-thick probes incorporated multilayer, deformable microfluidic channels for chemical agent delivery, electrical interconnects through Ga wires, and high-performance electrochemical glutamate sensing. These PDMS-based microprobes of ultra-large tunable stiffness (ULTS) should serve as an attractive platform for multifunctional chronic neural implants.

AimsLike drug addiction, cues associated with palatable foods can trigger food-seeking, even when sated. However, whether susceptibility to the motivating influence of food-related cues is a predisposing factor in overeating or a consequence of poor diet is difficult to determine in humans. Using a rodent model, we explored whether a highly palatable 'junk food' diet impacts responses to reward-paired cues in a Pavlovian-to-instrumental transfer test, using sweetened condensed milk (SCM) as the reward. The hedonic impact of SCM consumption was also assessed by analyzing licking microstructure.MethodsTo probe the effects of pattern and duration of junk food exposure, we provided rats with either regular chow ad libitum (controls) or chow plus access to junk food for either 2 or 24 h per day for 1, 3, or 6 weeks. We also examined how individual susceptibility to weight gain related to these measures.ResultsRats provided 24 h access to the junk food diet were insensitive to the motivational effects of a SCM-paired cue when tested sated even though their hedonic experience upon reward consumption was similar to controls. In contrast, rats provided restricted, 2 h access to junk food exhibited a cue generalization phenotype under sated conditions, lever-pressing with increased vigor in response to both a SCM-paired cue, and a cue not previously paired with reward. Hedonic response was also significantly higher in these animals relative to controls.ConclusionsThese data demonstrate that the pattern of junk food exposure differentially alters the hedonic impact of palatable foods and susceptibility to the motivating influence of cues in the environment to promote food-seeking actions when sated, which may be consequential for understanding overeating and obesity.

The dorsomedial striatum (DMS) has been strongly implicated in flexible, outcome-based decision making, including the outcome-specific Pavlovian-to-instrumental transfer effect (PIT), which measures the tendency for a reward-predictive cue to preferentially motivate actions that have been associated with the predicted reward over actions associated with different rewards. Although the neurochemical underpinnings of this effect are not well understood, there is growing evidence that striatal acetylcholine signaling may play an important role. This study investigated this hypothesis by assessing the effects of intra-DMS infusions of the nicotinic antagonist mecamylamine or the muscarinic antagonist scopolamine on expression of specific PIT in rats. These treatments produced dissociable behavioral effects. Mecamylamine infusions enhanced rats' tendency to use specific cue-elicited outcome expectations to select whichever action was trained with the predicted outcome, relative to their performance when tested after vehicle infusions. In contrast, scopolamine infusions appeared to render instrumental performance insensitive to this motivational influence of reward-paired cues. These drug treatments had no detectable effect on conditioned food cup approach behavior, indicating that they selectively perturbed cue-guided action selection without producing more wide-ranging alterations in behavioral control. Our findings reveal an important role for DMS acetylcholine signaling in modulating the impact of cue-evoked reward expectations on instrumental action selection.

It has been hypothesized that brain development during adolescence perturbs reward processing in a way that may ultimately contribute to the risky decision making associated with this stage of life, particularly in young males. To investigate potential reward dysfunction during adolescence, Experiment 1 examined palatable fluid intake in rats as a function of age and sex. During a series of twice-weekly test sessions, non-food-deprived rats were given the opportunity to voluntarily consume a highly palatable sweetened condensed milk (SCM) solution. We found that adolescent male, but not female, rats exhibited a pronounced, transient increase in SCM intake (normalized by body weight) that was centered around puberty. Additionally, adult females consumed more SCM than adult males and adolescent females. Using a well-established analytical framework to parse the influences of reward palatability and satiety on the temporal structure of feeding behavior, we found that palatability-driven intake at the outset of the meal was significantly elevated in adolescent males, relative to the other groups. Furthermore, although we found that there were some group differences in the onset of satiety, they were unlikely to contribute to differences in intake. Experiment 2 confirmed that adolescent male rats exhibit elevated palatable fluid consumption, relative to adult males, even when a non-caloric saccharin solution was used as the taste stimulus, demonstrating that these results were unlikely to be related to age-related differences in metabolic need. These findings suggest that elevated palatable food intake during adolescence is sex specific and driven by a fundamental change in reward processing. As adolescent risk taking has been hypothesized as a potential result of hypersensitivity to and overvaluation of appetitive stimuli, individual differences in reward palatability may factor into individual differences in adolescent risky decision making.

Through incentive learning, the emotional experience of a reward in a relevant need state (e.g. hunger for food) sets the incentive value that guides the performance of actions that earn that reward when the need state is encountered again. Opiate withdrawal has been proposed as a need state in which, through experience, opiate value can be increased, resulting in escalated opiate self-administration. Endogenous opioid transmission plays anatomically dissociable roles in the positive emotional experience of reward consumption and incentive learning. We, therefore, sought to determine if chronic opiate exposure and withdrawal produces a disruption in the fundamental incentive learning process such that reward seeking, even for non-opiate rewards, can become maladaptive, inconsistent with the emotional experience of reward consumption and irrespective of need. Rats trained to earn sucrose or water on a reward-seeking chain were treated with morphine (10-30 mg/kg, s.c.) daily for 11 days prior to testing in withdrawal. Opiate-withdrawn rats showed elevated reward-seeking actions, but only after they experienced the reward in withdrawal, an effect that was strongest in early (1-3 days), as opposed to late (14-16 days), withdrawal. This was sufficient to overcome a negative reward value change induced by sucrose experience in satiety and, in certain circumstances, was inconsistent with the emotional experience of reward consumption. Lastly, we found that early opiate withdrawal-induced inflation of reward value was blocked by inactivation of basolateral amygdala mu opioid receptors. These data suggest that in early opiate withdrawal, the incentive learning process is disrupted, resulting in maladaptive reward seeking.

Drug addiction is marked by pathological drug seeking and intense drug craving, particularly in response to drug-related stimuli. Repeated psychostimulant administration is known to induce long-term alterations in mesolimbic dopamine (DA) signaling that are hypothesized to mediate this heightened sensitivity to environmental stimuli. However, there is little direct evidence that drug-induced alteration in mesolimbic DA function underlies this hypersensitivity to motivational cues. In the current study, we tested this hypothesis using fast-scan cyclic voltammetry to monitor phasic DA signaling in the nucleus accumbens core of cocaine-pretreated (6 once-daily injections of 15 mg/kg, i.p.) and drug-naive rats during a test of cue-evoked incentive motivation for food-the Pavlovian-to-instrumental transfer task. We found that prior cocaine exposure augmented both reward seeking and DA release triggered by the presentation of a reward-paired cue. Furthermore, cue-evoked DA signaling positively correlated with cue-evoked food seeking and was found to be a statistical mediator of this behavioral effect of cocaine. Taken together, these findings provide support for the hypothesis that repeated cocaine exposure enhances cue-evoked incentive motivation through augmented phasic mesolimbic DA signaling. This work sheds new light on a fundamental neurobiological mechanism underlying motivated behavior and its role in the expression of compulsive reward seeking.

Reward-seeking actions can be guided by external cues that signal reward availability. For instance, when confronted with a stimulus that signals sugar, rats will prefer an action that produces sugar over a second action that produces grain pellets. Action selection is also sensitive to changes in the incentive value of potential rewards. Thus, rats that have been prefed a large meal of sucrose will prefer a grain-seeking action to a sucrose-seeking action. The current study investigated the dependence of these different aspects of action selection on cholinergic transmission. Hungry rats were given differential training with two unique stimulus-outcome (S1-O1 and S2-O2) and action-outcome (A1-O1 and A2-O2) contingencies during separate training phases. Rats were then given a series of Pavlovian-to-instrumental transfer tests, an assay of cue-triggered responding. Before each test, rats were injected with scopolamine (0, 0.03, or 0.1 mg/kg, intraperitoneally), a muscarinic receptor antagonist, or mecamylamine (0, 0.75, or 2.25 mg/kg, intraperitoneally), a nicotinic receptor antagonist. Although the reward-paired cues were capable of biasing action selection when rats were tested off-drug, both anticholinergic treatments were effective in disrupting this effect. During a subsequent round of outcome devaluation testing-used to assess the sensitivity of action selection to a change in reward value--we found no effect of either scopolamine or mecamylamine. These results reveal that cholinergic signaling at both muscarinic and nicotinic receptors mediates action selection based on Pavlovian reward expectations, but is not critical for flexibly selecting actions using current reward values.

BackgroundRecent theories addressing mesolimbic dopamine's role in reward processing emphasize two apparently distinct functions, one in reinforcement learning (i.e., prediction error) and another in incentive motivation (i.e., the invigoration of reward seeking elicited by reward-paired cues). Here, we evaluate the latter.MethodsUsing fast-scan cyclic voltammetry, we monitored, in real time, dopamine release in the nucleus accumbens core of rats (n = 9) during a Pavlovian-to-instrumental transfer task in which the effects of a reward-predictive cue on an independently trained instrumental action were assessed. Voltammetric data were parsed into slow and phasic components to determine whether these forms of dopamine signaling were differentially related to task performance.ResultsWe found that a reward-paired cue, which increased reward-seeking actions, induced an increase in phasic mesolimbic dopamine release and produced slower elevations in extracellular dopamine. Interestingly, phasic dopamine release was temporally related to and positively correlated with lever-press activity generally, while slow dopamine changes were not significantly related to such activity. Importantly, the propensity of the reward-paired cue to increase lever pressing was predicted by the amplitude of phasic dopamine release events, indicating a possible mechanism through which cues initiate reward-seeking actions.ConclusionsThese data suggest that those phasic mesolimbic dopamine release events thought to signal reward prediction error may also be related to the incentive motivational impact of reward-paired cues on reward-seeking actions.

The neurochemical changes underlying human emotions and social behaviour are largely unknown. Here we report on the changes in the levels of two hypothalamic neuropeptides, hypocretin-1 and melanin-concentrating hormone, measured in the human amygdala. We show that hypocretin-1 levels are maximal during positive emotion, social interaction and anger, behaviours that induce cataplexy in human narcoleptics. In contrast, melanin-concentrating hormone levels are minimal during social interaction, but are increased after eating. Both peptides are at minimal levels during periods of postoperative pain despite high levels of arousal. Melanin-concentrating hormone levels increase at sleep onset, consistent with a role in sleep induction, whereas hypocretin-1 levels increase at wake onset, consistent with a role in wake induction. Levels of these two peptides in humans are not simply linked to arousal, but rather to specific emotions and state transitions. Other arousal systems may be similarly emotionally specialized.

There is growing evidence that mere exposure to drugs can induce long-term alterations in the neural systems that mediate reward processing, motivation, and behavioral control, potentially causing the pathological pursuit of drugs that characterizes the addicted state. The incentive sensitization theory proposes that drug exposure potentiates the influence of reward-paired cues on behavior. It has also been suggested that drug exposure biases action selection towards the automatic execution of habits and away from more deliberate goal-directed control. The current study investigated whether rats given repeated exposure to peripherally administered cocaine would show alterations in incentive motivation (assayed using the Pavlovian-to-instrumental transfer (PIT) paradigm) or habit formation (assayed using sensitivity to reward devaluation). After instrumental and Pavlovian training for food pellet rewards, rats were given 6 daily injections of cocaine (15 mg/kg, IP) or saline, followed by a 10-d period of rest. Consistent with the incentive sensitization theory, cocaine-treated rats showed stronger cue-evoked lever pressing than saline-treated rats during the PIT test. The same rats were then trained on a new instrumental action with a new food pellet reward before undergoing a reward devaluation testing. Although saline-treated rats exhibited sensitivity to reward devaluation, indicative of goal-directed performance, cocaine-treated rats were insensitive to this treatment, suggesting a reliance on habitual processes. These findings, when taken together, indicate that repeated exposure to cocaine can cause broad alterations in behavioral control, spanning both motivational and action selection processes, and could therefore help explain aberrations of decision-making that underlie drug addiction.

BackgroundSequential reward-seeking actions are readily learned despite the temporal gap between the earliest (distal) action in the sequence and the reward delivery. Fast dopamine signaling is hypothesized to mediate this form of learning by reporting errors in reward prediction. However, such a role for dopamine release in voluntarily initiated action sequences remains to be demonstrated.MethodsUsing fast-scan cyclic voltammetry, we monitored phasic mesolimbic dopamine release, in real time, as rats performed a self-initiated sequence of lever presses to earn sucrose rewards. Before testing, rats received either 0 (n = 11), 5 (n = 11), or 10 (n = 8) days of action sequence training.ResultsFor rats acquiring the action sequence task at test, dopamine release was strongly elicited by response-contingent (but unexpected) rewards. With learning, a significant elevation in dopamine release preceded performance of the proximal action and subsequently came to precede the distal action. This predistal dopamine release response was also observed in rats previously trained on the action sequence task, and the amplitude of this signal predicted the latency with which rats completed the action sequence. Importantly, the dopamine response to contingent reward delivery was not observed in rats given extensive pretraining. Pharmacological analysis confirmed that task performance was dopamine-dependent.ConclusionsThese data suggest that phasic mesolimbic dopamine release mediates the influence that rewards exert over the performance of self-paced, sequentially-organized behavior and sheds light on how dopamine signaling abnormalities may contribute to disorders of behavioral control.

Impulsive behavior during adolescence may stem from developmental imbalances between motivational and cognitive-control systems, producing greater urges to pursue reward and weakened capacities to inhibit such actions. Here, we developed a Pavlovian-instrumental transfer (PIT) protocol to assay rats' ability to suppress cue-motivated reward seeking based on changes in reward expectancy. Traditionally, PIT studies focus on how reward-predictive cues motivate instrumental reward-seeking behavior (lever pressing). However, cues signaling imminent reward delivery also elicit countervailing focal-search responses (food-port entry). We first examined how reward expectancy (cue-reward probability) influences expression of these competing behaviors. Adult male rats increased rates of lever pressing when presented with cues signaling lower probabilities of reward but focused their activity at the food cup on trials with cues that signaled higher probabilities of reward. We then compared adolescent and adult male rats in their responsivity to cues signaling different reward probabilities. In contrast to adults, adolescent rats did not flexibly adjust patterns of responding based on the expected likelihood of reward delivery but increased their rate of lever pressing for both weak and strong cues. These findings indicate that control over cue-motivated behavior is fundamentally dysregulated during adolescence, providing a model for studying neurobiological mechanisms of adolescent impulsivity. [ABSTRACT FROM AUTHOR]