Search

How can animals behave effectively in conditions involving different motivational contexts? Here, we propose how reinforcement learning neural networks can learn optimal behavior for dynamically changing motivational salience vectors. First, we show that Q-learning neural networks with motivation can navigate in environment with dynamic rewards. Second, we show that such networks can learn complex behaviors simultaneously directed towards several goals distributed in an environment. Finally, we show that in Pavlovian conditioning task, the responses of the neurons in our model resemble the firing patterns of neurons in the ventral pallidum (VP), a basal ganglia structure involved in motivated behaviors. We show that, similarly to real neurons, recurrent networks with motivation are composed of two oppositely-tuned classes of neurons, responding to positive and negative rewards. Our model generates predictions for the VP connectivity. We conclude that networks with motivation can rapidly adapt their behavior to varying conditions without changes in synaptic strength when expected reward is modulated by motivation. Such networks may also provide a mechanism for how hierarchical reinforcement learning is implemented in the brain., Added the Methods section

Background: Binge Drinking (BD), a highly prevalent drinking pattern among youth, has been linked with anomalies in inhibitory control. However, it is still not well characterized whether the neural mechanisms involved in this process are compromised in binge drinkers (BDs). Furthermore, recent findings suggest that exerting inhibitory control to alcohol-related stimuli requires an increased effort in BDs, relative to controls, but the brain regions subserving these effects have also been scarcely investigated. Here we explored the impact of BD on the pattern of neural activity mediating response inhibition and its modulation by the motivational salience of stimuli (alcohol-related content). Methods: Sixty-seven (36 females) first-year university students, classified as BDs (n = 32) or controls (n = 35), underwent fMRI as they performed an alcohol-cued Go/NoGo task in which pictures of alcoholic or non-alcoholic beverages were presented as Go or NoGo stimuli. Results: During successful inhibition trials, BDs relative to controls showed greater activity in the bilateral inferior frontal gyrus (IFG), extending to the anterior insula, a brain region usually involved in response inhibition tasks, despite the lack of behavioral differences between groups. Moreover, BDs displayed increased activity in this region restricted to the right hemisphere when inhibiting a prepotent response to alcohol-related stimuli. Conclusions: The increased neural activity in the IFG/insula during response inhibition in BDs, in the absence of behavioral impairments, could reflect a compensatory mechanism. The findings suggest that response inhibition-related activity in the right IFG/insula is modulated by the motivational salience of stimuli and highlight the role of this brain region in suppressing responses to substance-associated cues. This investigation was supported by grants from the Spanish Ministerio de Sanidad, Servicios Sociales e Igualdad, Plan Nacional sobre Drogas (PNSD 2015/034), Ministerio de Economía y Competitividad (PSI2015-70525-P) co-funded for European Regional Development Fund and Xunta de Galicia (GRC ED431C 2017/06). SS-S was supported by a predoctoral fellowship from the Spanish Ministerio de Economía y Competitividad (BES-2016-076298). JP-G was supported by the FPU program from the Spanish Ministerio de Educación, Cultura y Deporte (FPU16/01573) SI

There is sufficient evidence to believe that variations in the error-related negativity (ERN) are linked to dispositional characteristics in individuals. However, explanations of individual differences in the amplitude of the ERN cannot be derived from functional theories of the ERN. The ERN has a counterpart that occurs after correct responses (correct-response negativity, CRN). Based on the assumption that ERN and CRN reflect an identical cognitive process, variations in CRN might be associated with dispositional characteristics as well. Higher CRN amplitudes have been found to reflect task engagement. In the present study, a simple-choice-reaction task was used to investigate ERN and CRN amplitudes in relation to their score on a conscientiousness scale. The task consisted of a simple rule that required pressing the left or right key when a circle or square appeared, respectively. During alternative conditions that occur infrequently, participants were instructed to violate or reverse the previously established response rules. Smaller ΔERN amplitudes (manifested in almost equal CRN and ERN amplitudes) and a tendency of better task performance from participants scoring high on the conscientiousness scale might indicate a greater focus on the task and higher motivation of responding correctly. In addition, higher Pc amplitudes directly following the CRN indicated that the response monitoring system of less conscientious participants showed a higher disengagement. The role of individual differences in CRN amplitude should be studied in future experiments on performance monitoring.

It is widely believed that females outperformed males in emotional information processing. The present study tested whether the female superiority in emotional information processing exists in a naturalistic social-emotional context, if so, what the temporal dynamics underlies. The behavioral and electrophysiological responses were recorded while participants were performing an interpersonal gambling game with opponents’ facial emotions given as feedback. The results yielded that emotional cues modulated the influence of monetary feedback on outcome valuation. Critically, this modulation was more conspicuous in females: opponents’ angry expressions increased females’ risky tendency and decreased the amplitude of reward positivity (RewP) and feedback P300. These findings indicate that females are more sensitive to emotional expressions in real interpersonal interactions, which is manifested in both early motivational salience detection and late conscious cognitive appraisal stages of feedback processing.

International audience; The study of food aversion in humans by the induction of illness is ethically unthinkable, and it is difficult to propose a type of food that is disgusting for everybody. However, although cheese is considered edible by most people, it can also be perceived as particularly disgusting to some individuals. As such, the perception of cheese constitutes a good model to study the cerebral processes of food disgust and aversion. In this study, we show that a higher percentage of people are disgusted by cheese than by other types of food. Functional magnetic resonance imaging then reveals that the internal and external globus pallidus and the substantia nigra belonging to the basal ganglia are more activated in participants who dislike or diswant to eat cheese (Anti) than in other participants who like to eat cheese, as revealed following stimulation with cheese odors and pictures. We suggest that the aforementioned basal ganglia structures commonly involved in reward are also involved in the aversive motivated behaviors. Our results further show that the ventral pallidum, a core structure of the reward circuit, is deactivated in Anti subjects stimulated by cheese in the wanting task, highlighting the suppression of motivation-related activation in subjects disgusted by cheese.

Food reward sensitivity may influence individual susceptibility to an environment replete with highly palatable foods of minimal nutritional value. These foods contain combinations of added sugar, fat, and/or salt that may enhance their motivational salience. This study examined associations of food reward sensitivity with eating behaviors in the NEXT Generation Health Study, a nationally representative sample of U.S. young adults. Participants (n = 2202) completed self-report measures including the Power of Food Scale, assessing food reward sensitivity, and intake frequency of 14 food groups. Multiple linear regressions estimated associations of food reward sensitivity with each of the eating behaviors adjusting for covariates. Higher food reward sensitivity was associated with more frequent intake of fast food (b ± linearized SE = 0.24 ± 0.05, p

Dopamine neurotransmission has long been identified as a key component of prefrontal cortical function and flexible cognition; however, flexible behavior does not depend solely on dopamine. Together, multiple systems allow fast and flexible behavior in the face of a constantly changing environment. This Research Topic illuminates work by researchers who are leading efforts to understand how different neural systems yield flexible behavior.

The attribution of incentive salience to reward associated cues is critical for motivation and the pursuit of rewards. Disruptions in the integrity of the neural systems controlling these processes can lead to avolition and anhedonia, symptoms that cross the diagnostic boundaries of many neuropsychiatric illnesses. Here, we consider whether the habenula (Hb), a region recently demonstrated to encode negatively valenced events, also modulates the attribution of incentive salience to a neutral cue predicting a food reward. The Pavlovian autoshaping paradigm was used in the rat as an investigative tool to dissociate Pavlovian learning processes imparting strictly predictive value from learning that attributes incentive motivational value. Electrolytic lesions of the fasciculus retroflexus (fr), the sole pathway through which descending Hb efferents are conveyed, significantly increased incentive salience as measured by conditioned approaches to a cue light predictive of reward. Conversely, generation of a fictive Hb signal via fr stimulation during CS+ presentation significantly decreased the incentive salience of the predictive cue. Neither manipulation altered the reward predictive value of the cue as measured by conditioned approach to the food. Our results provide new evidence supporting a significant role for the Hb in governing the attribution of incentive motivational salience to reward predictive cues and further imply that pathological changes in Hb activity could contribute to the aberrant pursuit of debilitating goals or avolition and depression-like symptoms.