Search

To identify biobehavioral mechanisms underlying excessive reward consumption, reward valuation-effort (RV-E) assessments should (a) parallel measures in basic science to permit translation from preclinical to clinical studies; (b) quantify constructs dimensionally from healthy to disease states; and (c) hold relevance across different diagnostic categories. To address these aims, we developed a progressive ratio (PR) task whereby RV-E is measured as breakpoint when participants worked for access to playing a game. We evaluated test-retest reliability of breakpoint and convergent and discriminant validity of interpretations of this score against an established PR task for food. In Study 1, female undergraduates (N = 71; 33% racial minority; 28% ethnic minority) completed the game and food tasks in fasted and fed states. In Study 2, women (N = 189; 29% racial minority; 27% ethnic minority) with eating disorders (n = 158) were compared to controls (n = 31) on tasks. Game task breakpoint demonstrated excellent test-retest reliability, intraclass correlation coefficient (ICC) = .91, 95% CI [.80, -.96], over 2 weeks and convergent validity with the fasted food task (r = .51, p < .001). Consistent with animal models, breakpoint was lower in fed compared to fasted states across tasks, B (SE) = 321.01 (552.40), p < .001. Finally, the game task demonstrated discriminant validity from measurement of satiation. In Study 2, women with eating disorders demonstrated higher breakpoint on both tasks compared to controls, and game PR task breakpoint decreased from a fasted to fed state. The game PR task offers a novel approach for translating results from animal models of RV-E into testable hypotheses in nonclinical and clinical samples. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Evolutionary game theory is widely applied in network attack and defense. The existing network attack and defense analysis methods based on evolutionary games adopt the bounded rationality hypothesis. However, the existing research ignores that both sides of the game get more information about each other with the deepening of the network attack and defense game, which may cause the attacker to crack a certain type of defense strategy, resulting in an invalid defense strategy. The failure of the defense strategy reduces the accuracy and guidance value of existing methods. To solve the above problem, we propose a reward value learning mechanism (RLM). By analyzing previous game information, RLM automatically incentives or punishes the attack and defense reward values for the next stage, which reduces the probability of defense strategy failure. RLM is introduced into the dynamic network attack and defense process under incomplete information, and a multistage evolutionary game model with a learning mechanism is constructed. Based on the above model, we design the optimal defense strategy selection algorithm. Experimental results demonstrate that the evolutionary game model with RLM has better results in the value of reward and defense success rate than the evolutionary game model without RLM.

A great wealth of studies has investigated the capacity of motivationally relevant stimuli to bias attention, suggesting that reward predicting cues are prioritized even when reward is no longer delivered and when attending to such stimuli is detrimental to reward achievement. Despite multiple procedures have been adopted to unveil the mechanisms whereby reward cues gain attentional salience, some open questions remain. Indeed, mechanisms different from motivation can be responsible for the capture of attention triggered by the reward cue. In addition, we note that at present only a few studies have sought to address whether the cue attractiveness dynamically follows changes in the associated reward value. Investigating how and to what extent the salience of the reward cue is updated when motivation changes, could help shedding light on how reward-cues attain and maintain their capacity to attract attention, and therefore on apparent irrational attentive behaviors.

Detecting objects of varied sizes in high resolution images is difficult due to the challenges of high memory requirement and huge computation burden. Existing state-of-the-art detectors perform well on low resolution images. However, its performance is greatly limited on high resolution images. In this paper, we propose a selective region enlargement network, called SRENet, which significantly reduces processing time and memory requirement while remaining high detection accuracy. The proposed SRENet does not need to conduct detection on original high resolution images but only needs to conduct detection on down-sampled images and some zoom-in regions selected from high resolution images. SRENet first conducts coarse detection on a low resolution image, and then sequentially selects promising regions that are expected to be analyzed at a higher resolution. Specifically, SRENet is built upon Deep Q-learning Network (DQN) and it outputs an action-reward map. The value of the reward map indicates the possibility that the action can improve detection accuracy. The region selected by the action with the maximum reward value will be analyzed further at a higher resolution. Extensive experiments are conducted to demonstrate SRENet on two challenging datasets obtaining high resolution images. Experimental results show that SRENet achieves state-of-the-art detection performance with high efficiency.

The present study investigated whether the representation of subjective preferences in the event-related potential is manipulable through selective devaluation, i.e., the consumption of a specific food item until satiety. Thirty-four participants completed a gambling task in which they chose between virtual doors to find one of three snack items, representing a high, medium, or low preference outcome as defined by individual desire-to-eat ratings. In one of two test sessions, they underwent selective devaluation of the high preference outcome. In the other, they completed the task on an empty stomach. Consistent with previous findings, averaged across sessions, amplitudes were increased for more preferred rewards in the time windows of P2, late FRN, and P300. As hypothesised, we also found a selective devaluation effect for the high preference outcome in the P300 time window, reflected in a decrease in amplitude. The present results provide evidence for modulations of reward processing not only by individual factors, such as subjective preferences, but also by the current motivational state. Importantly, the present data suggest that selective devaluation effects in the P300 may be a promising tool to further characterise altered valuation of food rewards in the context of eating disorders and obesity. Supplementary Information The online version contains supplementary material available at 10.3758/s13415-021-00904-x.

The orbitofrontal cortex (OFC) plays a prominent role in signaling reward expectations. Two important features of rewards are their value (how good they are) and their specific identity (what they are). Whereas research on OFC has traditionally focused on reward value, recent findings point toward a pivotal role of reward identity in understanding OFC signaling and its contribution to behavior. Here, we review work in rodents, nonhuman primates, and humans on how the OFC represents expectations about the identity of rewards, and how these signals contribute to outcome-guided behavior. Moreover, we summarize recent findings suggesting that specific reward expectations in OFC are learned and updated by means of identity errors in the dopaminergic midbrain. We conclude by discussing how OFC encoding of specific rewards complements recent proposals that this region represents a cognitive map of relevant task states, which forms the basis for model-based behavior. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Contains fulltext : 202568.pdf (Publisher’s version ) (Open Access) Smartphones have been shown to distract people from their main tasks (e.g., studying, working), but the psychological mechanisms underlying these distractions are not clear yet. In a preregistered experiment (https://osf.io/g8kbu/), we tested whether the distracting nature of smartphones stems from their high associated (social) reward value. Participants (N = 117) performed a visual search task while they were distracted by (a) high social reward apps (e.g., Facebook app icon + notification sign), (b) low social reward apps (e.g., Facebook app icon), and (c) no social reward apps (e.g., Weather app icon). We expected that high social reward app icons would slow down search, especially when people were deprived of their smartphones. Surprisingly, high social reward (vs. low or no social reward) apps did not impair visual search performance, yet in a survey (N = 158) participants indicated to perceive these icons as more rewarding. Our results demonstrate that even if people perceive social smartphone apps as more rewarding than nonsocial apps, this may not manifest in behavior. 13 p.

Several animals, including bees, use visual search to distinguish targets of interest and ignore distractors. While bee flower choice is well studied, we know relatively little about how they choose between multiple rewarding flowers in complex floral environments. Two factors that could influence bee visual search for multiple flowers are the saliency (colour contrast against the background) and the reward value of flowers. We here investigated how these two different factors contribute to bee visual search. We trained bees to independently recognize two rewarding flower types that, in different experiments, differed in either saliency, reward value or both. We then measured their choices and attention to these flowers in the presence of distractors in a test without reinforcement. We found that bees preferred more salient or higher rewarding flowers and ignored distractors. When the high-reward flowers were less salient than the low-reward flowers, bees were nonetheless equally likely to choose high-reward flowers, for the reward and saliency values we used. Bees were also more likely to attend to these high-reward flowers, spending higher inspection times around them and exhibiting faster search times when choosing them. When flowers differed in reward, we also found an effect of the training order with low-reward targets being more likely to be chosen if they had been encountered during the more immediate training session prior to the test. Our results parallel recent findings from humans demonstrating that reward value can attract attention even when targets are less salient and irrelevant to the current task. Supplementary Information The online version contains supplementary material available at 10.1007/s10071-021-01479-3.

Why are open people open? A recent theory suggests that openness/intellect reflects sensitivity to the reward value of information, but so far, this has undergone few direct tests. To assess preferences for information, we constructed a novel task, adapted from information‐seeking paradigms within decision science, in which participants could choose to see information related to a guessing game they had just completed. Across two studies (one exploratory, n = 151; one confirmatory, n = 301), openness/intellect did not predict information seeking. Our results thus do not support a straightforward version of the theory, whereby open individuals display a general‐purpose sensitivity to any sort of new information. However, trait curiosity (arguably a facet of openness/intellect) predicted information seeking in both studies, and uncertainty intolerance (inversely related to openness/intellect) predicted information seeking in Study 2. Thus, it is possible that the domain‐level null association masks two divergent information‐seeking pathways: one approach motivated (curiosity) and one avoidance motivated (uncertainty intolerance). It remains to be seen whether these conflicting motivations can be isolated and if doing so reveals any association between information‐seeking and the broader openness/intellect domain.

Islam limits the pattern of interaction between men and women outside of marriage so that their respective honor can be maintained. In humans, there is a tendency of animal tendencies that have the potential to lead to prohibited cases (mungkarat or muharramat). Islam also regulates the provisions if a man and woman want a halal relationship as well as a reward value in the framework of marriage. An ideal marriage is generally defined as a marriage that is the result of one's own choice without any outside intervention, the two partners are never heard of fighting and arguing, and a married couple is supported by an established economy, such family conditions are considered ideal families. After several weeks or more, the news was heard that the husband and wife were divorced, even though at the beginning of the marriage they had received a prayer "hopefully they will become a sakinah family, mawadah, wa-rahmah and mate in the hereafter" could not prevent the intention to separate. The research method in this article uses a qualitative literature approach. The conclusion from the study and analysis of the text of the verses of the Qur'an regarding the concept of mate and the concepts of sakinah, mawadah, warahmah in the Koran is mentioned differently by Allah SWT. The concept of mate is said to use Arabic khalaqah, and the concepts of sakinah, mawadah, warahmah are spoken in Arabic ja'ala. The consequence of disclosing the concept of a mate using lafadz khlaqah means that something is the personal right of Allah SWT and humans do not have the effort to intervene, while the disclosure of the concepts of sakinah, mawadah, warahmah uses lafadz ja'ala, this means that human intervention is needed in building a family that is ideal.

We assessed energy compensation, appetite, and reward value of foods during a 14-day military expedition in Greenland realized by 12 male French soldiers, during which energy compensation was optimized by providing them with easy-to-eat palatable foods in excess. Although daily energy expenditure (estimated by accelerometry) stayed relatively constant throughout the expedition (15 ± 9 MJ·day−1), energy intake (EI; estimated by self-reported diaries) was 17% higher during the D8–D14 period compared with the D1–D7 period, leading to a neutral energy balance (EB). Body fat mass (BFM) significantly decreased (–1.0 ± 0.7 kg, p < 0.001) but not body mass (BM). Neither hunger scores (assessed by visual analog scales) nor components of the reward value of food (explicit liking (EL) and food preference) were significantly altered. However, changes in EL at D10 were positively correlated with changes in BM (r = 0.600, p < 0.05) and BFM (r = 0.680, p < 0.05) and changes in hunger in the EI of the relevant period (r = 0.743, p < 0.01 for D1–D7, r = 0.652, p < 0.05 for D8–14). This study shows that the negative EB and BM loss can be attenuated by an appropriate food supply and that subjective components of eating behaviour, such as hunger and EL, may be useful to predict the magnitude of energy compensation. Novelty Energy intake increases during of a 14-day expedition in the cold. Energy compensation was likely facilitated by providing participants with easy-to-eat palatable and familiar foods. Hunger scores and EL for energy-dense foods were associated with high EIs and low BM changes.

Older adults (OA) evaluate faces to be more trustworthy than do younger adults (YA), yet the processes supporting these more positive evaluations are unclear. This study identified neural mechanisms spontaneously engaged during face perception that differentially relate to OA' and YA' later trustworthiness evaluations. We examined two mechanisms: salience (reflected by amygdala activation) and reward (reflected by caudate activation) - both of which are implicated in evaluating trustworthiness. We emphasized the salience and reward value of specific faces by having OA and YA evaluate ingroup male White and outgroup Black and Asian faces. Participants perceived faces during fMRI and made trustworthiness evaluations after the scan. OA rated White and Black faces as more trustworthy than YA. OA had a stronger positive relationship between caudate activity and trustworthiness than YA when perceiving ingroup, but not outgroup, faces. Ingroup cues might intensify how trustworthiness is rewarding to OA, potentially reinforcing their overall positivity.

Negative symptoms in the motivational domain are strongly correlated with deficits in social and occupational functioning in schizophrenia. However, the neural substrates underlying these symptoms remain largely unknown. Twenty-eight adults with schizophrenia and twenty healthy volunteers underwent functional magnetic resonance while completing a lottery game designed to capture reward-related cognitive processes. Each trial demanded an initial investment of effort in form of key presses to increase the odds of winning. Brain activity in response to different reward cues (1 euro versus 1 cent) was compared between groups. Whereas controls invested more effort in improving their chances to win 1 euro compared to 1 cent in the lottery game, patients invested similarly high amounts of effort in both reward conditions. The neuroimaging analysis revealed lower neural activity in the bilateral caudate and cingulo-opercular circuits and decreased effective connectivity between reward-associated areas and neural nodes in the frontoparietal and salience network in response to high- versus low-reward conditions in schizophrenia patients compared to controls. Effective connectivity differences across conditions were associated with amotivation symptoms in patients. Overall, our data provide the evidence of alterations in neural activity in the caudate and cingulo-opercular "task maintenance" circuits and frontoparietal effective connectivity with reward-associated nodes as possible underlying mechanisms of reward value discrimination deficits affecting effort computation in schizophrenia.

Previous studies have indicated that both increased physical salience and increased reward-value salience of a target improve behavioral measures of attentional selection. It is unclear, however, whether these two forms of salience interact with attentional networks through similar or different neural mechanisms, and what such differences might be. We examined this question by separately manipulating both the value-driven and physical salience of targets in a visual search task while recording response times (RTs) and event-related potentials, focusing on the attentional-orienting-sensitive N2pc event-related potential component. Human participants of both sexes searched arrays for targets of either a high-physical-salience color or one of two low-physical-salience colors across three experimental phases. The first phase (“baseline”) offered no rewards. RT and N2pc latencies were shorter for high-physical-salience targets, indicating faster attentional orienting. In the second phase (“equal-reward”), a low monetary reward was given for fast correct responses for all target types. This reward context improved overall performance, similarly shortening RTs and enhancing N2pc amplitudes for all target types, but with no change in N2pc latencies. In the third phase (“selective-reward”), the reward rate was made selectively higher for one of the two low-physical-salience colors, resulting in their RTs becoming as fast as the high-physical-salience targets. Despite the equally fast RTs, the N2pc9s for these low-physical-salience, high-value targets remained later than for high-physical-salience targets, instead eliciting significantly larger N2pc9s. These results suggest that enhanced physical salience leads to faster attentional orienting, but value-driven salience to stronger attentional orienting, underscoring the utilization of different underlying mechanisms. SIGNIFICANCE STATEMENT Associating relevant target stimuli with reward value can enhance their salience, facilitating their attentional selection. This value-driven salience improves behavioral performance, similar to the effects of physical salience. Recent theories, however, suggest that these forms of salience are intrinsically different, although the neural mechanisms underlying any such differences remain unclear. This study addressed this issue by manipulating the physical and value-related salience of targets in a visual search task, comparing their effects on several attention-sensitive neural-activity measures. Our findings show that, whereas physical salience accelerates the speed of attentional selection, value-driven salience selectively enhances its strength. These findings shed new insights into the theoretical and neural underpinnings of value-driven salience and its effects on attention and behavior.

Learning associations between cues and rewards requires the mesolimbic dopamine system. The dopamine response to cues signals differences in reward value in well-trained animals. However, these value-related dopamine responses are absent during early training sessions when cues signal differences in the reward rate. These findings suggest cue-evoked dopamine release conveys differences between outcomes only after extensive training, though it is unclear if this is unique to when cues signal differences in reward rate, or if this is also evident when cues signal differences in other value-related parameters such as reward size. To address this, we utilized a Pavlovian conditioning task in which one audio cue was associated with a small reward (one pellet) and another audio cue was associated with a large reward (three pellets). We performed fast-scan cyclic voltammetry to record changes in dopamine release in the nucleus accumbens of male and female rats throughout learning. While female rats exhibited higher levels of conditioned responding, a faster latency to respond, and elevated post-reward head entries relative to male rats, there were no sex differences in the dopamine response to cues. Multiple training sessions were required before cue-evoked dopamine release signaled differences in reward size. Reward-evoked dopamine release scaled with reward size, though females displayed lower reward-evoked dopamine responses relative to males. Conditioned responding related to the decrease in the peak reward-evoked dopamine response and not to cue-evoked dopamine release. Collectively these data illustrate sex differences in behavioral responding as well as in reward-evoked dopamine release during Pavlovian learning.

Regulating Drug Prices while Increasing Innovation To save money on drugs while encouraging high-value pharmaceutical innovation, we need to better reward value, increase NIH funding for early-stag...

The rewarding properties of social interactions facilitate relationship formation and maintenance. Prairie voles are one of the few laboratory species that form selective relationships, manifested as “partner preferences” for familiar partners versus strangers. While both sexes exhibit strong partner preferences, this similarity in outward behavior likely results from sex-specific neurobiological mechanisms. We recently used operant conditioning to demonstrate that females work harder for access to a familiar versus unfamiliar conspecific of either sex, while males worked equally hard for access to any female, indicating a key sex difference in social motivation. As tests were performed with one social target at a time, males might have experienced a ceiling effect, and familiar females might be more relatively rewarding in a choice scenario. Here we performed a social choice operant task in which voles could repeatedly lever-press to gain temporary access to either the chamber containing their mate or one containing a novel opposite-sex vole. Females worked hardest to access their mate, while males pressed at similar rates for either female. Individual male behavior was heterogeneous, congruent with multiple mating strategies in the wild. Voles exhibited preferences for favorable over unfavorable environments in a non-social operant task, indicating that lack of social preference does not reflect lack of discrimination between chambers. Oxytocin receptor genotype at the intronic SNP NT213739 replicated a prior association with stranger-directed aggression within the test. These findings suggest that convergent preference behavior in male and female voles results from sex-divergent pathways, particularly in the realm of social motivation.

Background A recent clinical trial showed that an immediate transition to very low nicotine content (VLNC) cigarettes, compared with a gradual transition, produced greater reductions in smoking behavior, smoke exposure, and dependence. However, there was less compliance with the instruction to smoke only VLNC cigarettes in the immediate versus gradual reduction condition. The goal of this study was to test whether nicotine reduction method alters subjective ratings of VLNC cigarettes, and whether subjective ratings mediate effects of nicotine reduction method on smoking behavior, smoke exposure, dependence, and compliance. Methods This is a secondary analysis of a randomized trial conducted across 10 sites in the United States. Smokers (n = 1250) were randomized to either a control condition, or to have the nicotine content of their cigarettes reduced immediately or gradually to 0.04 mg nicotine/g of tobacco during a 20-week study period. Participants completed the modified Cigarette Evaluation Questionnaire (mCEQ). Results After Week 20, the immediate reduction group scored significantly lower than the gradual reduction group on multiple subscales of the mCEQ (ps < .001). The Satisfaction subscale of the mCEQ mediated the impact of nicotine reduction method on smoke exposure, smoking behavior, dependence, compliance, and abstinence. Other subscales also mediated a subset of these outcomes. Conclusions An immediate reduction in nicotine content resulted in lower product satisfaction than a gradual reduction, suggesting that immediate reduction further reduces cigarette reward value. This study will provide the Food and Drug Administration with information about the impact of nicotine reduction method on cigarette reward value. Implications These data suggest that an immediate reduction in nicotine content will result in greater reductions in cigarette satisfaction than a gradual reduction, and this reduction in satisfaction is related to changes in smoking behavior and dependence.

Although maladaptive decision-making is a defining feature of drug abuse and addiction, we have yet to ascertain how cocaine self-administration disrupts neural signals in anterior cingulate cortex (ACC), a brain region thought to contribute to attentional control. To address this issue, rats were trained on a reward-guided decision-making task; reward value was manipulated by independently varying the size of or the delay to reward over several trial blocks. Subsequently, rats self-administered either a cocaine (experimental group) or sucrose (control) during 12 consecutive days, after which they underwent a 1-month withdrawal period. Upon completion of this period, rats performed the previously learned reward-guided decision-making task while we recorded from single neurons in ACC. We demonstrate that prior cocaine self-administration attenuates attention and attention-related ACC signals in an intake-dependent manner, and that changes in attention are decoupled from ACC firing. These effects likely contribute to the impaired decision-making—typified by chronic substance abuse and relapse—observed after drug use.

When choosing the best action from several alternatives, we compare each value that depends on the balance between benefit and cost. Previous studies have shown that animals and humans with low brain serotonin (5-HT) level tend to choose smaller immediate reward. We used a decision-making schedule task to investigate whether 5-HT1A receptor is responsible for the decisions related to reward. In this task, the monkeys chose either of two different alternatives that were comprised of 1–4 drops of liquid reward (benefit) and 1–4 repeats of a color discrimination trial (workload cost), then executed the chosen schedule. By the administration of 5-HT1A antagonist, WAY100635, the choice tendency did not change, however, the sensitivity to the amount of reward in the schedule part was diminished. The 5-HT1A could have a role in maintaining reward value to keep track with the promised reward rather than modulating workload discounting of reward value.

Introduction Clinical evidence suggests that Parkinson's Disease (PD) patients are risk averse. Dopaminergic therapy has been reported to increase risk tolerance, but the underlying mechanisms are unclear. Some studies have suggested an amplification of subjective reward value, consistent with the role of dopamine in reward value coding. Others have reported value-independent risk enhancement. We evaluated the value-dependence of the effects of PD and its therapy on risk using tasks designed to sensitively measure risk over a wide range of expected values. Method 36 patients with idiopathic PD receiving levodopa monotherapy and 36 healthy matched controls performed two behavioural economic tasks aimed at quantifying 1) risk tolerance/aversion in the gain frame and 2) valuation of potential gains relative to losses. PD patients performed the tasks on and off their usual dose of levodopa in randomized order; controls performed the same tasks twice. Results Relative to the controls, unmedicated PD patients showed significant value-independent risk aversion in the gain frame, which was normalized by levodopa. PD patients did not differ from controls in their valuation of gains relative to losses. However, across both tasks and regardless of medication, choices of the patients were more determined by expected values of the prospects than those of controls. Conclusion Dopamine deficiency in PD was associated with risk aversion, and levodopa promoted riskier choice in a value-independent manner. PD patients also showed an increased sensitivity to expected value, which was independent of levodopa and does not appear to result directly from dopamine deficiency.

To study how effort affects reward value, we replicated Fortes, Vasconcelos and Machado's (2015) study using an adjusting-delay task. Nine pigeons chose between a standard alternative that gave access to 4 s of food, after a 10 s delay, and an adjusting-delay alternative that gave access to 12 s of food after a delay that changed dynamically with the pigeons' choices, decreasing when they preferred the standard alternative, and increasing when they preferred the adjusting alternative. The delay value at which preference stabilized defined the indifference point, a measure of reward value. To manipulate effort across phases, we varied the response rate required during the delay of the standard alternative. Results showed that a) the indifference point increased in the higher-response-rate phases, suggesting that reward value decreased with effort, and b) in the higher-response-rate phases, response rate in the standard alternative was linearly related to the indifference point. We advance several conceptions of how effort may change perceived delay or amount and thereby affect reward value.

A common finding is that items associated with higher reward value are subsequently remembered better than items associated with lower value. A confounding factor is that when a higher value stimuli is presented, this typically signals to participants that it is now a particularly important time to engage in the task. When this was controlled, Madan, Fujiwara, Gerson, and Caplan (2012) still found a large value-bias of memory. Their value-learning procedure, however, explicitly pitted high- against low-value words. Our novel value-learning procedure trained words one at a time, avoiding direct competition between words, but with no difference in words signalling participants to engage in the task. Results converged on null effects of value on subsequent free recall accuracy. Re-analyses attributed Madan et al.’s value-bias to competition between choice items that were paired during learning. Value may not bias memory if it does not signal task importance or induce inter-item competition.

Environmental stimuli, when paired with reward, can influence behaviour in maladaptive ways, for example, by encouraging overeating or addiction. Such behaviour can be sensitive to reward value manipulations, under circumscribed conditions, but whether reward-seeking is also sensitive to stimulus value manipulations remains unclear. Thus, the current experiment investigated whether reducing the hedonic value of a reward-paired stimulus would reduce reward-seeking behaviour. In total, 36 participants successfully completed a single-response Pavlovian-instrumental transfer (PIT) task with a counter-conditioning procedure. The Pavlovian phase associated three conditioned stimuli (CSs) with money at 100%, 50%, or 0% contingency. Counter-conditioning then followed for the experimental group, who saw the 100% CS paired with unpleasant pictures, while the control group saw only neutral images. Instrumental training required participants to learn a button-pressing response to win money. The transfer phase contrasted instrumental responding during baseline and CS presentation. Both experimental and control groups liked the 100% CS more than the other CSs after Pavlovian training, but counter-conditioning reduced this 100% CS liking. In transfer, the experimental group showed an abolition of appetitive PIT, while the control group showed maintenance of appetitive PIT. However, this group difference was only evident in response vigour, not response initiation. In summary, CS hedonic value influences cue-potentiated instrumental responding. More specifically, hedonic value of a reward-paired cue influences the vigour of instrumental responses, but not the decision to initiate a response. These data may have relevance to smoking cessation policies, where the introduction of health warnings may be viewed as a real-world example of counter conditioning.

Recently, reinforcement learning has made remarkable achievements in the fields of natural science, engineering, medicine and operational research. Reinforcement learning addresses sequence problems and considers long-term returns. This long-term view of reinforcement learning is critical to find the optimal solution of many problems. The existing multi-agent reinforcement learning methods usually update the value function of state action slowly, and the reward value of agents is low. This paper presents a Dueling Multi-Agent Deep Deterministic Policy Gradient (MADDPG) method based on MADDPG, which modifies critic's network structure. The main work is to add two subnetworks behind the critic network of the traditional MADDPG method. This method allows the critic network to update its parameters faster and receive higher rewards. Finally, in order to verify the validity of the network structure, the improved framework is compared with the traditional MADDPG, DQN and DDPG methods in the simulation environment.

Attention can be involuntarily biased toward reward-associated distractors (value-driven attentional capture, VDAC). Yet past work has primarily demonstrated this distraction phenomenon during a particular set of circumstances: transient attentional orienting to potentially relevant stimuli occurring in our visual environment. Consequently, it is not well-understood if reward-based attentional capture can occur under other circumstances, such as during sustained visuospatial attention. Using EEG, we investigated whether associating transient distractors with reward value would increase their distractibility and lead to greater decrements in concurrent sustained spatial attention directed elsewhere. Human participants learned to associate three differently colored, laterally presented squares with rewards of varying magnitude (zero, small, and large). These colored squares were then periodically reintroduced as distractors at the same lateral locations during a demanding sustained-attention rapid-serial-visual-presentation (RSVP) task at the midline. Behavioral and neural evidence indicated that participants had successfully learned and maintained the reward associations to the distractors. During the RSVP task, consistent with prior work, we found that the distractors generated dips in the instantaneous amplitude of the steady-state visual evoked potentials (SSVEPs) elicited by the midline RSVP stimuli, indicating that the distractors were indeed transiently disrupting sustained spatial attention. Contrary to our hypotheses, however, the magnitude of this dip did not differ by the magnitude of the distractor’s reward associations. These results indicate that while sustained spatial attention can be impaired by the introduction of distractors at another location, the main distraction process is resistant to the distractors’ reward associations, thus providing evidence of an important boundary condition to value-driven attentional capture.

Significance Ongoing consumption reduces the subjective value of rewards to different degrees depending on their individual properties, a phenomenon referred to as sensory-specific satiety. Such value change should be manifested in economic choices, and neuronal signals for subjective economic reward value should be sensitive to reward-specific satiety. We tested monkeys during the choice between two options that each contained two different rewards (“bundles”); the two rewards were prone to different degrees of satiety. Ongoing reward consumption affected choices in a way that indicated satiety-induced reward-specific change of subjective economic value. Neuronal responses in the monkey orbitofrontal cortex (OFC) followed the differential reduction of subjective economic value. These results satisfy a crucial requirement for subjective reward value coding in OFC neurons., Sensitivity to satiety constitutes a basic requirement for neuronal coding of subjective reward value. Satiety from natural ongoing consumption affects reward functions in learning and approach behavior. More specifically, satiety reduces the subjective economic value of individual rewards during choice between options that typically contain multiple reward components. The unconfounded assessment of economic reward value requires tests at choice indifference between two options, which is difficult to achieve with sated rewards. By conceptualizing choices between options with multiple reward components (“bundles”), Revealed Preference Theory may offer a solution. Despite satiety, choices against an unaltered reference bundle may remain indifferent when the reduced value of a sated bundle reward is compensated by larger amounts of an unsated reward of the same bundle, and then the value loss of the sated reward is indicated by the amount of the added unsated reward. Here, we show psychophysically titrated choice indifference in monkeys between bundles of differently sated rewards. Neuronal chosen value signals in the orbitofrontal cortex (OFC) followed closely the subjective value change within recording periods of individual neurons. A neuronal classifier distinguishing the bundles and predicting choice substantiated the subjective value change. The choice between conventional single rewards confirmed the neuronal changes seen with two-reward bundles. Thus, reward-specific satiety reduces subjective reward value signals in OFC. With satiety being an important factor of subjective reward value, these results extend the notion of subjective economic reward value coding in OFC neurons.

Unequal outcomes disrupt cooperation in some situations, but this has not been tested in the context of coordination in economic games. To explore this, we tested brown capuchins (Sapajus [Cebus] apella) on a manual version of the Stag Hunt (or Assurance) Game, in which individuals sequentially chose between two options, Stag or Hare, and were rewarded according to their choices and that of their partner. Typically, coordination on Stag results in an equal highest payout, whereas coordinating on Hare results in a guaranteed equal but lower payoff and uncoordinated play results in the lowest payoff when playing Stag. We varied this structure such that one capuchin received double the rewards for the coordinated Stag outcome; thus, it was still both animals' best option, but no longer equally rewarding. Despite the inequality, capuchins coordinated on Stag in 78% of trials, and neither payoff structure nor their partner's choice impacted their decision. Additionally, there was no relationship between self-scratching, a measure of stress in capuchins, and choices. After completing the study, we discovered our reward, cheerios, was sufficiently valuable that in another study, capuchins never refused it, so post hoc we repeated the study using a lower value reward, banana flavored pellets. Capuchins completed only 26% of the pellet trials (compared to 98% with cheerios), constraining our ability to interpret the results, but nonetheless the monkeys showed a decrease in preference for Stag, particularly when they received fewer rewards for the coordinated Stag outcome. These results reinforce capuchins' ability to find coordinated outcomes in the Stag Hunt game, but more work is needed to determine whether the monkeys did not mind the inequality or were unwilling to sacrifice a highly preferred food to rectify it. In either case, researchers should carefully consider the impact of their chosen rewards on subjects' choices.

Soldiers on military expeditions usually fail to compensate for the increase in energy expenditure, with potential deleterious consequences. We therefore analyzed the characteristics of energy compensation in 12 male soldiers, during a 15‐day expedition in the cold, while alleviating some of the contextual limitations of food intake (~20‐MJ daily bags of easy‐to‐use, highly palatable and familiar foods with multiple and long breaks allowed during the day). Body and fat mass losses were low and moderate, respectively (−1.13 ± 1.42% and −19.5 ± 15.6%, respectively, p, We analyzed the characteristics of energy compensation in 12 male soldiers, during a 15‐day expedition in the cold, while alleviating some of the contextual limitations of food intake (~20‐MJ daily bags of easy‐to‐use, highly palatable and familiar foods with multiple and long breaks allowed during the day). This study indicates that complete energy compensation can be reached in challenging field conditions when food intake is facilitated, offering some guidelines to limit energy deficit during operational missions.

A novel guidance law is designed in this paper for intercepting a maneuvering target using zero-effort-miss with a reinforcement learning algorithm. After establishing the engagement scenario of the missile and the target in the vertical plane, the expressions of variables during relative motion are derived. Then the line-of-sight rate and the zero-effort-miss are selected as the basis for the Q-learning algorithm. Combining the relative motion variables with Q-learning, the guidance command for decreasing the zero-effort-miss is generated. Finally, the numerical simulation is carried out for validating the effectiveness of the proposed method. The history of reward value and miss distance demonstrate the performance of the provided guidance algorithm.

Appropriate actions are taken based on the values of future rewards. The phasic activity of midbrain dopamine neurons signals these values. Because reward values often change over time, even on a subsecond-by-subsecond basis, appropriate action selection requires continuous value monitoring. However, the phasic dopamine activity, which is sporadic and has a short duration, likely fails continuous monitoring. Here, we demonstrate a tonic firing mode of dopamine neurons that effectively tracks changing reward values. We recorded dopamine neuron activity in monkeys during a Pavlovian procedure in which the value of a cued reward gradually increased or decreased. Dopamine neurons tonically increased and decreased their activity as the reward value changed. This tonic activity was evoked more strongly by non-burst spikes than burst spikes producing a conventional phasic activity. Our findings suggest that dopamine neurons change their firing mode to effectively signal reward values, which could underlie action selection in changing environments.

Mindfulness training (MT) has been shown to influence smoking behavior, yet the involvement of reinforcement learning processes as underlying mechanisms remains unclear. This naturalistic, single-arm study aimed to examine slope trajectories of smoking behavior across uses of our app-based MT craving tool for smoking cessation, and whether this relationship would be mediated by the attenuating impact of MT on expected reward values of smoking. Our craving tool embedded in our MT app-based smoking cessation program was used by 108 participants upon the experience of cigarette cravings in real-world contexts. Each use of the tool involved mindful awareness to the experience of cigarette craving, a decision as to whether the participant wanted to smoke or ride out their craving with a mindfulness exercise, and paying mindful attention to the choice behavior and its outcome (contentment levels felt from engaging in the behavior). Expected reward values were computed using contentment levels experienced from the choice behavior as the reward signal in a Rescorla–Wagner reinforcement learning model. Multi-level mediation analysis revealed a significant decreasing trajectory of smoking frequency across MT craving tool uses and that this relationship was mediated by the negative relationship between MT and expected reward values (all ps < 0.001). After controlling for the mediator, the predictive relationship between MT and smoking was no longer significant (p < 0.001 before and p = 0.357 after controlling for the mediator). Results indicate that the use of our app-based MT craving tool is associated with negative slope trajectories of smoking behavior across uses, mediated by reward learning mechanisms. This single-arm naturalistic study provides preliminary support for further RCT studies examining the involvement of reward learning mechanisms underlying app-based mindfulness training for smoking cessation.

Even using simple techniques like taking the stairs, many individuals struggle to maintain the motivation to be physically active. Health gamification systems can aid this goal by providing points earned through exercise that are redeemable for tangible extrinsic rewards. Using self-determination theory, we conduct research on one such system and investigate rewards’ effectiveness to promote exercise considering reward value, redemption frequency patterns, and fitness levels. We find that rewards do significantly increase activity levels, and this effect is larger for advanced users who redeem multiple times for higher value rewards. We close by offering future research avenues and advice to optimize reward portfolios.

Reward affects our attention to stimuli, prioritizing those that lead to high-value outcomes. Recently, it has been suggested that such reward-related cognitive prioritization might be associated with the process of learning new stimulus-response (S-R) associations, because both are acquired through extended reward training, and once established, they are hard to overcome. We used event-related potentials (ERP) to analyze the contribution of S-R links to the formation of reward-related cognitive prioritization during reinforcement learning. Reward-related cognitive prioritization was measured by comparing the ERP signals for stimuli predicting high-value and low-value outcomes. In addition, we compared a strong S-R link (same stimulus, same response), with a weak S-R link condition (same stimulus, two different responses). The participants' performance was more accurate and faster when the procedure allowed for establishing strong S-R links and for high-value outcomes. Furthermore, those stimuli associated with strong S-R links showed a larger P3 amplitude at parietal sites. Value effects (larger ERP activity for those stimuli predicting a high-value outcome) were obtained at parietal and occipital sites in the P3 time window. However, value effects did not benefit from strong S-R links in either the P1 or the P3 components. These results suggest that strong S-R learning is not necessary to develop reward-related modulations of ERP activity.

SummaryIn naturalistic environments, animals navigate in order to harvest rewards. Successful goal-directed navigation requires learning to accurately estimate location and select optimal state-dependent actions. Midbrain dopamine neurons are known to be involved in reward value learning1–13. They have also been linked to reward location learning, as they play causal roles in place preference14,15 and enhance spatial memory16–21. Dopamine neurons are therefore ideally placed to provide teaching signals for goal-directed navigation. To test this, we imaged dopamine neural activity as mice learned to navigate in a closed-loop virtual reality corridor and lick to report the reward location. Across learning, phasic dopamine responses developed to visual cues and trial outcome that resembled reward prediction errors and indicated the animal’s estimate of the reward location. We also observed the development of pre-reward ramping activity, the slope of which was modulated by both learning stage and task engagement. The slope of the dopamine ramp was correlated with the accuracy of licks in the next trial, suggesting that the ramp sculpted accurate location-specific action during navigation. Our results indicate that midbrain dopamine neurons, through both their phasic and ramping activity, provide teaching signals for improving goal-directed navigation.HighlightsWe investigated midbrain dopamine activity in mice learning a goal-directed navigation task in virtual realityPhasic dopamine signals reflected prediction errors with respect to subjective estimate of reward locationA slow ramp in dopamine activity leading up to reward location developed over learning and was enhanced with task engagementPositive ramp slopes were followed by improved performance on subsequent trials, suggesting a teaching role during goal-directed navigation

Cocaine demand is a behavioral economic measure assessing drug reward value and motivation to use drug. The purpose of the current study was to develop a brief assessment of cocaine demand (BACD). Results from the BACD were compared with self-report measures of cocaine use. Participants consisted of treatment-seeking individuals with cocaine use disorder (CUD: N = 22). Results revealed that indices of brief demand were significantly associated with various self-report measures of cocaine use. Overall, these results support the utility of a BACD for assessing cocaine demand.

The orbitofrontal cortex receives from the ends of all sensory processing systems, and converts these representations of what the stimulus is into representations of their reward value. The orbitofrontal cortex is therefore a key brain region in emotions, which can be defined as states elicited by rewards and punishers. Indeed, orbitofrontal cortex activations are linearly related to the subjectively reported pleasantness of stimuli. The orbitofrontal cortex then projects this reward value information to other structures, which implement behavioural output, such as the anterior cingulate cortex, and the basal ganglia. A key computational capacity of the orbitofrontal cortex is one-trial object-reward associations, which are rule-based, and enable primates including humans to change their rewarded behaviour very rapidly. Decision-making using attractor neural networks is described.

It is widely known that neural activity in sensory representations is modulated by cognitive factors such as attention, reward value and working memory. In such cases, sensory responses are found to reflect a selection of the specific sensory information needed to achieve behavioral goals. In contrast, more abstract behavioral constraints that do not involve stimulus selection, such as task rules, are thought to be encoded by neurons at later stages. We show that information about abstract rules is encoded by neurons in primate visual cortex in the absence of sensory stimulation. Furthermore, we show that rule information is greatest among neurons with the least visual activity and the weakest coupling to local neuronal networks. Our results identify rule-specific signals within a sensory representation and suggest that distinct mechanisms exist there for mapping rule information onto sensory guided decisions.

Summary Reward value is known to modulate learning speed in spatial memory tasks, but little is known about its influence on the dynamical changes in hippocampal spatial representations. Here, we monitored the trial-to-trial changes in hippocampal place cell activity during the acquisition of place-reward associations with varying reward size. We show a faster reorganization and stabilization of the hippocampal place map when a goal location is associated with a large reward. The reorganization is driven by both rate changes and the appearance and disappearance of place fields. The occurrence of hippocampal replay activity largely followed the dynamics of changes in spatial representations. Replay patterns became more selectively tuned toward behaviorally relevant experiences over the course of learning via the refined contributions of specific cell subpopulations. These results suggest that high reward value enhances memory retention by accelerating the formation and stabilization of the hippocampal cognitive map and selectively enhancing its reactivation during learning.

The insula contributes to behavioral control and is disrupted by substance abuse, yet we know little about the neural signals underlying these functions or how they are disrupted after chronic drug self-administration. Here, rats self-administered either cocaine (experimental group) or sucrose (control) for twelve consecutive days. After a one-month withdrawal period, we recorded from anterior insula while rats performed a previously learned reward-guided decision-making task. Cocaine-exposed rats were more sensitive to value manipulations and were faster to respond. These behavioral changes were accompanied by elevated counts of neurons in the insula that increased firing to reward. These neurons also fired more strongly at the start of long delay trials-when a more immediate reward would be expected, and fired less strongly in anticipation of the actual delivery of delayed rewards. Although reward-related firing to immediate reward was enhanced after cocaine self-administration, reward-predicting cue and context signals were attenuated.Significance StatementThe insula plays a clear role in drug-addiction and drug-induced impairments of decision-making, yet there is little understanding of its underlying neural signals. We found that chronic cocaine self-administration reduces cue and context-encoding in insula, while enhancing signals related to immediate reward. These changes in neural activity likely contribute to impaired decision-making and impulsivity observed after drug use.

Several animals, including bees, use visual search to distinguish targets of interest and ignore distractors. While bee flower choice is well studied, we know relatively little about how they choose between multiple rewarding flowers in complex floral environments. Two important factors that could influence bee visual search for multiple flowers are the physical saliency (colour contrast against the background) of flowers and the reward value associated with them. We here investigated how these two different factors contribute to bee visual search. We trained bees to independently recognize two rewarding colours that in different experiments differed in either physical saliency, reward value or both. We then measured their choices and attention to these colours in the presence of distractors in a test without reinforcement. We found that bees preferred more salient or higher rewarding flowers and ignored distractors. When the high-reward flowers were less salient than the low-reward flowers, bees were nonetheless equally likely to choose high-reward flowers. Bees were more also more likely to attend to these high-reward flowers, with higher inspection times around them and faster search times when choosing them. When flowers differed in reward, we also found an effect of the training order with low-reward targets being more likely to be chosen if they had been encountered during the more immediate training session prior to the test. Our results parallel recent findings from humans demonstrating that reward value can attract attention even when targets are less salient and irrelevant to the current task.

Parkinson's disease is characterized by decreased dopamine and increased beta-band oscillatory activity accompanying debilitating motor and mood impairments. Coordinate dopamine-beta opposition is considered a normative rule for basal ganglia function. We report a breakdown of this rule. We developed multimodal systems allowing the first simultaneous, chronic recordings of dopamine release and beta-band activity in the striatum of nonhuman primates during behavioral performance. Dopamine and beta signals were anticorrelated over seconds-long time frames, in agreement with the posited rule, but at finer time scales, we identified conditions in which these signals were modulated with the same polarity. These measurements demonstrated that task-elicited beta suppressions preceded dopamine peaks and that relative dopamine-beta timing and polarity depended on reward value, performance history, movement, and striatal domain. These findings establish a new view of coordinate dopamine and beta signaling operations, critical to guide novel strategies for diagnosing and treating Parkinson's disease and related neurodegenerative disorders.

Midbrain dopamine neurons play key roles in decision-making by regulating reward valuation and actions. These roles are thought to depend on dopamine neurons innervating striatum. In addition to actions and rewards, however, efficient decisions often involve consideration of uncertain sensory signals. The functions of striatal dopamine during sensory decisions remains unknown. We trained mice in a task that probed decisions based on sensory evidence and reward value, and recorded the activity of striatal dopamine axons. Dopamine axons in ventral striatum (VS) responded to bilateral stimuli and trial outcomes, encoding prediction errors that scaled with decision confidence and reward value. By contrast, dopamine axons in dorsal striatum (DS) responded to contralateral stimuli and contralateral actions. Thus, during sensory decisions, striatal dopamine signals are anatomically organized. VS dopamine resembles prediction errors suitable for reward maximization under sensory uncertainty whereas DS dopamine encodes specific combinations of stimuli and actions in a lateralized fashion.

BackgroundReward processing has been proposed to underpin atypical social behavior, a core feature of autism spectrum disorder (ASD). However, previous neuroimaging studies have yielded inconsistent results regarding the specificity of atypicalities for social rewards in ASD. Utilizing a large sample, we aimed to assess altered reward processing in response to reward type (social, monetary) and reward phase (anticipation, delivery) in ASD.MethodsFunctional magnetic resonance imaging during social and monetary reward anticipation and delivery was performed in 212 individuals with ASD (7.6-30.5 years) and 181 typically developing (TD) participants (7.6-30.8 years).ResultsAcross social and monetary reward anticipation, whole-brain analyses (pConclusionsOur results do not support current theories linking atypical social interaction in ASD to specific alterations in processing of social rewards. Instead, they point towards a generalized hypoactivity of VS in ASD during anticipation of both social and monetary rewards. We suggest that this indicates attenuated subjective reward value in ASD independent of social content and ADHD symptoms.

Food intake is inherently variable and often characterized by episodical restraint or overeating (uncontrolled eating). Such heightened variability in intake has been associated with higher variability in the brain response to food reward, but it is an open issue whether comparable associations with elevated variability in reward seeking exist. Here, we assessed whether restraint and uncontrolled eating as markers of trait-like variability in eating are associated with higher intra-individual variability in reward seeking as captured by a cost-benefit paradigm. To test this hypothesis, 81 healthy, overnight-fasting participants (MBMI = 23.0 kg/m2 ± 3.0) completed an effort allocation task (EAT) twice. In the EAT, participants had to exert physical effort to earn monetary and food rewards and indicated levels of wanting through visual analog scales (VAS). As predicted, we found that greater trial-by-trial effort variability was associated with lower scores on cognitive restraint, rp(78) = −0.28, p = .011 (controlled for average effort). In line with previous findings, higher wanting variability was associated with higher BMI, rp(78) = 0.25, p = .026 (controlled for average effort). Collectively, our results support the idea that higher variability in reward seeking is a potential risk factor for eating beyond homeostatic need. Since associations with variability measures of reward exceeded associations with average reward seeking, our findings may indicate that variability in the representation of the reward value could be a crucial aspect driving fluctuations in food intake.

Ventral pallidum (VP) neurons scale firing increases to reward value and decrease firing to aversive cues. Anatomical connectivity suggests a critical role for the VP in threat-related behavior. Here we tested whether firing decreases in VP neurons conform to relative threat by recording single units while male rats discriminated cues predicting unique foot shock probabilities. Rats behavior and VP single unit firing discriminated danger, uncertainty and safety cues. We found that two VP populations (Low firing and Intermediate firing) signaled relative threat, proportionally decreased firing according shock probability: danger < uncertainty < safety. Low firing neurons showed reward firing increases, consistent with a general signal for relative value. Intermediate firing neurons were unresponsive to reward, revealing a specific signal for relative threat. The results suggest an integral role for the VP in threat-related behavior.

In delay discounting, individuals discount the value of a reward based on the delay to its receipt. The prelimbic cortex (PrL) is heavily interconnected with several brain regions implicated in delay discounting, but the specific contributions of the PrL to delay discounting are unknown. Here, we used multineuron electrophysiological recording methods in Long–Evans male (n= 10) and female (n= 9) rats to characterize the firing dynamics of PrL neurons during discrete cue and lever press events in a delay discounting task. Rats' initial preference for the large reward decreased as delays for that outcome increased across blocks, reflecting classic discounting behavior. Electrophysiological recordings revealed that subgroups of neurons exhibited phasic responses to cue presentations and lever presses. These phasic neurons were found to respond to either large/delay, small/immediate, or both trial types and the percentage of these neurons shifted across blocks as the expected value of the reward changed. Critically, this shift was only seen during trials in which animals could choose their preferred option (free choice trials) and not during trials where animals could choose only one option (forced choice trials). Further, this shift was dependent on rats' inherent impulsivity because high impulsive rats demonstrated a greater percentage of small/immediate-responsive neurons as the task progressed. Collectively, these findings suggest a unique role for the PrL in encoding reward value during delay discounting that is influenced by individual differences in impulsivity.SIGNIFICANCE STATEMENTIn delay discounting, individuals discount the value of a reward based on the delay to its receipt. Here, we used electrophysiology to investigate the role of the prelimbic cortex (PrL) in this process. We found that subsets of neurons shifted activity as a function of the changing expected delay and reward magnitude, but this shift was only evident during trials in which animals could choose their preferred option. Further, this dynamic neural activity depended on rats' inherent impulsivity, with impulsive rats exhibiting a stronger neural shift toward the immediate reward as the task progressed. These findings suggest a role for the PrL in encoding reward value during delay discounting that is influenced by goal-directed context and individual differences in impulsivity.

Sleep deprivation (SD) consistently degrades performance in tasks requiring sustained attention, resulting in slower and more variable response times that worsen with time-on-task. Loss of motivation to exert effort may exacerbate performance degradation during SD. To test this, we evaluated sustained performance on a vigilance task, combining this with an effort-based decision-making task and pupillometry. Vigilance was tested at rest and after sleep deprivation, under different incentive conditions (1, 5 or 15 cents for fast responses). Subsequently, preference measures were collected from an effort-discounting task, in which a commensurate reward was offered for maintaining attentional performance for different durations (1, 5, 10, 20 or 30 min). Vigilance was impaired during SD, in a manner modulated by reward value. Preference metrics showed that the value of available rewards was discounted by task duration, an effect compounded by SD. Pupillometry revealed that arousal was modulated during SD in a value-based manner, and moment-to-moment fluctuations in pupil diameter were directly predictive of performance. Together, these data demonstrate that attentional performance can be interpreted within a value-based effort allocation framework, such that the perceived cost of attentional effort increases after sleep deprivation.

Food intake is inherently variable and often characterized by episodical restraint or overeating (uncontrolled eating). Such heightened variability in intake has been associated with higher variability in the brain response to food reward, but it is an open issue whether comparable associations with elevated variability in reward seeking exist. Here, we assessed whether restraint and uncontrolled eating as markers of trait-like variability in eating are associated with higher intra-individual variability in reward seeking as captured by a cost-benefit paradigm. To test this hypothesis, 81 healthy, overnight-fasting participants (MBMI= 23.0 kg/m2 ± 2.95) completed an effort allocation task (EAT) twice. In the EAT, participants had to exert physical effort to earn monetary and food rewards and indicated levels of wanting through visual analog scales (VAS). As predicted, we found that greater trial-by-trial effort variability was associated with lower scores on cognitive restraint, rp(78) = −.28, p = .011 (controlled for average effort). In line with previous findings, higher wanting variability was associated with higher BMI, rp(78) = .25, p = .026 (controlled for average effort). Collectively, our results support the idea that higher variability in reward seeking is a potential risk factor for eating beyond homeostatic need. Since associations with variability measures of reward exceeded associations with average reward seeking, our findings may indicate that variability in the representation of the reward value could be a crucial aspect driving fluctuations in food intake.