Search

An exploration-exploitation trade-off, the arbitration between sampling a lesser-known against a known rich option, is thought to be solved using computationally demanding exploration algorithms. Given known limitations in human cognitive resources, we hypothesised the presence of additional cheaper strategies. We examined for such heuristics in choice behaviour where we show this involves a value-free random exploration, that ignores all prior knowledge, and a novelty exploration that targets novel options alone. In a double-blind, placebo-controlled drug study, assessing contributions of dopamine (400 mg amisulpride) and noradrenaline (40 mg propranolol), we show that value-free random exploration is attenuated under the influence of propranolol, but not under amisulpride. Our findings demonstrate that humans deploy distinct computationally cheap exploration strategies and that value-free random exploration is under noradrenergic control., Competing Interests: MD, JH, JM, RM, RD, TH No competing interests declared, (© 2021, Dubois et al.)

When deciding to act, the neurotransmitter dopamine is implicated in a valuation of prospective effort and reward. However, its role in dynamic effort-reward integration during action, a process central to everyday behaviour, remains unclear. In a placebo-controlled, within-subject, study, we probed the impact of increasing brain dopamine levels (150 mg of levodopa) and blocking dopamine receptors (1.5 mg of haloperidol) in the context of a novel dynamic effort task in healthy human subjects. We show that modulating homoeostatic dopamine balance distinctly alters implicit and explicit effort allocation as a function of instantaneous reward. Pharmacologically boosting dopamine enhanced motor vigour, reflected in an implicit increase in effort allocation for high rewards. Conversely, pharmacological blockade of dopamine attenuated sensitivity to differences in reward context, reflected in reduced strategic effort discounting. These findings implicate dopamine in an integration of momentary physical experience and instantaneous reward, suggesting a key role of dopamine in acting to maximise reward on the fly.

Episodic memory is sensitive to the influence of neuromodulators, such as dopamine and noradrenaline. These influences are considered important in the expression of several known memory biases, though their specific role in memory remains unclear. Using pharmacological agents with relatively high selectivity for either dopamine (400 mg amisulpride) or noradrenaline (40 mg propranolol) we examined their specific contribution to incidental memory. In a double-blind placebo-controlled human study (30 females, 30 males in total), we show that a memory selectivity bias was insensitive to propranolol but sensitive to amisulpride, consistent with a dominant influence from dopamine. By contrast, a putative arousal-induced memory boosting effect was insensitive to amisulpride but was sensitive to propranolol, consistent with a dominant noradrenaline effect. Thus, our findings highlight specific functional roles for dopamine and noradrenaline neurotransmission in the expression of incidental memory. SIGNIFICANCE STATEMENT Why some information is preferentially encoded into memory while other information is not is a central question in cognitive neuroscience. The neurotransmitters dopamine and noradrenaline are often assumed critical in influencing this selectivity, but their specific contributions remain obscure. In this double-blind, placebo-controlled, between-subjects drug study, we investigate the contributions of noradrenaline and dopamine to episodic memory. Using an incidental memory task, we find that blocking dopamine (400 mg amisulpride) eliminates a neural-gain related memory selectivity bias. Blocking noradrenaline function (40 mg propranolol), in contrast, abolishes an arousal-related memory enhancement. In this assessment of dopamine and noradrenaline neuromodulatory effects we reveal their specific contributions to episodic memory., (Copyright © 2019 Hauser et al.)

Most psychiatric disorders emerge during childhood and adolescence. This is also a period that coincides with the brain undergoing substantial growth and reorganisation. However, it remains unclear how a heightened vulnerability to psychiatric disorder relates to this brain maturation. Here, we propose 'developmental computational psychiatry' as a framework for linking brain maturation to cognitive development. We argue that through modelling some of the brain's fundamental cognitive computations, and relating them to brain development, we can bridge the gap between brain and cognitive development. This in turn can lead to a richer understanding of the ontogeny of psychiatric disorders. We illustrate this perspective with examples from reinforcement learning and dopamine function. Specifically, we show how computational modelling deepens an understanding of how cognitive processes, such as reward learning, effort learning, and social learning might go awry in psychiatric disorders. Finally, we sketch the promises and limitations of a developmental computational psychiatry., (© 2018 Association for Child and Adolescent Mental Health.)

Arbitrating between timely choice and extended information gathering is critical for effective decision making. Aberrant information gathering behavior is thought to be a feature of psychiatric disorders such as schizophrenia and obsessive-compulsive disorder, but we know little about the underlying neurocognitive control mechanisms. In a double-blind, placebo-controlled drug study involving 60 healthy human subjects (30 female), we examined the effects of noradrenaline and dopamine antagonism on information gathering during performance of an information sampling task. We show that modulating noradrenaline function with 40 mg of the β-blocker propranolol leads to decreased information gathering behavior. Modulating dopamine function via a single dose of 400 mg of amisulpride revealed some effects that were intermediate between those of propranolol and placebo. Using a Bayesian computational model, we show that sampling behavior is best explained by inclusion of a nonlinear urgency signal that promotes commitment to an early decision. Noradrenaline blockade promotes the expression of this decision-related urgency signal during information gathering. We discuss the findings with respect to psychopathological conditions that are linked to aberrant information gathering. SIGNIFICANCE STATEMENT Knowing when to stop gathering information and commit to a choice option is nontrivial. This is an important element in arbitrating between information gain and energy conservation. In this double-blind, placebo-controlled drug study, we investigated the role of catecholamines noradrenaline and dopamine on sequential information gathering. We found that blockade of noradrenaline led to a decrease in information gathering. Dopamine blockade showed an intermediate, but nonsignificant, effect. Using a Bayesian computational model, we show that this noradrenaline effect is driven by increased decision urgency, a signal that reflects an escalating subjective cost of sampling. The observation that noradrenaline modulates decision urgency suggests new avenues for treating patients that show information gathering deficits., (Copyright © 2018 Hauser et al.)