Search

Decision-making is traditionally described as a cognitive process of deliberation followed by commitment to an action choice, preceding the planning and execution of the chosen action. However, this is challenged by recent data suggesting that during situated decisions, multiple options are specified simultaneously and compete in premotor cortical areas for selection and execution. Previous studies focused on the competition during planning and left unaddressed the dynamics of decisions during movement. Does deliberation extend into the execution phase? Are nonselected options still considered? Here we studied a decision-making task in which human participants were instructed to select a reaching path trajectory from an origin to a rectangular target, where reward was distributed nonuniformly at the target. Critically, we applied mechanical perturbations to the arm during movement to study under which conditions such perturbations produce changes of mind. Our results show that participants initially selected the direction of movement toward the highest reward region and changed their mind most frequently when the two choices offered the same reward, showing that deliberation continues and follows cost-benefit considerations during movement. Furthermore, changes of mind were dependent on the intensity of the perturbation and the current state of the motor system, including velocity and distance to targets. Although reward remains most relevant, our results indicate that the state of the motor system when the perturbation occurs is a crucial determinant of changes of mind., (Copyright © 2021 Cos et al.)

Neurophysiological studies suggest that when decisions are made between concrete actions, the selection process involves a competition between potential action representations in the same sensorimotor structures involved in executing those actions. However, it is unclear how such models can explain situations, often encountered during natural behavior, in which we make decisions while were are already engaged in performing an action. Does the process of deliberation characterized in classical studies of decision-making proceed the same way when subjects are deciding while already acting? In the present study, human subjects continuously tracked a target moving in the horizontal plane and were occasionally presented with a new target to which they could freely choose to switch at any time, whereupon it became the new tracked target. We found that the probability of choosing to switch increased with decreasing distance to the new target and increasing size of the new target relative to the tracked target, as well as when the direction to the new target was aligned (either toward or opposite) to the current tracking direction. However, contrary to our expectations, subjects did not choose targets that minimized the energetic costs of execution, as calculated by a biomechanical model of the arm. When the constraints of continuous tracking were removed in variants of the task involving point-to-point movements, the expected preference for lower cost choices was seen. These results are discussed in the context of current theories of nested feedback control, internal models of forward dynamics, and high-dimensional neural spaces. NEW & NOTEWORTHY Current theories of decision-making primarily address how subjects make decisions before executing selected actions. However, in our daily lives we often make decisions while already performing some action (e.g., while playing a sport or navigating through a crowd). To gain insight into how current theories can be extended to such "decide-while-acting" scenarios, we examined human decisions during continuous manual tracking and found some intriguing departures from how decisions are made in classical "decide-then-act" paradigms.

Prominent theories of decision making suggest that the basal ganglia (BG) play a causal role in deliberation between action choices. An alternative hypothesis is that deliberation occurs in cortical regions, while the BG control the speed-accuracy trade-off (SAT) between committing to a choice versus continuing to deliberate. Here, we test these hypotheses by recording activity in the internal and external segments of the globus pallidus (GPi/GPe) while monkeys perform a task dissociating the process of deliberation, the moment of commitment, and adjustment of the SAT. Our data suggest that unlike premotor and motor cortical regions, pallidal output does not contribute to the process of deliberation but instead provides a time-varying signal that controls the SAT and reflects the growing urgency to commit to a choice. Once a target is selected by cortical regions, GP activity confirms commitment to the decision and invigorates the subsequent movement., (Copyright © 2017 Elsevier Inc. All rights reserved.)

Recent studies have shown that activity in sensorimotor structures varies depending on the speed-accuracy trade-off (SAT) context in which a decision is made. Here we tested the hypothesis that the same areas also reflect a more local adjustment of SAT established between individual trials, based on the outcome of the previous decision. Two monkeys performed a reaching decision task in which sensory evidence continuously evolves during the time course of a trial. In two SAT contexts, we compared neural activity in trials following a correct choice vs. those following an error. In dorsal premotor cortex (PMd), we found that 23% of cells exhibited significantly weaker baseline activity after error trials, and for ∼30% of these this effect persisted into the deliberation epoch. These cells also contributed to the process of combining sensory evidence with the growing urgency to commit to a choice. We also found that the activity of 22% of PMd cells was increased after error trials. These neurons appeared to carry less information about sensory evidence and time-dependent urgency. For most of these modulated cells, the effect was independent of whether the previous error was expected or unexpected. We found similar phenomena in primary motor cortex (M1), with 25% of cells decreasing and 34% increasing activity after error trials, but unlike PMd, these neurons showed less clear differences in their response properties. These findings suggest that PMd and M1 belong to a network of brain areas involved in SAT adjustments established using the recent history of reinforcement., New & Noteworthy: Setting the speed-accuracy trade-off (SAT) is crucial for efficient decision making. Previous studies have reported that subjects adjust their SAT after individual decisions, usually choosing more conservatively after errors, but the neural correlates of this phenomenon are only partially known. Here, we show that neurons in PMd and M1 of monkeys performing a reach decision task support this mechanism by adequately modulating their firing rate as a function of the outcome of the previous decision., (Copyright © 2017 the American Physiological Society.)

Recent work suggests that while animals decide between reaching actions, neurons in dorsal premotor (PMd) and primary motor (M1) cortex reflect a dynamic competition between motor plans and determine when commitment to a choice is made. This competition is biased by at least two sources of information: the changing sensory evidence for one choice versus another, and an urgency signal that grows over time. Here, we test the hypothesis that the urgency signal adjusts the trade-off between speed and accuracy during both decision-making and movement execution. Two monkeys performed a reaching decision task in which sensory evidence continuously evolves over the course of each trial. In different blocks, task timing parameters encouraged monkeys to voluntarily adapt their behavior to be either hasty or conservative. Consistent with our hypothesis, during the deliberation process the baseline and gain of neural activity in decision-related PMd (29%) and M1 cells (45%) was higher when monkeys applied a hasty policy than when they behaved conservatively, but at the time of commitment the population activity was similar across blocks. Other cells (30% in PMd, 30% in M1) showed activity that increased or decreased with elapsing time until the moment of commitment. Movement-related neurons were also more active after longer decisions, as if they were influenced by the same urgency signal controlling the gain of decision-related activity. Together, these results suggest that the arm motor system receives an urgency/vigor signal that adjusts the speed-accuracy trade-off for decision-making and movement execution. Significance statement: This work addresses the neural mechanisms that control the speed-accuracy trade-off in both decisions and movements, in the kinds of dynamic situations that are typical of natural animal behavior. We found that many "decision-related" premotor and motor neurons are modulated in a time-dependent manner compatible with an "urgency" signal that changes between hasty and conservative decision policies. We also found that such modulation influenced cells related to the speed of the reaching movements executed by the animals to report their decisions. These results suggest that a unified mechanism determines speed-accuracy trade-off adjustments during decision-making and movement execution, potentially influencing both the cognitive and motor aspects of reward-oriented behavior., (Copyright © 2016 the authors 0270-6474/16/360938-19$15.00/0.)

Speed-accuracy tradeoffs (SATs) exist in both decision-making and movement control, and are generally studied separately. However, in natural behavior animals are free to adjust the time invested in deciding and moving so as to maximize their reward rate. Here, we investigate whether shared mechanisms exist for SAT adjustment in both decisions and actions. Two monkeys performed a reach decision task in which they watched 15 tokens jump, one every 200 ms, from a central circle to one of two peripheral targets, and had to guess which target would ultimately receive the majority of tokens. The monkeys could decide at any time, and once a target was reached, the remaining token movements accelerated to either 50 ms ("fast" block) or 150 ms ("slow" block). Decisions were generally earlier and less accurate in fast than slow blocks, and in both blocks, the criterion of accuracy decreased over time within each trial. This could be explained by a simple model in which sensory information is combined with a linearly growing urgency signal. Remarkably, the duration of the reaching movements produced after the decision decreased over time in a similar block-dependent manner as the criterion of accuracy estimated by the model. This suggests that SATs for deciding and acting are influenced by a shared urgency/vigor signal. Consistent with this, we observed that the vigor of saccades performed during the decision process was higher in fast than in slow blocks, suggesting the influence of a context-dependent global arousal., (Copyright © 2014 the authors 0270-6474/14/3416442-13$15.00/0.)

When given a choice between actions that yield the same reward, we tend to prefer the one that requires the least effort. Recent studies have shown that humans are remarkably accurate at evaluating the effort of potential reaching actions and can predict the subtle energetic demand caused by the nonisotropic biomechanical properties of the arm. In the present study, we investigated the time course over which such information is computed and comes to influence decisions. Two independent approaches were used. First, subjects performed a reach decision task in which the time interval for deciding between two candidate reaching actions was varied from 200 to 800 ms. Second, we measured motor-evoked potential (MEPs) to single-pulse transcranial magnetic stimulation (TMS) over the primary motor cortex (M1) to probe the evolving decision at different times after stimulus presentation. Both studies yielded a consistent conclusion: that a prediction of the effort associated with candidate movements is computed very quickly and influences decisions within 200 ms after presentation of the candidate actions. Furthermore, whereas the MEPs measured 150 ms after stimulus presentation were well correlated with the choices that subjects ultimately made, later in the trial the MEP amplitudes were primarily related to the muscular requirements of the chosen movement. This suggests that corticospinal excitability (CSE) initially reflects a competition between candidate actions and later changes to reflect the processes of preparing to implement the winning action choice., (Copyright © 2014 the American Physiological Society.)

Neurophysiological studies of decision making have primarily focused on decisions about information that is stable over time. However, during natural behavior, animals make decisions in a constantly changing environment. To investigate the neural mechanisms of such dynamic choices, we recorded activity in dorsal premotor (PMd) and primary motor cortex (M1) while monkeys performed a two-choice reaching task in which sensory information about the correct choice was changing within each trial and the decision could be made at any time. During deliberation, activity in both areas did not integrate sensory information but instead tracked it and combined it with a growing urgency signal. Approximately 280 ms before movement onset, PMd activity tuned to the selected target reached a consistent peak while M1 activity tuned to the unselected target was suppressed. We propose that this reflects the resolution of a competition between the potential responses and constitutes the volitional commitment to an action choice., (Copyright © 2014 Elsevier Inc. All rights reserved.)

To make an accurate movement, the CNS has to overcome the inherent complexities of the multijoint limb. For example, interaction torques arise when motion of individual arm segments propagates to adjacent segments causing their movement without any muscle contractions. Since these passive joint torques significantly add to the overall torques generated by active muscular contractions, they must be taken into account during planning or execution of goal-directed movements. We investigated the role of the corticospinal tract in compensating for the interaction torques during arm movements in humans. Twelve subjects reached to visual targets with their arm supported by a robotic exoskeleton. Reaching to one target was accompanied by interaction torques that assisted the movement, while reaching to the other target was accompanied by interaction torques that resisted the movement. Corticospinal excitability was assessed at different times during movement using single-pulse transcranial magnetic stimulation (TMS) over the upper-arm region of M1 (primary motor cortex). We found that TMS responses in shoulder monoarticular and elbow-shoulder biarticular muscles changed together with the interaction torques during movements in which the interaction torques were resistive. In contrast, TMS responses did not correlate with assistive interaction torques or with co-contraction. This suggests that the descending motor command includes compensation for passive limb dynamics. Furthermore, our results suggest that compensation for interaction torques involves the biarticular muscles, which span both shoulder and elbow joints and are in a biomechanically advantageous position to provide such compensation.

It has been proposed that whenever an animal faces several action choices, their neural representations are processed in parallel in frontoparietal cortex and compete in a manner biased by any factor relevant to the decision. We tested this hypothesis by recording single-unit activity in dorsal premotor cortex (PMd) while a monkey performed two delayed center-out reaching tasks. In the one-target task, a single target was presented and its border style indicated its reward value. The two-target task was the same except two targets were presented and the value of each was varied. During the delay period of the one-target task, directionally tuned PMd activity showed no modulation with value. In contrast, during the two-target task, the same neurons showed strong effects of the value associated with their preferred target, always in relation to the value of the other target. Furthermore, the competition between action choices was strongest when targets were furthest apart. This angular distance effect appeared in neural activity as soon as cells became tuned, while modulation by relative value appeared much later. All of these findings can be reproduced by a computational model which suggests that decisions between actions are made through a biased competition taking place within a sensorimotor map of potential actions.

We show that while a primate chooses between two reaching actions, its motor system first represents both options and later reflects selection between them. When two potential targets appeared, many (43%) task-related, directionally tuned cells in dorsal premotor cortex (PMd) discharged if one of the targets was near their preferred direction. At the population level, this generated two simultaneous sustained directional signals corresponding to the current reach options. After a subsequent nonspatial cue identified the correct target, the corresponding directional signal increased, and the signal for the rejected target was suppressed. The PMd population reliably predicted the monkey's response choice, including errors. This supports a planning model in which multiple reach options are initially specified and then gradually eliminated in a competition for overt execution, as more information accumulates.

Behavioural and imaging studies suggest that when humans mentally rehearse a familiar action they execute some of the same neural operations used during overt motor performance. Similarly, neural activation is present during action observation in many of the same brain regions normally used for performance, including premotor cortex. Here we present behavioural evidence that monkeys also engage in mental rehearsal during the observation of sensory events associated with a well-learned motor task. Furthermore, most task-related neurons in dorsal premotor cortex exhibit the same activity patterns during observation as during performance, even during an instructed-delay period before any actual observed motion. This activity might be a single-neuron correlate of covert mental rehearsal.

To investigate the effector dependence of task-related neural activity in dorsal premotor (PMd) and primary motor cortex (M1), directional tuning functions were compared between instructed-delay reaching tasks performed separately with either the contralateral or the ipsilateral limb. During presentation of the instructional cue, the majority (55/90, 61%) of cells in PMd were tuned with both arms, and their dynamic range showed a trend for stronger discharge with the contralateral arm. Most strikingly, however, the preferred direction of most of these latter cells (41/55, 75%) was not significantly different between arms. During movement, many PMd cells continued to be tuned with both arms (53/90, 59%), with a trend for increasing directional differences between the arms over the course of the trial. In contrast, during presentation of the instructional cue only 5/74 (7%) cells in M1 were tuned with both arms. During movement, about half of M1 cells (41/74, 55%) were tuned with both arms but the preferred directions of their tuning functions were often very different and there was a strong bias toward greater discharge rates when the contralateral arm was used. Similar trends were observed for EMG activity. In conclusion, M1 is strongly activated during movements of the contralateral arm, but activity during ipsilateral arm movements is also common and usually different from that seen with the contralateral arm. In contrast, a major component of task-related activity in PMd represents movement in a more abstract or task-dependent and effector-independent manner, especially during the instructed-delay period.

We present evidence that the primate brain can simultaneously generate discrete directional signals related to multiple alternative reaching actions before making a decision between them. A monkey performed a task in which the correct target for a reaching movement was specified during two consecutive instructed-delay periods. First, two potential targets were presented; and second, a nonspatial cue identified one of them as the correct movement target. During the first period, two directional signals coexisted in the activity of cells in dorsal premotor cortex (PMd), oriented toward the two potential targets. During the second period, one of these disappeared and the remaining signal predicted the monkey's response choice. These results suggest that, when faced with multiple salient opportunities for reaching, the primate brain performs sensorimotor transformations in parallel to begin planning several reaching movements simultaneously before selecting one for overt execution.