Search

Social species rely on the ability to modulate feedback-monitoring in social contexts to adjust one's actions and obtain desired outcomes. When being awarded positive outcomes during a gambling task, feedback-monitoring is attenuated when strangers are rewarded, as less value is assigned to the awarded outcome. This difference in feedback-monitoring can be indexed by an event-related potential (ERP) component known as the Reward Positivity (RewP), whose amplitude is enhanced when receiving positive feedback. While the degree of familiarity influences the RewP, little is known about how the RewP and reinforcement learning are affected when gambling on behalf of familiar versus nonfamiliar agents, such as robots. This question becomes increasingly important given that robots may be used as teachers and/or social companions in the near future, with whom children and adults will interact with for short or long periods of time. In the present study, we examined whether feedback-monitoring when gambling on behalf of oneself compared with a robot is impacted by whether participants have familiarized themselves with the robot before the task. We expected enhanced RewP amplitude for self versus other for those who did not familiarize with the robot and that self-other differences in the RewP would be attenuated for those who familiarized with the robot. Instead, we observed that the RewP was larger when familiarization with the robot occurred, which corresponded to overall worse learning outcomes. We additionally observed an enhanced P3 effect for the high-familiarity condition, which suggests an increased motivation to reward. These findings suggest that familiarization with robots may cause a positive motivational effect, which positively affects RewP amplitudes, but interferes with learning.

A widely held though debatable claim is that the picture of an object like a frying pan automatically elicits features of a left/right-handed grasp action even in perceptual tasks that make no demands on the observer to consider the graspable properties of the depicted object. Here, we sought to further elucidate this claim by relying on a methodology that allowed us to distinguish between the influence of motor versus spatial codes on the selection of a left/right-handed response while electroencephalographic data were recorded. In our experiment, participants classified images of frying pans as upright or inverted using a left/right key press or by making a left/right-handed reach-and-grasp action towards a centrally located response element while we recorded electroencephalographic (EEG) data. In line with previous evidence (Bub, Masson, & van Noordenne, Journal of Experiment Psychology: Human Perception and Performance, 47(1), 53-80, 2021), these two modes of responding generated distinct correspondence effects on performance induced by the same set of images. In terms of our EEG data, we found that neither motor (the lateralized readiness potential) nor visual (N100 and P100) potentials were sensitive to handle-response hand correspondence. However, an exploratory theta analysis revealed that changes in frontal theta power mirrored the different correspondence effects evoked by the image on key press responses versus reach and grasp actions. Importantly, our results provide a link between these disparate effects and the engagement of cognitive control, highlighting a possible role of top-down control processes in separating motor features from the task-irrelevant features of an object, and thus in claims regarding object affordances more generally.

Studies of the benefits of a distributed practice schedule on motor skill acquisition have typically found that distribution of practice results in better learning. However, less research has focused on how the benefits of distributed practice are impacted by timing during acquisition. To examine how timing of skill acquisition interacts with distribution of practice we had two groups of participants complete either an extensive massed or distributed training schedule to learn a speed stacking sequence across ten sessions. For participants in both groups, we provided observational learning to facilitate skill acquisition. Analysis of speed stacking time on a retention test revealed an overall benefit for the distributed relative to the massed practice group. Interestingly, our analysis of the benefits of distributed practice during training only showed performance benefits in the early session (session one) and later sessions (sessions eight, nine, and ten) of skill acquisition but not mid-way through it (sessions two through seven). Our results support previous findings highlighting the learning benefits of a distributed practice schedule but suggest that these benefits occur differentially throughout acquisition. Our work also replicates research demonstrating that observational learning is more beneficial when it is yoked to actual practice.

This research evaluated the impact of rapid heat stress on the rate of salivary cortisol appearance. We hypothesized that rapid heat stress would result in an increased rate of salivary cortisol appearance. Fourteen adult male participants performed an incremental exercise test to a termination criterion (volitional maximum, core temperature = 39.5 °C, or a 2-h time maximum time) with or without firefighting gear in a laboratory with an ambient temperature of 25-26 °C. Salivary cortisol was collected at each 0.5 °C increase in core temperature. We observed a significant increase (p ≤ 0.01) in the rate of cortisol appearance when the subjects were wearing the firefighting gear; no change was observed without firefighting gear. Our results demonstrate that rapid heat stress and the resulting physiological stress cause a rapid increase in the rate of salivary cortisol appearance. Our results also support previous research demonstrating that cortisol is a sensitive strain metric of heat intolerance.

This study evaluated the impact of rapid heat stress on prefrontal cortex (PFC) oxygenation and hemodynamics. Previous work has demonstrated that heat stress affects cerebral oxygenation and hemodynamics. Fourteen male subjects performed a graded exercise test to a termination criterion (volitional maximum, core temperature = 39.5 °C, or a 2-hour time cap) with (GEAR) and without (NOGEAR) firefighting gear in a laboratory with an ambient temperature of 25-26 °C. Changes in oxyhemoglobin (O

Reinforcement learning can lead to rapid changes in performance. Computational accounts of reinforcement learning align with classic learning theory, as reported by Sutton and Barto (1998, 2018) and suggest that trial-to-trial changes in performance follow rapid but decelerating learning curves. Although there is some support for a link between changes in behavioural and neural data, evidence has been inconclusive. Here, we had a computational model and human participants learn a novel language through trial-and-error while recording electroencephalographic data. By conducting linear mixed-effects models of trial-to-trial analyses, we sought to determine whether neural signals were indicative of a learning process and whether they were related to changes in behaviour. We found that neural measures did diminish with trial-to-trial changes in performance and that they were predictive of behavioural adaptations in both simulated and empirical data. These neural signals are theorised as reward prediction errors—the computational difference between expectations and outcomes—and here we provide compelling evidence that they reflect an underlying learning process that parallels behavioural adaptation.

The decision trade-off between exploiting the known and exploring the unknown has been studied using a variety of approaches and techniques. Surprisingly, electroencephalography (EEG) has been underused in this area of study, even though its high temporal resolution has the potential to reveal the time-course of exploratory decisions. We addressed this issue by recording EEG data while participants tried to win as many points as possible in a two-choice gambling task called a two-armed bandit. After using a computational model to classify responses as either exploitations or explorations, we examined event-related potentials locked to two events preceding decisions to exploit/explore: the arrival of feedback, and the subsequent appearance of the next trial's choice stimuli. In particular, we examined the feedback-locked P300 component, thought to index a phasic release of norepinephrine (a neural interrupt signal), and the reward positivity, thought to index a phasic release of dopamine (a neural prediction error signal). We observed an exploration-dependent enhancement of the P300 only, suggesting a critical role of norepinephrine (but not dopamine) in triggering decisions to explore. Similarly, we examined the N200/P300 components evoked by the appearance of the choice stimuli. In this case, exploration was characterized by an enhancement of the N200, but not P300, a result we attribute to increased response conflict. These results demonstrate the usefulness of combining computational and EEG methodologies, and suggest that exploratory decisions are preceded by two characterizing events: a feedback-locked neural interrupt signal (enhanced P300), and a choice-locked increase in response conflict (enhanced N200).

Since the suggestion by Tolman (1948) that both rodents and humans create cognitive maps during navigation, the specifics of how navigators learn about their environment has been mired in debate. One facet of this debate is whether or not the creation of cognitive maps - also known as allocentric navigation - involves reinforcement learning. Here, we demonstrate a role for reinforcement learning during allocentric navigation using event-related brain potentials (ERPs). In the present experiment, participants navigated in a virtual environment that allowed the use of three different navigation strategies (allocentric, egocentric-response, & egocentric-cue), in which their goal was to locate and remember a hidden platform. Following the navigation phase of the experiment, participants were shown "cue images" representative of the three navigation strategies. Specifically, we examined whether or not these passively learned strategy images elicited a reward positivity - an ERP component associated with reinforcement learning and the anterior cingulate cortex. We found that when allocentric navigators were shown previously learned cues predicting the goal location a reward positivity was elicited. The present findings demonstrate that allocentric navigational cues carry long-term value after navigation and lend support to the claim that reinforcement learning plays a role in the acquisition of allocentric navigation and thus the generation of cognitive maps.

Humans reason intuitively by relying on gut hunches or rationally through analytical contemplation. The majority of research on human reasoning has relied on behavioural data and thus the neural underpinnings of this process remain unclear. To address this, we had participants perform a classic reasoning task while electroencephalographic (EEG) data was recorded. Within our reasoning task, participants completed a series of base-rate word problems wherein their decisions were either biased by a provided stereotype or based on statistical probability. Post experiment, we defined participant rationality as the percentage of responses that were made based on likelihood. We then examined frontal theta neural oscillations and found that increased power in this frequency range was associated with increased rationality. Our findings imply that theta oscillations are sensitive to rationality and further that rational reasoning involves a diverse brain network relative to intuitive reasoning.

A widely held though debatable claim is that the picture of an object like a frying pan automatically elicits features of a left/right-handed grasp action even in perceptual tasks that make no demands on the observer to consider the graspable properties of the depicted object. Here, we sought to further elucidate this claim by relying on a methodology that allowed us to distinguish between the influence of motor versus spatial codes on the selection of a left/right-handed response while electroencephalographic data were recorded. In our experiment, participants classified images of frying pans as upright or inverted using a left/right key press or by making a left/right-handed reach-and-grasp action towards a centrally located response element while we recorded electroencephalographic (EEG) data. In line with previous evidence (Bub, Masson,van Noordenne, Journal of Experiment Psychology: Human Perception and Performance, 47(1), 53-80, 2021), these two modes of responding generated distinct correspondence effects on performance induced by the same set of images. In terms of our EEG data, we found that neither motor (the lateralized readiness potential) nor visual (N100 and P100) potentials were sensitive to handle-response hand correspondence. However, an exploratory theta analysis revealed that changes in frontal theta power mirrored the different correspondence effects evoked by the image on key press responses versus reach and grasp actions. Importantly, our results provide a link between these disparate effects and the engagement of cognitive control, highlighting a possible role of top-down control processes in separating motor features from the task-irrelevant features of an object, and thus in claims regarding object affordances more generally.

The advent of mobile electroencephalography (mEEG) has created a means for large scale collection of neural data thus affording a deeper insight into cognitive phenomena such as cognitive fatigue. Cognitive fatigue – a neural state that is associated with an increased incidence of errorful performance – is responsible for accidents on a daily basis which at times can cost human lives. To gain better insight into the neural signature of cognitive fatigue in the present study we used mEEG to examine the relationship between perceived cognitive fatigue and human-event related brain potentials (ERPs) and electroencephalographic (EEG) oscillations in a sample of 1,000 people. As a secondary goal, we wanted to further demonstrate the capability of mEEG to accurately measure ERP and EEG data. To accomplish these goals, participants performed a standard visual oddball task on an Apple iPad while EEG data were recorded from a Muse EEG headband. Counter to traditional EEG studies, experimental setup and data collection was completed in less than seven minutes on average. An analysis of our EEG data revealed robust N200 and P300 ERP components and neural oscillations in the delta, theta, alpha, and beta bands. In line with previous findings we observed correlations between ERP components and EEG power and perceived cognitive fatigue. Further, we demonstrate here that a linear combination of ERP and EEG features is a significantly better predictor of perceived cognitive fatigue than any ERP or EEG feature on its own. In sum, our results provide validation of mEEG as a viable tool for research and provide further insight into the impact of cognitive fatigue on the human brain.

Human learning, at least in part, appears to be dependent on the evaluation of how outcomes of our actions align with our expectations. Over the past 23 years, electroencephalography (EEG) has been used to probe the neural signatures of feedback processing. Seminal work demonstrated a difference in the human event-related potential (ERP) dependent on whether people were processing correct or incorrect feedback. Since then, these feedback evoked ERPs have been associated with reinforcement learning and conflict monitoring, tied to subsequent behavioral adaptations, and shown to be sensitive to a wide range of factors (e.g., Parkinson's disease). Recently, research has turned to frequency decomposition techniques to examine how changes in the EEG power spectra are related to underlying learning mechanisms. Although the literature on the neural correlates of feedback processing is vast, there are still methodological discrepancies and differences in results across studies. Here, we provide reference results and an investigation of methodological considerations for the ERP (reward positivity) and frequency (delta and theta power) correlates of feedback evaluation with a large sample size. Specifically, participants (n = 500) performed a two-armed bandit task while we recorded EEG. Our findings provide key information about the data characteristics and relationships that exist between the neural signatures of feedback evaluation. Additionally, we conclude with selected methodological recommendations for standardization of future research. All data and scripts are freely provided to facilitate open science.

Humans often rely on feedback to learn. Indeed, in learning the difference between feedback and an expected outcome is computed to inform future actions. Further, recent work has found that reward and feedback have a unique role in modulating conflict processing and cognitive control. However, it is still not clear how conflict, especially concerning the processing and evaluation of feedback, impacts learning. To address this, we examined the effects of feedback competition on feedback evaluation in a reinforcement learning task. Specifically, we had participants play a simple two-choice gambling game while electroencephalographic (EEG) data were recorded. On half of the experiment blocks, we reversed the meaning of performance feedback for each trial from its prepotent meaning to induce response conflict akin to the Stroop effect (e.g., ‘✓’ meant incorrect). Behaviourally, we found that participants’ accuracy was reduced as a result of incongruent feedback. Paralleling this, an analysis of our EEG revealed that incongruent feedback resulted in a reduction in amplitude of the reward positivity and the P300, components of the human event-related brain potential implicated in reward processing. Our results demonstrate the negative impact of conflict on feedback evaluation and the impact of this on subsequent performance.

A brief group-based cognitive behavioral therapy (CBT), with running as an interoceptive exposure (IE) component, was effective in reducing anxiety sensitivity (AS) levels in undergraduate women (Watt, Stewart, Lefaivre, & Uman, 2006). This study investigated whether the CBT/IE intervention would result in decreases in AS and emotional distress that would be maintained over 14 weeks. Female undergraduates, high (n = 81) or low (n = 73) in AS, were randomized to 3-day CBT plus forty-two 10-min running IE trials (n = 83) or 3-day health education control (HEC) with interactive discussions and problem solving on exercise, nutrition, and sleep (n = 71). The CBT/IE intervention led to decreases in AS, depression, and stress symptoms for high AS participants, which were maintained at 14 weeks. Unexpectedly, HEC participants experienced similar and lasting decreases in AS, depression, and anxiety symptoms. Furthermore, there were no post-intervention differences between CBT/IE and HEC participants in any of the outcomes. Low AS participants experienced few sustained changes. Clinical implications and the possible role of aerobic exercise in explaining outcomes of both interventions are discussed.

Recognition memory is improved for items produced at study (e.g., by reading them aloud) relative to a non-produced control condition (e.g., silent reading). This production effect is typically attributed to the extra elements in the production task (e.g., motor activation, auditory perception) enhancing item distinctiveness. To evaluate this claim, the present study examined the neural mechanisms underlying the production effect. Prior to a recognition memory test, different words within a study list were read either aloud, silently, or while saying "check" (as a sensorimotor control condition). Production improved recognition, and aloud words yielded higher rates of both recollection and familiarity judgments than either silent or control words. During encoding, fMRI revealed stronger activation in regions associated with motor, somatosensory, and auditory processing for aloud items than for either silent or control items. These activations were predictive of recollective success for aloud items at test. Together, our findings are compatible with a distinctiveness-based account of the production effect, while also pointing to the possible role of other processing differences during the aloud trials as compared to silent and control.

Prism adaptation (PA) is both a model for visuomotor learning and a promising treatment for visuospatial neglect after stroke. The task involves reaching for targets while prism glasses horizontally displace the visual field. Adaptation is hypothesized to occur through two processes: strategic recalibration, a rapid self-correction of pointing errors; and spatial realignment, a more gradual adjustment of visuomotor reference frames that produce prism aftereffects (i.e., reaching errors upon glasses removal in the direction opposite to the visual shift). While aftereffects can ameliorate neglect, not all patients respond to PA, and the neural mechanisms underlying successful adaptation are unclear. We investigated the feedback-related negativity (FRN) and the P300 event-related potential (ERP) components as candidate markers of strategic recalibration and spatial realignment, respectively. Healthy young adults wore prism glasses and performed memory-guided reaching toward vertical-line targets. ERPs were recorded in response to three different between-subject error feedback conditions at screen-touch: view of hand and target (Experiment 1), view of hand only (Experiment 2), or view of lines to mark target and hand position (view of hand occluded; Experiment 3). Conditions involving a direct view of the hand-produced stronger aftereffects than indirect hand feedback, and also evoked a P300 that decreased in amplitude as adaptation proceeded. Conversely, the FRN was only seen in conditions involving target feedback, even when aftereffects were smaller. Since conditions producing stronger aftereffects were associated with a phase-sensitive P300, this component may index a "context-updating" realignment process critical for strong aftereffects, whereas the FRN may reflect an error monitoring process related to strategic recalibration.

Evidence ranging from behavioural adaptations to neurocognitive theories has made significant advances into our understanding of feedback-based learning. For instance, over the past twenty years research using electroencephalography has demonstrated that the amplitude of a component of the human event-related brain potential - the reward positivity - appears to change with learning in a manner predicted by reinforcement learning theory (Holroyd and Coles, 2002; Sutton and Barto, 1998). However, while the reward positivity (also known as the feedback related negativity) is well studied, whether the component reflects an underlying learning process or whether it is simply sensitive to feedback evaluation is still unclear. Here, we sought to provide support that the reward positivity is reflective of an underlying learning process and further we hoped to demonstrate this in a real-world medical education context. In the present study, students with no medical training viewed a series of patient cards that contained ten physiological readings relevant for diagnosing liver and biliary disease types, selected the most appropriate diagnostic classification, and received feedback as to whether their decisions were correct or incorrect. Our behavioural results revealed that our participants were able to learn to diagnose liver and biliary disease types. Importantly, we found that the amplitude of the reward positivity diminished in a concomitant manner with the aforementioned behavioural improvements. In sum, our data support theoretical predictions (e.g., Holroyd and Coles, 2002), suggest that the reward positivity is an index of a neural learning system, and further validate that this same system is involved in learning across a wide range of contexts.

The visuomotor mental rotation (VMR) of a saccade requires a response to a region of space that is dissociated from a stimulus by a pre-specified angle, and work has shown a monotonic increase in reaction times as a function of increasing oblique angles of rotation. These results have been taken as evidence of a continuous process of rotation and have generated competing hypotheses. One hypothesis asserts that rotation is mediated via frontoparietal structures, whereas a second states that a continuous shift in the activity of direction-specific neurons in the superior colliculus (SC) supports rotation. Research to date, however, has not examined the neural mechanisms underlying VMR saccades and both hypotheses therefore remain untested. The present study measured the behavioural data and event-related brain potentials (ERP) of standard (i.e., 0° of rotation) and VMR saccades involving 35°, 70° and 105° of rotation. Behavioural results showed that participants adhered to task-based rotation demands and ERP findings showed that the amplitude of the contingent negative variation (CNV) linearly decreased with increasing angle of rotation. The cortical generators of the CNV are linked to frontoparietal structures supporting movement preparation. Although our ERP design does not allow us to exclude a possible role of the SC in the rotation of a VMR saccade, they do demonstrate that such actions are supported by a continuous and cortically based rotation process.

Advancing age is often accompanied by a decline in motor control that results in a decreased ability to successfully perform motor tasks. While there are multiple factors that contribute to age-related deficits in motor control, one unexplored possibility is that age-related deficits in our ability to evaluate motor output result in an increase in motor errors. In line with this, previous work from our laboratory demonstrated that motor errors evoked an error-related negativity (ERN)-a component of the human ERP associated with error evaluation originating within the human medial-frontal cortex. In the present study, we examined whether or not deficits in the medial-frontal error evaluation system contribute to age-related deficits in motor control. Two groups of participants (young, old) performed a computer-based tracking task that paralleled driving while EEG data were recorded. Our results show that older adults committed more behavioral errors than young adults during performance of the tracking task. An analysis of our ERP data revealed that the amplitude of the ERN was reduced in older adults relative to young adults following motor errors. Our results make an important extension from previous work demonstrating age-related reductions in the ERN during performance of cognitive tasks. Importantly, our results imply the possibility of understanding motor deficits in older age.

Over the past 20 years there has been an increasing push for people to achieve or maintain “wellness” - a state in which one has not only physical but also mental and social well-being. While it may seem obvious that maintaining a state of wellness is beneficial, little research has been done to probe how maintaining a state of wellness impacts our brain. Here, we specifically examined the impact of wellness on a neural system within the medial-frontal cortex responsible for human reinforcement learning. Sixty-two undergraduate students completed the Perceived Wellness Survey after which they completed a computer-based learnable gambling game while electroencephalographic data were recorded. Within the game, participants were presented with a series of choices that either led to financial gains or losses. An analysis of our behavioral data indicated that participants were able to learn the underlying structure of the gambling game given that we observed improvements in performance. Concurrent with this, we observed an electroencephalographic response evoked by the evaluation of gambling outcomes - the reward positivity. Importantly, we found significant relationships between several aspects of wellness and the amplitude of the reward positivity. Given that the reward positivity is thought to reflect the function of a reinforcement learning system within the medial-frontal cortex, our results suggest that wellness impacts neural function – in this instance one of the systems responsible for human learning.

The feedback that we receive shapes how we learn. Previous research has demonstrated that quantitative feedback results in better performance than qualitative feedback. However, the data supporting a quantitative feedback advantage are not conclusive and further little work has been done to examine the mechanistic neural differences that underlie the relative benefits of quantitative and qualitative feedback. To address these issues, participants learned a simple motor task in quantitative and qualitative feedback conditions while electroencephalographic (EEG) data were recorded. We found that participants were more accurate and had a larger neural response – the feedback related negativity - when qualitative feedback was provided. Our data suggest that qualitative feedback is more advantageous than quantitative feedback during the early stages of skill acquisition. Additionally, our findings support previous work suggesting that a reinforcement learning system within the human medial-frontal cortex plays a key role in motor skill acquisition.

What makes a decision difficult? Two key factors are conflict and surprise: conflict emerges with multiple competing responses and surprise occurs with unexpected events. Conflict and surprise, however, are often thought of as parsimonious accounts of decision making rather than an integrated narrative. We sought to determine whether conflict and/or surprise concurrently or independently elicit effortful decision making. Participants made a series of diagnostic decisions from physiological readings while electroencephalographic (EEG) data were recorded. To induce conflict and surprise, we manipulated task difficulty by varying the distance between a presented physiological reading and the category border that separated the two diagnoses. Whereas frontal theta oscillations reflected surprise - when presented readings were far from the expected mean, parietal alpha and beta oscillations indicated conflict - when readings were near the category border. Our findings provide neural evidence that both conflict and surprise engage cognitive control to employ effort in decision making.

In the present experiment we evaluated the impact of rapid heat stress on decision-making and neural function. Previous work has demonstrated that heat stress has an impact on cognitive and neural function. Here, we hypothesized that a rapid increase in heat stress would result in reduced decision-making ability evidenced by a reduction in frontal theta electroencephalographic (EEG) power. Fifteen participants performed an incremental exercise test to a termination criterion (volitional maximum, core temperature = 39.5 °C, or a 2-h time cap) with or without fire-fighting gear (selection was randomized) in a laboratory with an ambient temperature of 25–26 °C. Immediately following the exercise test, participants completed a Go/No-Go task and we observed an increase in incorrect responses when the subjects were wearing fire-fighting gear; no change was observed without gear. Additionally, an analysis of frontal EEG revealed a decrease in theta power when comparing pre- and post-exercise values with fire-fighting gear on; no change was observed without gear. Importantly, our results suggest that rapid heat stress and the resulting increase in physiological strain causes a decrease in cognitive control that could result in serious consequences in life-saving occupations that require contemplative, effortful decision-making.

Decision-making is typically studied by presenting participants with a small set of options. However, real-world behaviour, like foraging, often occurs in continuous environments. The degree to which human decision-making in discrete tasks generalizes to continuous tasks is questionable. For example, successful foraging comprises both exploration (learning about the environment) and exploitation (taking advantage of what is known). Although progress has been made in understanding the neural processes related to this trade-off in discrete tasks, it is currently unclear how, or whether, the same processes are involved in continuous tasks. To address this, we recorded electroencephalographic data while participants “dug for gold” by selecting locations on a map. Participants were cued beforehand that the map contained either a single patch of gold, or many patches of gold. We then used a computational model to classify participant responses as either exploitations, which were driven by previous reward locations and amounts, or explorations. Our participants were able to adjust their strategy based on reward distribution, exploring more in multi-patch environments and less in single-patch environments. We observed an enhancement of the feedback-locked P300, a neural signal previously linked to exploration in discrete tasks, which suggests the presence of a general neural system for managing the explore-exploit trade-off. Furthermore, the P300 was accompanied by an exploration-related enhancement of the late positive potential that was greatest in the multi-patch environment, suggesting a role for motivational processes during exploration.

Mental state prior to sports skill execution is related to subsequent performance. For example, relationships between pre-performance electroencephalogram (EEG) power and subsequent movement outcomes in golf putting, pistol shooting, and basketball free throw shooting have been previously reported. With that said, the existing body of research examining the pre-performance EEG – performance relationship has been focused on the execution of internally as opposed to externally-paced motor skills. Given that the execution of internally and externally-paced movements are dependent on different neural pathways, in the present study we examined whether or not pre-performance EEG power predicted ensuing performance of an externally-paced motor skill – baseball batting. Sixty-seven baseball players had EEG data recorded for 120 s prior to batting practice. Performance was assessed by three expert coaches and the accuracy of coach performance ratings was verified via Generalizability Theory. An analysis of our data revealed an inverse relationship between frontal EEG power in the beta range and subsequent batting performance - reduced beta power was associated with better batting performance whereas increased beta power was associated with worse batting performance. Our results are in line with prior research that has demonstrated a relationship between increased EEG power in the beta range and the subsequent commitment of motor errors in addition to the aforementioned work examining pre-performance EEG and the execution of internally-paced motor skills.

Given the reduced formal instruction time for many of the basic sciences within medical curricula, educators are searching for instructional methods that ensure students have the necessary foundational knowledge. The objective of this study was to design an anatomical structure identification reinforcement learning task for participants with minimal prior neuroanatomical knowledge. We predicted that the provision of immediate feedback would activate reinforcement learning mechanisms within the brain thus enhancing knowledge acquisition in novice learners such that performance accuracy (correct identification of neuroanatomical structures) improves from approximately 50 % (guessing) to 90 % by task completion. Ten participants learned to identify 10 neuroanatomical structures shown using two-dimensional (2D) coronal brain images over the course of 320 trials (20 trials per experiment block with 16 blocks total). An analysis of behavioural learning curves demonstrated the progression of learning, and each participant achieved a 90–100 % accuracy by block 13 (260 trials) for each of the 10 structures. The total task duration was approximately 30–35 min with all participants reaching proficiency by 25–30 min. Importantly, there was a significant increase in performance on a post-task knowledge identification test. Our results highlight the key role of reinforcement learning approaches to establishing foundational knowledge in the pre-clinical sciences, specifically anatomy, in a time-efficient manner. Further, progression of learning can be assessed through examination of learning curves. Designing effective pre-class exercises that make use of reinforcement learning theory as a means to promote learning may be an effective method to build base knowledge prior to classroom interactions in anatomy education.

Clinical decision making requires knowledge, experience and analytical/non-analytical types of decision processes. As clinicians progress from novice to expert, research indicates decision-making becomes less reliant on foundational biomedical knowledge and more on previous experience. In this study, we investigated how knowledge and experience were reflected in terms of differences in neural areas of activation. Novice and expert clinicians diagnosed simple or complex (easy, hard) cases while functional magnetic resonance imaging (fMRI) data were collected. Our results highlight key differences in the neural areas activated in novices and experts during the clinical decision-making process. fMRI data were collected from ten second year medical students (novices) and ten practicing gastroenterologists (experts) while they diagnosed sixteen (eight easy and eight hard) clinical cases via multiple-choice questions. Behavioral data were collected for diagnostic accuracy (correct/incorrect diagnosis) and time taken to assign a clinical diagnosis. Two analyses were performed with the fMRI data. First, data from easy and hard cases were compared within respective groups (easy > hard, hard > easy). Second, neural differences between novices and experts (novice > expert, expert > novice) were assessed. Experts correctly diagnosed more cases than novices and made their diagnoses faster than novices on both easy and hard cases (all p's

Traditionally our understanding of goal-directed action been derived from either behavioral findings or neuroanatomically derived imaging (i.e., fMRI). While both of these approaches have proven valuable, they lack the ability to determine a direct locus of function while concurrently having the necessary temporal precision needed to understand millisecond scale neural interactions respectively. In this review we summarize some seminal behavioral findings across three broad areas (target perturbation, feed-forward control, and feedback processing) and for each discuss the application of electroencephalography (EEG) to the understanding of the temporal nature of visual cue utilization during movement planning, control, and learning using four existing scalp potentials. Specifically, we examine the appropriateness of using the N100 potential as an indicator of corrective behaviors in response to target perturbation, the N200 as an index of movement planning, the P300 potential as a metric of feed-forward processes, and the feedback-related negativity as an index of motor learning. Although these existing components have potential for insight into cognitive contributions and the timing of the neural processes that contribute to motor control further research is needed to expand the control-related potentials and to develop methods to permit their accurate characterization across a wide range of behavioral tasks.

The visual environment is filled with complex, multi-dimensional objects that vary in their value to an observer's current goals. When faced with multi-dimensional stimuli, humans may rely on biases to learn to select those objects that are most valuable to the task at hand. Here, we show that decision making in a complex task is guided by the sparsity bias: the focusing of attention on a subset of available features. Participants completed a gambling task in which they selected complex stimuli that varied randomly along three dimensions: shape, color, and texture. Each dimension comprised three features (e.g., color: red, green, yellow). Only one dimension was relevant in each block (e.g., color), and a randomly-chosen value ranking determined outcome probabilities (e.g., green > yellow > red). Participants were faster to respond to infrequent probe stimuli that appeared unexpectedly within stimuli that possessed a more valuable feature than to probes appearing within stimuli possessing a less valuable feature. Event-related brain potentials recorded during the task provided a neurophysiological explanation for sparsity as a learning-dependent increase in optimal attentional performance (as measured by the N2pc component of the human event-related potential) and a concomitant learning-dependent decrease in prediction errors (as measured by the feedback-elicited reward positivity). Together, our results suggest that the sparsity bias guides human reinforcement learning in complex environments.

It is common knowledge that alcohol intoxication impairs motor coordination, judgment, and decision making. Indeed, an abundance of literature links intoxication to impaired cognitive control that leads to accidents and injury. A broadening body of research, however, suggests that the impact of alcohol may continue beyond the point of intoxication and into the period of alcohol hangover. Here, we examined differences in the amplitude of reward positivity-a component of the human ERP associated with learning-between control and hangover participants. During performance of a learnable gambling task, we found a reduction in the reward positivity during alcohol hangover. Additionally, participants experiencing alcohol hangover demonstrated reduced performance in the experimental task in comparison to their nonhangover counterparts. Our results suggest that the neural systems that underlie performance monitoring and reward-based learning are impaired during alcohol hangover.

There is growing interest in using electroencephalography and specifically the event-related brain potential (ERP) methodology to study human reward processing. Since the discovery of the feedback related negativity (Miltner et al., 1997) and the development of theories associating the feedback related negativity and more recently the reward positivity with reinforcement learning, midbrain dopamine function, and the anterior cingulate cortex (i.e., Holroyd and Coles, 2002) researchers have used the ERP methodology to probe the neural basis of reward learning in humans. However, examination of the feedback related negativity and the reward positivity cannot be done without an understanding of some key methodological issues that must be taken into account when using ERPs and examining these ERP components. For example, even the component name - the feedback related negativity - is a source of debate within the research community as some now strongly feel that the component should be named the reward positivity (Proudfit, 2015). Here, ten key methodological issues are discussed - confusion in component naming, the reward positivity, component identification, peak quantification and the use of difference waveforms, frequency (the N200) and component contamination (the P300), the impact of feedback timing, action, and task learnability, and how learning results in changes in the amplitude of the feedback-related negativity/reward positivity. The hope here is to not provide a definitive approach for examining the feedback related negativity/reward positivity, but instead to outline the key issues that must be taken into account when examining this component to assist researchers in their study of human reward processing with the ERP methodology.