Search

Feedback-based associative learning (e.g., acquiring new associations from positive or negative outcomes) and generalization (e.g., applying past learning to new settings) are important cognitive skills that enable people to make economic decisions or social judgments. This ability to acquire new skills based on feedback and transfer those experiences to predict positive outcomes in novel situations is essential at all ages, but especially among older adults who must continually adapt to new people, environments, and technologies. Ample evidence from animal work, clinical research, and computational modeling has demonstrated that feedback-based associative learning is sensitive to basal ganglia dysfunction and generalization to medial temporal lobe dysfunction. This dissociation is relevant because of recent evidence that has suggested healthy aging compromises the basal ganglia system earlier than the medial temporal lobes. However, few studies have investigated how healthy aging influences these cognitive processes. Here, we examined both feedback-based associative learning and generalization in younger, middle-aged, and older adults using a computerized acquired equivalence task. Results revealed a significant effect of age group on feedback-based associative learning, consistent with evidence of persistent age-related declines in the basal ganglia. In contrast, generalization was spared in all but the oldest adult group, likely reflecting preserved medial temporal lobe function until advanced old age. Our findings add behavioral evidence to the emerging view that healthy aging affects the striatal system before the medial temporal lobes. Although further evidence is needed, this finding may shed light on the possible time course of neural system dysfunction in healthy aging., (PsycINFO Database Record (c) 2013 APA, all rights reserved.)

The hippocampus and the basal ganglia are thought to play fundamental and distinct roles in learning and memory, supporting two dissociable memory systems. Interestingly, however, the hippocampus and the basal ganglia have each, separately, been implicated as necessary for reversal learning-the ability to adaptively change a response when previously learned stimulus-outcome contingencies are reversed. Here, we compared the contribution of the hippocampus and the basal ganglia to distinct aspects of learning and reversal. Amnesic subjects with selective hippocampal damage, Parkinson subjects with disrupted basal ganglia function, and healthy controls were tested on a novel probabilistic learning and reversal paradigm. In this task, reversal can be achieved in two ways: Subjects can reverse a previously learned response, or they can select a new cue during the reversal phase, effectively "opting out" of the reversal. We found that both patient groups were intact at initial learning, but differed in their ability to reverse. Amnesic subjects failed to reverse, and continued to use the same cue and response learned before the reversal. Parkinson subjects, by contrast, opted out of the reversal by learning a new cue-outcome association. These results suggest that both the hippocampus and the basal ganglia support reversal learning, but in different ways. The basal ganglia are necessary for learning a new response when a previously learned response is no longer rewarding. The failure of the amnesic subjects to reverse their response or to learn a new cue is consistent with a more general role for the hippocampus in configural learning, and suggests it may also support the ability to respond to changes in cue-outcome contingencies.

The purpose of this study was to investigate basal ganglia (BG) and medial temporal lobe (MTL) dependent learning in patients with schizophrenia. Acquired equivalence is a phenomenon in which prior training to treat two stimuli as equivalent (if two stimuli are associated with the same response) increases generalization between them. The learning of stimulus-response pairs is related to the BG, whereas the MTL system participates in stimulus generalization. Forty-three patients with DSM-IV schizophrenia and 28 matched healthy controls participated. Volunteers received the Rutgers acquired equivalence task (face-fish task) by [Myers, C.E., Shohamy, D., Gluck, M.A. et al., 2003. Dissociating hippocampal versus basal ganglia contributions to learning and transfer. J. Cogn. Neurosci. 15, 185-193.], the California Verbal Learning Test (CVLT), and the n-back working memory test. The Rutgers acquired equivalence task investigates BG-dependent processes (stimulus-response learning) and MTL-dependent processes (stimulus generalization) with a single test. Results revealed that patients with schizophrenia showed a selective deficit on stimulus generalization, whereas stimulus-response learning was spared. The stimulus generalization deficit correlated with the CVLT performance (total scores from trials 1-5 and long-delay recall), but not with the n-back test performance. The number of errors during stimulus-response learning correlated with the daily chlorpromazine-equivalent dose of antipsychotics. In conclusion, this is the first study to show that patients with schizophrenia exhibit deficits during MTL-dependent learning, but not during BG-dependent learning within a single task. High-dose first generation antipsychotics may disrupt BG-dependent learning by blocking dopaminergic neurotransmission in the nigro-stiratal system.

The purpose of the present study was to investigate basal ganglia (BG) and medial temporal lobe (MTL) dependent learning in patients with schizophrenia. Acquired equivalence is a phenomenon in which prior training to treat two stimuli as equivalent (if two stimuli are associated with the same response) increases generalization between them. The learning of stimulus-response pairs is related to the BG, whereas the MTL system participates in stimulus generalization. Forty-three patients with DSM-IV schizophrenia and 28 matched healthy controls participated in the study. Volunteers received the acquired equivalence associative learning task (FISHES) during which associations between faces and pet fishes are learned. Results revealed that patients with schizophrenia showed a selective deficit on stimulus generalization, whereas stimulus-response learning was unaffected. The number of errors during stimulus-response learning correlated with the daily chlorpromazine-equivalent dose of antipsychotics. In conclusion, patients with schizophrenia showed deficits during MTL-dependent learning, but not during BG-dependent learning. High-dose first generation antipsychotics may disrupt BG-dependent learning by blocking dopaminergic neurotransmission in the nigro-striatal system.

Based on prior animal and computational models, we propose a double dissociation between the associative learning deficits observed in patients with medial temporal (hippocampal) damage versus patients with Parkinson's disease (basal ganglia dysfunction). Specifically, we expect that basal ganglia dysfunction may result in slowed learning, while individuals with hippocampal damage may learn at normal speed. However, when challenged with a transfer task where previously learned information is presented in novel recombinations, we expect that hippocampal damage will impair generalization but basal ganglia dysfunction will not. We tested this prediction in a group of healthy elderly with mild-to-moderate hippocampal atrophy, a group of patients with mild Parkinson's disease, and healthy controls, using an "acquired equivalence" associative learning task. As predicted, Parkinson's patients were slower on the initial learning but then transferred well, while the hippocampal atrophy group showed the opposite pattern: good initial learning with impaired transfer. To our knowledge, this is the first time that a single task has been used to demonstrate a double dissociation between the associative learning impairments caused by hippocampal versus basal ganglia damage/dysfunction. This finding has implications for understanding the distinct contributions of the medial temporal lobe and basal ganglia to learning and memory.

The medial temporal (MT) lobes and basal ganglia have both been implicated as brain substrates of associative learning. Here, we show a dissociation between medial temporal and basal ganglia damage using a latent learning task, in which prior exposure to cues, uncorrelated with each other, slows subsequent learning of an association between them. Consistent with prior work, we found a robust exposure effect in healthy controls, with exposed controls learning more slowly than non-exposed controls. This effect was abolished in medial temporal amnesia: both exposed and non-exposed amnesic patients learned at the same speed. A group of patients with basal ganglia damage due to Parkinson's disease showed a reversal of the effect: exposed subjects learned faster than non-exposed subjects. Our findings point to distinct and dissociable contributions of medial temporal lobe and basal ganglia structures to learning and memory.

Background and Objectives: Asymmetric onset of motor symptoms in PD can affect cognitive function. We examined whether motor-symptom laterality could affect feedback-based associative learning and explored its underlying neural mechanism by functional magnetic resonance imaging in PD patients.Methods: We recruited 63 early-stage medication-naïve PD patients (29 left-onset medication-naïve patients, 34 right-onset medication-naïve patients) and 38 matched normal controls. Subjects completed an acquired equivalence task (including acquisition, retention, and generalization) and resting-state functional magnetic resonance imaging scans. Learning accuracy and response time in each phase of the task were recorded for behavioral measures. Regional homogeneity was used to analyze resting-state functional magnetic resonance imaging data, with regional homogeneity lateralization to evaluate hemispheric functional asymmetry in the striatum.Results: Left-onset patients made significantly more errors in acquisition (feedback-based associative learning) than right-onset patients and normal controls, whereas right-onset patients performed as well as normal controls. There was no significant difference among these three groups in the accuracy of either retention or generalization phase. The three groups did not show significant differences in response time. In the left-onset group, there was an inverse relationship between acquisition errors and regional homogeneity in the right dorsal rostral putamen. There were no significant regional homogeneity changes in either the left or the right dorsal rostral putamen in right-onset patients when compared to controls.Conclusions: Motor-symptom laterality could affect feedback-based associative learning in PD, with left-onset medication-naïve patients being selectively impaired. Dysfunction in the right dorsal rostral putamen may underlie the observed deficit in associative learning in patients with left-sided onset.© 2016 International Parkinson and Movement Disorder Society. [ABSTRACT FROM AUTHOR]

To test a prediction of our previous computational model of cortico-hippocampal interaction (Gluck and Myers [1993, 2001]) for characterizing individual differences in category learning, we studied young healthy subjects using an fMRI-adapted category-learning task that has two phases, an initial phase in which associations are learned through trial-and-error feedback followed by a generalization phase in which previously learned rules can be applied to novel associations (Myers et al. [2003]). As expected by our model, we found a negative correlation between learning-related hippocampal responses and accuracy during transfer, demonstrating that hippocampal adaptation during learning is associated with better behavioral scores during transfer generalization. In addition, we found an inverse relationship between Blood Oxygenation Level Dependent (BOLD) activity in the striatum and that in the hippocampal formation and the orbitofrontal cortex during the initial learning phase. Conversely, activity in the dorsolateral prefrontal cortex, orbitofrontal cortex and parietal lobes dominated over that of the hippocampal formation during the generalization phase. These findings provide evidence in support of theories of the neural substrates of category learning which argue that the hippocampal region plays a critical role during learning for appropriately encoding and representing newly learned information so that that this learning can be successfully applied and generalized to subsequent novel task demands. Hum Brain Mapp 35:3122-3131, 2014. © 2013 Wiley Periodicals, Inc. [ABSTRACT FROM AUTHOR]

One barrier to interpreting past studies of cognition and major depressive disorder (MDD) has been the failure in many studies to adequately dissociate the effects of MDD from the potential cognitive side effects of selective serotonin reuptake inhibitors (SSRIs) use. To better understand how remediation of depressive symptoms affects cognitive function in MDD, we evaluated three groups of subjects: medication-naïve patients with MDD, medicated patients with MDD receiving the SSRI paroxetine, and healthy control (HC) subjects. All were administered a category-learning task that allows for dissociation between learning from positive feedback (reward) vs. learning from negative feedback (punishment). Healthy subjects learned significantly better from positive feedback than medication-naïve and medicated MDD groups, whose learning accuracy did not differ significantly. In contrast, medicated patients with MDD learned significantly less from negative feedback than medication-naïve patients with MDD and healthy subjects, whose learning accuracy was comparable. A comparison of subject's relative sensitivity to positive vs. negative feedback showed that both the medicated MDD and HC groups conform to Kahneman and Tversky's (1979) Prospect Theory, which expects losses (negative feedback) to loom psychologically slightly larger than gains (positive feedback). However, medicated MDD and HC profiles are not similar, which indicates that the state of medicated MDD is not "normal" when compared to HC, but rather balanced with less learning from both positive and negative feedback. On the other hand, medication-naïve patients with MDD violate Prospect Theory by having significantly exaggerated learning from negative feedback. This suggests that SSRI antidepressants impair learning from negative feedback, while having negligible effect on learning from positive feedback. Overall, these findings shed light on the importance of dissociating the cognitive consequences of MDD from those of SSRI treatment, and from cognitive evaluation of MDD subjects in a medication-naïve state before the administration of antidepressants. Future research is needed to correlate the mood-elevating effects and the cognitive balance between reward- and punishment-based learning related to SSRIs [ABSTRACT FROM AUTHOR]

Background/Aims: Levodopa and dopamine agonists have different effects on the motor, cognitive, and psychiatric aspects of Parkinson's disease (PD). Methods: Using a computational model of basal ganglia (BG) and prefrontal cortex (PFC) dopamine, we provide a theoretical synthesis of the dissociable effects of these dopaminergic medications on brain and cognition. Our model incorporates the findings that levodopa is converted by dopamine cells into dopamine, and thus activates prefrontal and striatal D1 and D2 dopamine receptors, whereas antiparkinsonian dopamine agonists directly stimulate D2 receptors in the BG and PFC (although some have weak affinity to D1 receptors). Results: In agreement with prior neuropsychological studies, our model explains how levodopa enhances, but dopamine agonists impair or have no effect on, stimulus-response learning and working memory. Conclusion: Our model explains how levodopa and dopamine agonists have differential effects on motor and cognitive processes in PD. Copyright © 2012 S. Karger AG, Basel [ABSTRACT FROM AUTHOR]

Abstract: Disruption to different components of the prefrontal cortex, basal ganglia, and hippocampal circuits leads to various psychiatric and neurological disorders including Parkinson’s disease (PD) and schizophrenia. Medications used to treat these disorders (such as levodopa, dopamine agonists, antipsychotics, among others) affect the prefrontal-striatal-hippocampal circuits in a complex fashion. We have built models of prefrontal-striatal and striatal-hippocampal interactions which simulate cognitive dysfunction in PD and schizophrenia. In these models, we argue that the basal ganglia is key for stimulus-response learning, the hippocampus for stimulus-stimulus representational learning, and the prefrontal cortex for stimulus selection during learning about multidimensional stimuli. In our models, PD is associated with reduced dopamine levels in the basal ganglia and prefrontal cortex. In contrast, the cognitive deficits in schizophrenia are associated primarily with hippocampal dysfunction, while the occurrence of negative symptoms is associated with frontostriatal deficits in a subset of patients. In this paper, we review our past models and provide new simulation results for both PD and schizophrenia. We also describe an extended model that includes simulation of the different functional role of D1 and D2 dopamine receptors in the basal ganglia and prefrontal cortex, a dissociation we argue is essential for understanding the non-uniform effects of levodopa, dopamine agonists, and antipsychotics on cognition. Motivated by clinical and physiological data, we discuss model limitations and challenges to be addressed in future models of these brain disorders. [Copyright &y& Elsevier]

Abstract: Functional MRI is widely used for imaging the neural correlates of psychological processes and how these brain processes change with learning, development and neuropsychiatric disorder. In order to interpret changes in imaging signals over time, for example, in patient studies, the long-term reliability of fMRI must first be established. Here, eight healthy adult subjects were scanned on two sessions, 1 year apart, while performing a classification learning task known to activate frontostriatal circuitry. We show that behavioral performance and frontostriatal activation were highly concordant at a group level at both time-points. Furthermore, intra-class correlation coefficients (ICCs), which index the degree of correlation between subjects at different time-points, were high for behavior and for functional activation. ICC was significantly higher within the network recruited by learning than outside that network. We conclude that fMRI can have high long-term test–retest reliability, making it suitable as a biomarker for brain development and neurodegeneration. [Copyright &y& Elsevier]

α-Synuclein (SNC4) plays an important rote in the regulation of dopaminergic neurotransmission and neurodegeneration in Parkin- son disease. We investigated reward and punishment learning in asymptomatic carriers of a rare SNCA gene duplication who were healthy siblings of patients with Parkinson disease. Results revealed that healthy SNCA duplication carriers displayed impaired reward and intact punishment learning compared with noncarriers. These results demonstrate that a copy number variation of the SNCA gene is associated with selective impairments on reinforcement learning in asymptomatic carriers without the motor symptoms of Parkinson disease. [ABSTRACT FROM AUTHOR]

To better understand how medication status and task demands affect cognition in major depressive disorder (MDD), we evaluated medication-naïve patients with MDD, medicated patients with MDD receiving the selective serotonin reuptake inhibitors (SSRI) paroxetine, and healthy controls. All three groups were administered a computer-based cognitive task with two phases, an initial phase in which a sequence is learned through reward-based feedback (which our prior studies suggest is striatal-dependent), followed by a generalization phase that involves a change in the context where learned rules are to be applied (which our prior studies suggest is hippocampal-region dependent). Medication-naïve MDD patients were slow to learn the initial sequence but were normal on subsequent generalization of that learning. In contrast, medicated patients learned the initial sequence normally, but were impaired at the generalization phase. We argue that these data suggest (i) an MDD-related impairment in striatal-dependent sequence learning which can be remediated by SSRIs and (ii) an SSRI-induced impairment in hippocampal-dependent generalization of past learning to novel contexts, not otherwise seen in the medication-naïve MDD group. Thus, SSRIs might have a beneficial effect on striatal function required for sequence learning, but a detrimental effect on the hippocampus and other medial temporal lobe structures is critical for generalization. [ABSTRACT FROM AUTHOR]

Abstract: Building on our previous neurocomputational models of basal ganglia and hippocampal region function (and their modulation by dopamine and acetylcholine, respectively), we show here how an integration of these models can inform our understanding of the interaction between the basal ganglia and hippocampal region in associative learning and transfer generalization across various patient populations. As a common test bed for exploring interactions between these brain regions and neuromodulators, we focus on the acquired equivalence task, an associative learning paradigm in which stimuli that have been associated with the same outcome acquire a functional similarity such that subsequent generalization between these stimuli increases. This task has been used to test cognitive dysfunction in various patient populations with damages to the hippocampal region and basal ganglia, including studies of patients with Parkinson’s disease (PD), schizophrenia, basal forebrain amnesia, and hippocampal atrophy. Simulation results show that damage to the hippocampal region—as in patients with hippocampal atrophy (HA), hypoxia, mild Alzheimer’s (AD), or schizophrenia—leads to intact associative learning but impaired transfer generalization performance. Moreover, the model demonstrates how PD and anterior communicating artery (ACoA) aneurysm—two very different brain disorders that affect different neural mechanisms—can have similar effects on acquired equivalence performance. In particular, the model shows that simulating a loss of dopamine function in the basal ganglia module (as in PD) leads to slow acquisition learning but intact transfer generalization. Similarly, the model shows that simulating the loss of acetylcholine in the hippocampal region (as in ACoA aneurysm) also results in slower acquisition learning. We argue from this that changes in associative learning of stimulus–action pathways (in the basal ganglia) or changes in the learning of stimulus representations (in the hippocampal region) can have similar functional effects. [Copyright &y& Elsevier]

Abstract: Recent meta-analytic evidence suggests that clinical neuropsychological methods are not likely to uncover circumscribed cognitive impairments in the deficit syndrome of schizophrenia. To overcome this issue, we adapted a cognitive neuroscience perspective and used a new “chaining” habit learning task. Participants were requested to navigate a cartoon character through a sequence of 4 rooms by learning to choose the open door from 3 colored doors in each room. The aim of the game was to learn the full sequence of rooms until the character reached the outside. In the training phase, each stimulus leading to reward (open door in each room) was trained via feedback until the complete sequence was learned. In the probe phase, the context of rewarded stimuli was manipulated: in a given room, in addition to the correct door of that room, there also appeared a door which was open in another room. Whereas the training phase is dominantly related to basal ganglia circuits, the context-dependent probe phase requires intact medial-temporal lobe functioning. Results revealed that deficit and non-deficit patients were similarly impaired on the probe phase compared with controls. However, the training phase was only compromised in deficit patients. More severe negative symptoms were associated with more errors on the training phase. Executive functions were unrelated to performance on the “chaining” task. These results indicate that the deficit syndrome is associated with prominently impaired stimulus–response reinforcement learning, which may indicate abnormal functioning of basal ganglia circuits. [Copyright &y& Elsevier]

Abstract: Objective: The purpose of this study was to examine stimulus–response (S–R) learning in active cocaine users. Participants and methods: Twenty-two cocaine-dependent participants (20 males and 2 females) and 21 non-drug using control participants (19 males and 2 females) who were similar in age and education were administered two computerized learning tasks. The Acquired Equivalence task initially requires learning of simple antecedent–consequent discriminations, but later requires generalization of this learning when the stimuli are presented in novel recombinations. The Weather Prediction task requires the prediction of a dichotomous outcome based on different stimuli combinations when the stimuli predict the outcome only probabilistically. Results: On the Acquired Equivalence task, cocaine users made significantly more errors than control participants when required to learn new discriminations while maintaining previously learned discriminations, but performed similarly to controls when required to generalize this learning. No group differences were seen on the Weather Prediction task. Conclusions: Cocaine users’ learning of stimulus discriminations under conflicting response demands was impaired, but their ability to generalize this learning once they achieved criterion was intact. This performance pattern is consistent with other laboratory studies of long-term cocaine users that demonstrated that established learning interfered with new learning on incremental learning tasks, relative to healthy controls, and may reflect altered dopamine transmission in the basal ganglia of long-term cocaine users. [Copyright &y& Elsevier]

Abstract: Evidence suggests that dopaminergic mechanisms in the basal ganglia (BG) are important in the learning of sequential associations. To test the specificity of this hypothesis, we assessed never-medicated patients with Parkinson''s disease (PD) and amnestic mild cognitive impairment (aMCI) using a chaining task. In the training phase of the chaining task, each link in a sequence of stimuli leading to reward is trained step-by-step using feedback after each decision, until the complete sequence is learned. In the probe phase of the chaining task, the context of stimulus-response associations must be used (the position of the associations in the sequence). Results revealed that patients with PD showed impaired learning during the training phase of the chaining task, but their performance was spared in the probe phase. In contrast, patients with aMCI with prominent medial temporal lobe (MTL) dysfunctions showed intact learning during the training phase of the chaining task, but their performance was impaired in the probe phase of the chaining task. These results indicate that when dopaminergic mechanisms in the BG are dysfunctional, series of stimulus-response associations are less efficiently acquired, but their sequential manner is maintained. In contrast, MTL dysfunctions may result in a non-sequential learning of associations, which may indicate a loss of contextual information. [Copyright &y& Elsevier]

Abstract: In this study we examined the effect of dopaminergic modulation on learning and memory. Parkinson''s patients were tested ‘on’ versus ‘off’ dopaminergic medication, using a two-phase learning and transfer task. We found that dopaminergic medication was associated with impaired learning of an incrementally acquired concurrent discrimination task, while patients withdrawn from dopaminergic medication performed as well as controls. In addition, we found a dissociation of the effect of medication within a single two-phase task: patients tested ‘on’ medication were not impaired at the ability to generalize based on learned information. The deficit among medicated patients appeared to be related specifically to the concurrent, incremental, feedback-based nature of the task: such a deficit was not found in a version of the task in which demands for concurrent error-processing learning were reduced. Taken together with a growing body of evidence emphasizing a role for midbrain dopamine in error-correcting, feedback-based learning processes, the present results suggest a framework for understanding previously conflicting results regarding the effect of medication on learning and memory in Parkinson''s disease. [Copyright &y& Elsevier]