Search

Optogenetics and calcium imaging can be combined to simultaneously stimulate and record neural activity in vivo. However, this usually requires two-photon microscopes, which are not portable nor affordable. Here we report the design and implementation of a miniaturized one-photon endoscope for performing simultaneous optogenetic stimulation and calcium imaging. By integrating digital micromirrors, the endoscope makes it possible to activate any neuron of choice within the field of view, and to apply arbitrary spatiotemporal patterns of photostimulation while imaging calcium activity. We used the endoscope to image striatal neurons from either the direct pathway or the indirect pathway in freely moving mice while activating any chosen neuron in the field of view. The endoscope also allows for the selection of neurons based on their relationship with specific animal behaviour, and to recreate the behaviour by mimicking the natural neural activity with photostimulation. The miniaturized endoscope may facilitate the study of how neural activity gives rise to behaviour in freely moving animals.

Unilateral dopamine (DA) depletion produces ipsiversive turning behaviour, and the injection of DA receptor agonists can produce contraversive turning, but the underlying mechanisms remain unclear. We conducted in vivo recording and pharmacological and optogenetic manipulations to study the role of DA and striatal output in turning behaviour. We used a video-based tracking programme while recording single unit activity in both putative medium spiny projection neurons (MSNs) and fast-spiking interneurons (FSIs) in the dorsal striatum bilaterally. Our results suggest that unilateral DA depletion reduced striatal output from the depleted side, resulting in asymmetric striatal output. Depletion systematically altered activity in both MSNs and FSIs, especially in neurons that increased firing during turning movements. Like D1 agonist SKF 38393, optogenetic stimulation in the depleted striatum increased striatal output and reversed biassed turning. These results suggest that relative striatal outputs from the two cerebral hemispheres determine the direction of turning: Mice turn away from the side of higher striatal output and towards the side of the lower striatal output.

Animals can learn to repeat behaviors to earn desired rewards, a process commonly known as reinforcement learning. While previous work has implicated the ascending dopaminergic projections to the basal ganglia in reinforcement learning, little is known about the role of the hippocampus. Here, we report that a specific population of hippocampal neurons and their dopaminergic innervation contribute to operant self-stimulation. These neurons are located in the dentate gyrus, receive dopaminergic projections from the locus coeruleus, and express D1 dopamine receptors. Activation of D1 + dentate neurons is sufficient for self-stimulation: mice will press a lever to earn optogenetic activation of these neurons. A similar effect is also observed with selective activation of the locus coeruleus projections to the dentate gyrus, and blocked by D1 receptor antagonism. Calcium imaging of D1 + dentate neurons revealed significant activity at the time of action selection, but not during passive reward delivery. These results reveal the role of dopaminergic innervation of the dentate gyrus in supporting operant reinforcement.

Animals can learn to repeat behaviors to earn desired rewards, a process commonly known as reinforcement learning. While previous work has implicated the ascending dopaminergic projections to the basal ganglia in reinforcement learning, little is known about the role of the hippocampus. Here we report that a specific population of hippocampal neurons and their dopaminergic innervation contribute to operant self-stimulation. These neurons are located in the dentate gyrus, receive dopaminergic projections from the locus coeruleus, and express D1 dopamine receptors. Activation of D1+ dentate neurons is sufficient for self-stimulation: mice will press a lever to earn optogenetic activation of these neurons. A similar effect is also observed with selective activation of the locus coeruleus projections to the dentate gyrus, and blocked by D1 receptor antagonism. Calcium imaging of D1+ dentate neurons revealed significant activity at the time of action selection, but not during passive reward delivery. These results reveal the role of dopaminergic innervation of the hippocampus in supporting operant reinforcement.

The ability to accurately determine when to perform an action is a fundamental brain function and vital to adaptive behavior. The behavioral mechanism and neural circuit for action timing, however, remain largely unknown. Using a new, self-paced action timing task in mice, we found that deprivation of auditory, but not somatosensory or visual input, disrupts learned action timing. The hearing effect was dependent on the auditory feedback derived from the animal’s own actions, rather than passive environmental cues. Neuronal activity in the secondary auditory cortex was found to be both correlated with and necessary for the proper execution of learned action timing. Closed-loop, action-dependent optogenetic stimulation of the specific task-related neuronal population within the secondary auditory cortex rescued the key features of learned action timing under auditory deprivation. These results unveil a previously underappreciated sensorimotor mechanism in which the secondary auditory cortex transduces self-generated audiomotor feedback to control action timing.

The subthalamic nucleus (STN), a diencephalic nucleus strongly connected with the basal ganglia, is a common target for deep brain stimulation (DBS) treatments of Parkinsonian motor symptoms. The STN is thought to suppress movement by enhancing inhibitory basal ganglia output via the indirect pathway, and disrupting STN output using DBS can restore movement in Parkinson’s patients. However, previous studies on STN DBS usually relied on electrical stimulation, which cannot selectively target STN output neurons. Moreover, most studies did not measure behavior precisely during STN manipulations. Here we selectively stimulated STN projection neurons, by expressing channelrhodopsin in vesicular glutamate transporter 2 (VGlut2)-positive projection neurons in the STN. We also quantified behavior in freely moving male mice with high spatial and temporal resolution using 3D motion capture at 200 frames per second. We found STN stimulation resulted in movements with very short latencies (10-15 ms). Unilateral stimulation quantitatively determines orientation, head yaw, and head roll consistently in the ipsiversive direction, toward thee side of stimulation. On the other hand, head raising (increased head pitch) was observed after stimulation on either side. Strikingly, a single pulse of light was sufficient to generate movement, and there was a highly linear relationship between stimulation frequency and kinematics. These results question the common assumption that STN suppresses movement; instead they suggest that STN output can precisely specific action parameters via direct projections to brainstem regions.

SummaryNeurogenesis and differentiation of the neural stem cells (NSCs) in the subventricular zone (SVZ) are controlled by cell-intrinsic molecular pathways that interact with extrinsic signaling cues. Here we identified a novel circuit that regulates neurogenesis and cellular proliferation in the lateral ventricle SVZ (LV-SVZ). Our results demonstrate direct glutamatergic inputs from the frontal cortex as well as local inhibitory interneurons, control the activity of distinctive cholinergic neurons in the subependymal zone (subep-ChAT+). In vivo optogenetic stimulation and inhibition in this circuit were sufficient to control local SVZ neurogenesis, LV NSCs proliferation, and SVZ cellular divisions in ventral SVZ. These findings shed light on local and distal neural circuit activity-dependent regulation of postnatal and adult SVZ neurogenesis and LV-SVZ cellular proliferation.

While in vivo calcium imaging makes it possible to record activity in defined neuronal populations with cellular resolution, optogenetics allows selective manipulation of neural activity. Recently, these two tools have been combined to stimulate and record neural activity at the same time, but current approaches often rely on two-photon microscopes that are difficult to use in freely moving animals, or one-photon fiberscopes with benchtop-based digital micromirror devices that limit system portability. To address these limitations, we have developed a new integrated system combining a one-photon endoscope and a digital micromirror device for simultaneous calcium imaging and precise optogenetic photo-stimulation (Miniscope with All-optical Patterned Stimulation and Imaging, MAPSI). Using this system, we were able to successfully image striatal neurons from either the direct pathway or the indirect pathway while simultaneously activating any neuron of choice within the field of view or synthesizing arbitrary spatio-temporal patterns of photo-stimulation in freely moving mice. We could also select neurons based on their relationship with behavior and recreate the behavior by mimicking the natural neural activity with photo-stimulation. MAPSI thus provides a powerful tool for in vivo interrogation of neural circuit function.

Significance Autism spectrum disorders (ASD) are heritable neurodevelopmental disorders affecting communication and behavior, and can include impaired intellectual ability. ASD is believed to result from altered synapse function and gene regulation. Among high-risk ASD genes, ANK2 is of particular interest since ANK2 mutations with an ASD diagnosis can occur with normal IQ. Here, we report that ASD ANK2 mutation in mice results in increased axon branching and ectopic connectivity associated with penetrant impairment in selected communicative and social behaviors combined with superior executive function. Thus, gain of axon branching is a candidate cellular mechanism to explain aberrant structural connectivity and dominantly inherited behavior that are compatible with normal intelligence and potentially can contribute to ASD and other forms of neurodiversity., Giant ankyrin-B (ankB) is a neurospecific alternatively spliced variant of ANK2, a high-confidence autism spectrum disorder (ASD) gene. We report that a mouse model for human ASD mutation of giant ankB exhibits increased axonal branching in cultured neurons with ectopic CNS axon connectivity, as well as with a transient increase in excitatory synapses during postnatal development. We elucidate a mechanism normally limiting axon branching, whereby giant ankB localizes to periodic axonal plasma membrane domains through L1 cell-adhesion molecule protein, where it couples microtubules to the plasma membrane and prevents microtubule entry into nascent axon branches. Giant ankB mutation or deficiency results in a dominantly inherited impairment in selected communicative and social behaviors combined with superior executive function. Thus, gain of axon branching due to giant ankB-deficiency/mutation is a candidate cellular mechanism to explain aberrant structural connectivity and penetrant behavioral consequences in mice as well as humans bearing ASD-related ANK2 mutations.

Selective activation of Pf-STN pathway initiates actions in normal mice and restores movement in a mouse model of PD., The parafascicular nucleus (Pf) of the thalamus provides major projections to the basal ganglia, a set of subcortical nuclei involved in action initiation. Here, we show that Pf projections to the subthalamic nucleus (STN), but not to the striatum, are responsible for movement initiation. Because the STN is a major target of deep brain stimulation treatments for Parkinson’s disease, we tested the effect of selective stimulation of Pf-STN projections in a mouse model of PD. Bilateral dopamine depletion with 6-OHDA created complete akinesia in mice, but Pf-STN stimulation immediately and markedly restored a variety of natural behaviors. Our results therefore revealed a functionally novel neural pathway for the initiation of movements that can be recruited to rescue movement deficits after dopamine depletion. They not only shed light on the clinical efficacy of conventional STN DBS but also suggest more selective and improved stimulation strategies for the treatment of parkinsonian symptoms.

Terrestrial locomotion presents tremendous computational challenges on account of the enormous degrees of freedom in legged animals, and the complex and unpredictable properties of the natural environment and the effectors. Yet the nervous system can achieve locomotion with ease. Here we introduce a quadrupedal robot capable of goal-directed posture control and locomotion over rough terrain. The underlying control architecture is a hierarchical network of simple negative feedback control systems inspired by the organization of the vertebrate nervous system. Without using an internal model or feedforward planning, and without any training, our robot shows robust posture control and locomotor behavior in novel environments with unpredictable disturbances.

Loss of sociability is a core symptom in autism spectrum disorder (ASD) that may arise from neural network dysconnectivity between multiple brain regions contributing to social behaviors. However, the pathogenic neural network mechanisms underlying social dysfunction of ASD are largely unknown. Here, we demonstrate that the circuit-selective mutation of ASD-risk Shank3 gene within a unidirectional neural circuit from the prefrontal cortex to the basolateral amygdala reduces sociability as well as elevates the neural activity and its amplitude-variability in the circuit, which is consistent with the neuroimaging results from human ASD patients. Moreover, the abnormal neural circuit activities reduce the temporal correlation of socially-tuned neurons to the events of social interactions and alter the intra-circuit functional network involved in social behaviors. Finally, optogenetic mimicry of the circuit hyperactivity recapitulates the reduced sociability of Shank3 ctMUT mice. Collectively these results highlight a circuit-level pathogenic mechanism of Shank3 mutation that drives social dysfunction

The ability to represent time in the brain relies on network interactions across multiple brain areas. While much attention has been paid to the role of prefrontal cortex and basal ganglia in timing, little work has been aimed towards understanding the role of the thalamus in timing. To this end, we utilized pharmacological and optogenetic techniques in mice to test the role of the mediodorsal nucleus of the thalamus (MD) in interval timing. The MD is strongly connected with the prefrontal cortex and receives major inputs from the basal ganglia output nuclei. We used an operant temporal production task, in which mice indicate their expected timing of available rewards by pressing a lever in anticipation. On probe trials, inactivation of the MD with muscimol produced rightward shifts in peak pressing as well as increases in peak spread, thus significantly altering both temporal accuracy and precision. Optogenetic inhibition of glutamatergic projection neurons in the MD resulted in similar changes in timing; the shift in peak time is proportional to the duration of inhibition. The observed effects were found to be independent of significant changes in movement. Taken together, these findings provide strong evidence for the importance of thalamo-cortical projections in maintaining proper timing behavior. Significance Statement While extensive research has been dedicated to the involvement of the prefrontal cortex in interval timing behavior, the degree to which thalamic inputs contribute to timing is unclear. Using pharmacological and optogenetic inhibition of the MD, a prefrontal projecting thalamic nucleus, we demonstrate a key role of this thalamic nucleus in timing behavior.

The dominant paradigm in neuroscience, the linear causation paradigm, has led to a number of conceptual confusions about how the brain generates behavior. Because biological organisms are collections of closed loop control systems, their behaviors cannot be explained by a sequence of causes and effects. On account of simultaneous actions of forward and feedback paths in the closed loop, a major emergent property of control systems is circular causation. Methods used to analyze input-output systems are not only inadequate for understanding circular causation; they can produce misleading results. I shall use specific examples from the history of neuroscience to illustrate the fallacy of the conventional input/output analysis of behavior. I shall also discuss why a seemingly simple mechanism like negative feedback control can have complex and counterintuitive properties, and why generations of students, influenced by modern engineering conventions and the cybernetic tradition, have misunderstood the central features of control theory.

Habits have been studied for decades, but it was not until recent years that experiments began to elucidate the underlying cellular and circuit mechanisms. The latest experiments have been enabled by advances in cell-type specific monitoring and manipulation of activity in large neuronal populations. Here we will review recent efforts to understand the neural substrates underlying habit formation, focusing on rodent studies on corticostriatal circuits.

Summary Terrestrial locomotion presents tremendous computational challenges on account of the enormous degrees of freedom in legged animals, and complex, unpredictable properties of natural environments, including the body and its effectors, yet the nervous system can achieve locomotion with ease. Here we introduce a quadrupedal robot that is capable of posture control and goal-directed locomotion across uneven terrain. The control architecture is a hierarchical network of simple negative feedback control systems inspired by the organization of the vertebrate nervous system. This robot is capable of robust posture control and locomotion in novel environments with unpredictable disturbances. Unlike current robots, our robot does not use internal inverse and forward models, nor does it require any training in order to perform successfully in novel environments., Graphical abstract, Highlights • Inspired by a neural hierarchy with control of input at each level • Higher level specifies reference state for lower level • Successful posture control and locomotion despite unpredictable disturbances • No need for training or computation of inverse or forward kinematics, Biological sciences; Neuroscience; Sensory neuroscience; Robotics

Summary: Huntington’s disease (HD) is caused by an autosomal dominant polyglutamine expansion mutation of Huntingtin (HTT). HD patients suffer from progressive motor, cognitive, and psychiatric impairments, along with significant degeneration of the striatal projection neurons (SPNs) of the striatum. HD is widely accepted to be caused by a toxic gain-of-function of mutant HTT. However, whether loss of HTT function, because of dominant-negative effects of the mutant protein, plays a role in HD and whether HTT is required for SPN health and function are not known. Here, we delete Htt from specific subpopulations of SPNs using the Cre-Lox system and find that SPNs require HTT for motor regulation, synaptic development, cell health, and survival during aging. Our results suggest that loss of HTT function in SPNs could play a critical role in HD pathogenesis. : Burrus et al. show that striatal projection neurons require Huntingtin, the gene mutated in Huntington’s disease, for normal synaptic connectivity, regulated gene expression, and neuronal survival with aging. Loss of Huntingtin from striatal neurons recapitulates several features of Huntington’s disease pathology, an important consideration for therapies non-specifically targeting Huntingtin expression. Keywords: Huntington's Disease, basal ganglia, striatum, synaptic connectivity, neuronal survival

The basal ganglia (BG) are the major subcortical nuclei in the brain. Disorders implicating the BG are characterized by diverse symptoms, but it remains unclear what these symptoms have in common or how they can be explained by changes in the BG circuits. This review summarizes recent findings that not only question traditional assumptions about the role of the BG in movement but also elucidate general computations performed by these circuits. To explain these findings, a new conceptual framework is introduced for understanding the role of the BG in behavior. According to this framework, the cortico-BG networks implement transition control in an extended hierarchy of closed loop negative feedback control systems. The transition control model provides a solution to the posture/movement problem, by postulating that BG outputs send descending signals to alter the reference states of downstream position control systems for orientation and body configuration. It also explains major neurological symptoms associated with BG pathology as a result of changes in system parameters such as multiplicative gain and damping.

This review is an attempt to explain the role of basal ganglia (BG) outputs in generating movements. Recent work showed that opponent outputs from the BG represent instantaneous body position coordinates during behavior. On the other hand, projection neurons in the striatum, the major input nucleus, as well as dopaminergic neurons that form the nigrostriatal pathway, can represent movement velocity. To explain these findings, a new model is proposed, in which the BG implement the level of transition control in an extended control hierarchy. BG outputs represent descending reference signals that command diverse lower-level position controllers. This model not only explains major neurological symptoms but also makes quantitative and testable predictions.

The basal ganglia have long been implicated in action initiation. Using three-dimensional motion capture, we quantified the effects of optogenetic stimulation of the striatonigral (direct) pathway on movement kinematics. We generated transgenic mice with channelrhodopsin-2 expression in striatal neurons that express the D1-like dopamine receptor. With optic fibres placed in the sensorimotor striatum, an area known to contain movement velocity-related single units, photo-stimulation reliably produced movements that could be precisely quantified with our motion capture programme. A single light pulse was sufficient to elicit movements with short latencies (< 30 ms). Increasing stimulation frequency increased movement speed, with a highly linear relationship. These findings support the hypothesis that the sensorimotor striatum is part of a velocity controller that controls rate of change in body configurations.

The tight balance between synaptic excitation and inhibition (E/I) within neocortical circuits in the mammalian brain is important for complex behavior. Many loss-of-function studies have demonstrated that brain-derived neurotrophic factor (BDNF) and its cognate receptor tropomyosin receptor kinase B (TrkB) are essential for the development of inhibitory GABAergic neurons. However, behavioral consequences of impaired BDNF/TrkB signaling in GABAergic neurons remain unclear, largely due to confounding motor function deficits observed in previous animal models. In this study, we generated conditional knockout mice (TrkB cKO) in which TrkB was ablated from a majority of corticolimbic GABAergic interneurons postnatally. These mice showed intact motor coordination and movement, but exhibited enhanced dominance over other mice in a group-housed setting. In addition, immature fast-spiking GABAergic neurons of TrkB cKO mice resulted in an E/I imbalance in layer 5 microcircuits within the medial prefrontal cortex (mPFC), a key region regulating social dominance. Restoring the E/I imbalance via optogenetic modulation in the mPFC of TrkB cKO mice normalized their social dominance behavior. Taken together, our results provide strong evidence for a role of BDNF/TrkB signaling in inhibitory synaptic modulation and social dominance behavior in mice.

Elucidating the neuronal mecha- nisms underlying movement disorders is a major chal- lenge because of the intricacy of the relevant neural circuits, which are characterized by diverse cell types and complex connectivity. A major limitation of traditional techniques, such as electrical stimulation or lesions, is that individual elements of a neural circuit cannot be selectively manipulated. Moreover, available treatments are largely based on trial and error rather than a detailed understanding of the circuit mechanisms. Gaps in our knowledge of the circuit mechanisms for movement dis- orders, as well as mechanisms underlying known treat- ments such as deep brain stimulation, make it difficult to design new and improved treatment options. In this per- spective, we discuss how optogenetics, which allows researchers to use light to manipulate neuronal activity, can contribute to the understanding and treatment of movement disorders. We outline the advantages and lim- itations of optogenetics and discuss examples of studies that have used this tool to clarify the role of the basal ganglia circuitry in movement. V C 2014 International Par- kinson and Movement Disorder Society

The basal ganglia (BG) are implicated in many movement disorders, yet how they contribute to movement remains unclear. Using wirelessin vivorecording, we measured BG output from the substantia nigra pars reticulata (SNr) in mice while monitoring their movements with video tracking. The firing rate of most nigral neurons reflected Cartesian coordinates (eitherx- ory-coordinates) of the animal's head position during movement. The firing rates of SNr neurons are either positively or negatively correlated with the coordinates. Using an egocentric reference frame, four types of neurons can be classified: each type increases firing during movement in a particular direction (left, right, up, down), and decreases firing during movement in the opposite direction. Given the high correlation between the firing rate and thexandycomponents of the position vector, the movement trajectory can be reconstructed from neural activity. Our results therefore demonstrate a quantitative and continuous relationship between BG output and behavior. Thus, a steady BG output signal from the SNr (i.e., constant firing rate) is associated with the lack of overt movement, when a stable posture is maintained by structures downstream of the BG. Any change in SNr firing rate is associated with a change in position (i.e., movement). We hypothesize that the SNr output quantitatively determines the direction, velocity, and amplitude of voluntary movements. By changing the reference signals to downstream position control systems, the BG can produce transitions in body configurations and initiate actions.

Axon initial segments (AISs) and nodes of Ranvier are sites of clustering of voltage-gated sodium channels (VGSCs) in nervous systems of jawed vertebrates that facilitate fast long-distance electrical signaling. We demonstrate that proximal axonal polarity as well as assembly of the AIS and normal morphogenesis of nodes of Ranvier all require a heretofore uncharacterized alternatively spliced giant exon of ankyrin-G (AnkG). This exon has sequence similarity to I-connectin/Titin and was acquired after the first round of whole-genome duplication by the ancestral ANK2/ANK3 gene in early vertebrates before development of myelin. The giant exon resulted in a new nervous system-specific 480-kDa polypeptide combining previously known features of ANK repeats and β-spectrin-binding activity with a fibrous domain nearly 150 nm in length. We elucidate previously undescribed functions for giant AnkG, including recruitment of β4 spectrin to the AIS that likely is regulated by phosphorylation, and demonstrate that 480-kDa AnkG is a major component of the AIS membrane "undercoat' imaged by platinum replica electron microscopy. Surprisingly, giant AnkG-knockout neurons completely lacking known AIS components still retain distal axonal polarity and generate action potentials (APs), although with abnormal frequency. Giant AnkG-deficient mice live to weaning and provide a rationale for survival of humans with severe cognitive dysfunction bearing a truncating mutation in the giant exon. The giant exon of AnkG is required for assembly of the AIS and nodes of Ranvier and was a transformative innovation in evolution of the vertebrate nervous system that now is a potential target in neurodevelopmental disorders.

The basal ganglia (BG) are a collection of subcortical nuclei critical for voluntary behavior. According to the standard model, the output projections from the BG tonically inhibit downstream motor centers and prevent behavior. A pause in the BG output opens the gate for behavior, allowing the initiation of actions. Hypokinetic neurological symptoms, such as inability to initiate actions in Parkinson’s disease, are explained by excessively high firing rates of the BG output neurons. This model, widely taught in textbooks, is contradicted by recent electrophysiological results, which are reviewed here. In addition, I also introduce a new model, based on the insight that behavior is a product of closed loop negative feedback control using internal reference signals rather than sensorimotor transformations. The nervous system is shown to be a functional hierarchy comprising independent controllers occupying different levels, each level controlling specific variables derived from its perceptual inputs. The BG represent the level of transition control in this hierarchy, sending reference signals specifying the succession of body orientations and configurations. This new model not only explains the major symptoms in movement disorders but also generates a number of testable predictions.

Genetic defects in the synaptic scaffolding protein gene, SHANK2, are linked to a variety of neuropsychiatric disorders, including autism spectrum disorders, schizophrenia, intellectual disability, and bipolar disorder, but the molecular mechanisms underlying the pleotropic effects of SHANK2 mutations are poorly understood. We generated and characterized a line of Shank2 mutant mice by deleting exon 24 (Δe24). Shank2Δe24-/- mice engage in significantly increased locomotor activity, display abnormal reward-seeking behavior, are anhedonic, have perturbations in circadian rhythms, and show deficits in social and cognitive behaviors. While these phenotypes recapitulate the pleotropic behaviors associated with human SHANK2-related disorders, major behavioral features in these mice are reminiscent of bipolar disorder. For instance, their hyperactivity was augmented with amphetamine but was normalized with the mood stabilizers lithium and valproate. Shank2 deficiency limited to the forebrain recapitulated the bipolar mania phenotype. The composition and functions of NMDA and AMPA receptors were altered at Shank2-deficient synapses, hinting toward the mechanism underlying these behavioral abnormalities. Human genetic findings support construct validity, and the behavioral features in Shank2 Δe24 mice support face and predictive validities of this model for bipolar mania. Further genetic studies to understand the contribution of SHANK2 deficiencies in bipolar disorder are warranted.

Summary Considerable evidence implicates the basal ganglia in interval timing, yet the underlying mechanisms remain poorly understood. Using a novel behavioral task, we demonstrate that head-fixed mice can be trained to show the key features of timing behavior within a few sessions. Single-trial analysis of licking behavior reveals stepping dynamics with variable onset times, which is responsible for the canonical Gaussian distribution of timing behavior. Moreover, the duration of licking bouts decreased as mice became sated, showing a strong motivational modulation of licking bout initiation and termination. Using optogenetics, we examined the role of the basal ganglia output in interval timing. We stimulated a pathway important for licking behavior, the GABAergic output projections from the substantia nigra pars reticulata to the deep layers of the superior colliculus. We found that stimulation of this pathway not only cancelled licking but also delayed the initiation of anticipatory licking for the next interval in a frequency-dependent manner. By combining quantitative behavioral analysis with optogenetics in the head-fixed setup, we established a new approach for studying the neural basis of interval timing.

Although the basal ganglia have long been implicated in the initiation of actions, their contribution to movement remains a matter of dispute. Using wireless multi-electrode recording and motion tracking, we examined the relationship between single-unit activity in the sensorimotor striatum and movement kinematics. We recorded single-unit activity from medium spiny projection neurons and fast-spiking interneurons while monitoring the movements of mice using motion tracking. In Experiment 1, we trained mice to generate movements reliably by water-depriving them and giving them periodic cued sucrose rewards. We found high correlations between single-unit activity and movement velocity in particular directions. This correlation was found in both putative medium spiny projection neurons and fast-spiking interneurons. In Experiment 2, to rule out the possibility that the observed correlations were due to reward expectancy, we repeated the same procedure but added trials in which sucrose delivery was replaced by an aversive air puff stimulus. The air puff generated avoidance movements that were clearly different from movements on rewarded trials, but the same neurons that showed velocity correlation on reward trials exhibited a similar correlation on air puff trials. These experiments show for the first time that the firing rate of striatal neurons reflects movement velocity for different types of movements, whether to seek rewards or to avoid harm.

Huntington's disease (HD) is a neurodegenerative disease caused by the expansion of a poly-glutamine (poly-Q) stretch in the huntingtin (Htt) protein. Gain-of-function effects of mutant Htt have been extensively investigated as the major driver of neurodegeneration in HD. However, loss-of-function effects of poly-Q mutations recently emerged as potential drivers of disease pathophysiology. Early synaptic problems in the excitatory cortical and striatal connections have been reported in HD, but the role of Htt protein in synaptic connectivity was unknown. Therefore, we investigated the role of Htt in synaptic connectivity in vivo by conditionally silencing Htt in the developing mouse cortex. When cortical Htt function was silenced, cortical and striatal excitatory synapses formed and matured at an accelerated pace through postnatal day 21 (P21). This exuberant synaptic connectivity was lost over time in the cortex, resulting in the deterioration of synapses by 5 weeks. Synaptic decline in the cortex was accompanied with layer- and region-specific reactive gliosis without cell loss. To determine whether the disease-causing poly-Q mutation in Htt affects synapse development, we next investigated the synaptic connectivity in a full-length knock-in mouse model of HD, the zQ175 mouse. Similar to the cortical conditional knock-outs, we found excessive excitatory synapse formation and maturation in the cortices of P21 zQ175, which was lost by 5 weeks. Together, our findings reveal that cortical Htt is required for the correct establishment of cortical and striatal excitatory circuits, and this function of Htt is lost when the mutant Htt is present.

Disorders implicating the basal ganglia are often characterized by postural deficits, but little is known about the role of the basal ganglia in posture control. Using wireless multi-electrode recording, we measured single unit activity from GABAergic and dopaminergic neurons in the substantia nigra as unrestrained mice stood on an elevated platform while introducing continuous postural disturbances in the roll plane. We found two major types of neurons - those activated by tilt to the left side of the body and suppressed by tilt to the right side, and others activated by tilt to the right side and suppressed by tilt to the left side. Contrary to the prevailing view that the basal ganglia output from the substantia nigra pars reticulata either inhibits or disinhibits downstream structures in an all or none fashion, we showed that it continuously sends anti-phase signals to their downstream targets. We also demonstrated for the first time that nigrostriatal dopaminergic transmission is modulated by postural disturbances.

Damage to the basal ganglia (BG) can produce diverse symptoms, such as neglect, abulia, akinesia, chorea, and tremor. Accordingly, these nuclei have been assigned diverse functions, but there is still no model that can explain the full range of BG contributions to behavior. Here I propose a new model of the BG based on the principles of hierarchical control. According to this model, the cerebral cortex and BG implement transition control, in particular the rate of change in various perceptual configurations. Each closed loop controller receives perceptual inputs representing the current rate of change and reference signals representing the desired rate. The BG outputs, in turn, generate transition errors to adjust the reference signals of position controllers in the midbrain and brainstem. The cortico-BG network also implements a special functional mode unique to the transition level of the control hierarchy, namely imagination. The imagination mode is the basis for planning, simulation, and working memory.

The timing of actions is critical for adaptive behavior. In this study we measured neural activity in the substantia nigra as mice learned to change their action duration to earn food rewards. We observed dramatic changes in single unit activity during learning: both dopaminergic and GABAergic neurons changed their activity in relation to behavior to reflect the learned instrumental contingency and the action duration. We found the emergence of “action-on” neurons that increased firing for the duration of the lever press and mirror-image “action-off” neurons that paused at the same time. This pattern is especially common among GABAergic neurons. The activity of many neurons also reflected confidence about the just completed action and the prospect of reward. Being correlated with the relative duration of the completed action, their activity could predict the likelihood of reward collection. Compared with the GABAergic neurons, the activity of dopaminergic neurons was more commonly modulated by the discriminative stimulus signaling the start of each trial, suggesting that their phasic activity reflected sensory salience rather than any reward prediction error found in previous work. In short, these results suggest that (1) nigral activity is highly plastic and modified by the learning of the instrumental contingency; (2) GABAergic output from the substantia nigra can simultaneously inhibit and disinhibit downstream structures, while the dopaminergic output also provide bidirectional modulation of the corticostriatal circuits; (3) dopaminergic and GABAergic neurons show similar task-related activity, although DA neurons are more responsive to the trial start signal.

Central to the production of adaptive behavior is the ability to learn the temporal order of behavioral elements (e.g., A, B, C). Yet little is known about neural substrates of serial order in self-initiated behavioral sequences. The present study assessed the contributions of specific dorsal striatal regions to the acquisition of serial order in mice, using a two-action sequence task without instructive cues. Excitotoxic lesions of the sensorimotor (dorsolateral) striatum dramatically impaired the acquisition of a simple sequence; in contrast, lesions of the associative (dorsomedial) striatum had no significant effect. Neither lesion caused gross motor impairments or affected the learning of nonsequential actions. These results demonstrate for the first time a critical role of the sensorimotor striatum in the learning of serial order.

In the version of this article initially published, ORCID links were missing for authors Erica Rodriguez, Koji Toda and Fan Wang. The error has been corrected in the HTML and PDF versions of the article.

The learning of new skills is characterized by an initial phase of rapid improvement in performance and a phase of more gradual improvements as skills are automatized and performance asymptotes. Using in vivo striatal recordings, we observed region-specific changes in neural activity during the different phases of skill learning, with the associative or dorsomedial striatum being preferentially engaged early in training and the sensorimotor or dorsolateral striatum being engaged later in training. Ex vivo recordings from medium spiny striatal neurons in brain slices of trained mice revealed that the changes observed in vivo corresponded to regional- and training-specific changes in excitatory synaptic transmission in the striatum. Furthermore, the potentiation of glutamatergic transmission observed in dorsolateral striatum after extensive training was preferentially expressed in striatopallidal neurons, rather than striatonigral neurons. These findings demonstrate that region- and pathway-specific plasticity sculpts the circuits involved in the performance of the skill as it becomes automatized.

Neurotensin is a peptide that has been suggested to mimic the actions of antipsychotics, but little is known about how it affects synaptic transmission in the striatum, the major input nucleus of the basal ganglia. In this study we measured the effects of neurotensin on EPSCs from medium spiny projection neurons in the sensorimotor striatum, a region implicated in habit formation and control of motor sequences. We found that bath-applied neurotensin reduced glutamate release from presynaptic terminals, and that this effect required retrograde endocannabinoid signaling, as it was prevented by the CB1 cannabinoid receptor antagonist AM251. Neurotensin-mediated inhibition of striatal EPSCs was also blocked by antagonists of D2-like dopamine receptors and group I metabotropic glutamate receptors, as well as by intracellular calcium chelation and phospholipase C inhibition. These results suggest that neurotensin can indirectly engage an endocannabinoid-mediated negative feedback signal to control glutamatergic input to the basal ganglia.

The striatum is a critical structure for the control of voluntary behaviour, and striatal synaptic plasticity has been implicated in instrumental learning. As ethanol consumption can cause impairments in cognition, learning, and action selection, it is important to understand the effects of this drug on striatal function. In this study we examined the effects of ethanol on long-term synaptic plasticity in the dorsomedial striatum (DMS), a striatal subregion that plays a central role in the acquisition and selection of goal-directed actions. Ethanol was found to impair N-methyl-d-aspartic acid receptor (NMDAR)-dependent long-term potentiation (LTP) dosedependently in the DMS, and to promote long-term depression (LTD) at the highest concentration (50 mm) used. These results suggest that ethanol, at a concentration usually associated with mild intoxication, could significantly change experience-dependent modification of corticostriatal circuits underlying the learning of goal-directed instrumental actions.

Long-term depression (LTD) at the corticostriatal synapse is postsynaptically induced but presynaptically expressed, the depression being a result of retrograde endocannabinoid signaling that activates presynaptic cannabinoid CB1receptors and reduces the probability of glutamate release. To study the role of protein synthesis in striatal LTD, we used a striatum-only preparation in which the presynaptic cell body is cut off, leaving intact only its axons, whose terminals synapse on medium spiny neurons. LTD (duration >150 min) was induced in this preparation, thus providing evidence that transcription in the presynaptic cell nucleus is not necessary for this form of plasticity. The maintenance of striatal LTD, however, was blocked by bath application of protein translation inhibitors but not by the same inhibitors loaded into the postsynaptic cell. These results suggest that local translation is critical for the expression of striatal LTD, distinguishing this form of mammalian synaptic plasticity from other forms that require postsynaptic protein synthesis. Possible roles of axonal or glial translation in striatal LTD are considered.

Long-term depression (LTD) of the synapse formed between cortical pyramidal neurons and striatal medium spiny neurons is central to many theories of motor plasticity and associative learning. The induction of LTD at this synapse is thought to depend upon D(2) dopamine receptors localized in the postsynaptic membrane. If this were true, LTD should be inducible in neurons from only one of the two projection systems of the striatum. Using transgenic mice in which neurons that contribute to these two systems are labeled, we show that this is not the case. Rather, in both cell types, the D(2) receptor dependence of LTD induction reflects the need to lower M(1) muscarinic receptor activity-a goal accomplished by D(2) receptors on cholinergic interneurons. In addition to reconciling discordant tracts of the striatal literature, these findings point to cholinergic interneurons as key mediators of dopamine-dependent striatal plasticity and learning.

Elucidating the neuronal mechanisms underlying movement disorders is a major challenge because of the intricacy of the relevant neural circuits, which are characterized by diverse cell types and complex connectivity. A major limitation of traditional techniques, such as electrical stimulation or lesions, is that individual elements of a neural circuit cannot be selectively manipulated. Moreover, available treatments are largely based on trial and error rather than a detailed understanding of the circuit mechanisms. Gaps in our knowledge of the circuit mechanisms for movement disorders, as well as mechanisms underlying known treatments such as deep brain stimulation, make it difficult to design new and improved treatment options. In this perspective, we discuss how optogenetics, which allows researchers to use light to manipulate neuronal activity, can contribute to the understanding and treatment of movement disorders. We outline the advantages and limitations of optogenetics and discuss examples of studies that have used this tool to clarify the role of the basal ganglia circuitry in movement.

Considerable evidence suggests that, in instrumental conditioning, rats learn the relationship between actions and their specific consequences or outcomes. The present study examined the role of the dorsomedial striatum (DMS) in this type of learning after excitotoxic lesions and reversible, muscimol-induced inactivation. In three experiments, rats were first trained to press two levers for distinct outcomes, and then tested after training using a variety of behavioural assays that have been established to detect action-outcome learning. In Experiment 1, pre-training lesions of the posterior DMS abolished the sensitivity of rats' instrumental performance to both outcome devaluation and contingency degradation when tested in extinction, whereas lesions of the anterior DMS had no effect. In Experiment 2, both pre-training and post-training lesions of the posterior DMS were equally effective in reducing the sensitivity of performance both to devaluation and degradation treatments. In Experiment 3, the infusion of muscimol into the posterior DMS selectively abolished sensitivity of performance to devaluation and contingency degradation without impairing the ability of rats to discriminate either the instrumental actions performed or the identity of the earned outcomes. Taken together, these results suggest that the posterior region of the DMS is a crucial neural substrate for the acquisition and expression of action-outcome associations in instrumental conditioning.

Although there is consensus that instrumental conditioning depends on the encoding of action-outcome associations, it is not known where this learning process is localized in the brain. Recent research suggests that the posterior dorsomedial striatum (pDMS) may be the critical locus of these associations. We tested this hypothesis by examining the contribution of N-methyl-D-aspartate receptors (NMDARs) in the pDMS to action-outcome learning. Rats with bilateral cannulae in the pDMS were first trained to perform two actions (left and right lever presses), for sucrose solution. After the pre-training phase, they were given an infusion of the NMDA antagonist 2-amino-5-phosphonopentanoic acid (APV, 1 mg/mL) or artificial cerebral spinal fluid (ACSF) before a 30-min session in which pressing one lever delivered food pellets and pressing the other delivered fruit punch. Learning during this session was tested the next day by sating the animals on either the pellets or fruit punch before assessing their performance on the two levers in extinction. The ACSF group selectively reduced responding on the lever that, in training, had earned the now devalued outcome, whereas the APV group did not. Experiment 2 replicated the effect of APV during the critical training session but found no effect of APV given after acquisition and before test. Furthermore, Experiment 3 showed that the effect of APV on instrumental learning was restricted to the pDMS; infusion into the dorsolateral striatum did not prevent learning. These experiments provide the first direct evidence that, in instrumental conditioning, NMDARs in the dorsomedial striatum are involved in encoding action-outcome associations.

Habits are controlled by antecedent stimuli rather than by goal expectancy. Interval schedules of feedback have been shown to generate habits, as revealed by the insensitivity of behaviour acquired under this schedule to outcome devaluation treatments. Two experiments were conducted to assess the role of the dorsolateral striatum in habit learning. In Experiment 1, sham operated controls and rats with dorsolateral striatum lesions were trained to press a lever for sucrose under interval schedules. After training, the sucrose was devalued by inducing taste aversion to it using lithium chloride, whereas saline injections were given to the controls. Only rats given the devaluation treatment reduced their consumption of sucrose and this reduction was similar in both the sham and the lesioned groups. All rats were then returned to the instrumental chamber for an extinction test, in which the lever was extended but no sucrose was delivered. In contrast to sham operated controls, rats with dorsolateral striatum lesions refrained from pressing the lever if the outcome was devalued. To assess the specificity of the role of dorsolateral striatum in this effect a second experiment was conducted in which a group with lesions of dorsomedial striatum was added. In relation now to both the sham and the dorsomedial lesioned groups, only rats with lesions of dorsolateral striatum significantly reduced responding after outcome devaluation. In conclusion, this study provides direct evidence that the dorsolateral striatum is necessary for habit formation. Furthermore, it suggests that, when the habit system is disrupted, control over instrumental performance reverts to the system controlling the performance of goal-directed instrumental actions.

This chapter reviews the mechanisms underlying reward-guided behavior and their implications for alcohol addiction. It can be divided into three parts. First, I review recent innovations in the analysis of goal-directed behavior using instrumental conditioning procedures and outline a model of motivated behavior based on hierarchical negative-feedback control systems. Secondly, I describe the anatomy and function of the cerebral cortico-basal ganglia networks, the neural implementations of motivational and motor-control hierarchies. And finally, I discuss the implications of the hierarchical model for our understanding of addiction in general and alcohol addiction in particular.

The dopaminergic projections to the basal ganglia have long been implicated in reward-guided behavior and decision-making, yet little is known about the role of the posterior pedunculopontine nucleus (pPPN), a major source of excitatory input to the mesolimbic dopamine system. Here we studied the contributions of the pPPN to decision-making under risk, using excitoxic lesions and reversible inactivation in rats. Rats could choose between two options - a small but certain reward on one lever; or a large but uncertain reward on the other lever. The overall payoff associated with each choice is the same, but the reward variance (risk) associated with the risky choice is much higher. In Experiment 1, we showed that excitotoxic lesions of the pPPN before training did not affect acquisition of lever pressing. But whereas the controls strongly preferred the safe choice, the lesioned rats did not. In Experiment 2, we found that muscimol inactivation of the pPPN also produced similar effects, but reversibly. These results show that permanent lesions or reversible inactivation of the pPPN both abolish risk aversion in decision-making.

Recent work on the role of overlapping cerebral networks in action selection and habit formation has important implications for alcohol addiction research. As reviewed below, (1) these networks, which all involve a group of deep-brain structures called the basal ganglia, are associated with distinct behavioral control processes, such as reward-guided Pavlovian conditional responses, goal-directed instrumental actions, and stimulus-driven habits; (2) different stages of action learning are associated with different networks, which have the ability to change (i.e., plasticity); and (3) exposure to alcohol and other addictive drugs can have profound effects on these networks by influencing the mechanisms underlying neural plasticity.