Search

Despite being unpredictable and uncertain, reward environments often exhibit certain regularities, and animals navigating these environments try to detect and utilize such regularities to adapt their behavior. However, successful learning requires that animals also adjust to uncertainty associated with those regularities. Here, we analyzed choice data from two comparable dynamic foraging tasks in mice and monkeys to investigate mechanisms underlying adjustments to different types of uncertainty. In these tasks, animals selected between two choice options that delivered reward probabilistically, while baseline reward probabilities changed after a variable number (block) of trials without any cues to the animals. To measure adjustments in behavior, we applied multiple metrics based on information theory that quantify consistency in behavior, and fit choice data using reinforcement learning models. We found that in both species, learning and choice were affected by uncertainty about reward outcomes (in terms of determining the better option) and by expectation about when the environment may change. However, these effects were mediated through different mechanisms. First, more uncertainty about the better option resulted in slower learning and forgetting in mice, whereas it had no significant effect in monkeys. Second, expectation of block switches accompanied slower learning, faster forgetting, and increased stochasticity in choice in mice, whereas it only reduced learning rates in monkeys. Overall, while demonstrating the usefulness of entropy-based metrics in studying adaptive behavior, our study provides evidence for multiple types of adjustments in learning and choice behavior according to uncertainty in the reward environment.

The entorhinal cortex (EC) is the main interface between the hippocampus and the neocortex. The EC plays a critical role in learning and memory. We investigated the neuronal representation of behavioral events during operant learning in the hippocampal-entorhinal circuit of head-fixed rats. Both CA1 and lateral entorhinal cortex (LEC) neurons develop task-related activities after learning. Among diverse task-related activities, we compared the transient peak activities that represent action and reward and found a distinct difference in the timing of behavioral event representation between CA1 and LEC. CA1 represents action and reward events in close to real-time, whereas both the superficial and deep layers of the LEC showed delayed representation of those events. Our results suggest that subpopulations exist within which CA1 and LEC neurons process the information in a different order from the anatomically defined hippocampal-entorhinal circuit.

Category-based thinking is a fundamental form of logical thinking. Here, we aimed to investigate its neural process at the local circuit level in the prefrontal cortex (PFC). We recorded single-unit PFC activity while male monkeys (Macaca fuscata) performed a task in which the category and rule were prerequisites of logical thinking and the outcome contingency was its consequence. Different groups of neurons coded a single type of information discretely or multiple types in a transitional form. Results of time-by-time analysis of neuronal activity suggest an information flow from category-coding and rule-coding neurons to transitional intermediate neurons, and then to contingency-coding neurons. Category-coding, rule-coding, and contingency-coding neurons showed stable coding of information, whereas intermediate neurons showed dynamic coding, as if it integrated category and rule to derive contingency. A similar process was confirmed by using a spiking neural network model that consisted of subnetworks coding category and rule on the input layer and those coding contingency on the output layer, with a subnetwork for integration in the intermediate layer. These results suggest that category-based logical thinking is realized in the PFC by separated neural populations organized for working in a feedforward manner. SIGNIFICANCE STATEMENT To elucidate the neural process for logical thinking, we combined an in-depth analysis of single-unit activity data with a biologically plausible computational model. Results of time-by-time analysis of prefrontal neuronal activity suggest an information flow from category-coding and rule-coding neurons to transitional intermediate neurons, and then to contingency-coding neurons. Category-coding, rule-coding, and contingency-coding neurons showed stable coding, whereas intermediate neurons showed dynamic coding, as if they integrated category and rule to derive contingency. A spiking neural network model reproduced similar temporal changes of information as the recorded neuronal data. Our results suggest that the prefrontal cortex (PFC) is critically involved in category-based thought process, and this process may be produced by separated neural populations organized for working in a feedforward manner.

The medial frontal cortex (MFC), especially its ventral part, has long been of great interest with respect to the pathology of mood disorders. A number of human brain imaging studies have demonstrated the abnormalities of this brain region in patients with mood disorders, however, whether it is critically and causally involved in the pathogenesis of such disorders remains to be fully elucidated. In this study, we examined how the suppression of neural activity in the ventral region of the MFC (vMFC) affects the behavioral and physiological states of monkeys by using repetitive transcranial magnetic stimulation (rTMS). By using low-frequency rTMS (LF-rTMS) as an inhibitory intervention, we found that LF-rTMS targeting the vMFC temporarily induced a depression-like state in monkeys, which was characterized by a reduced movement activity level, impaired sociability, and decreased motivation level, as well as increased plasma cortisol level. On the other hand, no such significant changes in behavioral and physiological states were observed when targeting the other MFC regions, dorsal or posterior. We further found that the administration of an antidepressant agent, ketamine, ameliorated the abnormal behavioral and physiological states induced by the LF-rTMS intervention. These findings causally indicate the involvement of the vMFC in the regulation of mood and the validity of the LF-rTMS-induced dysfunction of the vMFC as a nonhuman primate model of depression.

The medial frontal cortex (MFC), especially its ventral part, has long been of great interest with respect to the pathology of mood disorders. A number of human brain imaging studies have demonstrated the abnormalities of this brain region in patients with mood disorders, however, whether it is critically involved in the pathogenesis of such disorders remains to be fully elucidated. In this study, we conducted a causal study to investigate how the suppression of neural activity in the ventral region of the MFC (vMFC) affects the behavioral and physiological states of monkeys by using repetitive transcranial magnetic stimulation (rTMS). By using low-frequency rTMS (LF-rTMS) as an inhibitory intervention, we found that LF-rTMS targeting the vMFC induced a depression-like state in monkeys, which was characterized by a reduced spontaneous behavioral activity, increased plasma cortisol level, impaired sociability, and decreased motivation level. On the other hand, no such significant changes in behavioral and physiological states were observed when targeting the other MFC regions, dorsal or posterior. We further found that the administration of an antidepressant agent, ketamine, ameliorated the abnormal behavioral and physiological states induced by the LF-rTMS intervention. These findings indicate the causal involvement of the vMFC in the regulation of mood and affect and the validity of the LF-rTMS-induced dysfunction of the vMFC as a nonhuman primate model of the depression-like state.

Repetitive transcranial magnetic stimulation (rTMS) is now widely used as a means of neuromodulation, but the details of the mechanisms by which rTMS works remain unclarified. As a step forward to unveiling the neural phenomena occurring underneath the TMS coil, we conducted an electrophysiological study using awake and unanesthetized monkeys with subdural electrocorticogram (ECoG) electrodes implanted over the primary motor cortex (MI). We evaluated the effects of low-frequency (1 Hz) and high-frequency (10 Hz) rTMS on the resting-state ECoG signals in the stimulated MI, as well as the motor evoked potentials (MEPs) in the contralateral hand. Following the 1-Hz rTMS application, the ECoG beta band power and the MEP amplitude were significantly decreased. Following the 10-Hz rTMS application, the ECoG high-gamma power and the MEP amplitude significantly increased. Given that beta and high-gamma activities in the ECoG reflect the synchronous firing and the firing frequency of cell assemblies, respectively, in local neural circuits, these results suggest that low-frequency rTMS inhibits neural activity by desynchronizing the firing activity of local circuits, whereas high-frequency rTMS facilitates neural activity by increasing the firing rate of cell assemblies in the local circuits.

Methylphenidate (MPH; trade name Ritalin) is a widely used drug for the treatment of attention deficit hyperactivity disorder (ADHD) and is often used as a cognitive enhancer. Because MPH increases dopamine (DA) release by blocking the DA transporter in the human striatum, MPH is supposed to work on attention and cognition through a DA increase in the striatum. However, ADHD patients show impaired prefrontal cortex (PFC) function and MPH administration is associated with increased neural activity in the PFC. Although MPH is indicated to increase DA release in the rat PFC, there has been no study to examine MPH-induced DA changes in the human PFC because of technical difficulties associated with the low level of PFC DA receptors. Using the microdialysis technique, we examined the effects of oral administration of MPH on DA release in both the PFC and striatum in the monkey. We also tested the effect of MPH on cognitive task performance. As in human studies, in the striatum, both high and low doses of MPH induced consistent increases in DA release ∼30 min after their administrations. In the PFC, a consistent increase in DA release was observed 1 h after a high dose, but not low doses, of MPH. Low doses of MPH improved cognitive task performance, but a high dose of MPH made the monkey drowsy. Therefore, low-dose MPH-induced cognitive enhancement is supported by striatum DA increase.SIGNIFICANCE STATEMENTMethylphenidate (MPH) is a widely used drug for the treatment of attention deficit hyperactivity disorder and is often used as a cognitive enhancer. Although human positron emission tomography studies suggest that MPH works on attention and cognition through dopamine (DA) changes in the striatum, there has been no study to examine MPH-induced DA changes in the human prefrontal cortex (PFC). Using the microdialysis technique in monkeys, we found, for the first time, that low doses of MPH consistently increased DA release in the striatum but did not in the PFC. Cognitive enhancement effects of low doses of MPH are supposed to be supported by the striatum DA increase.

Risk derives from the variation of rewards and governs economic decisions, yet how the brain calculates risk from the frequency of experienced events, rather than from explicit risk-descriptive cues, remains unclear. Here, we investigated whether neurons in dorsolateral prefrontal cortex process risk derived from reward experience. Monkeys performed in a probabilistic choice task in which the statistical variance of experienced rewards evolved continually. During these choices, prefrontal neurons signaled the reward-variance associated with specific objects (‘object risk’) or actions (‘action risk’). Crucially, risk was not derived from explicit, risk-descriptive cues but calculated internally from the variance of recently experienced rewards. Support-vector-machine decoding demonstrated accurate neuronal risk discrimination. Within trials, neuronal signals transitioned from experienced reward to risk (risk updating) and from risk to upcoming choice (choice computation). Thus, prefrontal neurons encode the statistical variance of recently experienced rewards, complying with formal decision variables of object risk and action risk.

A functional category is a set of stimuli that are regarded as equivalent independently of their physical properties and elicit the same behavioral responses. Major psychological theories suggest the ability to form and utilize functional categories as a basis of higher cognition that markedly increases behavioral flexibility. Vaughan claimed the category use in pigeons on the basis of partition, a mathematical criterion for equivalence, however, there have been some criticisms that the evidence he showed was insufficient. In this study, by using a group reversal task, a procedure originally used by Vaughan, we aimed to gather further evidence to prove the category use in animals. Macaque monkeys, which served as subjects in our study, could efficiently perform the task not only with familiar stimulus sets as Vaughan demonstrated but also with novel sets, and furthermore the task performance was stable even when the number of stimuli in a set was increased, which we consider as further evidence for the category use in animals. In addition, by varying the timing of the reversal, we found that a category formation takes place soon after encountering new stimuli, i.e. in a few blocks of trial after a novel stimulus set was introduced. ispartof: SCIENTIFIC REPORTS vol:8 issue:1 ispartof: location:England status: published

Summary: Layer V of the entorhinal cortex (EC) receives input from the hippocampus and originates main entorhinal outputs. The deep-sublayer Vb, immunopositive for the transcription factor Ctip2, is thought to be the main recipient of hippocampal projections, whereas the superficial-sublayer LVa, immunonegative for Ctip2, originates the main outputs of EC. This disrupts the proposed role of EC as mediating hippocampal-cortical interactions. With the use of specific (trans)synaptic tracing approaches, we report that, in medial entorhinal cortex, layer Vb neurons innervate neurons in layers Va, II, and III. A similar circuitry exists in the lateral entorhinal cortex. We conclude that EC-layer Vb neurons mediate two circuits in the hippocampus-memory system: (1) a hippocampal output circuit to telencephalic areas by projecting to layer Va and (2) a feedback projection, sending information back to the EC-hippocampal loop via neurons in layers II and III. : Ohara et al. demonstrate the intrinsic connectivity of layer Vb neurons of both the medial and lateral entorhinal cortex. Layer Vb neurons are key elements of two circuits in the hippocampus-memory system: a hippocampal-output circuit and a feedback loop to the hippocampus. Keywords: parahippocampus, rodent, interlaminar connectivity, hippocampal-entorhinal connections, hippocampal-cortical connections

Nature Communications 7: Article number: 12554 (2016); Published: 13 September 2016; Updated: 23 November 2017. The previously published version of this Article contained an error in Figure 1. In panel b the x and y axis labels of the scatter graph were inadvertently inverted. This error has been corrected in both the PDF and HTML versions of the Article.

Multi-unit recording has been one of the most widely used techniques to investigate the correlation between multiple neuronal activities and behavior. However, a common problem of currently used multi-channel electrodes is their physical weakness. In this study, we developed a novel multi-channel electrode with sufficient physical strength to penetrate a thickened dura mater. This electrode consists of low-cost materials and is easily fabricated, and it enables recording without removing dura mater, thereby reducing the risk of inflammation, infection, or brain herniation. The low-cost multi-channel electrode developed in this study would be a useful tool for chronic recording in behaving animals.

Neural mechanisms of working memory, particularly its visuospatial aspect, have long been studied in non-human primates. On the other hand, rodents are becoming more important in systems neuroscience, as many of the innovative research methods have become available for them. There has been a question on whether primates and rodents have similar neural backgrounds for working memory. In this article, we carried out a comparative overview of the neural mechanisms of visuospatial working memory in monkeys and rats. In monkeys, a number of lesion studies indicate that the brain region most responsible for visuospatial working memory is the ventral dorsolateral prefrontal cortex (vDLPFC), as the performance in the standard tests for visuospatial working memory, such as delayed response and delayed alternation tasks, are impaired by lesions in this region. Single-unit studies revealed a characteristic firing pattern in neurons in this area, a sustained delay activity. Further studies indicated that the information maintained in the working memory, such as cue location and response direction in a delayed response, is coded in the sustained delay activity. In rats, an area comparable to the monkey vDLPFC was found to be the dorsal part of the medial prefrontal cortex (mPFC), as the delayed alternation in a T-maze is impaired by its lesion. Recently, the sustained delay activity similar to that found in monkeys has been found in the dorsal mPFC of rats performing the delayed response task. Furthermore, anatomical studies indicate that the vDLPFC in monkeys and the dorsal mPFC in rats have much in common, such as that they are both the major targets of parieto-frontal projections. Thus lines of evidence indicate that in both monkeys and rodents, the PFC plays a critical role in working memory.

In order to make a direct link between the morphological and functional study of the nervous system, we established an experimental protocol for labeling individual neurons persistently without microscopic guidance by injecting a plasmid encoding fluorescent protein electroporatively after recording their activity extracellularly. Using a glass pipette filled with electrolyte solution containing a plasmid encoding green fluorescent protein (GFP), single-neuron recording and electroporation were performed on anesthetized rats. When performing the electroporation at the completion of recording, the degree of contact between the target neuron and the electrode tip was adjusted by monitoring the change of the trace of recorded action potentials and the increase of electrode resistance. The expression of GFP and its immunostaining with a polyclonal antibody enabled us to clearly see the basic structural components such as cell bodies, axons, dendrites, and even smaller components such as spines. Identification of the morphological subtypes of neurons was possible with every labeled neuron. The optimum condition for labeling was a 30% increase of the electrode resistance, and the labeling success rate evaluated 3 days after labeling was 40%. The rate evaluated one month after labeling was only slightly lower (33%). We also confirmed experimentally that this recording and labeling procedure can be similarly successful in head-fixed behaving rats. This new experimental protocol will be a breakthrough in systems neuroscience because it makes a direct link between the morphology and behavior-related activity of single neurons.

Humans, monkeys, and other animals are considered to have the cognitive ability to use functional categories—that is, stimulus groups based on functional equivalence independent of physical properties. To investigate the underlying neural mechanisms of the use of functional categories, we recorded single-unit activity in the prefrontal cortex of monkeys performing a behavioral task in which the rule-dependent usage of functional category was needed to select an appropriate response. We found a neural correlate of functional categories on the single-neuron level and found that category information is coded independently of other task-relevant information such as rule and contingency information. Analysis of the time course of the information activation suggested that contingency information used for action selection is derived by integrating incoming category information with rule information maintained throughout a session. Such neural computation can be considered as the neural background of flexible behavioral control based on category and rule.SIGNIFICANCE STATEMENTPerceptual categories are based on perceptual similarity, whereas functional categories are based on functional equivalence independently of their physical properties. The neural background of perceptual categories has been investigated in a number of studies, but that of functional categories has been investigated in only a few. In the present study, we found neural correlates of functional categories on the single-neuron level. Further analysis suggested that functional category information and rule information is integrated within the prefrontal cortex to derive contingency information necessary for action selection. This study has shown how the brain uses the category to select an action appropriate to the behavioral context.

The architectonic subdivisions of the brain are believed to be functional modules, each processing parts of global functions. Previously, we showed that neurons in different regions operate in different firing regimes in monkeys. It is possible that firing regimes reflect differences in underlying information processing, and consequently the firing regimes in homologous regions across animal species might be similar. We analyzed neuronal spike trains recorded from behaving mice, rats, cats, and monkeys. The firing regularity differed systematically, with differences across regions in one species being greater than the differences in similar areas across species. Neuronal firing was consistently most regular in motor areas, nearly random in visual and prefrontal/medial prefrontal cortical areas, and bursting in the hippocampus in all animals examined. This suggests that firing regularity (or irregularity) plays a key role in neural computation in each functional subdivision, depending on the types of information being carried.SIGNIFICANCE STATEMENTBy analyzing neuronal spike trains recorded from mice, rats, cats, and monkeys, we found that different brain regions have intrinsically different firing regimes that are more similar in homologous areas across species than across areas in one species. Because different regions in the brain are specialized for different functions, the present finding suggests that the different activity regimes of neurons are important for supporting different functions, so that appropriate neuronal codes can be used for different modalities.

Abrupt onsets of visual cues capture an observer's attention, even when the cues do not reach the observer's visual awareness. In the present study, we investigated the effects of subthreshold cues on the performance of a useful field of view task. Participants localized a target stimulus presented in the peripheral visual field while identifying a character presented at the fovea. Before the presentation of central and peripheral targets, a suprathreshold or subthreshold cue indicating a likely location of the peripheral target was presented. We found that the suprathreshold cue led to both a benefit in the valid trials and cost in the invalid trials, while the subthreshold cue produced only a benefit in the valid trials without a cost in the invalid trials. Similar patterns of results were also observed when the cue preceded the targets by 10–200 ms, although a small cost was observed for the 12 deg eccentricity at the stimulus onset asynchronies of 50 ms and 100 ms in the subthreshold condition. These results indicate that attentional capture occurs without awareness of the cue and suggest that the effect of the cue on the spatial shift of attention would be different between the suprathreshold and subthreshold conditions.

In the current theory of learning, the reward prediction error (RPE), the difference between expected and received reward, is thought to be a key factor in reward-based learning, working as a teaching signal. The activity of dopamine neurons is known to code RPE, and the release of dopamine is known to modify the strength of synaptic connectivity in the target neurons. A fundamental interest in current neuroscience concerns the origin of RPE signals in the brain. Here, we show that a group of rat striatal neurons show a clear parametric RPE coding similar to that of dopamine neurons when tested under probabilistic pavlovian conditioning. Together with the fact that striatum and dopamine neurons have strong direct and indirect fiber connections, the result suggests that the striatum plays an important role in coding RPE signal by cooperating with dopamine neurons.