Search

Background: Physiological experiments have shown that the mean arterial blood pressure (MAP) can not be regulated after chemo and cardiopulmonary receptor denervation. Neuro-physiological information suggests that the nucleus tractus solitarius (NTS) is the only structure that receives information from its rostral neural nuclei and from the cardiovascular receptors and projects to nuclei that regulate the circulatory variables.Methods: From a control theory perspective, to answer if the cardiovascular regulation has a set point, we should find out whether in the cardiovascular control there is something equivalent to a comparator evaluating the error signal (between the rostral projections to the NTS and the feedback inputs). The NTS would function as a comparator if: a) its lesion suppresses cardiovascular regulation; b) the negative feedback loop still responds normally to perturbations (such as mechanical or electrical) after cutting the rostral afferent fibers to the NTS; c) perturbation of rostral neural structures (RNS) to the NTS modifies the set point without changing the dynamics of the elicited response; and d) cardiovascular responses to perturbations on neural structures within the negative feedback loop compensate for much faster than perturbations on the NTS rostral structures.Results: From the control theory framework, experimental evidence found currently in the literature plus experimental results from our group was put together showing that the above-mentioned conditions (to show that the NTS functions as a comparator) are satisfied.Conclusions: Physiological experiments suggest that long-term blood pressure is regulated by the nervous system. The NTS functions as a comparator (evaluating the error signal) between its RNS and the cardiovascular receptor afferents and projects to nuclei that regulate the circulatory variables. The mean arterial pressure (MAP) is regulated by the feedback of chemo and cardiopulmonary receptors and the baroreflex would stabilize the short term pressure value to the prevailing carotid MAP. The discharge rates of rostral neural projections to the NTS would function as the set point of the closed and open loops of cardiovascular control. No doubt, then, the RNS play a functional role not only under steady-state conditions, but also in different behaviors and pathologies. [ABSTRACT FROM AUTHOR]

A main goal in neuroscience is to understand the computations carried out by neural populations that give animals their cognitive skills. Neural network models allow to formulate explicit hypotheses regarding the algorithms instantiated in the dynamics of a neural population, its firing statistics, and the underlying connectivity. Neural networks can be defined by a small set of parameters, carefully chosen to procure specific capabilities, or by a large set of free parameters, fitted with optimization algorithms that minimize a given loss function. In this work we alternatively propose a method to make a detailed adjustment of the network dynamics and firing statistic to better answer questions that link dynamics, structure, and function. Our algorithm-termed generalised Firing-to-Parameter (gFTP)-provides a way to construct binary recurrent neural networks whose dynamics strictly follows a user pre-specified transition graph that details the transitions between population firing states triggered by stimulus presentations. Our main contribution is a procedure that detects when a transition graph is not realisable in terms of a neural network, and makes the necessary modifications in order to obtain a new transition graph that is realisable and preserves all the information encoded in the transitions of the original graph. With a realisable transition graph, gFTP assigns values to the network firing states associated with each node in the graph, and finds the synaptic weight matrices by solving a set of linear separation problems. We test gFTP performance by constructing networks with random dynamics, continuous attractor-like dynamics that encode position in 2-dimensional space, and discrete attractor dynamics. We then show how gFTP can be employed as a tool to explore the link between structure, function, and the algorithms instantiated in the network dynamics., (© 2024. The Author(s).)

Serotonin (5-HT) is a key neuromodulator of medial prefrontal cortex (mPFC) functions. Pharmacological manipulation of systemic 5-HT bioavailability alters the electrical activity of mPFC neurons. However, 5-HT modulation at the population level is not well characterized. In the present study, we made single neuron extracellular recordings in the mPFC of rats performing an operant conditioning task, and analyzed the effect of systemic administration of fluoxetine (a selective serotonin reuptake inhibitor) on the information encoded in the firing activity of the neural population. Chronic (longer than 15 days), but not acute (less than 15 days), fluoxetine administration reduced the firing rate of mPFC neurons. Moreover, fluoxetine treatment enhanced pairwise entropy but diminished noise correlation and redundancy in the information encoded, thus showing how mPFC differentially encodes information as a function of 5-HT bioavailability. Information about the occurrence of the reward-predictive stimulus was maximized during reward consumption, around 3 to 4 s after the presentation of the cue, and it was higher under chronic fluoxetine treatment. However, the encoded information was less robust to noise corruption when compared to control conditions.

Serotonin (5-HT) neurotransmission has been associated with reward-related behaviour. Moreover, the serotonergic system modulates the basolateral amygdala (BLA), a structure involved in reward encoding, and reward prediction error. However, the role played by 5-HT on BLA during a reward-driven task has not been fully elucidated. In this paper, we investigated whether serotonergic modulation of the BLA is involved in reward-driven learning. To this end, we trained Long Evans rats in an operant conditioning task, and examined the effects of fluoxetine treatment (a selective serotonin reuptake inhibitor, 10 mg/kg) in combination with BLA lesions with NMDA (20 mg/mL) on extinction learning. We also investigated whether intra-BLA injection of the serotonergic 5-HT 1A receptor agonist 8-OH DPAT, or antagonist WAY-100635, alters extinction performance. We found that fluoxetine treatment strongly accelerated extinction learning, while BLA lesions partially reverted this effect and slightly impaired consolidation of extinction. Stimulation and inhibition of 5-HT 1A receptors in BLA induced opposite effects to those of fluoxetine, impairing or accelerating extinction performance, respectively. Our findings suggest that 5-HT modulates reward-driven learning, and 5-HT 1A receptors located in the BLA are relevant for extinction., (Copyright © 2021 Elsevier B.V. All rights reserved.)

Neural network models are an invaluable tool to understand brain function since they allow us to connect the cellular and circuit levels with behaviour. Neural networks usually comprise a huge number of parameters, which must be chosen carefully such that networks reproduce anatomical, behavioural, and neurophysiological data. These parameters are usually fitted with off-the-shelf optimization algorithms that iteratively change network parameters and simulate the network to evaluate its performance and improve fitting. Here we propose to invert the fitting process by proceeding from the network dynamics towards network parameters. Firing state transitions are chosen according to the transition graph associated with the solution of a task. Then, a system of linear equations is constructed from the network firing states and membrane potentials, in a way that guarantees the consistency of the system. This allows us to uncouple the dynamical features of the model, like its neurons firing rate and correlation, from the structural features, and the task-solving algorithm implemented by the network. We employed our method to probe the structure-function relationship in a sequence memory task. The networks obtained showed connectivity and firing statistics that recapitulated experimental observations. We argue that the proposed method is a complementary and needed alternative to the way neural networks are constructed to model brain function.

A general agreement in psycholinguistics claims that syntax and meaning are unified precisely and very quickly during online sentence processing. Although several theories have advanced arguments regarding the neurocomputational bases of this phenomenon, we argue that these theories could potentially benefit by including neurophysiological data concerning cortical dynamics constraints in brain tissue. In addition, some theories promote the integration of complex optimization methods in neural tissue. In this paper we attempt to fill these gaps introducing a computational model inspired in the dynamics of cortical tissue. In our modeling approach, proximal afferent dendrites produce stochastic cellular activations, while distal dendritic branches-on the other hand-contribute independently to somatic depolarization by means of dendritic spikes, and finally, prediction failures produce massive firing events preventing formation of sparse distributed representations. The model presented in this paper combines semantic and coarse-grained syntactic constraints for each word in a sentence context until grammatically related word function discrimination emerges spontaneously by the sole correlation of lexical information from different sources without applying complex optimization methods. By means of support vector machine techniques, we show that the sparse activation features returned by our approach are well suited-bootstrapping from the features returned by Word Embedding mechanisms-to accomplish grammatical function classification of individual words in a sentence. In this way we develop a biologically guided computational explanation for linguistically relevant unification processes in cortex which connects psycholinguistics to neurobiological accounts of language. We also claim that the computational hypotheses established in this research could foster future work on biologically-inspired learning algorithms for natural language processing applications., (Copyright © 2020 Dematties, Rizzi, Thiruvathukal, Pérez, Wainselboim and Zanutto.)

Many computational theories have been developed to improve artificial phonetic classification performance from linguistic auditory streams. However, less attention has been given to psycholinguistic data and neurophysiological features recently found in cortical tissue. We focus on a context in which basic linguistic units-such as phonemes-are extracted and robustly classified by humans and other animals from complex acoustic streams in speech data. We are especially motivated by the fact that 8-month-old human infants can accomplish segmentation of words from fluent audio streams based exclusively on the statistical relationships between neighboring speech sounds without any kind of supervision. In this paper, we introduce a biologically inspired and fully unsupervised neurocomputational approach that incorporates key neurophysiological and anatomical cortical properties, including columnar organization, spontaneous micro-columnar formation, adaptation to contextual activations and Sparse Distributed Representations (SDRs) produced by means of partial N-Methyl-D-aspartic acid (NMDA) depolarization. Its feature abstraction capabilities show promising phonetic invariance and generalization attributes. Our model improves the performance of a Support Vector Machine (SVM) classifier for monosyllabic, disyllabic and trisyllabic word classification tasks in the presence of environmental disturbances such as white noise, reverberation, and pitch and voice variations. Furthermore, our approach emphasizes potential self-organizing cortical principles achieving improvement without any kind of optimization guidance which could minimize hypothetical loss functions by means of-for example-backpropagation. Thus, our computational model outperforms multiresolution spectro-temporal auditory feature representations using only the statistical sequential structure immerse in the phonotactic rules of the input stream., Competing Interests: The authors have declared that no competing interests exist.

Sugar consumption has increased dramatically in our society, a phenomenon that is primarily associated with obesity and diabetes appearance. However, whether this overconsumption of sugar has an impact on the developing CNS remains unknown. This study investigated the long-term effects of unlimited access to sucrose using the two-bottle choice paradigm and the juvenile and adult effects were compared. Male Sprague Dawley rats had free access to water containing 10% sucrose and water during youth (PD 25-50) or adulthood (PD 75-100). Rats in the sucrose group, privileged to take sugary solution over the water. No weight differences were observed between the sucrose groups and their age-matched water controls. After treatment all animals drank only water for another 25 days. Frustration, measured as the amount of water drank after the sucrose period, was higher in young-exposed animals compared to adults. In addition, rats that consumed sucrose during youth travelled less the central zones of an open field. Sucrose consumption during youth also affected fear behavior as animals exhibited impaired extinction of fear memory compared to control, indicating that prefrontal and hippocampal function is impaired. In contrast, rats exposed to sucrose during adulthood did not behave significantly different from control on either task. The calretinin and parvalbumin GABAergic interneurons go through extensive remodeling during youth in the medial prefrontal cortex and the ventral hippocampus. Here, we found that rats exposed to sucrose during youth presented an increased expression of calretinin-immunoreactivity in the medial prefrontal cortex, but not in the ventral hippocampus, indicating that early sucrose consumption produces enduring effects on the GABA system. Altogether these results indicate that sugar overconsumption at early stages of life induces long-term effects on behaviors related to fear and anxiety in adulthood., (Copyright © 2019 Elsevier Ltd. All rights reserved.)

Cooperation is one of the most studied paradigms for the understanding of social interactions. Reciprocal altruism -a special type of cooperation that is taught by means of the iterated prisoner dilemma game (iPD)- has been shown to emerge in different species with different success rates. When playing iPD against a reciprocal opponent, the larger theoretical long-term reward is delivered when both players cooperate mutually. In this work, we trained rats in iPD against an opponent playing a Tit for Tat strategy, using a payoff matrix with positive and negative reinforcements, that is food and timeout respectively. We showed for the first time, that experimental rats were able to learn reciprocal altruism with a high average cooperation rate, where the most probable state was mutual cooperation (85%). Although when subjects defected, the most probable behavior was to go back to mutual cooperation. When we modified the matrix by increasing temptation rewards (T) or by increasing cooperation rewards (R), the cooperation rate decreased. In conclusion, we observe that an iPD matrix with large positive reward improves less cooperation than one with small rewards, shown that satisfying the relationship among iPD reinforcement was not enough to achieve high mutual cooperation behavior. Therefore, using positive and negative reinforcements and an appropriate contrast between rewards, rats have cognitive capacity to learn reciprocal altruism. This finding allows to infer that the learning of reciprocal altruism has early appeared in evolution., Competing Interests: The authors have declared that no competing interests exist.

It has been proposed that neuronal populations in the prefrontal cortex (PFC) robustly encode task-relevant information through an interplay with the ventral tegmental area (VTA). Yet, the precise computation underlying such functional interaction remains elusive. Here, we conducted simultaneous recordings of single-unit activity in PFC and VTA of rats performing a GO/NoGO task. We found that mutual information between stimuli and neural activity increases in the PFC as soon as stimuli are presented. Notably, it is the activity of putative dopamine neurons in the VTA that contributes critically to enhance information coding in the PFC. The higher the activity of these VTA neurons, the better the conditioned stimuli are encoded in the PFC.

Background: While spherical treadmills are widely used in mouse models, there are only a few experimental setups suitable for adult rats, and none of them include head-fixation., New Method: We introduce a novel spherical treadmill apparatus for head-fixed rats that allows a wide repertory of natural responses. The rat is secured to a frame and placed on a freely rotating sphere. While being head-fixed, it can walk in any direction and perform different motor tasks., Comparison With Existing Methods: Instead of being air-lifted, which is acceptable for light animals, the treadmill is sustained by three spherical bearings ensuring a smooth rotation in any direction. Movement detection is accomplished using a video camera that registers a dot pattern plotted on the sphere., Results: Long Evans rats were trained to perform an auditory discrimination task in a Go/No-Go (walking/not-walking) paradigm. Animals were able to successfully discriminate between a 1 kHz and a 8 kHz auditory stimulus and execute the correct response, reaching the learning criterion (80% of correct responses) in approximately 20 training sessions., Conclusions: Our system broadens the possibilities of head-fixation experiments in adult rats making them compatible with spatial navigation on a spherical treadmill., (Copyright © 2017 Elsevier B.V. All rights reserved.)

The prefrontal cortex (PFC) is a key brain structure for decision making, behavioural flexibility and working memory. Neurons in PFC encode relevant stimuli through changes in their firing rate, although the metabolic cost of spiking activity puts strong constrains to neural codes based on firing rate modulation. Thus, how PFC neural populations code relevant information in an efficient way is not clearly understood. To address this issue we made single unit recordings in the PFC of rats performing a GO/NOGO discrimination task and analysed how entropy between pairs of neurons changes during cue presentation. We found that entropy rises only during reward-predicting cues. Moreover, this change in entropy occurred along an increase in the efficiency of the whole process. We studied possible mechanisms behind the efficient gain in entropy by means of a two neuron leaky integrate-and-fire model, and found that a precise relationship between synaptic efficacy and firing rate is required to explain the experimentally observed results.

Animals are proposed to learn the latent rules governing their environment in order to maximize their chances of survival. However, rules may change without notice, forcing animals to keep a memory of which one is currently at work. Rule switching can lead to situations in which the same stimulus/response pairing is positively and negatively rewarded in the long run, depending on variables that are not accessible to the animal. This fact raises questions on how neural systems are capable of reinforcement learning in environments where the reinforcement is inconsistent. Here we address this issue by asking about which aspects of connectivity, neural excitability and synaptic plasticity are key for a very general, stochastic spiking neural network model to solve a task in which rules change without being cued, taking the serial reversal task (SRT) as paradigm. Contrary to what could be expected, we found strong limitations for biologically plausible networks to solve the SRT. Especially, we proved that no network of neurons can learn a SRT if it is a single neural population that integrates stimuli information and at the same time is responsible of choosing the behavioural response. This limitation is independent of the number of neurons, neuronal dynamics or plasticity rules, and arises from the fact that plasticity is locally computed at each synapse, and that synaptic changes and neuronal activity are mutually dependent processes. We propose and characterize a spiking neural network model that solves the SRT, which relies on separating the functions of stimuli integration and response selection. The model suggests that experimental efforts to understand neural function should focus on the characterization of neural circuits according to their connectivity, neural dynamics, and the degree of modulation of synaptic plasticity with reward.

Dopamine encodes reward and its prediction in reinforcement learning. Catechol-O-methyltransferase (COMT) activity in the medial prefrontal cortex (mPFC) has been shown to influence cognitive abilities by modifying dopamine clearance. Nevertheless, it is unknown how COMT in the mPFC influences operant learning. Systemic entacapone (50mg/kg), as well as local entacapone (3 pg) and recombinant COMT (17 μg) in the mPFC were administered to male Long Evans rats prior to training in an operant conditioning task. We found that systemic and local administration of the COMT inhibitor entacapone significantly improves learning performance. Conversely, recombinant COMT administration totally impaired learning. These data have been interpreted through a computational model where the phasic firing of dopaminergic neurons was computed by means of a temporal difference algorithm and dopamine bioavailability in the mPFC was simulated with a gating window. The duration of this window was selected to simulate the effects of inhibited or enhanced COMT activity (by entacapone or recombinant COMT respectively). The model accounts for an improved performance reproducing the entacapone effects, and a detrimental impact on learning when the clearance is increased reproducing the recombinant COMT effects. The experimental and computational results show that learning performance can be deeply influenced by COMT manipulations in the mPFC., (Copyright © 2014 Elsevier B.V. All rights reserved.)

Serotonin (5-HT) has been proposed as a possible encoder of reward. Nevertheless, the role of this neurotransmitter in reward-based tasks is not well understood. Given that the major serotonergic circuit in the rat brain comprises the dorsal raphe nuclei and the medial prefrontal cortex (mPFC), and because the latter structure is involved in the control of complex behaviors and expresses 1A (5-HT1A), 2A (5-HT2A), and 3 (5-HT3) receptors, the aim was to study the role of 5-HT and of these receptors in the acquisition and extinction of a reward-dependent operant conditioning task. Long Evans rats were trained in an operant conditioning task while receiving fluoxetine (serotonin reuptake inhibitor, 10mg/kg), tianeptine (serotonin reuptake enhancer, 10mg/kg), buspirone (5-HT1A partial agonist, 10mg/kg), risperidone (5-HT2A antagonist, 1mg/kg), ondansetron (5-HT3 antagonist, 2mg/kg) or vehicle. Then, animals that acquired the operant conditioning without any treatment were trained to extinct the task in the presence of the pharmacological agents. Fluoxetine impaired acquisition but improved extinction. Tianeptine administration induced the opposite effects. Buspirone induced a mild deficit in acquisition and had no effects during the extinction phase. Risperidone administration resulted in learning deficits during the acquisition phase, although it promoted improved extinction. Ondansetron treatment showed a deleterious effect in the acquisition phase and an overall improvement in the extinction phase. These data showed a differential role of 5-HT in the acquisition and extinction of an operant conditioning task, suggesting that it may have a dual function in reward encoding., (Copyright © 2014 Elsevier B.V. All rights reserved.)

Blockade of N-methyl-d-aspartate receptor (NMDA) by the noncompetitive NMDA receptor (NMDAR) antagonist MK-801 produces behavioral abnormalities and alterations in prefrontal cortex (PFC) functioning. Due to the critical role of the PFC in operant conditioning task learning, we evaluated the effects of acute, repeated postnatal injections of MK-801 (0.1mg/kg) on learning performance. We injected Long-Evans rats i.p. with MK-801 (0.1mg/kg) using three different administration schedules: injection 40 min before beginning the task (during) (n=12); injection twice daily for six consecutive days prior to beginning the experimental procedures (prior) (n=12); or twice daily subcutaneous injections from postnatal day 7 to 11 (postnatal) (n=12). Next, we orally administered risperidone (serotonin receptor 2A and dopamine receptor 2 antagonist, 1mg/kg) or buspirone (serotonin receptor 1A partial agonist, 10mg/kg) to animals treated with the MK-801 schedule described above. The postnatal and prior administration schedules produced severe learning deficits, whereas injection of MK-801 just before training sessions had only mild effects on acquisition of an operant conditioning. Risperidone was able to reverse the detrimental effect of MK-801 in the animals that were treated with MK-801 during and prior training sessions. In contrast, buspirone was only effective at mitigating the cognitive deficits induced by MK-801 when administered during the training procedures. The data demonstrates that NMDA antagonism disrupts basic mechanisms of learning in a simple PFC-mediated operant conditioning task, and that buspirone and risperidone failed to attenuate the learning deficits when NMDA neurotransmission was blocked in the early stages of the postnatal period., (Copyright © 2013 Elsevier B.V. All rights reserved.)

Equivalence relations (ERs) are logical entities that emerge concurrently with the development of language capabilities. In this work we propose a computational model that learns to build ERs by learning simple conditional rules. The model includes visual areas, dopaminergic, and noradrenergic structures as well as prefrontal and motor areas, each of them modeled as a group of continuous valued units that simulate clusters of real neurons. In the model, lateral interaction between neurons of visual structures and top-down modulation of prefrontal/premotor structures over the activity of neurons in visual structures are necessary conditions for learning the paradigm. In terms of the number of neurons and their interaction, we show that a minimal structural complexity is required for learning ERs among conditioned stimuli. Paradoxically, the emergence of the ER drives a reduction in the number of neurons needed to maintain those previously specific stimulus-response learned rules, allowing an efficient use of neuronal resources.

Background: The notion of the nucleus tractus solitarius (NTS) as a comparator evaluating the error signal between its rostral neural structures (RNS) and the cardiovascular receptor afferents into it has been recently presented. From this perspective, stress can cause hypertension via set point changes, so offering an answer to an old question. Even though the local blood flow to tissues is influenced by circulating vasoactive hormones and also by local factors, there is yet significant sympathetic control. It is well established that the state of maturation of sympathetic innervation of blood vessels at birth varies across animal species and it takes place mostly during the postnatal period. During ontogeny, chemoreceptors are functional; they discharge when the partial pressures of oxygen and carbon dioxide in the arterial blood are not normal., Methods: The model is a simple biological plausible adaptative neural network to simulate the development of the sympathetic nervous control. It is hypothesized that during ontogeny, from the RNS afferents to the NTS, the optimal level of each sympathetic efferent discharge is learned through the chemoreceptors' feedback. Its mean discharge leads to normal oxygen and carbon dioxide levels in each tissue. Thus, the sympathetic efferent discharge sets at the optimal level if, despite maximal drift, the local blood flow is compensated for by autoregulation. Such optimal level produces minimum chemoreceptor output, which must be maintained by the nervous system. Since blood flow is controlled by arterial blood pressure, the long-term mean level is stabilized to regulate oxygen and carbon dioxide levels. After development, the cardiopulmonary reflexes play an important role in controlling efferent sympathetic nerve activity to the kidneys and modulating sodium and water excretion., Results: Starting from fixed RNS afferents to the NTS and random synaptic weight values, the sympathetic efferents converged to the optimal values. When learning was completed, the output from the chemoreceptors became zero because the sympathetic efferents led to normal partial pressures of oxygen and carbon dioxide., Conclusions: We introduce here a simple simulating computational theory to study, from a neurophysiologic point of view, the sympathetic development of cardiovascular regulation due to feedback signals sent off by cardiovascular receptors. The model simulates, too, how the NTS, as emergent property, acts as a comparator and how its rostral afferents behave as set point.

Circuit modification associated with learning and memory involves multiple events, including the addition and remotion of newborn cells trough adulthood. Adult neurogenesis and gliogenesis were mainly described in models of voluntary exercise, enriched environments, spatial learning and memory task; nevertheless, it is unknown whether it is a common mechanism among different learning paradigms, like reward dependent tasks. Therefore, we evaluated cell proliferation, neurogenesis, astrogliogenesis, survival and neuronal maturation in the medial prefrontal cortex (mPFC) and the hippocampus (HIPP) during learning an operant conditioning task. This was performed by using endogenous markers of cell proliferation, and a bromodeoxiuridine (BrdU) injection schedule in two different phases of learning. Learning an operant conditioning is divided in two phases: a first phase when animals were considered incompletely trained (IT, animals that were learning the task) when they performed between 50% and 65% of the responses, and a second phase when animals were considered trained (Tr, animals that completely learned the task) when they reached 100% of the responses with a latency time lower than 5 seconds. We found that learning an operant conditioning task promoted cell proliferation in both phases of learning in the mPFC and HIPP. Additionally, the results presented showed that astrogliogenesis was induced in the medial prefrontal cortex (mPFC) in both phases, however, the first phase promoted survival of these new born astrocytes. On the other hand, an increased number of new born immature neurons was observed in the HIPP only in the first phase of learning, whereas, decreased values were observed in the second phase. Finally, we found that neuronal maturation was induced only during the first phase. This study shows for the first time that learning a reward-dependent task, like the operant conditioning, promotes neurogenesis, astrogliogenesis, survival and neuronal maturation depending on the learning phase in the mPFC-HIPP circuit.

Nitric oxide (NO) promotes plasticity and it is essential for learning, the NO synthases involved in these events are the endothelial NO synthase (eNOS) and neuronal NO synthase (nNOS) isoforms. The aim of this study was to study transcription, protein expression and enzymatic activity of eNOS and nNOS in the prefrontal cortex and the hippocampus during learning an operant conditioning task. Animals were considered incompletely trained (IT) when performed between 50% and 65% of responses, whereas animals were considered trained when reached 100% of responses with a latency time lower than 5 s. Following training session animals were killed and we quantified mRNA levels by Real Time RT-PCR, protein expression by western blot and enzymatic activity. eNOS and nNOS mRNA levels were only incremented in IT group. On the contrary, protein expression of both isoforms were augmented during all learning process. Moreover, we also found that eNOS and nNOS synthase activity were incremented in IT group and in trained group. Here, we showed that during learning there is a differential regulation of eNOS and nNOS in the prefrontal cortex and hippocampus and that NO could be acting as a promoter of plasticity.

The plasticity in the medial Prefrontal Cortex (mPFC) of rodents or lateral prefrontal cortex in non human primates (lPFC), plays a key role neural circuits involved in learning and memory. Several genes, like brain-derived neurotrophic factor (BDNF), cAMP response element binding (CREB), Synapsin I, Calcium/calmodulin-dependent protein kinase II (CamKII), activity-regulated cytoskeleton-associated protein (Arc), c-jun and c-fos have been related to plasticity processes. We analysed differential expression of related plasticity genes and immediate early genes in the mPFC of rats during learning an operant conditioning task. Incompletely and completely trained animals were studied because of the distinct events predicted by our computational model at different learning stages. During learning an operant conditioning task, we measured changes in the mRNA levels by Real-Time RT-PCR during learning; expression of these markers associated to plasticity was incremented while learning and such increments began to decline when the task was learned. The plasticity changes in the lPFC during learning predicted by the model matched up with those of the representative gene BDNF. Herein, we showed for the first time that plasticity in the mPFC in rats during learning of an operant conditioning is higher while learning than when the task is learned, using an integrative approach of a computational model and gene expression.

A new method for spike sorting of tetrode recordings during data acquisition is introduced. For each tetrode channel, putative spikes are detected by means of a threshold, and then convolved with a cascade of wavelet filters. These transformed putative spikes are averaged and this average is used as a matched filter to find portions of signals that are likely to contain a spike. A collection of vectors containing the correlation coefficients between putative spikes and the matched filters is then clustered using K-Means. Centroids of the resulting clusters contain enough information to sort spikes recorded by all tetrode channels simultaneously. On-line sorting is achieved by measuring euclidean distance between putative new spikes and the cluster centroids.

The Basal Ganglia (BG) are a group of nuclei, in the brain of mammalians and other vertebrates, strongly connected with the cerebral cortex, thalamus and other brain areas. The BG are associated with several brain functions including learning and motor control. When there is cortical activation, there is a strong synchronization between BG and cortex, i.e. when a given task is being executed or in the case of Parkinson disease[1], [2]. If we consider the internal segment of the Globus Pallidus (GPi) there is synchronism between GPi-cortex at frequencies as low as 3Hz to as high as 85Hz [1], [3]. In the other hand, in a delta sleep or in an anesthetized case, a very low frequency correlation is observed (1-10 Hz), but no high frequency correlation between GPi-cortex [1], [2], [3]. It is unknown why this decorrelation happens. But It is agreement that when there is no pattern to select, like in delta sleep or with an anesthetized model, the BG network would maintain the GPi and cortex decorrelated at high frequencies. Many thalamus-BG and thalamus-BG-cortex loops are modulators of the BG activity. Particularly there exists an anatomic thalamus-BG loop, formed by GPi, intralaminar thalamic nuclei (IL) and Subthalamic Nucleus (STN) [4]. Using a computational model, based on an "Integrate and Fire" neural network, we analyzed the IL nucleus as a modulator of the so-called hyper direct pathway. Our results show that, in an anesthetic case, this thalamic path could be relevant to allow a high frequency decorrelated state between the GPi and cortex.

Changes in transcription levels of brain-derived neurotrophic factor (BDNF), cyclic adenosine monophosphate (cAMP) response element binding (CREB), Synapsin I, Ca(2+)/calmodulin-dependent protein kinase II (CamKII), activity-regulated cytoskeleton-associated protein (Arc), c-jun and c-fos have been associated to several learning paradigms in different brain areas. In this study, we measured mRNA expression in the hippocampus by real time (RT)-PCR mRNA levels of BDNF, CREB, Synapsin I, CamKII, Arc, c-jun and c-fos, during learning and operant conditioning task. Experimental groups were as follows: control (C, the animals never left the bioterium), when the animals reached 50-65% of the expected response (Incompletely Trained, IT), when animals reached 100% of the expected response with a latency time lower than 5 s (Trained, Tr), Box Control of Incompletely Trained (BCIT), animals spent the same time as the IT in the operant conditioning box and Box Control of Trained (BCTr) animals spent the same time as the Tr in the operant conditioning box. All rats were killed at the same time by cervical dislocation 15 min after training and hippocampi were removed and processed. We found increments of mRNA levels of most genes (BDNF, CREB, Synapsin I, Arc, c-jun and c-fos) in IT and Tr groups compared to their box controls, but increments in Tr were smaller compared with IT. These results describe a differential gene expression in the rat hippocampus when the animals are learning and when animals have already learned. Taking together the results presented herein with the known functions of these genes, we propose a link between changes in gene expression in the hippocampus and different degrees of cellular activation and plasticity during learning of an operant conditioning task.

Rats, people, and many other omnivores eat in meals rather than continuously. We show by experimental test that eating in meals is regulated by a simple bang-bang control system, an idea foreshadowed by Le Magnen and many others, shown by us to account for a wide range of behavioral data, but never explicitly tested or tied to neurophysiological facts. The hypothesis is simply that the tendency to eat rises with time at a rate determined by satiety signals. When these signals fall below a set point, eating begins, in on-off fashion. The delayed sequelae of eating increment the satiety signals, which eventually turn eating off. Thus, under free conditions, the organism eats in bouts separated by noneating activities. We report an experiment with rats to test novel predictions about meal patterns that are not explained by existing homeostatic approaches. Access to food was systematically but unpredictably interrupted just as the animal tried to start a new meal. A simple bang-bang model fits the resulting meal-pattern data well, and its elements can be identified with neurophysiological processes. Hypothalamic inputs can provide the set point for longer-term regulation carried out by a comparator in the hindbrain. Delayed gustatory and gastrointestinal aftereffects of eating act via the nucleus of the solitary tract and other hindbrain regions as neural feedback governing short-term regulation. In this way, the model forges real links between a functioning feedback mechanism, neuro-hormonal data, and both short-term (meals) and long-term (eating-rate regulation) behavioral data.

Artificial intelligence researchers have been attracted by the idea of having robots learn how to accomplish a task, rather than being told explicitly. Reinforcement learning has been proposed as an appealing framework to be used in controlling mobile agents. Robot learning research, as well as research in biological systems, face many similar problems in order to display high flexibility in performing a variety of tasks. In this work, the controlling of a vehicle in an avoidance task by a previously developed operant learning model (a form of animal learning) is studied. An environment in which a mobile robot with proximity sensors has to minimize the punishment for colliding against obstacles is simulated. The results were compared with the Q-Learning algorithm, and the proposed model had better performance. In this way a new artificial intelligence agent inspired by neurobiology, psychology, and ethology research is proposed.

The prisoner's dilemma (PD) is the leading metaphor for the evolution of cooperative behavior in populations of selfish agents. Although cooperation in the iterated prisoner's dilemma (IPD) has been studied for over twenty years, most of this research has been focused on strategies that involve nonlearned behavior. Another approach is to suppose that players' selection of the preferred reply might be enforced in the same way as feeding animals track the best way to feed in changing nonstationary environments. Learning mechanisms such as operant conditioning enable animals to acquire relevant characteristics of their environment in order to get reinforcements and to avoid punishments. In this study, the role of operant conditioning in the learning of cooperation was evaluated in the PD. We found that operant mechanisms allow the learning of IPD play against other strategies. When random moves are allowed in the game, the operant learning model showed low sensitivity. On the basis of this evidence, it is suggested that operant learning might be involved in reciprocal altruism.