Search

This paper presents a systems identification approach for studying the long-term synaptic plasticity using natural spiking activities. This approach consists of three modeling steps. First, a multi-input, single-output (MISO), nonlinear dynamical spiking neuron model is formulated to estimate and represent the synaptic strength in means of functional connectivity between input and output neurons. Second, this MISO model is extended to a nonstationary form to track the time-varying properties of the synaptic strength. Finally, a Volterra modeling method is used to extract the synaptic learning rule, e.g., spike-timing-dependent plasticity, for the explanation of the input-output nonstationarity as the consequence of the past input-output spiking patterns. This framework is developed to study the underlying mechanisms of learning and memory formation in behaving animals, and may serve as the computational basis for building the next-generation adaptive cortical prostheses., (Copyright © 2014 Elsevier B.V. All rights reserved.)

Although an anatomical connection from CA1 to CA3 via the Entorhinal Cortex (EC) and through backprojecting interneurons has long been known it exist, it has never been examined quantitatively on the single neuron level, in the in-vivo nonpatholgical, nonperturbed brain. Here, single spike activity was recorded using a multi-electrode array from the CA3 and CA1 areas of the rodent hippocampus (N = 7) during a behavioral task. The predictive power from CA3→CA1 and CA1→CA3 was examined by constructing Multivariate Autoregressive (MVAR) models from recorded neurons in both directions. All nonsignificant inputs and models were identified and removed by means of Monte Carlo simulation methods. It was found that 121/166 (73 %) CA3→CA1 models and 96/145 (66 %) CA1→CA3 models had significant predictive power, thus confirming a predictive 'Granger' causal relationship from CA1 to CA3. This relationship is thought to be caused by a combination of truly causal connections such as the CA1→EC→CA3 pathway and common inputs such as those from the Septum. All MVAR models were then examined in the frequency domain and it was found that CA3 kernels had significantly more power in the theta and beta range than those of CA1, confirming CA3's role as an endogenous hippocampal pacemaker.

Background: Neural information processing involves a series of nonlinear dynamical input/output transformations between the spike trains of neurons/neuronal ensembles. Understanding and quantifying these transformations is critical both for understanding neural physiology such as short-term potentiation and for developing cognitive neural prosthetics., New Method: A novel method for estimating Volterra kernels for systems with point-process inputs and outputs is developed based on elementary probability theory. These Probability Based Volterra (PBV) kernels essentially describe the probability of an output spike given q input spikes at various lags t1, t2, …, tq., Results: The PBV kernels are used to estimate both synthetic systems where ground truth is available and data from the CA3 and CA1 regions rodent hippocampus. The PBV kernels give excellent predictive results in both cases. Furthermore, they are shown to be quite robust to noise and to have good convergence and overfitting properties. Through a slight modification, the PBV kernels are shown to also deal well with correlated point-process inputs., Comparison With Existing Methods: The PBV kernels were compared with kernels estimated through least squares estimation (LSE) and through the Laguerre expansion technique (LET). The LSE kernels were shown to fair very poorly with real data due to the large amount of input noise. Although the LET kernels gave the best predictive results in all cases, they require prior parameter estimation. It was shown how the PBV and LET methods can be combined synergistically to maximize performance., Conclusions: The PBV kernels provide a novel and intuitive method of characterizing point-process input-output nonlinear systems., (Copyright © 2014 Elsevier B.V. All rights reserved.)

Intracortical recordings comprise both fast events, action potentials (APs), and slower events, known as local field potentials (LFPs). Although it is believed that LFPs mostly reflect local synaptic activity, it is unclear which of their signal components are most closely related to synaptic potentials and would therefore be causally related to the occurrence of individual APs. This issue is complicated by the significant contribution from AP waveforms, especially at higher LFP frequencies. In recordings of single-cell activity and LFPs from the human temporal cortex, we computed quantitative, nonlinear, causal dynamic models for the prediction of AP timing from LFPs, at millisecond resolution, before and after removing AP contributions to the LFP. In many cases, the timing of a significant number of single APs could be predicted from spike-free LFPs at different frequencies. Not surprisingly, model performance was superior when spikes were not removed. Cells whose activity was predicted by the spike-free LFP models generally fell into one of two groups: in the first group, neuronal spike activity was associated with specific phases of low LFP frequencies, lower spike activity at high LFP frequencies, and a stronger linear component in the spike-LFP model; in the second group, neuronal spike activity was associated with larger amplitude of high LFP frequencies, less frequent phase locking, and a stronger nonlinear model component. Spike timing in the first group was better predicted by the sign and level of the LFP preceding the spike, whereas spike timing in the second group was better predicted by LFP power during a certain time window before the spike.

This paper presents a pilot application of the Boolean-Volterra modeling methodology presented in the companion paper (Part I) that is suitable for the analysis of systems with point-process inputs and outputs (e.g., recordings of the activity of neuronal ensembles). This application seeks to discover the causal links between two neuronal ensembles in the hippocampus of a behaving rat. The experimental data come from multi-unit recordings in the CA3 and CA1 regions of the hippocampus in the form of sequences of action potentials-treated mathematically as point-processes and computationally as spike-trains-that are collected in vivo during two behavioral tasks. The modeling objective is to identify and quantify the causal links among the neurons generating the recorded activity, using Boolean-Volterra models estimated directly from the data according to the methodological framework presented in the companion paper. The obtained models demonstrate the feasibility of the proposed approach using short data-records and provide some insights into the functional properties of the system (e.g., regarding the presence of rhythmic characteristics in the neuronal dynamics of these ensembles), making the proposed methodology an attractive tool for the analysis and modeling of multi-unit recordings from neuronal systems in a practical context.

To understand the function of a brain region, e.g., hippocampus, it is necessary to model its input-output property. Such a model can serve as the computational basis of the development of cortical prostheses restoring the transformation of population neural activities performed by the brain region. We formulate a sparse generalized Laguerre-Volterra model (SGLVM) for the multiple-input, multiple-output (MIMO) transformation of spike trains. A SGLVM consists of a set of feedforward Laguerre-Volterra kernels, a feedback Laguerre-Volterra kernel, and a probit link function. The sparse model representation involving only significant self and cross terms is achieved through statistical model selection and cross-validation methods. The SGLVM is applied successfully to the hippocampal CA3-CA1 population dynamics.

The increasing availability of multiunit recordings gives new urgency to the need for effective analysis of "multidimensional" time-series data that are derived from the recorded activity of neuronal ensembles in the form of multiple sequences of action potentials--treated mathematically as point-processes and computationally as spike-trains. Whether in conditions of spontaneous activity or under conditions of external stimulation, the objective is the identification and quantification of possible causal links among the neurons generating the observed binary signals. A multiple-input/multiple-output (MIMO) modeling methodology is presented that can be used to quantify the neuronal dynamics of causal interrelationships in neuronal ensembles using spike-train data recorded from individual neurons. These causal interrelationships are modeled as transformations of spike-trains recorded from a set of neurons designated as the "inputs" into spike-trains recorded from another set of neurons designated as the "outputs." The MIMO model is composed of a set of multiinput/single-output (MISO) modules, one for each output. Each module is the cascade of a MISO Volterra model and a threshold operator generating the output spikes. The Laguerre expansion approach is used to estimate the Volterra kernels of each MISO module from the respective input-output data using the least-squares method. The predictive performance of the model is evaluated with the use of the receiver operating characteristic (ROC) curve, from which the optimum threshold is also selected. The Mann-Whitney statistic is used to select the significant inputs for each output by examining the statistical significance of improvements in the predictive accuracy of the model when the respective inputs is included. Illustrative examples are presented for a simulated system and for an actual application using multiunit data recordings from the hippocampus of a behaving rat.

The dentate gyrus is the first region of the hippocampus that receives and integrates sensory information (e.g., visual, auditory, and olfactory) via the perforant path, which is composed of two distinct neuronal pathways: the Lateral Perforant Path (LPP) and the Medial Perforant Path (MPP). This paper examines the nonlinear dynamic interactions among arbitrary stimulation patterns at these two afferent pathways and their combined effect on the resulting response of the granule cells at the dentate gyrus. We employ non-parametric Poisson-Volterra models that serve as canonical quantitative descriptors of the nonlinear dynamic transformations of the neuronal signals propagating through these two neuronal pathways. These Poisson-Volterra models are estimated in the so-called "reduced form" with experimental data from in vitro hippocampal slices and provide excellent predictions of the electrophysiological activity of the granule cells in response to arbitrary stimulation patterns. The data are acquired through a custom-made multi-electrode-array system, which stimulated simultaneously the two pathways with random impulse trains and recorded the neuronal postsynaptic activity at the granule cell layer. The results of this study show that significant nonlinear interactions exist between the LPP and the MPP that may be critical for the integration of sensory information performed by the dentate gyrus of the hippocampus.

A modeling approach to characterize the nonlinear dynamic transformations of the dentate gyrus of the hippocampus is presented and experimentally validated. The dentate gyrus is the first region of the hippocampus which receives and integrates sensory information via the perforant path. The perforant path is composed of two distinct pathways: 1) the lateral path and 2) the medial perforant path. The proposed approach examines and captures the short-term dynamic characteristics of these two pathways using a nonparametric, third-order Poisson-Volterra model. The nonlinear characteristics of the two pathways are represented by Poisson-Volterra kernels, which are quantitative descriptors of the nonlinear dynamic transformations. The kernels were computed with experimental data from in vitro hippocampal slices. The electrophysiological activity was measured with custom-made multielectrode arrays, which allowed selective stimulation with random impulse trains and simultaneous recordings of extracellular field potential activity. The results demonstrate that this mathematically rigorous approach is suitable for the multipathway complexity of the hippocampus and yields interpretable models that have excellent predictive capabilities. The resulting models not only accurately predict previously reported electrophysiological descriptors, such as paired pulses, but more important, can be used to predict the electrophysiological activity of dentate granule cells to arbitrary stimulation patterns at the perforant path.

One of the fundamental principles of cortical brain regions, including the hippocampus, is that information is represented in the ensemble firing of populations of neurons, i.e., spatio-temporal patterns of electrophysiological activity. The hippocampus has long been known to be responsible for the formation of declarative, or fact-based, memories. Damage to the hippocampus disrupts the propagation of spatio-temporal patterns of activity through hippocampal internal circuitry, resulting in a severe anterograde amnesia. Developing a neural prosthesis for the damaged hippocampus requires restoring this multiple-input, multiple-output transformation of spatio-temporal patterns of activity. Because the mechanisms underlying synaptic transmission and generation of electrical activity in neurons are inherently nonlinear, any such prosthesis must be based on a nonlinear multiple-input, multiple-output model. In this paper, we have formulated the transformational process of multi-site propagation of spike activity between two subregions of the hippocampus (CA3 and CA1) as the identification of a multiple-input, multiple-output (MIMO) system, and proposed that it can be decomposed into a series of multiple-input, single-output (MISO) systems. Each MISO system is modeled as a physiologically plausible structure that consists of 1) linear/nonlinear feedforward Volterra kernels modeling synaptic transmission and dendritic integration, 2) a linear feedback Volterra kernel modeling spike-triggered after-potentials, 3) a threshold for spike generation, 4) a summation process for somatic integration, and 5) a noise term representing intrinsic neuronal noise and the contributions of unobserved inputs. Input and output spike trains were recorded from hippocampal CA3 and CA1 regions of rats performing a spatial delayed-nonmatch-to-sample memory task that requires normal hippocampal function. Kernels were expanded with Laguerre basis functions and estimated using a maximum-likelihood method. Complexity of the feedforward kernel was progressively increased to capture higher-order system nonlinear dynamics. Results showed higher prediction accuracies as kernel complexity increased. Self-kernels describe the nonlinearities within each input. Cross-kernels capture the nonlinear interaction between inputs. Second- and third-order nonlinear models were found to successfully predict the CA1 output spike distribution based on CA3 input spike trains. First-order, linear models were shown to be insufficient.

The encoding of mechanical stimuli into action potentials in two types of spider mechanoreceptor neurons is modeled by use of the principal dynamic modes (PDM) methodology. The PDM model is equivalent to the general Wiener-Bose model and consists of a minimum set of linear dynamic filters (PDMs), followed by a multivariate static nonlinearity and a threshold function. The PDMs are obtained by performing eigen-decomposition of a matrix constructed using the first-order and second-order Volterra kernels of the system, which are estimated by means of the Laguerre expansion technique, utilizing measurements of pseudorandom mechanical stimulation (input signal) and the resulting action potentials (output signal). The static nonlinearity, which can be viewed as a measure of the probability of action potential firing as a function of the PDM output values, is computed as the locus of points of the latter that correspond to output action potentials. The performance of the model is assessed by computing receiver operating characteristic (ROC) curves, akin to the ones used in decision theory and quantified by computing the area under the ROC curve. Three PDMs are revealed by the analysis. The first PDM exhibits a high-pass characteristic, illustrating the importance of the velocity of slit displacement in the generation of action potentials at the mechanoreceptor output, while the second and third PDMs exhibit band-pass and low-pass characteristics, respectively. The corresponding three-input nonlinearity exhibits asymmetric behavior with respect to its arguments, suggesting directional dependence of the mechanoreceptor response on the mechanical stimulation and the PDM outputs, in agreement to our findings from a previous study (Ann Biomed Eng 27:391-402, 1999). Differences between the Type A and B neurons are observed in the zeroth-order Volterra kernels (related to the average firing), as well as in the magnitudes of the second and third PDMs that perform band-pass and low-pass processing of the input signal, respectively.

A new modeling approach of hippocampal nonlinear dynamics is presented. It is based on Principal Dynamics Modes (PDMs) derived from the Volterra kernels quantifying the hippocampal transformations. The approach is illustrated using data obtained from acute hippocampal slice preparations and from behaving rats performs a memory task. The resulting PDM models are comparable in performance to the Volterra models and require significantly less representational and implementational overhead.

This paper presents a novel modeling approach for neural systems with point-process inputs and outputs (binary time-series of 0's and 1's) that utilizes Boolean operators of modulo-2 multiplication and addition, corresponding to the logical AND and OR operations respectively. The form of the employed mathematical model is akin to a "Boolean-Volterra" model that contains the product terms of all relevant input lags in a hierarchical order, where terms of order higher than first represent nonlinear interactions among the various lagged values of each input point-process or among lagged values of various inputs (if multiple inputs exist) as they reflect on the output. The coefficients of this Boolean model are also binary variables that indicate the presence or absence of the respective term in each specific model/system. Simulations are used to explore the properties of such models and the feasibility of accurate estimation of such models from short data-records in the presence of noise (i.e. spurious spikes). The results demonstrate the feasibility of obtaining reliable estimates of such models, even in the presence of considerable noise in the input and/or output, thus making the proposed approach an attractive candidate for modeling neural systems in a practical context.

Nonlinear kernel models are developed and estimated for the spike train transformation from hippocampal CA3 region to CA1 region. The physiologically plausible model structure consists of nonlinear feedforward kernels that model synaptic transmission and dendritic integration, a linear feedback kernel that models spike-triggered after potential, a threshold, an adder, and a noise term that assesses the system uncertainties. Model parameters are estimated using maximum-likelihood method. Model goodness-of-fit is evaluated using correlation measures and time-rescaling theorem. First order, linear model is shown to be insufficient. Second and third order nonlinear models can successfully predict the output spike distribution.

Much of the research on cannabinoids (CBs) has focused on their effects at the molecular and synaptic level. However, the effects of CBs on the dynamics of neural circuits remains poorly understood. This study aims to disentangle the effects of CBs on the functional dynamics of the hippocampal Schaffer collateral synapse by using data-driven nonparametric modeling. Multi-unit activity was recorded from rats doing an working memory task in control sessions and under the influence of exogenously administered tetrahydrocannabinol (THC), the primary CB found in marijuana. It was found that THC left firing rate unaltered and only slightly reduced theta oscillations. Multivariate autoregressive models, estimated from spontaneous spiking activity, were then used to describe the dynamical transformation from CA3 to CA1. They revealed that THC served to functionally isolate CA1 from CA3 by reducing feedforward excitation and theta information flow. The functional isolation was compensated by increased feedback excitation within CA1, thus leading to unaltered firing rates. Finally, both of these effects were shown to be correlated with memory impairments in the working memory task. By elucidating the circuit mechanisms of CBs, these results help close the gap in knowledge between the cellular and behavioral effects of CBs. [ABSTRACT FROM AUTHOR]

We develop an autoregressive model framework based on the concept of Principal Dynamic Modes (PDMs) for the process of action potential (AP) generation in the excitable neuronal membrane described by the Hodgkin-Huxley (H-H) equations. The model's exogenous input is injected current, and whenever the membrane potential output exceeds a specified threshold, it is fed back as a second input. The PDMs are estimated from the previously developed Nonlinear Autoregressive Volterra (NARV) model, and represent an efficient functional basis for Volterra kernel expansion. The PDM-based model admits a modular representation, consisting of the forward and feedback PDM bases as linear filterbanks for the exogenous and autoregressive inputs, respectively, whose outputs are then fed to a static nonlinearity composed of polynomials operating on the PDM outputs and cross-terms of pair-products of PDM outputs. A two-step procedure for model reduction is performed: first, influential subsets of the forward and feedback PDM bases are identified and selected as the reduced PDM bases. Second, the terms of the static nonlinearity are pruned. The first step reduces model complexity from a total of 65 coefficients to 27, while the second further reduces the model coefficients to only eight. It is demonstrated that the performance cost of model reduction in terms of out-of-sample prediction accuracy is minimal. Unlike the full model, the eight coefficient pruned model can be easily visualized to reveal the essential system components, and thus the data-derived PDM model can yield insight into the underlying system structure and function. [ABSTRACT FROM AUTHOR]