Search

This paper addresses the problem of consistently estimating a continuous-time (CT) diffusively coupled network (DCN) to identify physical components in a physical network. We develop a three-step frequency-domain identification method for linear CT DCNs that allows to accurately recover all the physical component values of the network while exploiting the particular symmetric structure in a DCN model. This method uses the estimated noise covariance as a non-parametric noise model to minimize variance of the parameter estimates, obviating the need to select a parametric noise model. Moreover, this method is extended to subnetworks identification, which enables identifying the local dynamics in DCNs on the basis of partial measurements. The method is illustrated with an application from In-Circuit Testing of printed circuit boards. Experimental results highlight the method's ability to consistently estimate component values in a complex network with only a single excitation., Comment: 12 pages, 6 figures, extended version of paper submitted to European Control Conference, 2025, Thessaloniki, Greece

When estimating models of of a multivariable dynamic system, a typical condition for consistency is to require the input signals to be persistently exciting, which is guaranteed if the input spectrum is positive definite for a sufficient number of frequencies. In this paper it is investigated how such a condition can be relaxed by exploiting prior structural information on the multivariable system, such as structural zero elements in the transfer matrix or entries that are a priori known and therefore not parametrized. It is shown that in particular situations the data-informativity condition can be decomposed into different MISO (multiple input single output) situations, leading to relaxed conditions for the MIMO (multiple input multiple output) model. When estimating a single module in a linear dynamic network, the data-informativity conditions can generically be formulated as path-based conditions on the graph of the network. The new relaxed conditions for data-informativity will then also lead to relaxed path-based conditions on the network graph. Additionally the new expressions are shown to be closely related to earlier derived conditions for (generic) single module identifiability., Comment: 15 pages, 3 figures

Control in a classical transfer function or state-space setting typically views a controller as a signal processor: sensor outputs are mapped to actuator inputs. In behavioral system theory, control is simply viewed as interconnection; the interconnection of a plant with a controller. In this paper we consider the problem of control of interconnected systems in a behavioral setting. The behavioral setting is especially fit for modelling interconnected systems, because it allows for the interconnection of subsystems without imposing inputs and outputs. We introduce a so-called canonical distributed controller that implements a given interconnected behavior that is desired, provided that necessary and sufficient conditions hold true. The controller design can be performed in a decentralized manner, in the sense that a local controller only depends on the local system behavior. Regularity of interconnections is an important property in behavioral control that yields feedback interconnections. We provide conditions under which the interconnection of this distributed controller with the plant is regular. Furthermore, we show that the interconnections of subsystems of the canonical distributed controller are regular if and only if the interconnections of the plant and desired behavior are regular.

In order to identify a system (module) embedded in a dynamic network, one has to formulate a multiple-input estimation problem that necessitates certain nodes to be measured and included as predictor inputs. However, some of these nodes may not be measurable in many practical cases due to sensor selection and placement issues. This may result in biased estimates of the target module. Furthermore, the identification problem associated with the multiple-input structure may require determining a large number of parameters that are not of particular interest to the experimenter, with increased computational complexity in large-sized networks. In this paper, we tackle these problems by using a data augmentation strategy that allows us to reconstruct the missing node measurements and increase the accuracy of the estimated target module. To this end, we develop a system identification method using regularized kernel-based methods coupled with approximate inference methods. Keeping a parametric model for the module of interest, we model the other modules as Gaussian Processes (GP) with a kernel given by the so-called stable spline kernel. An Empirical Bayes (EB) approach is used to estimate the parameters of the target module. The related optimization problem is solved using an Expectation-Maximization (EM) method, where we employ a Markov-chain Monte Carlo (MCMC) technique to reconstruct the unknown missing node information and the network dynamics. Numerical simulations on dynamic network examples illustrate the potentials of the developed method., Comment: 17 pages, 7 Figures. Draft paper submitted to Automatica

Modeling and control of dynamical systems rely on measured data, which contains information about the system. Finite data measurements typically lead to a set of system models that are unfalsified, i.e., that explain the data. The problem of data-informativity for stabilization or control with quadratic performance is concerned with the existence of a controller that stabilizes all unfalsified systems or achieves a desired quadratic performance. Recent results in the literature provide informativity conditions for control based on input-state data and ellipsoidal noise bounds, such as energy or magnitude bounds. In this paper, we consider informativity of input-state data for control where noise bounds are defined through the cross-covariance of the noise with respect to an instrumental variable; bounds that were introduced originally as a noise characterization in parameter bounding identification. The considered cross-covariance bounds are defined by a finite number of hyperplanes, which induce a (possibly unbounded) polyhedral set of unfalsified systems. We provide informativity conditions for input-state data with polyhedral cross-covariance bounds for stabilization and $\mathcal{H}_2$/$\mathcal{H}_\infty$ control through vertex/half-space representations of the polyhedral set of unfalsified systems.

This paper deals with dynamic networks in which the causality relations between the vertex signals are represented by linear time-invariant transfer functions (modules). Considering an acyclic network where only a subset of its vertices are measured and a subset of the vertices are excited, we explore conditions under which all the modules are identifiable on the basis of measurement data. Two sufficient conditions are presented in the paper, where the first condition concerns an identifiability analysis that needs to be performed for each vertex, while the second condition, based on the concept of tree/anti-tree covering, results from a graphical synthesis approach to allocate actuators and sensors in an acyclic network for achieving generic identifiability.

In this paper we develop new data informativity based controller synthesis methods that extend existing frameworks in two relevant directions: a more general noise characterization in terms of cross-covariance bounds and informativity conditions for control based on input-output data. Previous works have derived necessary and sufficient informativity conditions for noisy input-state data with quadratic noise bounds via an S-procedure. Although these bounds do not capture cross-covariance bounds in general, we show that the S-procedure is still applicable for obtaining non-conservative conditions on the data. Informativity-conditions for stability, $\mathcal{H}_\infty$ and $\mathcal{H}_2$ control are developed, which are sufficient for input-output data and also necessary for input-state data. Simulation experiments illustrate that cross-covariance bounds can be less conservative for informativity, compared to norm bounds typically employed in the literature., Comment: In the previous version of this arXiv article and the corresponding L-CSS article, DOI: 10.1109/LCSYS.2021.3139526, there was a typographical error in equation (21) and (25). The equations contain $P_-$, which should be $Y_-$. This typo is corrected in this version

Identification methods for dynamic networks typically require prior knowledge of the network and disturbance topology, and often rely on solving poorly scalable non-convex optimization problems. While methods for estimating network topology are available in the literature, less attention has been paid to estimating the disturbance topology, i.e., the (spatial) noise correlation structure and the noise rank in a filtered white noise representation of the disturbance signal. In this work we present an identification method for dynamic networks, in which an estimation of the disturbance topology precedes the identification of the full dynamic network with known network topology. To this end we extend the multi-step Sequential Linear Regression and Weighted Null Space Fitting methods to deal with reduced rank noise, and use these methods to estimate the disturbance topology and the network dynamics in the full measurement situation. As a result, we provide a multi-step least squares algorithm with parallel computation capabilities and that rely only on explicit analytical solutions, thereby avoiding the usual non-convex optimizations involved. Consequently we consistently estimate dynamic networks of Box Jenkins model structure, while keeping the computational burden low. We provide a consistency proof that includes path-based data informativity conditions for allocation of excitation signals in the experimental design. Numerical simulations performed on a dynamic network with reduced rank noise clearly illustrate the potential of this method., Comment: 17 pages, 4 figures, accepted and published in Automatica Volume 141, July 2022

Physical dynamic networks most commonly consist of interconnections of physical components that can be described by diffusive couplings. These diffusive couplings imply that the cause-effect relationships in the interconnections are symmetric and therefore physical dynamic networks can be represented by undirected graphs. This paper shows how prediction error identification methods developed for linear time-invariant systems in polynomial form can be configured to consistently identify the parameters and the interconnection structure of diffusively coupled networks. Further, a multi-step least squares convex optimization algorithm is developed to solve the nonconvex optimization problem that results from the identification method.

In classical approaches of dynamic network identification, in order to identify a system (module) embedded in a dynamic network, one has to formulate a Multi-input-Single-output (MISO) identification problem that requires identification of a parametric model for all the modules constituting the MISO setup including (possibly) the noise model, and determine their model order. This requirement leads to model order selection steps for modules that are of no interest to the experimenter which increases the computational complexity for large-sized networks. Also, identification using a parametric noise model (like BJ method) can suffer from local minima, however neglecting the noise model has its impact on the variance of the estimates. In this paper, we provide a two-step identification approach to avoid these problems. The first step involves performing a non-parametric indirect approach for a MISO identification problem to get the non-parametric frequency response function (FRF) estimates and its variance as a function of frequency. In the second step, the estimated non-parametric FRF of the target module is smoothed using a parametric frequency domain estimator with the estimated variance from the previous step as the non-parametric noise model. The developed approach is practical with weak assumptions on noise, uses the available toolbox, requires a parametric model only for the target module of interest, and uses a non-parametric noise model to reduce the variance of the estimates. Numerical simulations illustrate the potentials of the introduced method in comparison with the classical identification methods., Comment: 8 pages, 5 figures, Submitted for publication in Automatica, 22 May 2021

This paper considers dynamic networks where vertices and edges represent manifest signals and causal dependencies among the signals, respectively. We address the problem of how to determine if the dynamics of a network can be identified when only partial vertices are measured and excited. A necessary condition for network identifiability is presented, where the analysis is performed based on identifying the dependency of a set of rational functions from excited vertices to measured ones. This condition is further characterised by using an edge-removal procedure on the associated bipartite graph. Moreover, on the basis of necessity analysis, we provide a necessary and sufficient condition for identifiability in circular networks.

The increase in available data and complexity of dynamical systems has sparked the research on data-based system performance analysis and controller design. Recent approaches can guarantee performance and robust controller synthesis based on noisy input-state data of a single dynamical system. In this paper, we extend a recent data-based approach for guaranteed performance analysis to distributed analysis of interconnected linear systems. We present a new set of sufficient LMI conditions based on noisy input-state data that guarantees $\mathcal{H}_\infty$ performance and have a structure that lends itself well to distributed controller synthesis from data. Sufficient LMI conditions based on noisy data are provided for the existence of a dynamic distributed controller that achieves $\mathcal{H}_\infty$ performance. The presented approach enables scalable analysis and control of large-scale interconnected systems from noisy input-state data sets.

Identifiability of a single module in a network of transfer functions is determined by whether a particular transfer function in the network can be uniquely distinguished within a network model set, on the basis of data. Whereas previous research has focused on the situations that all network signals are either excited or measured, we develop generalized analysis results for the situation of partial measurement and partial excitation. As identifiability conditions typically require a sufficient number of external excitation signals, this work introduces a novel network model structure such that excitation from unmeasured noise signals is included, which leads to less conservative identifiability conditions than relying on measured excitation signals only. More importantly, graphical conditions are developed to verify global and generic identifiability of a single module based on the topology of the dynamic network. Depending on whether the input or the output of the module can be measured, we present four identifiability conditions which cover all possible situations in single module identification. These conditions further lead to synthesis approaches for allocating excitation signals and selecting measured signals, to warrant single module identifiability. In addition, if the identifiability conditions are satisfied, indirect identification methods are developed to provide a consistent estimate of the module. All the obtained results are also extended to identifiability of multiple modules in the network.

In this paper, the problem of synthesizing a distributed controller from data is considered, with the objective to optimize a model-reference control criterion. We establish an explicit ideal distributed controller that solves the model-reference control problem for a structured reference model. On the basis of input-output data collected from the interconnected system, a virtual experiment setup is constructed which leads to a network identification problem. We formulate a prediction-error identification criterion that has the same global optimum as the model-reference criterion, when the controller class contains the ideal distributed controller. The developed distributed controller synthesis method is illustrated on an academic example network of nine subsystems and the influence of the controller interconnection structure on the achieved closed-loop performance is analyzed.

Several studies claim that listening to Mozart music affects cognition and can be used to treat neurological conditions like epilepsy. Research into this Mozart effect has not addressed how dynamic interactions between brain networks, i.e. effective connectivity, are affected. The Granger-causality analysis is often used to infer effective connectivity. First, we investigate if a new method, Bayesian topology identification, can be used as an alternative. Both methods are evaluated on simulation data, where the Bayesian method outperforms the Granger-causality analysis in the inference of connectivity graphs of dynamic networks, especially for short data lengths. In the second part, the Bayesian method is extended to enable the inference of changes in effective connectivity between groups of subjects. Next, we apply both methods to fMRI scans of 16 healthy subjects, who were scanned before and after exposure to Mozart's sonata K448 at least 2 hours a day for 7 days. Here, we investigate if the effective connectivity of the subjects significantly changed after listening to Mozart music. The Bayesian method detected changes in effective connectivity between networks related to cognitive processing and control: First, in the connection from the central executive to the superior sensori-motor network. Second, in the connection from the posterior default mode to the fronto-parietal right network. Finally, in the connection from the anterior default mode to the dorsal attention network, but only in a subgroup of subjects with a longer listening duration. Only in this last connection an effect was found by the Granger-causality analysis.

Identifiability conditions for single or multiple modules in a dynamic network specify under which conditions the considered modules can be uniquely recovered from the second-order statistical properties of the measured signals. Conditions for generic identifiability of multiple modules, i.e. a subnetwork, are developed for the situation that all node signals are measured and excitation of the network is provided by both measured excitation signals and unmeasured disturbance inputs. Additionally, the network model set is allowed to contain non-parametrized modules that are fixed, and e.g. reflect modules of which the dynamics are known to the user. The conditions take the form of path-based conditions on the graph of the network model set. Based on these conditions, synthesis results are formulated for allocating external excitation signals to achieve generic identifiability of particular subnetworks. If there are a sufficient number of measured external excitation signals, the formulated results give rise to a generalized indirect type of identification algorithm that requires only the measurement of a subset of the node signals in the network.

In order to identify one system (module) in an interconnected dynamic network, one typically has to solve a Multi-Input-Single-Output (MISO) identification problem that requires identification of all modules in the MISO setup. For application of a parametric identification method this would require estimating a large number of parameters, as well as an appropriate model order selection step for a possibly large scale MISO problem, thereby increasing the computational complexity of the identification algorithm to levels that are beyond feasibility. An alternative identification approach is presented employing regularized kernel-based methods. Keeping a parametric model for the module of interest, we model the impulse response of the remaining modules in the MISO structure as zero mean Gaussian processes (GP) with a covariance matrix (kernel) given by the first-order stable spline kernel, accounting for the noise model affecting the output of the target module and also for possible instability of systems in the MISO setup. Using an Empirical Bayes (EB) approach the target module parameters are estimated through an Expectation-Maximization (EM) algorithm with a substantially reduced computational complexity, while avoiding extensive model structure selection. Numerical simulations illustrate the potentials of the introduced method in comparison with the state-of-the-art techniques for local module identification., Comment: 15 pages, 7 figures, Submitted for publication in Automatica, 12 May 2020. Final version of paper submitted on 06 January 2021 (To appear in Automatica)

The current limitation in the synthesis of distributed $\mathscr{H}_2$ controllers for linear interconnected systems is scalability due to non-convex or unstructured synthesis conditions. In this paper we develop convex and structured conditions for the existence of a distributed $\mathscr{H}_2$ controller for discrete-time interconnected systems with an interconnection structure that corresponds to an arbitrary graph. Neutral interconnections and a storage function with a block-diagonal structure are utilized to attain coupling conditions that are of a considerably lower computational complexity compared to the corresponding centralized $\mathscr{H}_2$ controller synthesis problem. Additionally, the developed conditions are adapted for the corresponding decentralized $\mathscr{H}_2$ controller synthesis problem with fixed supply functions for the interconnections. The effectiveness and scalability of the developed distributed $\mathscr{H}_2$ controller synthesis method is demonstrated for small- to large-scale oscillator networks on a cycle graph., Comment: Changes in this version include: overview of dissipativity-based results for interconnected systems is removed, result on the existence of a decentralized controller is included and a simulation example for the illustration of scalability replaces the previous simulation example

A recent research direction in data-driven modeling is the identification of dynamic networks, in which measured vertex signals are interconnected by dynamic edges represented by causal linear transfer functions. The major question addressed in this paper is where to allocate external excitation signals such that a network model set becomes generically identifiable when measuring all vertex signals. To tackle this synthesis problem, a novel graph structure, referred to as \textit{directed pseudotree}, is introduced, and the generic identifiability of a network model set can be featured by a set of disjoint directed pseudotrees that cover all the parameterized edges of an \textit{extended graph}, which includes the correlation structure of the process noises. Thereby, an algorithmic procedure is devised, aiming to decompose the extended graph into a minimal number of disjoint pseudotrees, whose roots then provide the appropriate locations for excitation signals. Furthermore, the proposed approach can be adapted using the notion of \textit{anti-pseudotrees} to solve a dual problem, that is to select a minimal number of measurement signals for generic identifiability of the overall network, under the assumption that all the vertices are excited.

The identification of local modules in dynamic networks with known topology has recently been addressed by formulating conditions for arriving at consistent estimates of the module dynamics, under the assumption of having disturbances that are uncorrelated over the different nodes. The conditions typically reflect the selection of a set of node signals that are taken as predictor inputs in a MISO identification setup. In this paper an extension is made to arrive at an identification setup for the situation that process noises on the different node signals can be correlated with each other. In this situation the local module may need to be embedded in a MIMO identification setup for arriving at a consistent estimate with maximum likelihood properties. This requires the proper treatment of confounding variables. The result is a set of algorithms that, based on the given network topology and disturbance correlation structure, selects an appropriate set of node signals as predictor inputs and outputs in a MISO or MIMO identification setup. Three algorithms are presented that differ in their approach of selecting measured node signals. Either a maximum or a minimum number of measured node signals can be considered, as well as a preselected set of measured nodes., Comment: Submitted for publication in IEEE Transactions on Automatic Control, 2 August 2019. arXiv admin note: text overlap with arXiv:1809.07502. Final version of paper scheduled to appear in IEEE Transactions on Automatic Control, Vol. 66, No. 11, November 2021

In networks of dynamic systems, one challenge is to identify the interconnection structure on the basis of measured signals. Inspired by a Bayesian approach in [1], in this paper, we explore a Bayesian model selection method for identifying the connectivity of networks of transfer functions, without the need to estimate the dynamics. The algorithm employs a Bayesian measure and a forward-backward search algorithm. To obtain the Bayesian measure, the impulse responses of network modules are modeled as Gaussian processes and the hyperparameters are estimated by marginal likelihood maximization using the expectation-maximization algorithm. Numerical results demonstrate the effectiveness of this method.

In abstractions of linear dynamic networks, selected node signals are removed from the network, while keeping the remaining node signals invariant. The topology and link dynamics, or modules, of an abstracted network will generally be changed compared to the original network. Abstractions of dynamic networks can be used to select an appropriate set of node signals that are to be measured, on the basis of which a particular local module can be estimated. A method is introduced for network abstraction that generalizes previously introduced algorithms, as e.g. immersion and the method of indirect inputs. For this abstraction method it is shown under which conditions on the selected signals a particular module will remain invariant. This leads to sets of conditions on selected measured node variables that allow identification of the target module., Comment: 17 pages, 7 figures. Paper to appear in Automatica, Vol. 117, July 2020

The identification of local modules in dynamic networks with known topology has recently been addressed by formulating conditions for arriving at consistent estimates of the module dynamics, typically under the assumption of having disturbances that are uncorrelated over the different nodes. The conditions typically reflect the selection of a set of node signals that are taken as predictor inputs in a MISO identification setup. In this paper an extension is made to arrive at an identification setup for the situation that process noises on the different node signals can be correlated with each other. In this situation the local module may need to be embedded in a MIMO identification setup for arriving at a consistent estimate with maximum likelihood properties. This requires the proper treatment of confounding variables. The result is an algorithm that, based on the given network topology and disturbance correlation structure, selects an appropriate set of node signals as predictor inputs and outputs in a MISO or MIMO identification setup. As a first step in the analysis, we restrict attention to the (slightly conservative) situation where the selected output node signals are predicted based on all of their in-neighbor node signals in the network., Comment: Extended version of paper submitted to the 58th IEEE Conf. Decision and Control, Nice, 2019

The problem of identifying single modules in multiple-input-single-output (MISO) systems is considered. A novel approach to distributed identification of MISO finite impulse response systems is presented. The distributed identification is discerned by the local estimation of local parameters, which correspond to a module in the MISO system. The local estimators are derived from the standard recursive least squares estimator and require limited information exchange. By Lyapunov's second method, sufficient conditions are derived for asymptotic convergence of the estimators to the true parameters in the absence of disturbances, which lead to asymptotic unbiasedness in the presence of additive output disturbances.

Recent developments in science and engineering have motivated control systems to be considered as interconnected and networked systems. From a system identification point of view, modelling of a local module in such a structured system is a relevant and interesting problem. This work focuses on the quality, in terms of variance, of an estimate of a local module. We analyse which predictor input signals are relevant and contribute to variance reduction, while still guaranteeing the consistency of the estimate. For a targeted local module, a comparison of its estimate variance is made between a full-MISO approach and an immersed network setting, where a reduced number of inputs is used, while still guaranteeing consistency. A case study of a four-node network is considered and it is shown that a smaller set of predictor inputs can, under some conditions, result in a smaller variance compared to the full-MISO approach., Comment: 6 pages, 6 figures

A recent development in data-driven modelling addresses the problem of identifying dynamic models of interconnected systems, represented as linear dynamic networks. For these networks the notion network identifiability has been introduced recently, which reflects the property that different network models can be distinguished from each other. Network identifiability is extended to cover the uniqueness of a single module in the network model. Conditions for single module identifiability are derived and formulated in terms of path-based topological properties of the network models., Comment: 6 pages, 2 figures, submitted to Control Systems Letters (L-CSS) and the 57th IEEE Conference on Decision and Control (CDC)

Dynamic networks are interconnected dynamic systems with measured node signals and dynamic modules reflecting the links between the nodes. We address the problem of \red{identifying a dynamic network with known topology, on the basis of measured signals}, for the situation of additive process noise on the node signals that is spatially correlated and that is allowed to have a spectral density that is singular. A prediction error approach is followed in which all node signals in the network are jointly predicted. The resulting joint-direct identification method, generalizes the classical direct method for closed-loop identification to handle situations of mutually correlated noise on inputs and outputs. When applied to general dynamic networks with rank-reduced noise, it appears that the natural identification criterion becomes a weighted LS criterion that is subject to a constraint. This constrained criterion is shown to lead to maximum likelihood estimates of the dynamic network and therefore to minimum variance properties, reaching the Cramer-Rao lower bound in the case of Gaussian noise., Comment: 17 pages, 5 figures, revision submitted for publication in Automatica, 4 April 2018

System identification is a common tool for estimating (linear) plant models as a basis for model-based predictive control and optimization. The current challenges in process industry, however, ask for data-driven modelling techniques that go beyond the single unit/plant models. While optimization and control problems become more and more structured in the form of decentralized and/or distributed solutions, the related modelling problems will need to address structured and interconnected systems. An introduction will be given to the current state of the art and related developments in the identification of linear dynamic networks. Starting from classical prediction error methods for open-loop and closed-loop systems, several consequences for the handling of network situations will be presented and new research questions will be highlighted.

Dynamic networks are structured interconnections of dynamical systems (modules) driven by external excitation and disturbance signals. In order to identify their dynamical properties and/or their topology consistently from measured data, we need to make sure that the network model set is identifiable. We introduce the notion of network identifiability, as a property of a parameterized model set, that ensures that different network models can be distinguished from each other when performing identification on the basis of measured data. Different from the classical notion of (parameter) identifiability, we focus on the distinction between network models in terms of their transfer functions. For a given structured model set with a pre-chosen topology, identifiability typically requires conditions on the presence and location of excitation signals, and on presence, location and correlation of disturbance signals. Because in a dynamic network, disturbances cannot always be considered to be of full-rank, the reduced-rank situation is also covered, meaning that the number of driving white noise processes can be strictly less than the number of disturbance variables. This includes the situation of having noise-free nodes., Comment: Provisionally accepted for publication in Automatica