Search

We introduce a novel dataset for multi-robot activity recognition (MRAR) using two robotic arms integrating WiFi channel state information (CSI), video, and audio data. This multimodal dataset utilizes signals of opportunity, leveraging existing WiFi infrastructure to provide detailed indoor environmental sensing without additional sensor deployment. Data were collected using two Franka Emika robotic arms, complemented by three cameras, three WiFi sniffers to collect CSI, and three microphones capturing distinct yet complementary audio data streams. The combination of CSI, visual, and auditory data can enhance robustness and accuracy in MRAR. This comprehensive dataset enables a holistic understanding of robotic environments, facilitating advanced autonomous operations that mimic human-like perception and interaction. By repurposing ubiquitous WiFi signals for environmental sensing, this dataset offers significant potential aiming to advance robotic perception and autonomous systems. It provides a valuable resource for developing sophisticated decision-making and adaptive capabilities in dynamic environments.

Motivated by the growing use of Artificial Intelligence (AI) tools in control design, this paper takes the first steps towards bridging the gap between results from Direct Gradient methods for the Linear Quadratic Regulator (LQR), and neural networks. More specifically, it looks into the case where one wants to find a Linear Feed-Forward Neural Network (LFFNN) feedback that minimizes a LQR cost. This paper starts by computing the gradient formulas for the parameters of each layer, which are used to derive a key conservation law of the system. This conservation law is then leveraged to prove boundedness and global convergence of solutions to critical points, and invariance of the set of stabilizing networks under the training dynamics. This is followed by an analysis of the case where the LFFNN has a single hidden layer. For this case, the paper proves that the training converges not only to critical points but to the optimal feedback control law for all but a set of measure-zero of the initializations. These theoretical results are followed by an extensive analysis of a simple version of the problem (the ``vector case''), proving the theoretical properties of accelerated convergence and robustness for this simpler example. Finally, the paper presents numerical evidence of faster convergence of the training of general LFFNNs when compared to traditional direct gradient methods, showing that the acceleration of the solution is observable even when the gradient is not explicitly computed but estimated from evaluations of the cost function.

Vision-based methods are commonly used in robotic arm activity recognition. These approaches typically rely on line-of-sight (LoS) and raise privacy concerns, particularly in smart home applications. Passive Wi-Fi sensing represents a new paradigm for recognizing human and robotic arm activities, utilizing channel state information (CSI) measurements to identify activities in indoor environments. In this paper, a novel machine learning approach based on discrete wavelet transform and vision transformers for robotic arm activity recognition from CSI measurements in indoor settings is proposed. This method outperforms convolutional neural network (CNN) and long short-term memory (LSTM) models in robotic arm activity recognition, particularly when LoS is obstructed by barriers, without relying on external or internal sensors or visual aids. Experiments are conducted using four different data collection scenarios and four different robotic arm activities. Performance results demonstrate that wavelet transform can significantly enhance the accuracy of visual transformer networks in robotic arms activity recognition., Comment: Accepted at 2024 IEEE International Symposium on Personal, Indoor and Mobile Radio Communications

This paper introduces a novel method for the stability analysis of positive feedback systems with a class of fully connected feedforward neural networks (FFNN) controllers. By establishing sector bounds for fully connected FFNNs without biases, we present a stability theorem that demonstrates the global exponential stability of linear systems under fully connected FFNN control. Utilizing principles from positive Lur'e systems and the positive Aizerman conjecture, our approach effectively addresses the challenge of ensuring stability in highly nonlinear systems. The crux of our method lies in maintaining sector bounds that preserve the positivity and Hurwitz property of the overall Lur'e system. We showcase the practical applicability of our methodology through its implementation in a linear system managed by a FFNN trained on output feedback controller data, highlighting its potential for enhancing stability in dynamic systems., Comment: 6 pages, 7 figures, to be published in IEEE Control Systems Letters (L-CSS)

Numerical ``direct'' approaches to time-optimal control often fail to find solutions that are singular in the sense of the Pontryagin Maximum Principle, performing better when searching for saturated (bang-bang) solutions. In previous work by one of the authors, singular solutions were shown to exist for the time-optimal control problem for fully actuated mechanical systems under hard torque constraints. Explicit formulas, based on a Lie theoretic analysis of the problem, were given for singular segments of trajectories, but the global structure of solutions remains unknown. In this work, we review the aforementioned framework, and show how to effectively combine these formulas with the use of general-purpose optimal control software packages. By using the explicit formula given by the theory in the intervals where the numerical solution enters a singular arc, we not only obtain an algebraic expression for the control in that interval but we are also able to remove artifacts present in the numerical solution. In this way, the best features of numerical algorithms and theory complement each other and provide a better picture of the global optimal structure. We illustrate the technique on a two degree of freedom robotic arm example, using two distinct optimal control numerical software packages running on different programming languages.

This paper addresses the challenge of network synchronization under limited communication, involving heterogeneous agents with different dynamics and various network topologies, to achieve consensus. We investigate the distributed adaptive control for interconnected unknown linear subsystems with a leader and followers, in the presence of input-output disturbance. We enhance the communication within multi-agent systems to achieve consensus under the leadership's guidance. While the measured variable is similar among the followers, the incoming measurements are weighted and constructed based on their proximity to the leader. We also explore the convergence rates across various balanced topologies (Star-like, Cyclic-like, Path, Random), featuring different numbers of agents, using three distributed algorithms, ranging from first- to high-order tuners to effectively address time-varying regressors. The mathematical foundation is rigorously presented from the network designs of the unknown agents following a leader, to the distributed methods. Moreover, we conduct several numerical simulations across various networks, agents and tuners to evaluate the effects of sparsity in the interaction between subsystems using the $L_2-$norm and $L_\infty-$norm. Some networks exhibit a trend where an increasing number of agents results in smaller errors, although this is not universally the case. Additionally, patterns observed at initial times may not reliably predict overall performance across different networks. Finally, we demonstrate that the proposed modified high-order tuner outperforms its counterparts, and we provide related insights along with our conclusions., Comment: This is the extended version of the paper accepted for publication in IEEE Control Systems Letters (L-CSS). On page(s): 1421-1426. 2024

Despite the current surge of interest in autonomous robotic systems, robot activity recognition within restricted indoor environments remains a formidable challenge. Conventional methods for detecting and recognizing robotic arms' activities often rely on vision-based or light detection and ranging (LiDAR) sensors, which require line-of-sight (LoS) access and may raise privacy concerns, for example, in nursing facilities. This research pioneers an innovative approach harnessing channel state information (CSI) measured from WiFi signals, subtly influenced by the activity of robotic arms. We developed an attention-based network to classify eight distinct activities performed by a Franka Emika robotic arm in different situations. Our proposed bidirectional vision transformer-concatenated (BiVTC) methodology aspires to predict robotic arm activities accurately, even when trained on activities with different velocities, all without dependency on external or internal sensors or visual aids. Considering the high dependency of CSI data on the environment motivated us to study the problem of sniffer location selection, by systematically changing the sniffer's location and collecting different sets of data. Finally, this paper also marks the first publication of the CSI data of eight distinct robotic arm activities, collectively referred to as RoboFiSense. This initiative aims to provide a benchmark dataset and baselines to the research community, fostering advancements in the field of robotics sensing., Comment: 11 pages, 11 figures

Autonomous robotic systems have gained a lot of attention, in recent years. However, accurate prediction of robot motion in indoor environments with limited visibility is challenging. While vision-based and light detection and ranging (LiDAR) sensors are commonly used for motion detection and localization of robotic arms, they are privacy-invasive and depend on a clear line-of-sight (LOS) for precise measurements. In cases where additional sensors are not available or LOS is not possible, these technologies may not be the best option. This paper proposes a novel method that employs channel state information (CSI) from WiFi signals affected by robotic arm motion. We developed a convolutional neural network (CNN) model to classify four different activities of a Franka Emika robotic arm. The implemented method seeks to accurately predict robot motion even in scenarios in which the robot is obscured by obstacles, without relying on any attached or internal sensors., Comment: 6 pages, 10 figures, 2 tables, MLSP Conference

Recent research in neural networks and machine learning suggests that using many more parameters than strictly required by the initial complexity of a regression problem can result in more accurate or faster-converging models -- contrary to classical statistical belief. This phenomenon, sometimes known as ``benign overfitting'', raises questions regarding in what other ways might overparameterization affect the properties of a learning problem. In this work, we investigate the effects of overfitting on the robustness of gradient-descent training when subject to uncertainty on the gradient estimation. This uncertainty arises naturally if the gradient is estimated from noisy data or directly measured. Our object of study is a linear neural network with a single, arbitrarily wide, hidden layer and an arbitrary number of inputs and outputs. In this paper we solve the problem for the case where the input and output of our neural-network are one-dimensional, deriving sufficient conditions for robustness of our system based on necessary and sufficient conditions for convergence in the undisturbed case. We then show that the general overparametrized formulation introduces a set of spurious equilibria which lay outside the set where the loss function is minimized, and discuss directions of future work that might extend our current results for more general formulations., Comment: 10 pages, 1 figure, extended conference version

Motivated by biochemical reaction networks, a generalization of the classical secant condition for the stability analysis of cyclic interconnected commensurate fractional-order systems is provided. The main result presents a sufficient condition for stability of networks of cyclic interconnection of fractional-order systems when the digraph describing the network conforms to a single circuit. The condition becomes necessary under a special situation where coupling weights are uniform. We then investigate the robustness of fractional-order linear networks. Robustness performance of a fractional-order linear network is quantified using the $\mathcal{H}_2$-norm of the dynamical system. Finally, the theoretical results are confirmed via some numerical illustrations.

During an epidemic, infectious individuals might not be detectable until some time after becoming infected. The studies show that carriers with mild or no symptoms are the main contributors to the transmission of a virus within the population. The average time it takes to develop the symptoms causes a delay in the spread dynamics of the disease. When considering the influence of delay on the disease propagation in epidemic networks, depending on the value of the time-delay and the network topology, the peak of epidemic could be considerably different in time, duration, and intensity. Motivated by the recent worldwide outbreak of the COVID-19 virus and the topological extent in which this virus has spread over the course of a few months, this study aims to highlight the effect of time-delay in the progress of such infectious diseases in the meta-population networks rather than individuals or a single population. In this regard, the notions of epidemic network centrality in terms of the underlying interaction graph of the network, structure of the uncertainties, and symptom development duration are investigated to establish a centrality-based analysis of the disease evolution. A convex traffic volume optimization method is then developed to control the outbreak. The control process is done by identifying the sub-populations with the highest centrality and then isolating them while maintaining the same overall traffic volume (motivated by economic considerations) in the meta-population level. The numerical results, along with the theoretical expectations, highlight the impact of time-delay as well as the importance of considering the worst-case scenarios in investigating the most effective methods of epidemic containment.

We develop some basic principles for the design and robustness analysis of a continuous-time bilinear dynamical network, where an attacker can manipulate the strength of the interconnections/edges between some of the agents/nodes. We formulate the edge protection optimization problem of picking a limited number of attack-free edges and minimizing the impact of the attack over the bilinear dynamical network.In particular, the $\mathcal{H}_2$-norm of bilinear systems is known to capture robustness and performance properties analogous to its linear counterpart and provides valuable insights for identifying which edges are most sensitive to attacks. The exact optimization problem is combinatorial in the number of edges, and brute-force approaches show poor scalability. However, we show that the $\mathcal{H}_2$-norm as a cost function is supermodular and, therefore, allows for efficient greedy approximations of the optimal solution. We illustrate and compare the effectiveness of our theoretical findings via numerical simulations., Comment: 8 pages, 7 figures, technical note

We study the problem of jointly designing a sparse sensor and actuator schedule for linear dynamical systems while guaranteeing a control/estimation performance that approximates the fully sensed/actuated setting. We further prove a separation principle, showing that the problem can be decomposed into finding sensor and actuator schedules separately. However, it is shown that this problem cannot be efficiently solved or approximated in polynomial, or even quasi-polynomial time for time-invariant sensor/actuator schedules; instead, we develop deterministic polynomial-time algorithms for a time-varying sensor/actuator schedule with guaranteed approximation bounds. Our main result is to provide a polynomial-time joint actuator and sensor schedule that on average selects only a constant number of sensors and actuators at each time step, irrespective of the dimension of the system. The key idea is to sparsify the controllability and observability Gramians while providing approximation guarantees for Hankel singular values. This idea is inspired by recent results in theoretical computer science literature on sparsification., Comment: arXiv admin note: text overlap with arXiv:1805.00606

This paper studies a strategic model of marketing and product diffusion in social networks. We consider two firms offering substitutable products which can improve their market share by seeding the key individuals in the market. Consumers update their consumption level for each of the two products as the best response to the consumption of their neighbors in the previous period. This results in linear update dynamics for the product consumption. Each consumer receives externality from the consumption of each neighbor where the strength of the externality is higher for consumption of the products of the same firm. We represent the above setting as a duopoly game between the firms and introduce a novel framework that allows for sparse seeding to emerge as an equilibrium strategy. We then study the effect of the network structure on the optimal seeding strategies and the extent to which the strategies can be sparsified. In particular, we derive conditions under which near Nash equilibrium strategies can asymptotically lead to sparse seeding in large populations. The results are illustrated using a core-periphery network.

We investigate notions of network centrality in terms of the underlying coupling graph of the network, structure of exogenous uncertainties, and communication time-delay. Our focus is on time-delay linear consensus networks, where uncertainty is modeled by structured additive noise on the dynamics of agents. The centrality measures are defined using the $\mathcal H_2$-norm of the network. We quantify the centrality measures as functions of time-delay, the graph Laplacian, and the covariance matrix of the input noise. Several practically relevant uncertainty structures are considered, where we discuss two notions of centrality: one w.r.t intensity of the noise and the other one w.r.t coupling strength between the agents. Furthermore, explicit formulas for the centrality measures are obtained for all types of uncertainty structures. Lastly, we rank agents and communication links based on their centrality indices and highlight the role of time-delay and uncertainty structure in each scenario. Our counter intuitive grasp is that some of centrality measures are highly volatile with respect to time-delay.

We analyze performance of a class of time-delay first-order consensus networks from a graph topological perspective and present methods to improve it. The performance is measured by network's square of H-2 norm and it is shown that it is a convex function of Laplacian eigenvalues and the coupling weights of the underlying graph of the network. First, we propose a tight convex, but simple, approximation of the performance measure in order to achieve lower complexity in our design problems by eliminating the need for eigen-decomposition. The effect of time-delay reincarnates itself in the form of non-monotonicity, which results in nonintuitive behaviors of the performance as a function of graph topology. Next, we present three methods to improve the performance by growing, re-weighting, or sparsifying the underlying graph of the network. It is shown that our suggested algorithms provide near-optimal solutions with lower complexity with respect to existing methods in literature., Comment: 16 pages, 11 figures

In this paper, we investigate the problem of actuator selection for linear dynamical systems. We develop a framework to design a sparse actuator schedule for a given large-scale linear system with guaranteed performance bounds using deterministic polynomial-time and randomized approximately linear-time algorithms. First, we introduce systemic controllability metrics for linear dynamical systems that are monotone and homogeneous with respect to the controllability Gramian. We show that several popular and widely used optimization criteria in the literature belong to this class of controllability metrics. Our main result is to provide a polynomial-time actuator schedule that on average selects only a constant number of actuators at each time step, independent of the dimension, to furnish a guaranteed approximation of the controllability metrics in comparison to when all actuators are in use. Our results naturally apply to the dual problem of sensor selection, in which we provide a guaranteed approximation to the observability Gramian. We illustrate the effectiveness of our theoretical findings via several numerical simulations using benchmark examples.

A proper abstraction of a large-scale linear consensus network with a dense coupling graph is one whose number of coupling links is proportional to its number of subsystems and its performance is comparable to the original network. Optimal design problems for an abstracted network are more amenable to efficient optimization algorithms. From the implementation point of view, maintaining such networks are usually more favorable and cost effective due to their reduced communication requirements across a network. Therefore, approximating a given dense linear consensus network by a suitable abstract network is an important analysis and synthesis problem. In this paper, we develop a framework to compute an abstraction of a given large-scale linear consensus network with guaranteed performance bounds using a nearly-linear time algorithm. First, the existence of abstractions of a given network is proven. Then, we present an efficient and fast algorithm for computing a proper abstraction of a given network. Finally, we illustrate the effectiveness of our theoretical findings via several numerical simulations.

In this paper, we investigate the performance analysis and synthesis of distributed system throttlers (DST). A throttler is a mechanism that limits the flow rate of incoming metrics, e.g., byte per second, network bandwidth usage, capacity, traffic, etc. This can be used to protect a service's backend/clients from getting overloaded, or to reduce the effects of uncertainties in demand for shared services. We study performance deterioration of DSTs subject to demand uncertainty. We then consider network synthesis problems that aim to improve the performance of noisy DSTs via communication link modifications as well as server update cycle modifications.

This paper develops some basic principles to study autocatalytic networks and exploit their structural properties in order to characterize their inherent fundamental limits and tradeoffs. In a dynamical system with autocatalytic structure, the system's output is necessary to catalyze its own production. We consider a simplified model of Glycolysis pathway as our motivating application. First, the properties of these class of pathways are investigated through a simplified two-state model, which is obtained by lumping all the intermediate reactions into a single intermediate reaction. Then, we generalize our results to autocatalytic pathways that are composed of a chain of enzymatically catalyzed intermediate reactions. We explicitly derive a hard limit on the minimum achievable $\mathcal L_2$-gain disturbance attenuation and a hard limit on its minimum required output energy. Finally, we show how these resulting hard limits lead to some fundamental tradeoffs between transient and steady-state behavior of the network and its net production.

We propose an axiomatic approach for design and performance analysis of noisy linear consensus networks by introducing a notion of systemic performance measure. This class of measures are spectral functions of Laplacian eigenvalues of the network that are monotone, convex, and orthogonally invariant with respect to the Laplacian matrix of the network. It is shown that several existing gold-standard and widely used performance measures in the literature belong to this new class of measures. We build upon this new notion and investigate a general form of combinatorial problem of growing a linear consensus network via minimizing a given systemic performance measure. Two efficient polynomial-time approximation algorithms are devised to tackle this network synthesis problem: a linearization-based method and a simple greedy algorithm based on rank-one updates. Several theoretical fundamental limits on the best achievable performance for the combinatorial problem is derived that assist us to evaluate optimality gaps of our proposed algorithms. A detailed complexity analysis confirms the effectiveness and viability of our algorithms to handle large-scale consensus networks.

Our goal is to analyze performance of stable linear dynamical networks subject to external stochastic disturbances. The square of the $\mathcal H_2$-norm of the network is used as a performance measure to quantify the expected steady-state dispersion of the outputs of the network. We show that this performance measure can be tightly bounded from below and above by some spectral functions of the state-space matrices of the network. This result is applied to a class of cyclic linear networks and shown that their performance measure scale quadratically with the network size., Comment: 14 pages; submitted for possible journal publication. arXiv admin note: text overlap with arXiv:1403.1494

We consider a network of evolving opinions. It includes multiple individuals with first-order opinion dynamics defined in continuous time and evolving based on a general exogenously defined time-varying underlying graph. In such a network, for an arbitrary fixed initial time, a subset of individuals forms an eminence grise coalition, abbreviated as EGC, if the individuals in that subset are capable of leading the entire network to agreeing on any desired opinion, through a cooperative choice of their own initial opinions. In this endeavor, the coalition members are assumed to have access to full profile of the underlying graph of the network as well as the initial opinions of all other individuals. While the complete coalition of individuals always qualifies as an EGC, we establish the existence of a minimum size EGC for an arbitrary time-varying network; also, we develop a non-trivial set of upper and lower bounds on that size. As a result, we show that, even when the underlying graph does not guarantee convergence to a global or multiple consensus, a generally restricted coalition of agents can steer public opinion towards a desired global consensus without affecting any of the predefined graph interactions, provided they can cooperatively adjust their own initial opinions. Geometric insights into the structure of EGC's are given. The results are also extended to the discrete time case where the relation with Decomposition-Separation Theorem is also made explicit., Comment: 35 pages

In this paper, we develop a novel unified methodology for performance and robustness analysis of linear dynamical networks. We introduce the notion of systemic measures for the class of first--order linear consensus networks. We classify two important types of performance and robustness measures according to their functional properties: convex systemic measures and Schur--convex systemic measures. It is shown that a viable systemic measure should satisfy several fundamental properties such as homogeneity, monotonicity, convexity, and orthogonal invariance. In order to support our proposed unified framework, we verify functional properties of several existing performance and robustness measures from the literature and show that they all belong to the class of systemic measures. Moreover, we introduce new classes of systemic measures based on (a version of) the well--known Riemann zeta function, input--output system norms, and etc. Then, it is shown that for a given linear dynamical network one can take several different strategies to optimize a given performance and robustness systemic measure via convex optimization. Finally, we characterized an interesting fundamental limit on the best achievable value of a given systemic measure after adding some certain number of new weighted edges to the underlying graph of the network., Comment: Submitted to the IEEE Conference on Decision and Control (IEEE CDC)

We consider performance deterioration of interconnected linear dynamical networks subject to exogenous stochastic disturbances. The focus of this paper is on first-order and second-order linear consensus networks. We employ the expected value of the steady state dispersion of the state of the entire network as a performance measure and develop a graph-theoretic methodology to relate structural specifications of the underlying graphs of the network to the performance measure. We explicitly quantify several inherent fundamental limits on the best achievable levels of performance in linear consensus networks and show that these limits of performance are merely imposed by the specific structure of the underlying graphs. Furthermore, we discover new connections between notions of sparsity and the performance measure. Particularly, we characterize several fundamental tradeoffs that reveal interplay between the performance measure and various sparsity measures of a linear consensus network. At the end, we apply our results to two real-world dynamical networks and provide energy interpretations for the proposed performance measures. It is shown that the total power loss in synchronous power networks and total kinetic energy of a network of autonomous vehicles in a formation are viable performance measure for these networks and fundamental limits on these measures quantify the best achievable levels of energy-efficiency in these dynamical networks., Comment: 41-pages, One Column

Let $\gamma'_s(G)$ be the signed edge domination number of G. In 2006, Xu conjectured that: for any $2$-connected graph G of order $ n (n \geq 2),$ $\gamma'_s(G)\geq 1$. In this article we show that this conjecture is not true. More precisely, we show that for any positive integer $m$, there exists an $m$-connected graph $G$ such that $ \gamma'_s(G)\leq -\frac{m}{6}|V(G)|.$ Also for every two natural numbers $m$ and $n$, we determine $\gamma'_s(K_{m,n})$, where $K_{m,n}$ is the complete bipartite graph with part sizes $m$ and $n$.