Search

The interplay between robotics and neuromechanics facilitates discoveries in both fields: nature provides roboticists with design ideas, while robotics research elucidates critical features that confer performance advantages to biological systems. Here, we explore a system particularly well suited to exploit the synergies between biology and robotics: high-speed antenna-based wall following of the American cockroach (Periplaneta americana). Our approach integrates mathematical and hardware modeling with behavioral and neurophysiological experiments. Specifically, we corroborate a prediction from a previously reported wall-following template--the simplest model that captures a behavior--that a cockroach antenna-based controller requires the rate of approach to a wall in addition to distance, e.g., in the form of a proportional-derivative (PD) controller. Neurophysiological experiments reveal that important features of the wall-following controller emerge at the earliest stages of sensory processing, namely in the antennal nerve. Furthermore, we embed the template in a robotic platform outfitted with a bio-inspired antenna. Using this system, we successfully test specific PD gains (up to a scale) fitted to the cockroach behavioral data in a "real-world" setting, lending further credence to the surprisingly simple notion that a cockroach might implement a PD controller for wall following. Finally, we embed the template in a simulated lateral-leg-spring (LLS) model using the center of pressure as the control input. Importantly, the same PD gains fitted to cockroach behavior also stabilize wall following for the LLS model. Index Terms--Bio-inspiration, biological system modeling, biomimicry, insect antenna, legged locomotion, wall following.

Epidural spinal cord stimulation has been reported to partially restore volitional movement and autonomic functions after motor and sensory-complete spinal cord injury (SCI). Modern spinal cord stimulation platforms offer significant flexibility in spatial and temporal parameters of stimulation delivered. Heterogeneity in SCI and injury-related symptoms necessitate stimulation personalization to maximally restore functions. However, the large multi-dimensional stimulation space makes exhaustive tests impossible. In this paper, we present a Bayesian optimization strategy for identifying personalized optimal stimulation patterns based on the participant’s expressed preference for stimulation settings. We present companion validation protocols for investigating the credibility of learned preference models. The results obtained for five participants in the E-STAND spinal cord stimulation clinical trial are reported. Personalized preference models produced by the proposed learning and optimization algorithm show that there is more similarity in optimal frequency than in pulse width across participants. Across five participants, the average model prediction accuracy is 71.5% in internal cross-validation and 65.6% in prospective validation. Statistical tests of both validation studies show that the ability of the preference models to correctly predict unseen preference data is significantly greater than chance. The personalized preference models are also shown to be significantly correlated with motor task performance across participants. We show that several aspects in participants’ quality of life has been improved over the course of the trial. Overall, the results indicate that the Bayesian preference optimization algorithm could assist clinicians in the systematic programming of individualized therapeutic stimulation settings and improve the therapeutic outcomes. [ABSTRACT FROM AUTHOR]

Neuromodulation technologies such as vagus nerve stimulation and deep brain stimulation, have shown some efficacy in controlling seizures in medically intractable patients. However, inherent patient-to-patient variability of seizure disorders leads to a wide range of therapeutic efficacy. A patient specific approach to determining stimulation parameters may lead to increased therapeutic efficacy while minimizing stimulation energy and side effects. This paper presents a reinforcement learning algorithm that optimizes stimulation frequency for controlling seizures with minimum stimulation energy. We apply our method to a computational model called the epileptor. The epileptor model simulates inter-ictal and ictal local field potential data. In order to apply reinforcement learning to the Epileptor, we introduce a specialized reward function and state-space discretization. With the reward function and discretization fixed, we test the effectiveness of the temporal difference reinforcement learning algorithm (TD(0)). For periodic pulsatile stimulation, we derive a relation that describes, for any stimulation frequency, the minimal pulse amplitude required to suppress seizures. The TD(0) algorithm is able to identify parameters that control seizures quickly. Additionally, our results show that the TD(0) algorithm refines the stimulation frequency to minimize stimulation energy thereby converging to optimal parameters reliably. An advantage of the TD(0) algorithm is that it is adaptive so that the parameters necessary to control the seizures can change over time. We show that the algorithm can converge on the optimal solution in simulation with slow and fast inter-seizure intervals. [ABSTRACT FROM AUTHOR]

This work presents the solution to a class of decentralized linear quadratic state-feedback control problems, in which the plant and controller must satisfy the same combination of delay and sparsity constraints. Using a novel decomposition of the noise history, the control problem is split into independent subproblems that are solved using dynamic programming. The approach presented herein both unifies and generalizes many existing results. [ABSTRACT FROM AUTHOR]

This article introduces Periodically Controlled Hybrid Automata (PCHA) for modular specification of embedded control systems. In a PCHA, control actions that change the control input to the plant occur roughly periodically, while other actions that update the state of the controller may occur in the interim. Such actions could model, for example, sensor updates and information received from higher-level planning modules that change the set point of the controller. Based on periodicity and subtangential conditions, a new sufficient condition for verifying invariant properties of PCHAs is presented. For PCHAs with polynomial continuous vector fields, it is possible to check these conditions automatically using, for example, quantifier elimination or sum of squares decomposition. We examine the feasibility of this automatic approach on a small example. The proposed technique is also used to manually verify safety and progress properties of a fairly complex planner-controller subsystem of an autonomous ground vehicle. Geometric properties of planner-generated paths are derived which guarantee that such paths can be safely followed by the controller. [ABSTRACT FROM AUTHOR]

The interplay between robotics and neuromechanics facilitates discoveries in both fields: nature provides roboticists with design ideas, while robotics research elucidates critical features that confer performance advantages to biological systems. Here, we explore a system particularly well suited to exploit the synergies between biology and robotics: high-speed antenna-based wall following of the American cockroach (Periplaneta americana). Our approach integrates mathematical and hardware modeling with behavioral and neurophysiological experiments. Specifically, we corroborate a prediction from a previously reported wall-following template—the simplest model that captures a behavior—that a cockroach antenna-based controller requires the rate of approach to a wall in addition to distance, e.g., in the form of a proportional-derivative (PD) controller. Neurophysiological experiments reveal that important features of the wall-following con- troller emerge at the earliest stages of sensory processing, namely in the antennal nerve. Furthermore, we embed the template in a robotic platform outfitted with a bio-inspired antenna. Using this system, we successfully test specific PD gains (up to a scale) fitted to the cockroach behavioral data in a "real-world" setting, lending further credence to the surprisingly simple notion that a cockroach might implement a PD controller for wall following. Finally, we embed the template in a simulated lateral-leg-spring (LLS) model using the center of pressure as the control input. Importantly, the same PD gains fitted to cockroach behavior also stabilize wall following for the LLS model. [ABSTRACT FROM AUTHOR]

This paper proposes a method based on semidefinite programming for estimating moments of stochastic hybrid systems (SHSs). The class of SHSs considered herein consists of a finite number of discrete states and a continuous state whose dynamics as well as the reset maps and transition intensities are polynomial in the continuous state. For these SHSs, the dynamics of moments evolve according to a system of linear ordinary differential equations. However, it is generally not possible to exactly solve the system since time evolution of a specific moment may depend upon moments of order higher than it. Our methodology recasts an SHS with multiple discrete modes to a single-mode SHS with algebraic constraints. We then find lower and upper bounds on a moment of interest via a semidefinite program that includes linear constraints obtained from moment dynamics and those arising from the recasting process, along with semidefinite constraints coming from the non-negativity of moment matrices. We illustrate the methodology via an example of SHS. [ABSTRACT FROM AUTHOR]