Search

This paper investigates a new class of equations called measure functional differential equations with state-dependent delays. We establish the existence and uniqueness of solutions and present a discussion concerning the appropriate phase space to define these equations. Also, we prove a version of periodic averaging principle to these equations. This type of result was completely open in the literature. These equations involving measure bring the advantage to encompass others such as impulsive, dynamic equations on time scales and difference equations, expanding their application potential. Additionally, we apply our theoretical insights to a real-time optimization strategy, using extremum seeking to validate the stability of an innovative algorithm under state-dependent delays. This application confirm the relevance of our findings in practical scenarios, offering valuable tools for advanced control system design. Our research provides significant contributions to the mathematical field and suggests new directions for future technological developments., Comment: 37 pages, 5 figures, 1 table

The development of extremum seeking (ES) has progressed, over the past hundred years, from static maps, to finite-dimensional dynamic systems, to networks of static and dynamic agents. Extensions from ODE dynamics to maps and agents that incorporate delays or even partial differential equations (PDEs) is the next natural step in that progression through ascending research challenges. This paper reviews results on algorithm design and theory of ES for such infinite-dimensional systems. Both hyperbolic and parabolic dynamics are presented: delays or transport equations, heat-dominated equation, wave equations, and reaction-advection-diffusion equations. Nash equilibrium seeking (NES) methods are introduced for noncooperative game scenarios of the model-free kind and then specialized to single-agent optimization. Even heterogeneous PDE games, such as a duopoly with one parabolic and one hyperbolic agent, are considered. Several engineering applications are touched upon for illustration, including flow-traffic control for urban mobility, oil-drilling systems, deep-sea cable-actuated source seeking, additive manufacturing modeled by the Stefan PDE, biological reactors, light-source seeking with flexible-beam structures, and neuromuscular electrical stimulation., Comment: Preprint submitted to IEEE Control Systems Magazine (Special Issue: Into the Second Century of Extremum Seeking Control, 38 pages and 34 figures)

This paper deals with sliding mode control for multivariable polytopic uncertain systems. We provide systematic procedures to design variable structure controllers (VSCs) and unit-vector controllers (UVCs). Based on suitable representations for the closed-loop system, we derive sufficient conditions in the form of linear matrix inequalities (LMIs) to design the robust sliding mode controllers such that the origin of the closed-loop system is globally stable in finite time. Moreover, by noticing that the reaching time depends on the initial condition and the decay rate, we provide convex optimization problems to design robust controllers by considering the minimization of the reaching time associated with a given set of initial conditions. Two examples illustrate the effectiveness of the proposed approaches., Comment: 8 pages, 4 figures

This paper addresses the design and analysis of a multivariable gradient-based stochastic extremum-seeking control method for multi-input systems with arbitrary input delays. The approach accommodates systems with distinct time delays across input channels and achieves local exponential stability of the closed-loop system, guaranteeing convergence to a small neighborhood around the extremum point. By incorporating phase compensation for dither signals and a novel predictor-feedback mechanism with averaging-based estimates of the unknown gradient and Hessian, the proposed method overcomes traditional challenges associated with arbitrary, distinct input delays. Unlike previous work on deterministic multiparameter extremum-seeking with distinct input delays, this stability analysis is achieved without using backstepping transformations, simplifying the predictor design and enabling a more straightforward implementation. Specifically, the direct application of Artstein's reduction approach results in delay- and system-dimension-independent convergence rates, enhancing practical applicability. A numerical example illustrates the robust performance and advantages of the proposed delay-compensated stochastic extremum-seeking method., Comment: 8 pages, 8 figures

Giardia lamblia is a flagellate intestinal protozoan with global distribution causing the disease known as giardiasis. This parasite is responsable for 35.1% of outbreaks of diarrhea caused by contaminated water which and mainly affects children in whom it can cause physical and cognitive impairment. In this paper, we consider a model of population dynamics to represent the behavior of Giardia lamblia in vitro, taking into account its mutation characteristic that guarantees to the protozoan resistance to the drug metronidazole. Different from what is found in the literature, it is pursued as the control objective the extermination of the protozoan considering that the parameters of the model are uncertain and only the partial measurement of the state vector is possible. On these assumptions, a control law is designed and the stability of the closed-loop system is rigorously proved. Simulation and experimental results illustrate the benefits of the proposed population control method of Giardia lamblia., Comment: 7 pages, 5 figures, 1 Table

This paper presents the design of an extremum seeking controller based on sliding modes and cyclic search for real-time optimization of non-linear multivariable dynamic systems. These systems have arbitrary relative degree, compensated by the technique of time-scaling. The resulting approach guarantees global convergence of the system output to a small neighborhood of the optimum point. To corroborate with the theoretical results, numerical simulations are presented considering a system with two inputs and one output, which rapidly converges to the optimal parameters of the objective function., Comment: 6 pages, 5 figures

This paper deals with the gradient extremum seeking control for static scalar maps with actuators governed by distributed diffusion partial differential equations (PDEs). To achieve the real-time optimization objective, we design a compensation controller for the distributed diffusion PDE via backstepping transformation in infinite dimensions. A further contribution of this paper is the appropriate motion planning design of the so-called probing (or perturbation) signal, which is more involved than in the non-distributed counterpart. Hence, with these two design ingredients, we provide an averaging-based methodology that can be implemented using the gradient and Hessian estimates. Local exponential stability for the closed-loop equilibrium of the average error dynamics is guaranteed through a Lyapunov-based analysis. By employing the averaging theory for infinite-dimensional systems, we prove that the trajectory converges to a small neighborhood surrounding the optimal point. The effectiveness of the proposed extremum seeking controller for distributed diffusion PDEs in cascade of nonlinear maps to be optimized is illustrated by means of numerical simulations., Comment: 8 pages and 7 figures

This paper discusses the design of an extremum seeking controller that relies on a monitoring function for a class of SISO uncertain nonlinear systems characterized by arbitrary and uncertain relative degree. Our demonstration illustrates the feasibility of achieving an arbitrarily small proximity to the desired optimal point through output feedback. The core concept involves integrating a monitoring function with a norm state observer for the unitary relative degree case and its expansion to arbitrary relative degrees by means of the employment of a time-scaling technique. Significantly, our proposed scheme attains the extremum of an unknown nonlinear mapping across the entire domain of initial conditions, ensuring global convergence and stability for the real-time optimization algorithm. Furthermore, we provide tuning rules to ensure convergence to the global maximum in the presence of local extrema. To validate the effectiveness of the proposed approach, we present a numerical example and apply it to a source-seeking problem involving a cart-track linear positioning servomechanism. Notably, the cart lacks the ability to sense its velocity or the source's position, but can detect the source of a light signal of unknown concentration field., Comment: 27 pages, 14 figures

This paper introduces a new method to achieve stable convergence to Nash equilibrium in duopoly noncooperative games. Inspired by the recent fixed-time Nash Equilibrium seeking (NES) as well as prescribed-time extremum seeking (ES) and source seeking schemes, our approach employs a distributed sliding mode control (SMC) scheme, integrating extremum seeking with sinusoidal perturbation signals to estimate the pseudogradients of quadratic payoff functions. Notably, this is the first attempt to address noncooperative games without relying on models, combining classical extremum seeking with relay components instead of proportional control laws. We prove finite-time convergence of the closed-loop average system to Nash equilibrium using stability analysis techniques such as time-scaling, Lyapunov's direct method, and averaging theory for discontinuous systems. Additionally, we quantify the size of residual sets around the Nash equilibrium and validate our theoretical results through simulations., Comment: 8 pages and 2 figures. arXiv admin note: substantial text overlap with arXiv:2404.07287

This paper proposes a novel approach for locally stable convergence to Nash equilibrium in duopoly noncooperative games based on a distributed event-triggered control scheme. The proposed approach employs extremum seeking, with sinusoidal perturbation signals applied to estimate the Gradient (first derivative) of unknown quadratic payoff functions. This is the first instance of noncooperative games being tackled in a model-free fashion integrated with the event-triggered methodology. Each player evaluates independently the deviation between the corresponding current state variable and its last broadcasted value to update the player action, while they preserve control performance under limited bandwidth of the actuation paths and still guarantee stability for the closed-loop dynamics. In particular, the stability analysis is carried out using time-scaling technique, Lyapunov's direct method and averaging theory for discontinuous systems. We quantify the size of the ultimate small residual sets around the Nash equilibrium and illustrate the theoretical results numerically on an example.

A second-order Newton-based extremum seeking (SONES) algorithm is presented to estimate directional inflection points for multivariable static maps. The design extends the first-order Newton-based extremum seeking algorithm that drives the system toward its peak point. This work provides perturbation matrices to estimate the second- and third-order derivatives necessary for implementation of the SONES. A set of conditions are provided for the probing frequencies that ensure accurate estimation of the derivatives. A differential Riccati filter is used to calculate the inverse of the third-order derivative. The local stability of the new algorithm is proven for general multivariable static maps using averaging analysis. The proposed algorithm ensures uniform convergence toward directional inflection point without requiring information about the curvature of the map and its gradient. Simulation results show the effectiveness of the proposed algorithm.

This paper proposes an event-triggered control scheme for multivariable extremum seeking of static maps. Both static and dynamic triggering conditions are developed. Integrating Lyapunov and averaging theories for discontinuous systems, a systematic design procedure and stability analysis are developed. Both event-based methods enable one to achieve an asymptotic stability result. Ultimately, the resulting closed-loop dynamics demonstrates the advantages of combining both approaches, namely, event-triggered control and extremum seeking. Although we keep the presentation using the classical event-triggered method, the extension of the results for the periodic event-triggered approach is also indicated. An illustration of the benefits of the new control method is presented using consistent simulation results, which compare the static and the dynamic triggering approaches., Comment: 21 pages, 6 figures, and 1 table

This paper presents the design and analysis of the extremum seeking for static maps with input passed through a partial differential equation (PDE) of the diffusion type defined on a time-varying spatial domain whose boundary position is governed by an ordinary differential equation (ODE). This is the first effort to pursue an extension of extremum seeking from the heat PDE to the Stefan PDE. We compensate the average-based actuation dynamics by a controller via backstepping transformation for the moving boundary, which is utilized to transform the original coupled PDE-ODE into a target system whose exponential stability of the average equilibrium of the average system is proved. The discussion for the delay-compensated extremum seeking control of the Stefan problem is also presented and illustrated with numerical simulations., Comment: 10 pages and 10 figures

This paper develops boundary control for freeway traffic with a downstream bottleneck. Traffic on a freeway segment with capacity drop at outlet of the segment is a common phenomenon leading to traffic bottleneck problem. The capacity drop can be caused by lane-drop, hills, tunnel, bridge or curvature on the road. If incoming traffic flow remains unchanged, traffic congestion forms upstream of the bottleneck due to outgoing traffic overflowing its capacity. Therefore, it is important for us to regulate the incoming traffic flow of the segment so that the outgoing traffic at the bottleneck can be discharged with the maximum flow rate. Traffic densities on the freeway segment are described with Lighthill-Whitham-Richards (LWR) macroscopic Partial Differential Equation (PDE) model. To prevent the traffic congestion forming upstream of the bottleneck, incoming flow at the inlet of the freeway segment is controlled so that the optimal density could be achieved to maximize the outgoing flow and not to surpass the capacity at outlet. The density and traffic flow relation, described with fundamental diagram, is assumed to be unknown at the bottleneck area. We tackle this problem using Extremum Seeking (ES) Control with delay compensation for LWR PDE. ES control, a non-model based approach for real-time optimization, is adopted to find the optimal density for the unknown fundamental diagram. A predictor feedback control design is proposed to compensate the delay effect of traffic dynamics in the freeway segment. In the end, simulation results validate a desired performance of the controller on the nonlinear LWR model with an unknown fundamental diagram.