Search

This article is an editorial that focuses on the topic of decision-making and planning for multi-agent systems. Multi-agent systems are used in various real-world applications, but there are challenges in coordinating the behaviors of multiple agents. The article discusses the difficulties in translating single-agent techniques to the multi-agent domain, including complex interaction dynamics, constrained communication, and heterogeneity. The objective of this research topic is to report on recent advances in multi-agent planning and decision-making and to address the existing challenges in this area. The article includes summaries of five papers that cover different aspects of multi-agent decision-making, such as emergent communication, motion planning, reinforcement learning, and cooperative navigation. These papers provide insights into the complexity of multi-agent systems and suggest potential areas for further research. [Extracted from the article]

In the third paper, I Deep transfer learning: a novel glucose prediction framework for new subjects with Type 2 diabetes i , the authors designed a novel cross-subject glucose prediction framework by integrating instance-based and network-based deep transfer learning via segmented continuous glucose monitoring time series. Control and optimization Six papers have devoted to the computational intelligence-based decision-making and analysis of complex systems. Complex systems, which are composed of many interconnected and interactive functional parts, widely exist in the nature and human society. [Extracted from the article]

This paper investigates state estimation and system consensus control for multiagent systems with nonlinear function under communication topology. A novel weighted fixed-time observer is designed to estimate the system states. The observer designed in this paper takes the output errors of its own agent into account in weight distribution, and the agent state should not be known. A Lyapunov function is designed to make the estimation error globally fast fixed-time stable. This observer-based feedback controller is explored for keeping the consensus error system globally fast fixed-time stable. At last, two examples are considered in the simulation section to illustrate the effectiveness of the weighted fixed-time observer as well as controller. [ABSTRACT FROM AUTHOR]

Various technologies with AI (Artificial Intelligence), DS (Data Science), and/or IoT (Internet of Things) have been starting to be pervasive in e-tourism (i.e., smart tourism). However, most of them for a target (e.g., what to do in such a tourism spot as Hikone Castle) utilize their "typical/major signals" (e.g., taking a photo) as summarized knowledge based on "The Principle of Majority", and tend to filter out not only their noises but also their valuable "peculiar/minor signals" (e.g., view Sawayama Castle) as instantiated knowledge. Therefore, as a challenge to salvage not only "typical signals" but also "peculiar signals" without noises for e-tourism, this paper compares various methods of ML (Machine Learning) to text-classify a tweet as being a "tourism tweet" or not, to precisely mine tourism tweets as not summarized but instantiated knowledge. In addition, this paper proposes a MAS (Multi-Agent Simulation), powered with artisoc, for visualizing "tourism tweets", including not only "typical signals" but also "peculiar signals", whose number can be enormous, as not summarized but instantiated knowledge, i.e., instances of them without any summarization, and validates the effects of the proposed MAS by conducting some experiments with subjects. [ABSTRACT FROM AUTHOR]

The deployment of multi-agent systems (MASs) is widely used in the fields of unmanned agricultural machineries, unmanned aerial vehicles, intelligent transportation, etc. To make up for the defect that the existing PDE-based results are overly idealistic in terms of system models and control strategies, we study the PDE-based deployment of clustered nonlinear first-order and second- order MASs over a finite-time interval (FTI). By designing special communication protocols, the collective dynamics of numerous agents are modeled by simple fist-order and second-order PDEs. Two practical factors, external disturbance and Markov switching topology, are considered in this paper to better match actual situations. Besides, T-S fuzzy technology is used to approximate the unknown nonlinearity of MASs. Then, by using boundary control scheme with collocated measurements, two theorems are obtained to ensure the finite-time H∞ deployment of first-order and second-order agents, respectively. Finally, numerical examples are provided to illustrate the effectiveness of the proposed approaches. [ABSTRACT FROM AUTHOR]

Norms are utilised in agent societies to encourage acceptable behaviour by the participating agents. They can be established or revised from the top-down (authority) or from the bottom-up (populace). The study of norm creation from the bottom-up—or norm emergence/convergence—shows evidence of increasing activity. In consequence, we seek to analyse and categorize the approaches proposed in the literature for facilitating norm emergence. This paper makes three contributions to the study of norm emergence. Firstly, we present the different perspectives of norms and their impact on the norm emergence process, with the aim of comparing their similarities and differences in implementing the norm life cycle. Secondly, we identify the characteristics that support norm emergence that are observed in the emergence literature. Finally, we identify and propose future topics for study for the community, through a discussion of the challenges and opportunities in norm emergence. [ABSTRACT FROM AUTHOR]

Load variation, distributed power output uncertainty and multi‐microgrids network complexity have brought great difficulties to the frequency stability of the whole microgrid. To address this problem, this paper uses a multi‐agent deep reinforcement learning(DRL) algorithm to design the controllers to control the frequency of the multi‐microgrids. Firstly, a load frequency control (LFC) model for multi‐microgrids was built. Secondly, based on the centralized training and decentralized execution (CTDE) multi‐agent reinforcement learning (RL) framework, the multi‐agent soft actor‐critic (MASAC) algorithm was designed and applied to the multi‐microgrids model. The state space and action space of multi‐agent were established according to the frequency deviation of every sub‐microgrid and the output of each distributed power source. The reward function was then established according to the frequency deviation. The appropriate neural network and training parameters were selected to generate the interconnected microgrid controllers through multiple training of pre‐learning. Finally, the simulation study shows that the MASAC controller proposed in this paper can quickly maintain frequency stability when the system is disturbed. Sensitivity analysis shows that the MASAC controller can effectively cope with the uncertainty of the system parameters. [ABSTRACT FROM AUTHOR]

Flocking cohesion is critical for maintaining a group's aggregation and integrity. Designing a potential function to maintain flocking cohesion unaffected by social distance is challenging due to the uncertainty of real-world conditions and environments that cause changes in agents' social distance. Previous flocking research based on potential functions has primarily focused on agents' same social distance and the attraction–repulsion of the potential function, ignoring another property affecting flocking cohesion: well depth, as well as the effect of changes in agents' social distance on well depth. This paper investigates the effect of potential function well depths and agent's social distances on the multi-agent flocking cohesion. Through the analysis, proofs, and classification of these potential functions, we have found that the potential function well depth is proportional to the flocking cohesion. Moreover, we observe that the potential function well depth varies with the agents' social distance changes. Therefore, we design a segmentation potential function and combine it with the flocking control algorithm in this paper. It enhances flocking cohesion significantly and has good robustness to ensure the flocking cohesion is unaffected by variations in the agents' social distance. Meanwhile, it reduces the time required for flocking formation. Subsequently, the Lyapunov theorem and the LaSalle invariance principle prove the stability and convergence of the proposed control algorithm. Finally, this paper adopts two subgroups with different potential function well depths and social distances to encounter for simulation verification. The corresponding simulation results demonstrate and verify the effectiveness of the flocking control algorithm. [ABSTRACT FROM AUTHOR]

Cooperative multi-agent systems make it possible to employ miniature robots in order to perform different experiments for data collection in wide open areas to physical interactions with test subjects in confined environments such as a hive. This paper proposes a new multi-agent path-planning approach to determine a set of trajectories where the agents do not collide with each other or any obstacle. The proposed algorithm leverages a risk-aware probabilistic roadmap algorithm to generate a map, employs node classification to delineate exploration regions, and incorporates a customized genetic framework to address the combinatorial optimization, with the ultimate goal of computing safe trajectories for the team. Furthermore, the proposed planning algorithm makes the agents explore all subdomains in the workspace together as a formation to allow the team to perform different tasks or collect multiple datasets for reliable localization or hazard detection. The objective function for minimization includes two major parts, the traveling distance of all the agents in the entire mission and the probability of collisions between the agents or agents with obstacles. A sampling method is used to determine the objective function considering the agents' dynamic behavior influenced by environmental disturbances and uncertainties. The algorithm's performance is evaluated for different group sizes by using a simulation environment, and two different benchmark scenarios are introduced to compare the exploration behavior. The proposed optimization method establishes stable and convergent properties regardless of the group size. [ABSTRACT FROM AUTHOR]

Understanding the emergence of symbol systems, especially language, requires the construction of a computational model that reproduces both the developmental learning process in everyday life and the evolutionary dynamics of symbol emergence throughout history. This study introduces the collective predictive coding (CPC) hypothesis, which emphasizes and models the interdependence between forming internal representations through physical interactions with the environment and sharing and utilizing meanings through social semiotic interactions within a symbol emergence system. The total system dynamics is theorized from the perspective of predictive coding. The hypothesis draws inspiration from computational studies grounded in probabilistic generative models and language games, including the Metropolis-Hastings naming game. Thus, playing such games among agents in a distributed manner can be interpreted as a decentralized Bayesian inference of representations shared by a multi-agent system. Moreover, this study explores the potential link between the CPC hypothesis and the free-energy principle, positing that symbol emergence adheres to the society-wide free-energy principle. Furthermore, this paper provides a new explanation for why large language models appear to possess knowledge about the world based on experience, even though they have neither sensory organs nor bodies. This paper reviews past approaches to symbol emergence systems, offers a comprehensive survey of related prior studies, and presents a discussion on CPC-based generalizations. Future challenges and potential cross-disciplinary research avenues are highlighted. [ABSTRACT FROM AUTHOR]

This paper addressed the challenging problem of distributed optimization for nonlinear singular perturbation multi-agent systems. The main focus lies in steering the system outputs toward the optimal points of a globally objective function, which was formed by the combination of several local functions. To achieve this objective, the singular perturbation multi-agent system was initially decomposed into fast and slow subsystems. Compared to traditional methods, robustness in referencetracking signals was ensured through the design of fast-slow sliding mode controllers. Additionally, our method ensured robustness against errors between reference signals and optimal values by employing a distributed optimizer to generate precise reference signals. Furthermore, the stability of the entire closed-loop system was rigorously guaranteed through the application of the small-gain theorem. To demonstrate the efficacy of the proposed approach, a numerical example was presented, providing empirical validation of its effectiveness in practical scenarios. [ABSTRACT FROM AUTHOR]

This paper investigates the stability and motion of two interactive oscillating agents. Multiple agents can be controlled in a centralized and/or distributed manner to form specific patterns in cooperative tracking, pursuit, and evasion games, as well as environmental exploration. This paper studies the behavior of two oscillating agents due to their interaction. It shows that, through a combination of selecting oscillation centers and interaction gain, a variety of motions, including limit-cycles and stationary behavior, can be realized. [ABSTRACT FROM AUTHOR]

This paper presents a novel approach to analyzing trends in federated learning (FL) using automatic semantic keyword clustering. The authors collected a dataset of FL research papers from the Scopus database and extracted keywords to form a collection representing the FL research landscape. They employed natural language processing (NLP) techniques, specifically a pre-trained transformer model, to convert keywords into vector embeddings. Agglomerative clustering was then used to identify major thematic trends and sub-areas within FL. The study provides a granular view of the thematic landscape and captures the broader dynamics of research activity in FL. The key focus areas are divided into theoretical areas and practical applications of FL. The authors make their FL paper dataset and keyword clustering results publicly available. This data-driven approach moves beyond manual literature reviews and offers a comprehensive overview of the current evolution of FL. [ABSTRACT FROM AUTHOR]

This paper investigates the problem of spacing control between adjacent trains in train formation and proposes a distributed train-formation speed-convergence cooperative-control algorithm based on barrier Lyapunov function. Considering practical limitations such as communication distance and bandwidth constraints during operation, not all trains can directly communicate with the leader and obtain the expected trajectory it sends, making it difficult to maintain formation consistency as per the predetermined ideal state. Furthermore, to address the challenge of unknown external disturbances encountered by trains during operation, this paper designs a distributed observer deployed on each train in the formation. This observer can estimate and dynamically compensate for unknown reference trajectories and disturbances solely based on the states of adjacent trains. Additionally, to ensure that the spacing between adjacent trains remains within a predefined range, a safety hard constraint, this paper encodes the spacing hard constraint using barrier Lyapunov function. By integrating nonlinear adaptive control theory to handle model parameter uncertainties, a barrier Lyapunov function-based adaptive control method is proposed, which enables all trains to track the reference trajectory while ensuring that the spacing between them remains within the preset interval, therefore guaranteeing the asymptotic stability of the closed-loop system. Finally, a practical example using data from the Guangzhou Metro Line 22, specifically the route from Shiguang Road Station to Chentougang Station over three stations and two sections, is utilized to validate the effectiveness and robustness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

Understanding the peer review process could help research and shed light on the mechanisms that underlie crowdsourcing. In this paper, we present an agent-based model of peer review built on three entities - the paper, the scientist and the conference. The system is implemented on a BDI platform (Jason) that allows to define a rich model of scoring, evaluating and selecting papers for conferences. Then, we propose a programme committee update mechanism based on disagreement control that is able to remove reviewers applying a strategy aimed to prevent papers better than their own to be accepted ("rational cheating"). We analyze a homogeneous scenario, where all conferences aim to the same level of quality, and a heterogeneous scenario, in which conferences request different qualities, showing how this affects the update mechanism proposed. We also present a first step toward an empirical validation of our model that compares the amount of disagreements found in real conferences with that obtained in our simulations. [ABSTRACT FROM AUTHOR]

This paper discusses a Multiagent System architecture and its supporting concepts and technical implementation for food-producing systems. The Food and Beverages industry is in dire need of embracing more advanced industrial digitization practices to be able to meet immediate sustainability requirements. One such challenge is improving and optimizing resource utilization. A more rationalized use of raw materials, production processes and machinery is a key aspect of the latter. At the same time, food is still produced, in many instances, in a very traditional way, particularly when it comes to ingredient selection. The architecture introduced in this paper has the ambition of articulating the supply and demand of food products based in the technical characteristics of food (e.g., composition, nutritional content and value, processing efficiency, and taste profiles) instead of the more traditional characteristics. To that end, the paper introduces, among other key concepts, the notion of the Digital Food Identity Card as an active digital document that stores such technical information and the notion of Dynamic Recipe as an active software entity with the dynamic capability of adjusting production parameters in a recipe to market conditions, as well as coordinating the resources included in the execution of a industrial food recipe. Both concepts are modeled as agents and part of the proposed architecture. Finally, the paper provides a formal grammar for a domain specific language, that can be used by human specialists to define a dynamic recipe and be simultaneously interpreted by Dynamic Recipe Agents to enact the behaviours previously described. The domain specific language is an integral part of the architecture, together with the agent-based formulation, and an important link in creating an effectively data-oriented way of articulating different stake-holder concerns. The proposed solution is informed by requirements elicited within domain experts and sustainability targets that food-producing companies currently must adhere to. [ABSTRACT FROM AUTHOR]

With the development of the Internet of Things (IoT), Big Data, Artificial Intelligence technology, and the emergence of modern information technologies such as intelligent manufacturing, welding systems are changing, and intelligentized welding manufacturing and systems (IWMS) utilizing these technologies are attracting attention from both academia and industry. This paper investigates sensing technology, multi-information sensor fusion technology, feature recognition technology, the quality prediction method, control method, and intelligent welding production line application in the IWMS. Combining IoT technology and multi-agent systems, a hierarchical structure model welding manufacturing system (IoT-MAS) in the form of "leader-following" was constructed. The multi-agent welding manufacturing system has the advantages of distribution, intelligence, internal coordination and so on. The IoT-MAS consists of several sub-agents, which are divided into five categories according to their functions and internal processing logic. Combined with the functions of the intelligent welding manufacturing system, the agent structure of the whole welding process was proposed, and the matching communication technology and algorithm were designed. The intelligent welding manufacturing system based on IoT-MAS proposed in this paper can effectively solve the integrated design problem of large welding manufacturing systems. [ABSTRACT FROM AUTHOR]

The comprehensive and safe application of unmanned surface vessels is certainly one of the biggest challenges currently facing maritime science. Such vessels can be implemented within a wide range of autonomy levels that goes from remote-controlled vessels to fully autonomous vessels in which intelligent vessel systems completely perform all necessary operations. One of the ways to achieve autonomous vessel systems is to implement multi-agent systems that take over all functions performed by the crew in classical manned crew vessels. A vessel is a complex system that conceptually can be considered as a set of interconnected subsystems. Theoretically, the functions of these subsystems could be performed using appropriate multi-agent systems. In this paper we analyzed 24 relevant papers. A review of the current state of implementation of multi-agent systems for performing the functions of unmanned surface vessels is presented. [ABSTRACT FROM AUTHOR]

The applicability of the distance aggregation problem has attracted the interest of many authors. Motivated by this fact, in this paper, we face the modular quasi-(pseudo-)metric aggregation problem, which consists of analyzing the properties that a function must have to fuse a collection of modular quasi-(pseudo-)metrics into a single one. In this paper, we characterize such functions as monotone, subadditive and vanishing at zero. Moreover, a description of such functions in terms of triangle triplets is given, and, in addition, the relationship between modular quasi-(pseudo-)metric aggregation functions and modular (pseudo-)metric aggregation functions is discussed. Specifically, we show that the class of modular (quasi-)(pseudo-)metric aggregation functions coincides with that of modular (pseudo-)metric aggregation functions. The characterizations are illustrated with appropriate examples. A few methods to construct modular quasi-(pseudo-)metrics are provided using the exposed theory. By exploring the existence of absorbent and neutral elements of modular quasi-(pseudo-)metric aggregation functions, we find that every modular quasi-pseudo-metric aggregation function with 0 as the neutral element is an Aumann function, is majored by the sum and satisfies the 1-Lipschitz condition. Moreover, a characterization of those modular quasi-(pseudo-)metric aggregation functions that preserve modular quasi-(pseudo-)metrics is also provided. Furthermore, the relationship between modular quasi-(pseudo-)metric aggregation functions and quasi-(pseudo-)metric aggregation functions is studied. Particularly, we have proven that they are the same only when the former functions are finite. Finally, the usefulness of modular quasi-(pseudo-)metric aggregation functions in multi-agent systems is analyzed. [ABSTRACT FROM AUTHOR]

Autonomous region protection is a significant research area in multi-agent systems, aiming to empower defenders in preventing intruders from accessing specific regions. This paper presents a Multi-agent Region Protection Environment (MRPE) featuring fewer defenders, defender damages, and intruder evasion strategies targeting defenders. MRPE poses challenges for traditional protection methods due to its high nonstationarity and limited interception time window. To surmount these hurdles, we modify evolutionary reinforcement learning, giving rise to the corresponding multi-agent region protection method (MRPM). MRPM amalgamates the merits of evolutionary algorithms and deep reinforcement learning, specifically leveraging Differential Evolution (DE) and Multi-Agent Deep Deterministic Policy Gradient (MADDPG). DE facilitates diverse sample exploration and overcomes sparse rewards, while MADDPG trains defenders and expedites the DE convergence process. Additionally, an elite selection strategy tailored for multi-agent systems is devised to enhance defender collaboration. The paper also presents ingenious designs for the fitness and reward functions to effectively drive policy optimizations. Finally, extensive numerical simulations are conducted to validate the effectiveness of MRPM. [ABSTRACT FROM AUTHOR]

This paper introduces a virtual consensus‐based wide area differential protection method through cooperative control concepts and graph theory. Using multi‐agent systems eliminates the need for a direct telecommunication connection between the protective relays to implement the proposed differential protection. In addition, applying telecommunication subgraphs facilitates the establishment of numerous differential protection areas. Collaboration between protected areas is facilitated by common agents, establishing a wide‐area cooperative protection network. The capability of the network operator to define various protection areas and the collaboration between these areas ensure the versatility of the proposed method for various protection purposes. The present paper primarily represents the application of the proposed protection system as a wide‐area supervisor protection for distance relays. Performance evaluations on an IEEE 39‐bus test system illustrate the method's effectiveness in various scenarios. The results show enhanced power system stability and resilience, particularly when traditional methods struggle to detect power swings with high impedance variation rates. [ABSTRACT FROM AUTHOR]

This paper studies the distributed convex optimization of bipartite containment control problem for a class of higher order nonlinear multi-agent systems with uncertain states. For the optimization problem, the penalty function is constructed by summing the local objective function of each agent and combining the penalty term formed by the adjacency matrix. For the unknown nonlinear function and unpredictable states in the system, this paper construct radial basis function Neural-networks and state observer for approaching, respectively. In order to avoid "explosion of complexity," under the framework of Lyapunov function theory, we propose the dynamic surface control (DSC) technology and design the distributed adaptive backstepping neural network controller to ensure all the signals remain semi-global uniformly ultimately bounded in the closed-loop system and all agents can converge to the convex hull containing each boundary trajectory as well as its opposite trajectory different in sign. Simulation results confirm the feasibility of the proposed control method. [ABSTRACT FROM AUTHOR]

In this paper, two novel methodologies of employing machine learning (here, the type-2 fuzzy system) are presented to control a multiagent system in which the agents are flexible joint robots. In the previous methods, the static mode controller has been investigated, which has little flexibility and cannot measure all the states of the system, but in the method presented in this paper, we can eliminate these disadvantages. The control signal is consisting of feedback from the output and the estimated states of the system. In the first method, the control signal coefficients are calculated from the linear matrix inequality (LMI), followed by a type-2 fuzzy system that adds the compensation signal to the control signal. In the second method, the type-2 fuzzy system is directly used to estimate the control signal coefficients which do not employ LMI. Both methods have their disadvantages and benefits, so in general, one of these two methods cannot be considered superior. To prove the effectiveness of the two proposed methods, a topology with four robots has been considered. Both proposed methods have been evaluated for controlling the angle and speed of the robot link. Also, another simulation was made without using the fuzzy system to verify the importance of our methods. Simulation results indicate the proper efficiency of proposed methods, especially in presence of uncertainty in the system. [ABSTRACT FROM AUTHOR]

In a rapidly evolving digital landscape autonomous tools and robots are becoming commonplace. Recognizing the significance of this development, this paper explores the integration of Large Language Models (LLMs) like Generative pre-trained transformer (GPT) into human-robot teaming environments to facilitate variable autonomy through the means of verbal human-robot communication. In this paper, we introduce a novel simulation framework for such a GPT-powered multi-robot testbed environment, based on a Unity Virtual Reality (VR) setting. This system allows users to interact with simulated robot agents through natural language, each powered by individual GPT cores. By means of OpenAI's function calling, we bridge the gap between unstructured natural language input and structured robot actions. A user study with 12 participants explores the effectiveness of GPT-4 and, more importantly, user strategies when being given the opportunity to converse in natural language within a simulated multi-robot environment. Our findings suggest that users may have preconceived expectations on how to converse with robots and seldom try to explore the actual language and cognitive capabilities of their simulated robot collaborators. Still, those users who did explore were able to benefit from a much more natural flow of communication and human-like back-and-forth. We provide a set of lessons learned for future research and technical implementations of similar systems. [ABSTRACT FROM AUTHOR]

In this paper, we investigate the consensus control problem of Euler–Lagrange systems which can be used to describe the motion of various mechanical systems such as manipulators and quadcopters. We focus on consensus control strategies, which are important for achieving coordinated behavior in multi-agent systems. The paper considers the key challenges posed by random communication delays and packet losses that are increasingly common in networked control systems. In addition, it is assumed that each system receives information from neighboring agents intermittently. Addressing these challenges is critical to ensure the reliability and efficiency of such systems in real-world applications. Communication delay is time-varying and can be very large, but should be smaller than some bounded constant. To decrease the frequency of control input updates, we implement an event-triggered scheme that regulates the controller's updates for each agent. Specifically, it does not update control inputs at traditional fixed intervals, but responds to predefined conditions and introduces a dynamic consensus item to handle information irregularities caused by communication delays and intermittent information exchange. The consensus can be achieved if the communication graph of agents contains a spanning tree with the desired velocity as the root node. That is, all Euler–Lagrange systems need to obtain the desired velocity, directly or indirectly (via neighbors), to reach consensus. We establish that the Zeno behavior can be avoided, ensuring a positive minimum duration between successive event-triggered instances. Finally, we provide simulation results to show the performance of our proposed algorithm. [ABSTRACT FROM AUTHOR]

Mean-field games (MFGs) are developed to model the decision-making processes of a large number of interacting agents in multi-agent systems. This paper studies mean-field games on graphs (G -MFGs). The equilibria of G -MFGs, namely, mean-field equilibria (MFE), are challenging to solve for their high-dimensional action space because each agent has to make decisions when they are at junction nodes or on edges. Furthermore, when the initial population state varies on graphs, we have to recompute MFE, which could be computationally challenging and memory-demanding. To improve the scalability and avoid repeatedly solving G -MFGs every time their initial state changes, this paper proposes physics-informed graph neural operators (PIGNO). The PIGNO utilizes a graph neural operator to generate population dynamics, given initial population distributions. To better train the neural operator, it leverages physics knowledge to propagate population state transitions on graphs. A learning algorithm is developed, and its performance is evaluated on autonomous driving games on road networks. Our results demonstrate that the PIGNO is scalable and generalizable when tested under unseen initial conditions. [ABSTRACT FROM AUTHOR]

The article discusses the advances in fractional-order neural networks and their applications in various fields such as biology, biochemistry, engineering, economics, and physics. Volume II of the Special Issue focuses on the synchronization of fractional-order neural networks, with four papers addressing this topic. Other papers explore variable-order fractionals, non-periodicity of complex maps, impulsive delayed reaction-diffusion gene regulatory networks, split-plot designs, consensus in multi-agent systems, and the mathematical theory of nabla tempered fractional calculus. The editors express their gratitude to the authors and reviewers for their contributions, and believe that the selected papers will enrich readers' knowledge in this field. [Extracted from the article]

When the number of interacting agents in a multi-agent system is large, the detailed study of the dynamics of each agent tends to obfuscate the collective and possibly emergent dynamics of the multi-agent system as a whole. When the interest is on the collective properties of the multi-agent system, a statistical study of the dynamics of the states of the agents can provide a more effective perspective on the system. In particular, a statistical approach can better focus on the long-term asymptotic properties of the studied multi-agent system. The initial part of this paper outlines a framework to approach the study of the collective properties of multi-agent systems. The framework targets large and decentralized multi-agent systems in which the relevant collective properties emerge from interactions. Then, the paper exemplifies the use of the framework to study the long-term asymptotic properties of multi-agent systems in which agents interact using the symmetric gossip algorithm. The state of each agent is represented as a real number, and the use of the framework shows that all agents exponentially converge to the average of their initial states. The analytic results provided by the framework are confirmed by independent multi-agent simulations. Finally, the paper is concluded with a brief discussion of related work and an overview of future extensions. [ABSTRACT FROM AUTHOR]

Digital twins are emerging as a prime analysis, prediction, and control concepts for enabling the Industrie 4.0 vision of cyber-physical production systems (CPPSs). Today's growing complexity and volatility cannot be handled by monolithic digital twins but require a fundamentally decentralized paradigm of cooperating digital twins. Moreover, societal trends such as worldwide urbanization and growing emphasis on sustainability highlight competing goals that must be reflected not just in cooperating but also competing digital twins, often even interacting in "coopetition". This paper argues for multi-agent systems (MASs) to address this challenge, using the example of embedding industrial digital twins into an urban planning context. We provide a technical discussion of suitable MAS frameworks and interaction protocols; data architecture options for efficient data supply from heterogeneous sensor streams and sovereignty in data sharing; and strategic analysis for scoping a digital twin systems design among domain experts and decision makers. To illustrate the way still in front of research and practice, the paper reviews some success stories of MASs in Industrie/Logistics 4.0 settings and sketches a comprehensive vision for digital twin-based holistic urban planning. [ABSTRACT FROM AUTHOR]

This paper studies the distributedH∞-consensus control problem for a class of multi-rate multi-agent systems with fading measurements. A multi-rate sampling strategy is adopted to be more in line with actual need and the channels between each agent and its sensor always fade non-identically. The multi-rate system is transformed into a single-rate system via the lifting technique. For the purpose of reducing the transmission burden, a dynamic event-triggered mechanism is utilized to determine whether the agent's information is allowed to transmit to its neighbours. This paper aims to design an observer-based event-triggered controller for each agent to achieve the H∞-consensus control performance constraint. With the help of the Lyapuonv stability theory, sufficient conditions are obtained that can ensure the desired control performance for the resulting closed-loop systems, and then the desired gain matrices are calculated by solving the linear matrix inequality. Finally, a numerical simulation example is given to demonstrate the effectiveness of the distributed event-triggered consensus control scheme. [ABSTRACT FROM AUTHOR]

An Overview of Published Articles This Special Issue consists of fifteen practical papers covering key topics in the field of multi-agent systems and complex systems. Using multi-agent simulation, the authors simulated the bounded rational decision-making and interaction process of multiple agents in multiple periods and analyzed the influence of the main parameters. Introduction This Editorial summarizes the content of the Special Issue entitled I Advancements in The Practical Applications of i Agents, Multi-Agent Systems I and Simulating Complex Systems i , published in the "Complex Systems" section of I Systems i (ISSN 2079-8954). Conclusions This Special Issue showcases a variety of research papers on practical approaches to the use of complex systems and complementary agent-based AI models, facilitating the parallel use of data treatment and knowledge processing algorithms. [Extracted from the article]

This document discusses the importance of optimization in various fields such as statistics, biology, finance, economics, and control. It highlights the advancements made in optimization theory and methods, including first-order methods and augmented Lagrangian methods. The document also introduces a special issue on "Symmetry in Optimization Theory, Algorithms and Applications," which features five papers on topics such as ensemble learning, ant colony system algorithms, subspace algorithms, consensus problems in multi-agent systems, and dynamic conditional correlation models. The authors express their gratitude to the contributors and reviewers of the special issue. [Extracted from the article]

As a universal language in the world, English has become a necessary language communication tool under the globalization of trade. Intelligent, efficient, and reasonable English language-assisted learning system helps to further improve the English ability of language learners. English online learning dictionary, as an important query tool for English learners, is an important part of English online learning. This paper will optimize the design of English online learning dictionary system based on multiagent architecture. Based on the hybrid multiagent cooperative algorithm, this paper will improve the disadvantages of the online English learning dictionary system and propose an appropriate dictionary application evaluation function. At the same time, an improved reinforcement learning algorithm is introduced into the corresponding English online learning dictionary navigation problem so as to improve the efficiency of the online English learning dictionary system. English online learning dictionary is more intelligent and efficient. In this paper, the new online learning dictionary system optimization algorithm is proposed and compared with the traditional system algorithm. The experimental results show that the algorithm proposed in this paper solves the collaborative confusion problem of English learning online dictionary to a certain extent and further solves the corresponding navigation problem so as to improve the efficiency. [ABSTRACT FROM AUTHOR]

Background: Policy coordination is necessary to address many of the sustainability challenges we face today. The formal representations of policy coordination focus on modeling conflict management but neglect its collaborative nature. This limits efforts to build more realistic models of policy coordination. The objective of this paper is to simulate collaboration and noncollaboration between agents in the context of policy coordination in order to determine the effect of different approaches to policy coordination. Methods: For this purpose, a multiagent simulation of collaboration based on evolutionary game theory is used. Results: The results suggest that policy coordination through collaboration produces the most desirable outcomes and that reducing the cost of communication between agents is necessary to increase the probability of collaboration. Conclusions: The cost of information (both its transmission and transformation) is critical to increase the probability of collaboration in policy coordination. This paper advances the understanding of how to model the collaborative nature of policy coordination by contributing to the methodological standardization of the analysis and implementation of public policy coordination. [ABSTRACT FROM AUTHOR]

Heterogeneous multi-agent systems can be deployed to complete a variety of tasks, including some that are impossible using a single generic modality. This paper introduces an approach to solving the problem of cooperative behavior planning in small heterogeneous robot teams where members can both function independently as well as physically interact with each other in ways that give rise to additional functionality. This approach enables, for the first time, the cooperative completion of tasks that are infeasible when using any single modality from those agents comprising the team. [ABSTRACT FROM AUTHOR]

Meeting today's major scientific and societal challenges requires understanding dynamics of prosociality in complex adaptive systems. Artificial intelligence (AI) is intimately connected with these challenges, both as an application domain and as a source of new computational techniques: On the one hand, AI suggests new algorithmic recommendations and interaction paradigms, offering novel possibilities to engineer cooperation and alleviate conflict in multiagent (hybrid) systems; on the other hand, new learning algorithms provide improved techniques to simulate sophisticated agents and increasingly realistic environments. In various settings, prosocial actions are socially desirable yet individually costly, thereby introducing a social dilemma of cooperation. How can AI enable cooperation in such domains? How to understand long‐term dynamics in adaptive populations subject to such cooperation dilemmas? How to design cooperation incentives in multiagent learning systems? These are questions that I have been exploring and that I discussed during the New Faculty Highlights program at AAAI 2023. This paper summarizes and extends that talk. [ABSTRACT FROM AUTHOR]

Promoting cooperation in the network has always been a focus of evolutionary game dynamics research. In this paper, a three-strategy local decision model is designed to promote cooperative behavior between agents. The hide right is introduced to accurately describe the agents which tend to choose conservative strategy to achieve stable payoffs. Agents only consider their own and non-defective neighbors' payoffs information to make their decisions for next move. According to the adaptive dynamics, the equilibrium states under different conditions have been studied. It is found that the introduction of hide strategy helps to reduce the occurrence of defection. The conclusion of this paper will provide a reference for the cooperation promotion mechanism of selfish agents that are closer to the actual situation. [ABSTRACT FROM AUTHOR]

In this paper, the adaptive consensus problem of unknown non-linear multi-agent systems (MAs) with communication noises under Markov switching topologies is studied. Based on the adaptive control theory, a novel distributed control protocol for non-linear multi-agent systems is designed. It consists of the local interfered relative information and the estimation of the unknown dynamic. The Radial Basis Function networks (RBFNNs) approximate the nonlinear dynamic, and the estimated weight matrix is updated by utilizing the measurable state information. Then, using the stochastic Lyapunov analysis method, conditions for attaining consensus are derived on the consensus gain and the weight of RBFNNs. The main findings of this paper are as follows: the consensus control of multi-agent systems under more complicated and practical circumstances, including unknown nonlinear dynamic, Markov switching topologies and communication noises, is discussed; the nonlinear dynamic is approximated based on the RBFNNs and the local interfered relative information; the consensus gain k must to be small to guarantee the consensus performance; and the proposed algorithm is validated by the numerical simulations finally. [ABSTRACT FROM AUTHOR]

Large amounts of data are created from sensors in Internet of Things (IoT) services and applications. These data create a challenge in directing these data to the cloud, which needs extreme network bandwidth. Fog computing appears as a modern solution to overcome these challenges, where it can expand the cloud computing model to the boundary of the network, consequently adding a new class of services and applications with high-speed responses compared to the cloud. Cloud and fog computing propose huge amounts of resources for their clients and devices, especially in IoT environments. However, inactive resources and large number of applications and servers in cloud and fog computing data centers waste a huge amount of electricity. This paper will propose a Dynamic Power Provisioning (DPP) system in fog data centers, which consists of a multi-agent system that manages the power consumption for the fog resources in local data centers. The suggested DPP system will be tested by using the CloudSim and iFogsim tools. The outputs show that employing the DPP system in local fog data centers reduced the power consumption for fog resource providers. [ABSTRACT FROM AUTHOR]

This paper presents a study of the cooperative optimal swarm control problem for two‐order multi‐agent systems with partially unknown nonlinear functions. Unlike traditional approaches that consider a single error, this paper proposes to use multi‐order errors in the performance index function to achieve optimal control performance. Additionally, different proportional coefficients are assigned to illustrate the varying influences of each sequence error, and a two‐order cooperative (TOC)performance index function is designed. To address the influence of unknown nonlinear functions, a swarm control system based on sliding mode control with an actor‐critic network is constructed, which increases the applicability of the proposed method to a variety of dynamic models. Furthermore, to alleviate the computational pressure caused by the multi‐order errors in the TOC performance index function, a new reinforcement learning (RL)‐based sliding mode swarm controller is designed. The stability of the proposed controller is demonstrated using the Lyapunov function. Finally, the control model and control rate are applied to a quadrotor unmanned aerial vehicle system, and simulation results demonstrate that the multi‐agent systems can effectively achieve swarm control. Impact Statement: This paper proposes a reinforcement learning‐based sliding mode control strategy for the cooperative optimal swarm control problem, where the nonlinear functions of two‐order multi‐agent systems are only partially known. In addition, we also propose a cooperative performance index function, which takes into account multi‐order errors for optimizing the performance. This contribution is significant for research in sliding mode control strategies and error co‐optimization. [ABSTRACT FROM AUTHOR]

"Multi-agent systems (MAS)" have been extensively studied across various fields, including robotics, economics, biology, and computer science. A distinctive feature of these systems is the ability of multiple agents, each with different characteristics, to perform system-wide tasks through local bottom-up interactions. Furthermore, design and control methods for system networks based on graph theory are being developed. Recent applications of these methods include autonomous driving technology, smart grids, and understanding social systems. This special issue aims to deepen the understanding of MAS, focusing on their control and applications. It features 16 papers, including one review paper. The accepted papers cover a wide range of topics, including reinforcement learning, autonomous mobility systems, and machine learning, presenting the latest research findings on MAS. These studies provide valuable insights into various aspects and potential applications of MAS. We hope that this issue will be beneficial to our readers and contribute to the advancement of future research. [ABSTRACT FROM AUTHOR]

The electrical protection of active distribution networks is crucial for ensuring reliable, safe, and flexible operations. However, protecting these networks presents several challenges due to the emergence of bi-directional power flows, network reconfiguration capabilities, and changes in fault current levels resulting from the integration of inverter-based resources. This paper introduces an innovative protection strategy for active distribution networks, leveraging the principles of distributed coordination and multi-agent systems. The proposed strategy consists of two stages. The first stage involves a fault detection algorithm that relies solely on local measurements, while the second stage uses agent classification to compute the optimal operating time based on a dynamic matrix representation of the fault path, combined with a simplified distributed optimization problem. The coordination process is formulated as a set of linear optimization problems, simplifying the solution. The proposed protection strategy is validated in a real-time simulation environment using a modified CIGRE MV European grid as a case study, considering low-impedance symmetric fault scenarios and topological changes. The results demonstrate that the protection scheme exhibits robust performance, enhancing the adaptability of the protection equipment while ensuring suitable sensitivity and operational speed. [ABSTRACT FROM AUTHOR]

This paper presents a two-stage hybrid stochastic–robust coordination of energy management and self-healing in smart distribution networks with multiple microgrids. A multi-agent systems approach is first used for coupling energy management and self-healing strategies of microgrids, based on expert system rules. The second stage problem, a framework similar to that of the first stage, is then established for the smart distribution networks. Then, hybrid stochastic–robust optimization is used to model the uncertainties of demand, energy price, power generation of renewable energy sources, demand of electric vehicles, and accessibility of zone agents. Further, the grey wolf algorithm is used to solve the formulated optimization problem and achieve an optimal and reliable solution. The proposal is validated on a 69-bus distribution network consisting of three microgrids. The results validate that the proposal minimizes microgrids' utilization indices, such as energy costs, energy losses, and network voltage drops, while simultaneously managing a flexible distribution network. It is also verified that the proposed multi-agent system design provides a high-speed and optimized self-healing solution for the network. [ABSTRACT FROM AUTHOR]

This paper explores the group consensus problem of second-order multi-agent systems (MAS) under asynchronous denial-of-service (DoS) attacks. Asynchronous DoS attacks involve the interruption of certain communication links, allowing the MAS to be reimagined as a switching system with a persistent dwell time (PDT). The agents in each group can be divided into three types, which are inter-act agents, intra-act agents with zero in-degree, and other agents. Then, according to the properties of the different agents, suitable agents are pinned. By leveraging the concepts of switching topology and the PDT, a suitable event-triggered control protocol is designed, along with the establishment of conditions to ensure the group consensus of the MAS. Moreover, through the construction of topology-dependent Lyapunov functions, the achievement of group consensus within the MAS under asynchronous DoS attacks is demonstrated. Subsequently, a numerical example is presented to validate the effectiveness of the proposed results. [ABSTRACT FROM AUTHOR]

In recent years, the cost-effectiveness and versatility of Unmanned Aerial Vehicles (UAVs) have led to their widespread adoption in both military and civilian applications, particularly for operations in remote or hazardous environments where human intervention is impractical. The use of multi-agent UAV systems has notably increased for complex tasks such as surveying and monitoring, driving extensive research and development in control, communication, and coordination technologies. Evaluating and analysing these systems under dynamic flight conditions present significant challenges. This paper introduces a mathematical model for leader–follower structured Quadrotor UAVs that encapsulates their dynamic behaviour, incorporating a novel multi-agent ad hoc coordination network simulated via COOJA. Simulation results with a pipeline surveillance case study demonstrate the efficacy of the coordination network and show that the system offers various improvements over contemporary pipeline surveillance approaches. [ABSTRACT FROM AUTHOR]

This paper studies the problem of differentially private bipartite output consensus in continuous-time heterogeneous multi-agent systems (MASs) characterized by antagonistic interactions. A novel hybrid privacy-preserving event-triggered impulsive consensus protocol is introduced to protect the agent's initial information from disclosure, which involves a discrete-time information transmission based on an event-triggering mechanism. Using stochastic Lyapunov method, sufficient conditions have been obtained to achieve mean square bipartite output consensus with a guaranteed level of privacy. Furthermore, the differential privacy of competitive agent pairs is exclusively secured by the proposed control scheme by injecting Laplace noise. The protocol also effectively prevents Zeno behavior by imposing a lower bound for impulsive intervals under all event-triggered conditions. A simulation example is provided to validate the effectiveness of the theoretical result. [ABSTRACT FROM AUTHOR]