Resource Type

Journal Article 1731

Conference Videos 252

Conference Information 75

Conference Topics 3

Year

2024 5

2023 177

2022 235

2021 279

2020 222

2019 155

2018 131

2017 102

2016 60

2015 58

2014 27

2013 34

2012 36

2011 34

2010 38

2009 24

2008 44

2007 52

2006 69

2005 54

open ︾

Keywords

Artificial intelligence 35

Machine learning 24

intelligent manufacturing 20

artificial intelligence 18

Deep learning 14

index system 10

Intelligent manufacturing 8

Multi-agent system 8

Qian Xuesen 7

Reinforcement learning 7

architecture 7

Multi-agent systems 6

industrial software 6

Smart manufacturing 5

engineering 5

high-quality development 5

intelligence 5

standards system 5

sustainable development 5

open ︾

Search scope:

排序： Display mode:

Existence and practice of gaming: thoughts on the development of multi-agent system gaming Perspective

Qi DONG, Zhenyu WU, Jun LU, Fengsong SUN, Jinyu WANG, Yanyu YANG, Xiaozhou SHANG

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 995-1001 doi: 10.1631/FITEE.2100593

Abstract: Game is a universal being in the universe. Starting with human understanding of the game process, we discuss the existence and practice of gaming, expound challenges in multi-agent gaming, and put forward a theoretical framework for a multiagent evolutionary game based on the idea of evolution and system theory. Taking the next-generation early warning and detection system as an example, we introduce the applications of multi-agent evolutionary game. We construct a multi-agent selforganizing game decision-making model and develop a multi-agent method based on reinforcement learning, which are significant in studying organized and systematic game behaviors in a high-dimensional complex environment.

Keywords： 博弈；多智能体系统；多智能体演化博弈；预警探测    

HTML PDF Collect

Prospects for multi-agent collaboration and gaming: challenge, technology, and application Perspective

Yu LIU, Zhi LI, Zhizhuo JIANG, You HE

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 1002-1009 doi: 10.1631/FITEE.2200055

Abstract: Recent years have witnessed significant improvement of multi-agent systems for solving various decision-making problems in complex environments and achievement of similar or even better performance than humans. In this study, we briefly review multi-agent collaboration and gaming technology from three perspectives, i.e., task challenges, technology directions, and application areas. We first highlight the typical research problems and challenges in the recent work on multi-agent systems. Then we discuss some of the promising research directions on multi-agent collaboration and gaming tasks. Finally, we provide some focused prospects on the application areas in this field.

Keywords： 多智能体；博弈论；集体智能；强化学习；智能控制    

HTML PDF Collect

Multi-agent differential game based cooperative synchronization control using a data-driven method Research Article

Yu SHI, Yongzhao HUA, Jianglong YU, Xiwang DONG, Zhang REN

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 1043-1056 doi: 10.1631/FITEE.2200001

Abstract: This paper studies the multi-agent based problem and its application to cooperative . A systematized formulation and analysis method for the multi-agent is proposed and a methodology based on the (RL) technique is given. First, it is pointed out that typical distributed controllers may not necessarily lead to global Nash equilibrium of the in general cases because of the coupling of networked interactions. Second, to this end, an alternative local Nash solution is derived by defining the best response concept, while the problem is decomposed into local s. An off-policy RL algorithm using neighboring interactive data is constructed to update the controller without requiring a system model, while the stability and robustness properties are proved. Third, to further tackle the dilemma, another configuration is investigated based on modified coupling index functions. The distributed solution can achieve global Nash equilibrium in contrast to the previous case while guaranteeing the stability. An equivalent parallel RL method is constructed corresponding to this Nash solution. Finally, the effectiveness of the learning process and the stability of are illustrated in simulation results.

Keywords： Multi-agent system     Differential game     Synchronization control     Data-driven     Reinforcement learning    

HTML PDF Collect

Decentralized multi-agent reinforcement learning with networked agents: recent advances Review Article

Kaiqing Zhang, Zhuoran Yang, Tamer Başar,kzhang66@illinois.edu,zy6@princeton.edu,basar1@illinois.edu

Frontiers of Information Technology & Electronic Engineering 2021, Volume 22, Issue 6,   Pages 802-814 doi: 10.1631/FITEE.1900661

Abstract: Multi-agent (MARL) has long been a significant research topic in both machine learning and control systems. Recent development of (single-agent) deep has created a resurgence of interest in developing new MARL algorithms, especially those founded on theoretical analysis. In this paper, we review recent advances on a sub-area of this topic: decentralized MARL with networked agents. In this scenario, multiple agents perform sequential decision-making in a common environment, and without the coordination of any central controller, while being allowed to exchange information with their neighbors over a communication network. Such a setting finds broad applications in the control and operation of robots, unmanned vehicles, mobile sensor networks, and the smart grid. This review covers several of our research endeavors in this direction, as well as progress made by other researchers along the line. We hope that this review promotes additional research efforts in this exciting yet challenging area.

Keywords： 强化学习；多智能体系统；网络系统；一致性优化；分布式优化；博弈论    

HTML PDF Collect

The Application of Multi-agent Based Distributed Intelligent Control in VAV Air Conditioning System

Zhang Hongwei,Wu Aiguo,Sheng Tao

Strategic Study of CAE 2006, Volume 8, Issue 7,   Pages 58-62

Abstract:

A VAV system can be treated as a multi-agent system. In this paper, a multi-agent-based distributed intelligent control method is presented to solve the problem of concordance and decoupling in the VAV system. A simulation program of VAV system is set up for control analysis. Through a simulation, this control method has been proved to be satisfactory.

Keywords： VAV     agent     multi-agent system     distributed intelligent control    

HTML PDF Collect

Optimal synchronization control for multi-agent systems with input saturation: a nonzero-sum game Research Article

Hongyang LI, Qinglai WEI

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 1010-1019 doi: 10.1631/FITEE.2200010

Abstract: This paper presents a novel method for with . The multi-agent game theory is introduced to transform the problem into a multi-agent . Then, the Nash equilibrium can be achieved by solving the coupled Hamilton–Jacobi–Bellman (HJB) equations with nonquadratic input energy terms. A novel method is presented to obtain the Nash equilibrium solution without the system models, and the critic neural networks (NNs) and actor NNs are introduced to implement the presented method. Theoretical analysis is provided, which shows that the iterative control laws converge to the Nash equilibrium. Simulation results show the good performance of the presented method.

Keywords： Optimal synchronization control     Multi-agent systems     Nonzero-sum game     Adaptive dynamic programming     Input saturation     Off-policy reinforcement learning     Policy iteration    

HTML PDF Collect

Institutionalized and systematized gaming for multi-agent systems Editorial

Jun LU, Fei-Yue WANG, Qi DONG, Qinglai WEI

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 991-994 doi: 10.1631/FITEE.2240000

Abstract: Multi-agent system gaming (MASG) is widely applied in military intelligence, information networks, unmanned systems, intelligent transportation, and smart grids, exhibiting systematic and organizational characteristics. It requires the multi-agent system perceive and act in a complex dynamic environment and at the same time achieve a balance between individual interests and the maximization of group interests within the system. Some problems include complex system structure, uncertain game environment, incomplete decision information, and unexplainable results. As a result, the study of multi-agent game has transformed from a traditional simple game to a game facing a high-dimensional, continuous, and complex environment, which prompts an urgent need for institutionalized and systematized gaming (InSys gaming). With this background, several important tendencies have emerged in the development of InSys gaming for multi-agent systems:1. Analyzing the evolution law of MASG and establishing the InSys gaming theory model for multi-agent systemsThe organized and systematic MASG has orderly and structured characteristics, so it is necessary to establish a system game model. To study political, military, economic, and other systemic confrontation gaming problems, the first step is to analyze the system’s internal evolution characteristics and external interaction information. In addition, establishing the evolution model of InSys gaming and studying the elements, relationships, and criteria of the game evolution help provide theoretical support for the system design, decision-making planning, and other research in this field.2. Combining several artificial intelligence learning algorithms to achieve collaborative decision-making of multi-agent systemsThe current mainstream artificial intelligence learning methods all have application advantages in specific scenarios. In solving InSys gaming problems, we can combine the environmental representation ability of deep learning and the decision generation ability of reinforcement learning (RL). For example, by building a digital simulation training environment, intelligent decision algorithms and unsupervised training methods can be designed to generate a multi-agent system’s collaborative decision in a complex and unknown environment.3. Adopting a hierarchical task planning and decision-making action architecture to reduce the complexity of collaborative decision-making algorithmsWith the increase of the scale of multi-agent systems, the problems of node coupling, observation uncertainty, and interaction disorder faced by collaborative decision-making have become increasingly prominent. The complexity of solving its systematic and organized game problems has increased significantly. A multi-agent hierarchical algorithm architecture is constructed through game task decomposition, longterm planning, and real-time action decision-making. It can effectively reduce the complexity of the search process of a collaborative decision-making algorithm. In addition, it is a feasible idea for solving an organized and systematic game.4. Establishing the robustness analysis framework of the algorithm model to solve the model deviation between data-driven methods and the actual sceneWhen the training data deviates from the actual scene for data-driven methods, the algorithm’s performance will be degraded. Thus, it is necessary to study the robustness analysis framework of data-driven methods. For example, a robust algorithm model and an actual data fine-tuning method are designed to reduce the performance loss of the trained algorithm. This strategy helps support the actual deployment of data-driven methods.Game theory has become a basic analytical framework for solving problems in strategic politics, military confrontation, market economy, and so on. The object of analysis is characterized by complex systematization and organization and has been highly concerned with and valued by academic and industrial circles alike. A multi-agent system is used to model the organized and systematic game, combined with an artificial intelligence method to solve the game decision-making problem, providing a new idea for developing theories, methods, and technologies in this field.
HTML PDF Collect

Coach-assisted multi-agent reinforcement learning framework for unexpected crashed agents Research Article

Jian ZHAO, Youpeng ZHAO, Weixun WANG, Mingyu YANG, Xunhan HU, Wengang ZHOU, Jianye HAO, Houqiang LI

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 1032-1042 doi: 10.1631/FITEE.2100594

Abstract: Multi-agent is difficult to apply in practice, partially because of the gap between simulated and real-world scenarios. One reason for the gap is that simulated systems always assume that agents can work normally all the time, while in practice, one or more agents may unexpectedly "crash" during the coordination process due to inevitable hardware or software failures. Such crashes destroy the cooperation among agents and lead to performance degradation. In this work, we present a formal conceptualization of a cooperative multi-agent system with unexpected crashes. To enhance the robustness of the system to crashes, we propose a coach-assisted multi-agent framework that introduces a virtual coach agent to adjust the crash rate during training. We have designed three coaching strategies (fixed crash rate, curriculum learning, and adaptive crash rate) and a re-sampling strategy for our coach agent. To our knowledge, this work is the first to study unexpected crashes in a . Extensive experiments on grid-world and StarCraft II micromanagement tasks demonstrate the efficacy of the adaptive strategy compared with the fixed crash rate strategy and curriculum learning strategy. The ablation study further illustrates the effectiveness of our re-sampling strategy.

Keywords： Multi-agent system     Reinforcement learning     Unexpected crashed agents    

HTML PDF Collect

Leader-following synchronization of a multi-agent system with heterogeneous delays Research Articles

Branislav Rehák, Volodymyr Lynnyk,rehakb@utia.cas.cz,volodymyr.lynnyk@utia.cas.cz

Frontiers of Information Technology & Electronic Engineering 2021, Volume 22, Issue 1,   Pages 1-140 doi: 10.1631/FITEE.2000207

Abstract: An algorithm is presented for leader-following synchronization of a composed of linear agents with . The presence of different delays in various agents can cause a synchronization error that does not converge to zero. However, the norm of this error can be bounded and this boundary is presented. The proof of the main results is formulated by means of linear matrix inequalities, and the size of this problem is independent of the number of agents. Results are illustrated through examples, highlighting the fact that the steady error is caused by heterogeneous delays and demonstrating the capability of the proposed algorithm to achieve synchronization up to a certain error.

Keywords： Multi-agent system     Time delay     Linear matrix inequality    

HTML PDF Collect

Designing a novel consensus protocol formultiagent systemswith general dynamics under directed networks Article

Hao-liang LI, Ren-nong YANG, Qiu-ni LI

Frontiers of Information Technology & Electronic Engineering 2017, Volume 18, Issue 8,   Pages 1071-1081 doi: 10.1631/FITEE.1601422

Abstract: The consensus problem for general linear multi-agent systems (MASs) under directed topology is investigated. First, a novel consensus protocol based on proportional-integral-derivative (PID) control is proposed. Second, the consensus problem is converted into an asymptotic stability problem through transformations. Third, through a state projection method the consensus condition is proved and the explicit expression of the consensus function is given. Then, a Lyapunov function is constructed and the gain matrices of the protocol are given based on the linear matrix inequality. Finally, two experiments are conducted to explain the advantages of the method. Simulation results show the effectiveness of the proposed algorithm.

Keywords： Multi-agent     Consensus     PID control     Linear matrix inequality    

HTML PDF Collect

Stability of General Linear Dynamic Multi-Agent Systems under Switching Topologies with Positive Real Eigenvalues Article

Shengbo Eben Li, Zhitao Wang, Yang Zheng, Diange Yang, Keyou You

Engineering 2020, Volume 6, Issue 6,   Pages 688-694 doi: 10.1016/j.eng.2020.05.006

Abstract:

The time-varying network topology can significantly affect the stability of multi-agent systems. This paper examines the stability of leader–follower multi-agent systems with general linear dynamics and switching network topologies, which have applications in the platooning of connected vehicles. The switching interaction topology is modeled as a class of directed graphs in order to describe the information exchange between multi-agent systems, where the eigenvalues of every associated matrix are required to be positive real. The Hurwitz criterion and the Riccati inequality are used to design a distributed control law and estimate the convergence speed of the closed-loop system. A sufficient condition is provided for the stability of multi-agent systems under switching topologies. A common Lyapunov function is formulated to prove closed-loop stability for the directed network with switching topologies. The result is applied to a typical cyber–physical system—that is, a connected vehicle platoon—which illustrates the effectiveness of the proposed method.

Keywords： Stability     Multi-agent system     Switching topologies     Common Lyapunov function    

HTML PDF Collect

Supermodular interference suppression game for multistatic MIMO radar networks and multiple jammers with multiple targets Research Article

Bin HE, Hongtao SU,aihebin19@163.com,suht@xidian.edu.cn

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 4,   Pages 617-629 doi: 10.1631/FITEE.2000652

Abstract: To deal with the threat of the new generation of electronic warfare, we establish a non-cooperative countermeasure game model to analyze and interference suppression between multistatic multiple-input multiple-output (MIMO) radars and in this study. First, according to the strategy, a supermodular game framework with a fixed weight (FW) vector is constructed. At the same time, a constrained optimization model for maximizing the radar utility function is established. Based on the utility function, the best strategies for the radars and jammers are obtained. The existence and uniqueness of the Nash equilibrium (NE) of the are proved. A algorithm with FW is proposed which converges to the NE. In addition, we use adaptive methods to suppress cross-channel interference that occurs as direct wave interferences between the radars and jammers. A algorithm for joint and is also proposed. The algorithm can ensure the best , and also improves the interference suppression ability of the . Finally, the effectiveness and convergence of two algorithms are verified by numerical results.

Keywords： Supermodular game     Power allocation     Beamforming     MIMO radar     Multiple jammers    

HTML PDF Collect

Leader-following consensus of second-order nonlinear multi-agent systems subject to disturbances None

Mao-bin LU, Lu LIU

Frontiers of Information Technology & Electronic Engineering 2019, Volume 20, Issue 1,   Pages 88-94 doi: 10.1631/FITEE.1800611

Abstract:

In this study, we investigate the leader-following consensus problem of a class of heterogeneous secondorder nonlinear multi-agent systems subject to disturbances. In particular, the nonlinear systems contain uncertainties that can be linearly parameterized. We propose a class of novel distributed control laws, which depends on the relative state of the system and thus can be implemented even when no communication among agents exists. By Barbalat’s lemma, we demonstrate that consensus of the second-order nonlinear multi-agent system can be achieved by the proposed distributed control law. The effectiveness of the main result is verified by its application to consensus control of a group of Van der Pol oscillators.

Keywords： Multi-agent systems     Leader-following consensus     Distributed control    

HTML PDF Collect

Bipartite asynchronous impulsive tracking consensus for multi-agent systems Research Article

Lingzhong ZHANG, Yuanyuan LI, Jungang LOU, Jianquan LU

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 10,   Pages 1522-1532 doi: 10.1631/FITEE.2100122

Abstract:

In this study, we discuss how (MASs) with a leader can achieve distributed using control strategies. The proposed control approach does not require the impulse to occur simultaneously for all agents. The communication links between neighboring nodes of MASs are antagonistic. When the leader’s control input is non-zero, sufficient conditions are obtained to achieve bipartite tracking in closed-loop MASs. More extensive ranges of effects are discussed, and the designed controller’s feedback can effectively work against adverse impulsive permutation. Simple algebraic conditions for estimating the impulsive gain boundary and interval are presented. Theoretical results are demonstrated with illustrative examples.

Keywords： Bipartite tracking     Multi-agent systems     Asynchronous impulsive     Consensus    

HTML PDF Collect

Containment control for heterogeneous nonlinear multi-agent systems under distributed event-triggered schemes Research Articles

Ya-ni Sun, Wen-cheng Zou, Jian Guo, Zheng-rong Xiang,xiangzr@njust.edu.cn

Frontiers of Information Technology & Electronic Engineering 2021, Volume 22, Issue 1,   Pages 1-140 doi: 10.1631/FITEE.2000034

Abstract: We study the problem for high-order heterogeneous nonlinear under distributed event-triggered schemes. To achieve the objective and reduce communication consumption among agents, a scheme is proposed by applying the backstepping method, Lyapunov functional approach, and neural networks. Then, the results are extended to the self-triggered control case to avoid continuous monitoring of state errors. The developed protocols and triggered rules ensure that the output for each follower converges to the convex hull spanned by multi-leader signals within a bounded error. In addition, no agent exhibits . Two numerical simulations are finally presented to verify the correctness of the obtained results.

Keywords： Multi-agent systems     Distributed event-triggered control     Containment control     Heterogeneous nonlinear systems     Zeno behavior    

HTML PDF Collect

Title Author Date Type Operation

Existence and practice of gaming: thoughts on the development of multi-agent system gaming

Qi DONG, Zhenyu WU, Jun LU, Fengsong SUN, Jinyu WANG, Yanyu YANG, Xiaozhou SHANG

Journal Article

Prospects for multi-agent collaboration and gaming: challenge, technology, and application

Yu LIU, Zhi LI, Zhizhuo JIANG, You HE

Journal Article

Multi-agent differential game based cooperative synchronization control using a data-driven method

Yu SHI, Yongzhao HUA, Jianglong YU, Xiwang DONG, Zhang REN

Journal Article

Decentralized multi-agent reinforcement learning with networked agents: recent advances

Kaiqing Zhang, Zhuoran Yang, Tamer Başar,kzhang66@illinois.edu,zy6@princeton.edu,basar1@illinois.edu

Journal Article

The Application of Multi-agent Based Distributed Intelligent Control in VAV Air Conditioning System

Zhang Hongwei,Wu Aiguo,Sheng Tao

Journal Article

Optimal synchronization control for multi-agent systems with input saturation: a nonzero-sum game

Hongyang LI, Qinglai WEI

Journal Article

Institutionalized and systematized gaming for multi-agent systems

Jun LU, Fei-Yue WANG, Qi DONG, Qinglai WEI

Journal Article

Coach-assisted multi-agent reinforcement learning framework for unexpected crashed agents

Jian ZHAO, Youpeng ZHAO, Weixun WANG, Mingyu YANG, Xunhan HU, Wengang ZHOU, Jianye HAO, Houqiang LI

Journal Article

Leader-following synchronization of a multi-agent system with heterogeneous delays

Branislav Rehák, Volodymyr Lynnyk,rehakb@utia.cas.cz,volodymyr.lynnyk@utia.cas.cz

Journal Article

Designing a novel consensus protocol formultiagent systemswith general dynamics under directed networks

Hao-liang LI, Ren-nong YANG, Qiu-ni LI

Journal Article

Stability of General Linear Dynamic Multi-Agent Systems under Switching Topologies with Positive Real Eigenvalues

Shengbo Eben Li, Zhitao Wang, Yang Zheng, Diange Yang, Keyou You

Journal Article

Supermodular interference suppression game for multistatic MIMO radar networks and multiple jammers with multiple targets

Bin HE, Hongtao SU,aihebin19@163.com,suht@xidian.edu.cn

Journal Article

Leader-following consensus of second-order nonlinear multi-agent systems subject to disturbances

Mao-bin LU, Lu LIU

Journal Article

Bipartite asynchronous impulsive tracking consensus for multi-agent systems

Lingzhong ZHANG, Yuanyuan LI, Jungang LOU, Jianquan LU

Journal Article

Containment control for heterogeneous nonlinear multi-agent systems under distributed event-triggered schemes

Ya-ni Sun, Wen-cheng Zou, Jian Guo, Zheng-rong Xiang,xiangzr@njust.edu.cn

Journal Article