Resource Type

Journal Article 3059

Conference Videos 306

Conference Information 126

Conference Topics 4

Year

2024 10

2023 320

2022 354

2021 406

2020 312

2019 302

2018 230

2017 197

2016 135

2015 95

2014 59

2013 65

2012 63

2011 60

2010 73

2009 57

2008 70

2007 102

2006 102

2005 97

open ︾

Keywords

Machine learning 43

Artificial intelligence 35

Deep learning 34

artificial intelligence 18

intelligent manufacturing 18

neural network 15

optimization 14

Additive manufacturing 11

disruptive technology 11

sustainable development 11

COVID-19 10

Reinforcement learning 10

index system 10

simulation 9

Multi-agent system 8

management 8

Big data 7

engineering 7

the Belt and Road 7

open ︾

Search scope:

排序： Display mode:

Decentralized multi-agent reinforcement learning with networked agents: recent advances Review Article

Kaiqing Zhang, Zhuoran Yang, Tamer Başar,kzhang66@illinois.edu,zy6@princeton.edu,basar1@illinois.edu

Frontiers of Information Technology & Electronic Engineering 2021, Volume 22, Issue 6,   Pages 802-814 doi: 10.1631/FITEE.1900661

Abstract: Multi-agent (MARL) has long been a significant research topic in both machine learning and control systems. Recent development of (single-agent) deep has created a resurgence of interest in developing new MARL algorithms, especially those founded on theoretical analysis. In this paper, we review recent advances on a sub-area of this topic: decentralized MARL with networked agents. In this scenario, multiple agents perform sequential decision-making in a common environment, and without the coordination of any central controller, while being allowed to exchange information with their neighbors over a communication network. Such a setting finds broad applications in the control and operation of robots, unmanned vehicles, mobile sensor networks, and the smart grid. This review covers several of our research endeavors in this direction, as well as progress made by other researchers along the line. We hope that this review promotes additional research efforts in this exciting yet challenging area.

Keywords： 强化学习；多智能体系统；网络系统；一致性优化；分布式优化；博弈论    

HTML PDF Collect

Optimal synchronization control for multi-agent systems with input saturation: a nonzero-sum game Research Article

Hongyang LI, Qinglai WEI

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 1010-1019 doi: 10.1631/FITEE.2200010

Abstract: This paper presents a novel method for with . The multi-agent game theory is introduced to transform the problem into a multi-agent . Then, the Nash equilibrium can be achieved by solving the coupled Hamilton–Jacobi–Bellman (HJB) equations with nonquadratic input energy terms. A novel method is presented to obtain the Nash equilibrium solution without the system models, and the critic neural networks (NNs) and actor NNs are introduced to implement the presented method. Theoretical analysis is provided, which shows that the iterative control laws converge to the Nash equilibrium. Simulation results show the good performance of the presented method.

Keywords： Optimal synchronization control     Multi-agent systems     Nonzero-sum game     Adaptive dynamic programming     Input saturation     Off-policy reinforcement learning     Policy iteration    

HTML PDF Collect

Robust distributed model predictive consensus of discrete-time multi-agent systems: a self-triggered approach Research Articles

Jiaqi Li, Qingling Wang, Yanxu Su, Changyin Sun,jiaqil2018@seu.edu.cn,qlwang@seu.edu.cn,yanxu.su@seu.edu.cn,cysun@seu.edu.cn

Frontiers of Information Technology & Electronic Engineering 2021, Volume 22, Issue 8,   Pages 1068-1079 doi: 10.1631/FITEE.2000182

Abstract: This study investigates the problem of a nonlinear discrete-time multi-agent system (MAS) under bounded additive disturbances. We propose a self-triggered robust algorithm. A new cost function is constructed and MAS is coupled through this function. Based on the proposed cost function, a self-triggered mechanism is adopted to reduce the communication load. Furthermore, to overcome additive disturbances, a local minimum– maximum optimization problem under the worst-case scenario is solved iteratively by the model predictive controller of each agent. Sufficient conditions are provided to guarantee the iterative feasibility of the algorithm and the of the closed-loop MAS. For each agent, we provide a concrete form of compatibility constraint and a error terminal region. Numerical examples are provided to illustrate the effectiveness and correctness of the proposed algorithm.

Keywords： 一致性；自触发控制；分布式模型预测控制    

HTML PDF Collect

Bipartite asynchronous impulsive tracking consensus for multi-agent systems Research Article

Lingzhong ZHANG, Yuanyuan LI, Jungang LOU, Jianquan LU

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 10,   Pages 1522-1532 doi: 10.1631/FITEE.2100122

Abstract:

In this study, we discuss how (MASs) with a leader can achieve distributed using control strategies. The proposed control approach does not require the impulse to occur simultaneously for all agents. The communication links between neighboring nodes of MASs are antagonistic. When the leader’s control input is non-zero, sufficient conditions are obtained to achieve bipartite tracking in closed-loop MASs. More extensive ranges of effects are discussed, and the designed controller’s feedback can effectively work against adverse impulsive permutation. Simple algebraic conditions for estimating the impulsive gain boundary and interval are presented. Theoretical results are demonstrated with illustrative examples.

Keywords： Bipartite tracking     Multi-agent systems     Asynchronous impulsive     Consensus    

HTML PDF Collect

Multi-agent differential game based cooperative synchronization control using a data-driven method Research Article

Yu SHI, Yongzhao HUA, Jianglong YU, Xiwang DONG, Zhang REN

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 1043-1056 doi: 10.1631/FITEE.2200001

Abstract: This paper studies the multi-agent based problem and its application to cooperative . A systematized formulation and analysis method for the multi-agent is proposed and a methodology based on the (RL) technique is given. First, it is pointed out that typical distributed controllers may not necessarily lead to global Nash equilibrium of the in general cases because of the coupling of networked interactions. Second, to this end, an alternative local Nash solution is derived by defining the best response concept, while the problem is decomposed into local s. An off-policy RL algorithm using neighboring interactive data is constructed to update the controller without requiring a system model, while the stability and robustness properties are proved. Third, to further tackle the dilemma, another configuration is investigated based on modified coupling index functions. The distributed solution can achieve global Nash equilibrium in contrast to the previous case while guaranteeing the stability. An equivalent parallel RL method is constructed corresponding to this Nash solution. Finally, the effectiveness of the learning process and the stability of are illustrated in simulation results.

Keywords： Multi-agent system     Differential game     Synchronization control     Data-driven     Reinforcement learning    

HTML PDF Collect

Consensus of multi-agent systems with dynamic join characteristics under impulsive control Research Articles

Xiang Hu, Zufan Zhang, Chuandong Li,huyangyu0203@163.com,zhangzf@cqupt.edu.cn,cdli@swu.edu.cn

Frontiers of Information Technology & Electronic Engineering 2021, Volume 22, Issue 1,   Pages 1-140 doi: 10.1631/FITEE.2000062

Abstract: We study how to achieve the of a whole after adding some new agent groups dynamically in the original . We analyze the feasibility of dynamically adding agent groups under different forms of network topologies that are currently common, and obtain four feasible schemes in theory, including one scheme that is the best in actual industrial production. Then, we carry out dynamic modeling of s for the best scheme. Impulsive control theory and Lyapunov stability theory are used to analyze the conditions so that the whole with can achieve . Finally, we provide a numerical example to verify the practicality and validity of the theory

Keywords： Multi-agent system     Network topology     Impulsive input     Dynamic join characteristics     State consensus    

HTML PDF Collect

Designing a novel consensus protocol formultiagent systemswith general dynamics under directed networks Article

Hao-liang LI, Ren-nong YANG, Qiu-ni LI

Frontiers of Information Technology & Electronic Engineering 2017, Volume 18, Issue 8,   Pages 1071-1081 doi: 10.1631/FITEE.1601422

Abstract: The consensus problem for general linear multi-agent systems (MASs) under directed topology is investigated. First, a novel consensus protocol based on proportional-integral-derivative (PID) control is proposed. Second, the consensus problem is converted into an asymptotic stability problem through transformations. Third, through a state projection method the consensus condition is proved and the explicit expression of the consensus function is given. Then, a Lyapunov function is constructed and the gain matrices of the protocol are given based on the linear matrix inequality. Finally, two experiments are conducted to explain the advantages of the method. Simulation results show the effectiveness of the proposed algorithm.

Keywords： Multi-agent     Consensus     PID control     Linear matrix inequality    

HTML PDF Collect

A distributed stochastic optimization algorithm with gradient-tracking and distributed heavy-ball acceleration Research Articles

Bihao Sun, Jinhui Hu, Dawen Xia, Huaqing Li,huaqingli@swu.edu.cn

Frontiers of Information Technology & Electronic Engineering 2021, Volume 22, Issue 11,   Pages 1463-1476 doi: 10.1631/FITEE.2000615

Abstract: has been well developed in recent years due to its wide applications in machine learning and signal processing. In this paper, we focus on investigating to minimize a global objective. The objective is a sum of smooth and strongly convex local cost functions which are distributed over an undirected network of nodes. In contrast to existing works, we apply a distributed heavy-ball term to improve the convergence performance of the proposed algorithm. To accelerate the convergence of existing distributed stochastic first-order gradient methods, a momentum term is combined with a gradient-tracking technique. It is shown that the proposed algorithm has better acceleration ability than GT-SAGA without increasing the complexity. Extensive experiments on real-world datasets verify the effectiveness and correctness of the proposed algorithm.

Keywords： 分布式优化；高性能算法；多智能体系统；机器学习问题；随机梯度    

HTML PDF Collect

Prospects for multi-agent collaboration and gaming: challenge, technology, and application Perspective

Yu LIU, Zhi LI, Zhizhuo JIANG, You HE

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 1002-1009 doi: 10.1631/FITEE.2200055

Abstract: Recent years have witnessed significant improvement of multi-agent systems for solving various decision-making problems in complex environments and achievement of similar or even better performance than humans. In this study, we briefly review multi-agent collaboration and gaming technology from three perspectives, i.e., task challenges, technology directions, and application areas. We first highlight the typical research problems and challenges in the recent work on multi-agent systems. Then we discuss some of the promising research directions on multi-agent collaboration and gaming tasks. Finally, we provide some focused prospects on the application areas in this field.

Keywords： 多智能体；博弈论；集体智能；强化学习；智能控制    

HTML PDF Collect

Autonomous fault-diagnosis and decision-making algorithm for determining faulty nodes in distributed wireless networks Article

Adel KHOSRAVI,Yousef SEIFI KAVIAN

Frontiers of Information Technology & Electronic Engineering 2016, Volume 17, Issue 9,   Pages 885-896 doi: 10.1631/FITEE.1500176

Abstract: In this paper, we address fault-diagnosis agreement (FDA) problems in distributed wireless networks (DWNs) with arbitrary fallible nodes and healthy access points. We propose a new algorithm to reach an agreement among fault-free members about the faulty ones. The algorithm is designed for fully connected DWN and can also be easily adapted to partially connected networks. Our contribution is to reduce the bit complexity of the Byzantine agreement process by detecting the same list of faulty units in all fault-free members. Therefore, the malicious units can be removed from other consensus processes. Also, each healthy unit detects a local list of malicious units, which results in lower packet transmissions in the network. Our proposed algorithm solves FDA problems in 2t+1 rounds of packet transmissions, and the bit complexity in each wireless node is O(nt+1).

Keywords： Fault diagnosis     Decision making     Byzantine agreement     Distributed wireless networks     Consensus    

HTML PDF Collect

Finite-time leader-follower consensus of a discrete-time system via sliding mode control Research Article

Ruizhuo SONG, Shi XING, Zhen XU

Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 7,   Pages 1057-1068 doi: 10.1631/FITEE.2100565

Abstract: In this study, we solve the problem of discrete-time second-order (MASs) under the constraints of external disturbances. First, a novel consensus scheme is designed using a novel theory. Our adaptive controller is designed using the traditional sliding mode reaching law, and its advantages are chatter reduction and invariance to disturbances. In addition, the stability is demonstrated by presenting a discrete Lyapunov function. Finally, simulation results are presented to prove the validity of our theoretical results.

Keywords： Finite-time     Leader-follower consensus     Adaptive sliding mode control     Multi-agent systems    

HTML PDF Collect

Distributed optimization based on improved push-sum framework for optimization problem with multiple local constraints and its application in smart grid

徐谦,俞楚天,袁翔,韦梦立,刘洪喆

Frontiers of Information Technology & Electronic Engineering 2023, Volume 24, Issue 9,   Pages 1253-1260 doi: 10.1631/FITEE.2200596

Abstract: In this paper, the optimization problem subject to ,N, nonidentical closed convex set constraints is studied. The aim is to design a corresponding distributed optimization algorithm over the fixed unbalanced graph to solve the considered problem. To this end, with the push-sum framework improved, the distributed optimization algorithm is newly designed, and its strict convergence analysis is given under the assumption that the involved graph is strongly connected. Finally, simulation results support the good performance of the proposed algorithm.

Keywords： Distributed optimization     Nonidentical constraints     Improved push-sum framework    

HTML Collect

Freshness constraints of an age of information based event-triggered Kalman consensus filter algorithm over a wireless sensor network Research Articles

Rui Wang, Yahui Li, Hui Sun, Youmin Zhang,h-sun@cauc.edu.cn

Frontiers of Information Technology & Electronic Engineering 2021, Volume 22, Issue 1,   Pages 1-140 doi: 10.1631/FITEE.2000206

Abstract: This paper presents the design of a new event-triggered Kalman consensus filter (ET-KCF) algorithm for use over a wireless sensor network (WSN). This algorithm is based on information freshness, which is calculated as the of the sampled data. The proposed algorithm integrates the traditional , information freshness calculation method, and Kalman consensus filter (KCF) algorithm to estimate the concentrations of pollutants in the aircraft more efficiently. The proposed method also considers the influence of data packet loss and the aircraft’s loss of communication path over the WSN, and presents an AoI-freshness-based threshold selection method for the ET-KCF algorithm, which compares the packet AoI to the minimum average AoI of the system. This method can obviously reduce the energy consumption because the transmission of expired information is reduced. Finally, the convergence of the algorithm is proved using the Lyapunov stability theory and matrix theory. Simulation results show that this algorithm has better fault tolerance compared to the existing KCF and lower power consumption than other ET-KCFs.

Keywords： Distributed Kalman consensus filter (KCF)     Event-triggered mechanism     Age of information (AoI)     Stability analysis     Energy optimization    

HTML PDF Collect

The Application of Multi-agent Based Distributed Intelligent Control in VAV Air Conditioning System

Zhang Hongwei,Wu Aiguo,Sheng Tao

Strategic Study of CAE 2006, Volume 8, Issue 7,   Pages 58-62

Abstract:

A VAV system can be treated as a multi-agent system. In this paper, a multi-agent-based distributed intelligent control method is presented to solve the problem of concordance and decoupling in the VAV system. A simulation program of VAV system is set up for control analysis. Through a simulation, this control method has been proved to be satisfactory.

Keywords： VAV     agent     multi-agent system     distributed intelligent control    

HTML PDF Collect

Coherence analysis and Laplacian energy of recursive trees with controlled initial states Research Articles

Mei-du Hong, Wei-gang Sun, Su-yu Liu, Teng-fei Xuan,wgsun@hdu.edu.cn

Frontiers of Information Technology & Electronic Engineering 2020, Volume 21, Issue 6,   Pages 809-962 doi: 10.1631/FITEE.1900133

Abstract: We study the of a family of recursive trees with novel features that include the initial states controlled by a parameter. The problem in a linear system with additive noises is characterized as , which is defined by a Laplacian spectrum. Based on the structures of our recursive treelike model, we obtain the recursive relationships for Laplacian eigenvalues in two successive steps and further derive the exact solutions of first- and second-order coherences, which are calculated by the sum and square sum of the reciprocal of all nonzero Laplacian eigenvalues. For a large network size , the scalings of the first- and second-order coherences are ln and $, respectively. The smaller the number of initial nodes, the better the bears. Finally, we numerically investigate the relationship between and , showing that the first- and second-order coherences increase with the increase of at approximately exponential and linear rates, respectively.

Keywords： 一致性；网络一致性；拉普拉斯能量    

HTML PDF Collect

Title Author Date Type Operation

Decentralized multi-agent reinforcement learning with networked agents: recent advances

Kaiqing Zhang, Zhuoran Yang, Tamer Başar,kzhang66@illinois.edu,zy6@princeton.edu,basar1@illinois.edu

Journal Article

Optimal synchronization control for multi-agent systems with input saturation: a nonzero-sum game

Hongyang LI, Qinglai WEI

Journal Article

Robust distributed model predictive consensus of discrete-time multi-agent systems: a self-triggered approach

Jiaqi Li, Qingling Wang, Yanxu Su, Changyin Sun,jiaqil2018@seu.edu.cn,qlwang@seu.edu.cn,yanxu.su@seu.edu.cn,cysun@seu.edu.cn

Journal Article

Bipartite asynchronous impulsive tracking consensus for multi-agent systems

Lingzhong ZHANG, Yuanyuan LI, Jungang LOU, Jianquan LU

Journal Article

Multi-agent differential game based cooperative synchronization control using a data-driven method

Yu SHI, Yongzhao HUA, Jianglong YU, Xiwang DONG, Zhang REN

Journal Article

Consensus of multi-agent systems with dynamic join characteristics under impulsive control

Xiang Hu, Zufan Zhang, Chuandong Li,huyangyu0203@163.com,zhangzf@cqupt.edu.cn,cdli@swu.edu.cn

Journal Article

Designing a novel consensus protocol formultiagent systemswith general dynamics under directed networks

Hao-liang LI, Ren-nong YANG, Qiu-ni LI

Journal Article

A distributed stochastic optimization algorithm with gradient-tracking and distributed heavy-ball acceleration

Bihao Sun, Jinhui Hu, Dawen Xia, Huaqing Li,huaqingli@swu.edu.cn

Journal Article

Prospects for multi-agent collaboration and gaming: challenge, technology, and application

Yu LIU, Zhi LI, Zhizhuo JIANG, You HE

Journal Article

Autonomous fault-diagnosis and decision-making algorithm for determining faulty nodes in distributed wireless networks

Adel KHOSRAVI,Yousef SEIFI KAVIAN

Journal Article

Finite-time leader-follower consensus of a discrete-time system via sliding mode control

Ruizhuo SONG, Shi XING, Zhen XU

Journal Article

Distributed optimization based on improved push-sum framework for optimization problem with multiple local constraints and its application in smart grid

徐谦,俞楚天,袁翔,韦梦立,刘洪喆

Journal Article

Freshness constraints of an age of information based event-triggered Kalman consensus filter algorithm over a wireless sensor network

Rui Wang, Yahui Li, Hui Sun, Youmin Zhang,h-sun@cauc.edu.cn

Journal Article

The Application of Multi-agent Based Distributed Intelligent Control in VAV Air Conditioning System

Zhang Hongwei,Wu Aiguo,Sheng Tao

Journal Article

Coherence analysis and Laplacian energy of recursive trees with controlled initial states

Mei-du Hong, Wei-gang Sun, Su-yu Liu, Teng-fei Xuan,wgsun@hdu.edu.cn

Journal Article