This study investigates resilient platoon control for constrained intelligent and connected vehicles (ICVs) against F-local Byzantine attacks. We introduce a resilient distributed model-predictive platooning control framework for such ICVs. This framework seamlessly integrates the predesigned optimal control with distributed model predictive control (DMPC) optimization and introduces a unique distributed attack detector to ensure the reliability of the transmitted information among vehicles. Notably, our strategy uses previously broadcasted information and a specialized convex set, termed the “resilience set”, to identify unreliable data. This approach significantly eases graph robustness prerequisites, requiring only an (F + 1)-robust graph, in contrast to the established mean sequence reduced algorithms, which require a minimum (2F + 1)-robust graph. Additionally, we introduce a verification algorithm to restore trust in vehicles under minor attacks, further reducing communication network robustness. Our analysis demonstrates the recursive feasibility of the DMPC optimization. Furthermore, the proposed method achieves exceptional control performance by minimizing the discrepancies between the DMPC control inputs and predesigned platoon control inputs, while ensuring constraint compliance and cybersecurity. Simulation results verify the effectiveness of our theoretical findings.
Henglai Wei, Hui Zhang, Kamal AI-Haddad, Yang Shi.
Ensuring Secure Platooning of Constrained Intelligent and Connected Vehicles Against Byzantine Attacks: A Distributed MPC Framework.
Engineering, 2024, 33(2): 41-54 DOI:10.1016/j.eng.2023.10.007
Platoon control in intelligent and connected vehicles (ICVs) has garnered significant attention owing to its potential to reduce fuel consumption and increase transportation system efficiency. Although several commendable platoon control strategies have emerged [1], practical challenges remain. Information communicated over public vehicle-to-vehicle (V2V) networks is susceptible to malicious intrusions and cyberattacks, rendering ICVs vulnerable. Traditional platoon control methods often fail in security-centric ICVs, especially for constraints demanding heightened security assurances.
Secure platoon control is crucial when malicious vehicles in the network disregard established communication protocols, thereby misleading their counterparts. Byzantine attacks manifest when one or several vehicles deliberately disseminate deceptive data within the ICV network, jeopardizing platoon coordination, and possibly leading to collisions. The urgency to devise innovative control algorithms and detection mechanisms capable of addressing this malicious behavior cannot be overstated; they are vital for the safety and security of platoon systems. Given the computational complexity and inherently distributed structure of ICVs, distributed control approaches are appropriate. Thus, developing a resilient distributed platoon control system to prevent cyberattacks is of paramount importance.
Numerous secure control methods for ICVs under cyberattacks have emerged. Comprehensive overviews of this topic are available in Refs. [2], [3], [4].
Malicious cyberattacks targeting communication channels tend to undermine data availability, integrity, and confidentiality, as detailed in Refs. [5], [6], [7], [8]. Recognizing this threat, various secure control schemes have emerged for ICVs to counteract the detrimental effects of diverse cyberattacks, such as denial-of-service (DoS), deception, and eavesdropping attacks. For example, ICVs under DoS attacks were investigated in Ref. [9]. DoS attacks manifest as time delays, and researchers have used a combination of adaptive estimation and sliding mode control techniques to detect and gauge the impact of such attacks. Furthermore, DoS attacks represented by packet dropouts were examined in Ref. [10]. A resilient cooperative adaptive cruise control system was developed, pinpointing the resilience boundary against the most permissible consecutive packet dropouts. This subject has also received attention in recent studies [11], [12], [13]. Deception attacks on data integrity such as replay [14] and false data injection (FDI) attacks [15], [16], [17] pose challenges. In Ref. [14], a dynamic tracking controller melds the output feedback control with a robust reset control to counteract replay attacks that appear as significant random communication delays. For FDI attacks, two distinct detection mechanisms are prominent: one introduces a cloud-based sandboxing technique to assess and segregate adversarial attacks in ICV scenarios [15], and the other elucidates a partial differential equation-based observer to detect FDI attacks and determine their injection points in the ICV platoon [16]. Additionally, strides in privacy-preserving control methods for ICVs concerning data confidentiality have become evident [18], [19]. Specifically, proposed a differentially private data streaming approach that integrates noise within the data streams among vehicles [18].
In the following discussion, we briefly outline developments related to attacks executed on agents. A dominant strategy for addressing resilient control challenges is prevention, which is invoked before the onset of attacks; comprehensive insights into this methodology can be found in Refs. [20], [21], [22], [23]. Byzantine-resilient distributed observers were conceptualized for a fully distributed implementation, as highlighted in Ref. [24]. The mean sequence reduced (MSR) algorithm [25] empowers multi-agent systems (MASs) with bounded adversaries to attain resilient control objectives, provided that the communication graph meets certain robustness criteria. Specifically, the MSR algorithm shifts through the state values of neighboring systems, discarding outliers, and using the remaining conventional values to update the control input. Although several adaptations of MSR-type resilient algorithms for MAS have emerged under attack scenarios [20], [26], [27], these often face complications owing to coupled system states, complicating attack detection. Additionally, the bulk of the existing work primarily focuses on the theoretical facets of the resilient consensus of MAS. By contrast, research offering security assurances that are explicitly tailored for practical ICVs in the context of Byzantine attacks remains underexplored.
Conversely, distributed model predictive control (DMPC) has gained substantial attention owing to its exceptional capabilities in constraint management and computational resource optimization, as evidenced in Refs. [28], [29]. DMPC approaches for tackling cooperative stabilization challenges in MASs were explored in Ref. [30], whereas solutions addressing consensus issues in cooperative systems appeared in Refs. [31], [32]. Despite their merits, existing DMPC methodologies lack in the context of security-sensitive operations. This highlights the necessity for a unified and resilient DMPC-based strategy to safeguard ICVs against cyberattacks.
This study addresses platoon control in ICVs under physical constraints and Byzantine attacks, in which malicious information is transmitted between vehicles. Meeting both the constraint satisfaction and security demands of ICVs is a nontrivial task that requires the co-design of an effective control strategy and reliable attack detection mechanism.
(1) We develop a resilient distributed model predictive platoon control (RDMP2C) for constrained ICVs. This framework allows vehicles to detect and identify malicious information, thereby ensuring that they consistently meet the desired platoon control objectives. By integrating the predesigned optimal control with DMPC optimization, our approach ensures both superior control performance and constraint adherence.
(2) To address the challenge of high communication network robustness requirements in the existing resilient distributed control algorithms for ICVs under Byzantine attacks [25], [33], we designed a distributed attack detector based on previously broadcast information and a resilience set. Communication links are characterized by different levels of thrust based on the intensity of Byzantine attacks, and a novel second verification algorithm is designed to restore the thrust of communication links that are not severely attacked.
(3) We establish sufficient conditions for the recursive feasibility of the RDMP2C algorithm and the stability of the closed-loop ICV system. Notably, our method is the first attempt to concurrently address the cybersecurity, constraints, and control performance of constrained ICVs under potential attacks. Even during Byzantine attacks, our method maintains closed-loop stability and security in ICVs with reduced reliance on network robustness.
The remainder of this paper is organized as follows. Section 2 presents some basic preliminaries and formulates the resilient platoon control problem. In Section 3, we present the distributed detection algorithms for Byzantine attacks. In Section 4, we propose the RDMP2C framework for constrained ICVs. In Section 5, we prove the theoretical properties, including the recursive feasibility and closed-loop stability. Section 6 presents the simulation results and Section 7 concludes the paper.
2. Preliminaries and problem formulation
2.1. Communication networks
A directed graph is used to describe the information exchange among the ICVs, in which denotes the vertex set, M, represents the edge set, , denotes the set of nonnegative integers and represents the adjacency matrix with , . An edge with implies that vehicle can send information to vehicle at time . The in-degree of vehicle is denoted by . For the in-degree matrix , the Laplacian matrix is given as . The neighbors of vehicle are denoted by . Only a subset of follower vehicles can receive information from leader vehicle in this work. The corresponding pinning matrix is given as with a pinning gain . Follower vehicle receives information from the preceding vehicles and , . The notations of -reachable set and -robustness introduced in Ref. [25] characterize graph robustness properties.
Definition 1.(-reachable set). Given a graph and a nonempty subset , the set is -reachable if such that , .
Definition 2. (-robust graph). A nonempty graph is -robust () if at least one of the subsets is -reachable for any pair of nonempty disjoint subsets , at least one of the subsets is -reachable.
2.2. ICV longitudinal dynamics
For precise control over the longitudinal dynamics, we adopt certain assumptions [34]. We neglect the longitudinal slip of the tire, assume a rigid and symmetric vehicle, and disregard any lateral effects. These assumptions streamline the model, ensuring that longitudinal dynamics are both predictable and accurately controllable. The longitudinal dynamics of vehicle , , are detailed in Ref. [34].
where and are, respectively, the position and the velocity along the longitudinal axis; is the mechanical efficiency of the driveline; is the tire radius; is the aerodynamic drag coefficient; is the vehicle mass; is the gravity constant; is the rolling resistance; is the actual driving torque; is the desired driving torque; and is the inertial lag of the longitudinal dynamic of the vehicle. A feedback linearization technique is adopted to transform the nonlinear longitudinal dynamics Eq. 1 into a linear system model as follows:
in which denotes the control input. For acceleration of vehicle :
From Eqs. 1, 2, 3, we obtain the compact form
in which ,
The dynamics of the vehicle Eq. 4 in discrete time follows
where
with being the sampling period. For the sake of notation simplicity, we abbreviate and as and , respectively.
Note that the ICV in Eq. 6 is subject to the state and control input constraints.
in which the sets and are compact and contain the origin as the interior point, with the state bounds and control input bounds .
2.3. Byzantine attack model
This subsection describes the characterization of the Byzantine attack model. Here, a vehicle under Byzantine attack is called a Byzantine vehicle. If a vehicle is free of attack, it is called a normal vehicle and always obeys a predefined control strategy. Let and denote the set of normal and Byzantine vehicles, respectively. The cardinality of the normal vehicle set is denoted as . The cardinality of the Byzantine vehicle set is denoted as .
In the following section, we introduce the notations for Byzantine vehicles, normal vehicles, and -local Byzantine attacks [25].
Definition 3. (Byzantine vehicle). Vehicle in Eq. 4 is Byzantine if it broadcasts arbitrarily different state values to its neighbors.
Definition 4. (Normal vehicle). Vehicle in Eq. 4 is normal if it updates and broadcasts its state values based on the designed control protocol.
Definition 5. (-local Byzantine attacks). Given graph and a number , if the number of Byzantine vehicles in the neighborhood of the normal vehicle , is no more than , that is, , then we say that the ICV is subject to -local Byzantine attacks.
ICVs typically have inter-vehicle communication networks, such as V2V and intra-vehicle networks (e.g., controller area networks) for controller–sensor communication. Moreover, these vehicles have an array of sensors dedicated to perception [2]. However, although these connected networks and sensors enhance intra- and inter-vehicle communication, they also present vulnerabilities. These can become entry points for adversarial Byzantine attacks, causing arbitrary system updates. Notably, a vehicle under malicious attack transmits identical state values to all neighboring vehicles [25]. Consequently, this malicious vehicle can be regarded as a specific example of a Byzantine vehicle.
In the realm of vehicle platooning, Byzantine attacks pose a significant risk, as they occur when an adversarial vehicle disseminates deceptive data, such as its position, speed, or acceleration, to other vehicles within the platoon. Such misinformation can throw off the synchronized movement of a platoon, creating operational inefficiencies and potential safety hazards. Risks escalate if the compromised vehicle is situated at the front of the platoon, where it has considerable influence over the entire formation. Addressing the challenges posed by Byzantine attacks on vehicle platooning systems involves a two-pronged approach. First, control strategies must be designed to preserve the stability and security of the platoon, even in the face of malicious actors within the ranks. Second, these strategies must demonstrate resilience to different types of adversarial incursions. Achieving this resilience requires the creation of innovative control algorithms and robust detection mechanisms capable of identifying and mitigating malicious activities.
Byzantine attacks can occur in various manners during platoon operations, ranging from FDI and packet loss to more elaborate replay attacks. The perpetrators of these attacks could be insiders with access to the communication systems or external agents of the platoon. Furthermore, these attacks can vary in duration and frequency, whether intermittent or sustained.
Let denote the Byzantine attack time instant for vehicle , with , , and being the set of integers in interval . We define as the duration of the Byzantine attack, and vehicle is attacked by a Byzantine attacker during . Following are the assumptions for the Byzantine attack model and ICVs:
Assumption 1. Constants and exist such that: ① the attack duration satisfies for ; ② the intensity of malicious Byzantine attacks remains unchanged in the attack duration ; ③ the ICVs in Eq. 6 are subject to -local Byzantine attacks, and the upper bound is available for the normal vehicles; ④ the lead vehicle is attack-free.
Given the limited energy of adversarial cyberattacks, assuming the number of Byzantine attacks and maximum attack duration for the ICV is reasonable. A similar assumption can be made in the DoS attack results [35], [36].
2.4. Problem formulation
This work aims to develop a resilient and distributed platoon control framework such that constrained ICVs under -local Byzantine attacks achieve the following two objectives:
(1) Resilient platoon: Byzantine vehicles can be detected and isolated. Normal vehicle keeps a desired distance from lead vehicle and tracks the speed of lead vehicle , that is, and , where and the constant is the desired gap between two consecutive vehicles.
(2) Constraint satisfaction: normal vehicle
satisfies the physical constraints in Eq. 8 for all .
3. Distributed detection algorithms for Byzantine attacks
The proposed RDMP2C framework for ICV in the right lane is outlined in Fig. 1. Each follower vehicle comprises five parts: the broadcaster (block a), controlled vehicle (block b), DMPC controller (block c), attack detector (block d), and receiver (block e). The information transmitted between vehicles is broadcast and received by a broadcaster and receiver, respectively. The attack detector is responsible for determining malicious information and retaining normal information from its neighbors. Given normal broadcast information, the optimal platoon control input is generated for vehicle by solving the DMPC problem (see Section 4).
Before discussing the distributed detection algorithms for ICVs under Byzantine attacks, we introduce two pivotal sets: the estimation error set and the resilience set. The estimation error set was meticulously designed and integrated into the DMPC problem to facilitate parallel execution of the distributed control algorithm. Building upon the estimation error set, we design a tube , centered around the prior broadcast state sequence. This tube constrains the current broadcast state sequence shared among vehicles. Expanding the estimation error set, we formulate a resilience set to detect and identify potential attacks targeting vehicles. Consequently, the resilience tube , leveraging the previously broadcast predicted state sequence and the resilience set, is structured within the attack detector (the attack detection mechanism) (block d) for vehicle .
3.1. Estimation error set
Typically, cooperative agents calculate the optimal predicted state sequences and exchange them simultaneously [37], [38]. However, this approach is not feasible in practice. To address this problem, the predicted states of each vehicle broadcast at the previous time instant (termed as “the assumed predicted states”) are used to estimate the current predicted system states at time , . Consequently, vehicles can implement distributed control algorithms simultaneously. Let be the assumed predicted state sequence of vehicle , hereafter, which is used to estimate the current optimal predicted state sequence at time . More precisely, is given by
where , and denotes the optimal predicted state sequence generated by solving the DMPC problem . As indicated in Eq. 10, the assumed predicted states exchanged among the ICV inevitably lead to estimation errors. In this case, the estimation errors induced by a more practical transmission were treated as external disturbances. Note that an estimation error set used to limit the estimation error is specified for the ICV, aiming at achieving the desired formation. The estimation error set plays an important role in the ICV that distributively performs the control algorithm. Accordingly, the optimized predicted states of vehicle , are required to lie in a specified neighborhood of the assumed predicted states for ,
in which the estimation error set is convex and contains the origin, with and denoting the Euclidean norm.
Inspired by the tube-based MPC for linear systems with external disturbances, the estimation errors between the current optimal predicted states and assumed states are treated as external disturbances. Constraint Eq. 11 is incorporated into the robust DMPC optimization problem to constrain the optimal predicted state sequence within the predesigned tube centered along the assumed state . Moreover, this constraint ensures that the robust DMPC optimization problem can be solved in a distributed fashion. Note that the estimation error set provides consistency between the intended behaviors of a vehicle and what makes the neighbors believe how it will behave from the perspective of the broadcaster (the vehicle is the broadcaster when it broadcasts the predicted states to its neighbors; likewise, the receiver refers to the vehicle that receives the predicted states from its neighbors) (block a).
3.2. Resilience set
As achieving resilient platoon control requires reliable and secure information from neighboring vehicles, each vehicle must be able to detect adversarial vehicles and communication links. To identify potential Byzantine attacks, we construct a resilience set for the distributed attack detector (block d), as shown in Fig. 1. For communication networks of the ICV that can afford resilience against -local Byzantine vehicles, each normal vehicle must detect and discard adversarial interconnections to eliminate adverse effects; otherwise, resilient platoon control of the ICV cannot be guaranteed. To this end, the resilience set is designed based on the estimation error set to detect and identify Byzantine adversaries. More precisely, resilience set is given by
where the constant is a resilience parameter. The design parameter reflects the ability of the ICV to tolerate cyber-attacks.
Next, based on the estimation error set and resilience set, vehicle , categorizes the received predicted state sequence from neighbors , into three levels: normal, recoverable, and adversarial communication.
(1) Normal communication: If the assumed predicted state sequence of neighbors , transmitted from vehicle to vehicle satisfies
with , then the communication link is normal at time . From Eq. 13, it can be seen that the assumed predicted state sequence broadcast at time serves as the center of the tube .
(2) Recoverable communication: The adversarial predicted state sequence of neighbors may be in the resilience tube that centers along the previous broadcast assumed predicted state sequence , with . If the assumed predicted-state sequence satisfies
with , then the communication link is adversarial but recoverable at time . . Let denote the set of all recoverable communication links, with . The weight used in the platoon control design becomes , which dynamically adjusts the level of trust in the corresponding communication link/channel among the ICV.
(3) Adversarial communication: If the received assumed predicted state sequence satisfies
with , then the communication link is adversarial. The adversarial predicted state information is discarded and not used in the platoon control design for vehicle (which implies ).
This study assumes no Byzantine attacks on the ICV at the initial time . For vehicle , , the corresponding trustworthiness weight at the initial time , with . At time , the trustworthiness weight becomes:
where , , and represent the normal, recoverable, and adversarial neighboring sets, respectively.
Note that normal vehicles do not require an exact determination of which of their neighboring vehicles is adversarial. Only the adversarial communication induced by Byzantine adversaries must be detected based on the assumed predicted states broadcast at the last time instant, estimation error set, and resilience set.
3.3. Distributed detection algorithm
In this subsection, we present the distributed attack detection algorithm and the second verification algorithm for ICV in the presence of -local Byzantine attacks.
MSR-type algorithms [20], [25], [39] usually require each agent to gather the neighboring state information, sort the received information, and discard the extreme system state values. These algorithms collect and detect adversarial agents in a centralized manner, which is a requirement for robust communication networks. More precisely, the communication network is at least ()-robust. In contrast, the proposed detection algorithm distributively detects broadcast information from neighbors, which significantly relaxes the restriction on network robustness. Each normal vehicle only ignores at most received neighbors’ information for the ICV in the presence of -local Byzantine attacks.
Algorithm 1 summarizes the implementation of the distributed attack detection scheme for vehicle , at time in this paper.
Before proceeding, we make the following remarks on Algorithm 1.
Redundant network interconnections are crucial for a resilient ICV platoon under -local Byzantine attacks. Typically, MSR-type algorithms filter adversarial information from neighbors by discarding suspicious system state values at each time step, which requires the communication network to be at least ()-robust [20], [24], [40]. By contrast, our distributed attack detection algorithm relaxes the network robustness requirement from () to (). Owing to the resilience set and assumed predicted states, each normal vehicle can detect the received neighbor information under relaxed graph robustness. This constitutes a distinct contribution to this study.
Applying Algorithm 1 identifies and ignores severely adversarial assumed predicted states from neighbors, as indicated in Eq. 15, in the distributed control strategy. Now, let us consider the special case (slight cyberattacks) where the broadcast assumed predicted states violate the estimation error set while remaining within the resilience set, as given in Eq. 14. In Algorithm 1, instead of discarding this information directly, we dynamically adjust the edge weight of the adjacency matrix to eliminate the adverse effects of Byzantine attacks. A question arises naturally: If the communication link , becomes normal, is it possible to recover the confidence weight? To address this problem, we provide a “second verification” mechanism for recovering less severe communication links. Under this verification mechanism, if attacks recur in the same communication channel/link and vehicles broadcast the misbehaving assumed predicted state given in Eq. 15, we consider the vehicle vulnerable and discard it. Conversely, if Byzantine attacks Eq. 14 occur at time , then we will restore the trustworthiness of the associated vehicle and communication links at based on Algorithm 1.
This algorithm is referred to as the second verification algorithm and is summarized in Algorithm 2.
The detection and isolation mechanism (i.e., detecting attacks and isolating corrupted communication links/agents) for MAS under cyberattacks has recently gained attention [20], [41]. In contrast to these existing attack detection methodologies, the proposed secondary verification algorithm enhances the resilience of the system to a higher number of Byzantine attacks without increasing the robustness threshold of the network.
4. Resilient DMPC-based platoon control
In this section, we present a DMPC-based platoon control algorithm for constrained ICVs in the presence of -local Byzantine attacks. Inspired by the “pre-stabilizing” control method [42], the proposed control policy is designed in two steps:
(1) Pre-design the optimal platoon control strategy for the unconstrained ICV based on the reliable predicted state information from the normal neighbors and the updated communication network .
(2) Design the DMPC optimization problem for vehicle , to explicitly handle the estimation errors and the physical constraints, including the state and control input constraints. Solving the DMPC optimization problem yields the optimal control input .
4.1. Pre-designed platoon control
At time , communication network may be updated when Byzantine attacks occur. In this work, we design an optimal platoon control for the unconstrained ICV to achieve optimal control performance. Specifically, the predesigned optimal platoon control for vehicle depends on the relative states with its normal neighbors, that is,
where denotes the predesigned optimal control gain matrix. For vehicle , the assumed predicted states of neighbors are employed to construct the predesigned optimal platoon control law. Consequently, the predesigned platoon control input in Eq. 17 can be written as follows:
Once the Byzantine vehicles are detected by Algorithm 1 and Algorithm 2, information from these vehicles is discarded. That is, Byzantine vehicles were isolated from the ICV, yielding a time-dependent communication network, . When the communication networks change, we update the predesigned optimal control gain matrix , using various methods outlined in Refs. [43], [44].
4.2. DMPC for constrained ICVs
At time , the cost function for vehicle , is designed as
where the weighting matrix is positive definite and denotes the control sequence. Note that is written as and denotes the weighted Euclidean norm .
At time , given the current system state of each vehicle , and its neighbors’ assumed states , , the DMPC problem is given as
where . denotes the state at time , and denotes the predicted state at future time determined at time . Let be the optimal solution to problem at time . Then, we obtain the optimal control input for vehicle
where , the optimal control input sequence at time is and the corresponding optimal predicted state becomes
where , the optimal state sequence is denoted by . Furthermore, applying the first term of the optimal control input in Eq. 21 to the vehicle system in Eq. 4 yields
with .
In what follows, some discussions of computation, stability, and optimality are provided.
(1) Discussion on computation and stability. The DMPC problem with an infinite prediction horizon usually has a high computational resource requirement, facilitating theoretical analysis, for example, feasibility and stability analysis. In practical applications, we use a DMPC problem with a sufficiently long finite prediction horizon to estimate an infinite prediction horizon case [45]. The stability analysis of finite horizon DMPC for ICV deserves further investigation.
(2) Discussion on optimality and constraint satisfaction. For an unconstrained ICV, a predesigned platoon control law is optimal for a specific cost function [44]. By contrast, the proposed DMPC-based platoon control gradually converges to the optimal control input and achieves suboptimal platoon control performance. Therefore, the algorithm handles physical constraints and achieves a trade-off between optimality and constraint satisfaction.
The overall RDMP2C algorithm for vehicle , is summarized in Algorithm 3.
Note that each vehicle verifies the information from its neighbors in step 2 of Algorithm 3 based on Algorithms 1 and 2 at each time step. When the communication networks change, the predesigned platoon control gain matrix in Eq. 21 is recalculated and updated.
5. Theoretical analysis
In this section, the recursive feasibility of Algorithm 3 and the convergence analysis of the ICV under Byzantine attacks are discussed. We first present three technical lemmas before proceeding with the feasibility and convergence analyses in Theorem 1.
The following lemma on the nonnegative sequences , and are fundamental to the resilient platoon analysis, and the proof can be found in Ref. [46].
Lemma 1. Let , and be nonnegative sequences, suppose and
then the sequence converges and .
Let be the candidate control input sequence for optimization problem at time . Depending on whether the ICV is under attack at time , two candidate input sequences can be constructed.
Case 1. The network does not change at time .
A candidate input sequence at is then created by dropping the first input and appending a terminal zero element of the optimal control at ,
Case 2. The network changes at time .
A candidate input sequence is constructed based on the optimal control sequence , that is
Lemma 2. For the ICV in the presence of -local Byzantine attacks, if the initial state is feasible and , , then the control sequence satisfies .
Proof of Lemma 2.To prove the convergence of as , we introduce the following function
By choosing the control input sequence for the ICV when there are no attacks at , the following relationship can be obtained:
The control input sequence is feasible but not necessarily an optimal solution to the problem at . Then, one has
It holds that
Note that there are at most -local Byzantine attacks for vehicle , , which implies that the control input candidate in Eq. 26 is adopted no more than times during the time interval . Additionally, , with .
Upon summing up in Eq. 30 from to , we obtain
and as , satisfies
in which . From Lemma 1, we obtain that converges as . Therefore, we have , which implies that .
Lemma 3. For any given scalar , suppose that the summable sequence satisfies , then it holds that .
The main theoretical results of ICV under the RDMP2C algorithm are as follows. Note that represents its spectral radius of the matrix .
Theorem 1. Consider constrained ICV Eq. 6 in the presence of -local Byzantine attacks. Suppose that the communication network is ()-robust, and Byzantine attacks can be detected using Algorithms 1 and 2. If the conditions are satisfied, with , and the optimization problem is feasible at , , , then
(1) the optimization problem has a feasible solution at ;
(2) the normal vehicles achieve resilient platoon, with and .
Proof of Theorem 1. (1) Proof of the recursive feasibility. For case 1 (i.e., network does not change), the proof directly follows the proof in Ref. [47] and is omitted here.
For case 2 (i.e., the network changes), the control input becomes
where . The constraint holds at time .
With the initial condition and the control inputs in Eq. 33, the corresponding system state becomes
where . Hence, constraints Eqs. (20e) and (20f) hold.
From Eqs. 22, 23, the feasibility is established at time when attacks occur.
(2) Proof of the convergence for the resilient platoon.
By substituting Eq. 21 into Eq. 4, we obtain
where , , , , , , is the identity matrix, and the symbol denotes the Kronecker product. The corresponding variables and matrices for normal vehicles in Eq. 35 have compatible dimensions.
The state of the leader vehicle 0 is ,
Define , and , , then we have
in which and is a compatible vector with all elements to be .
There always exists an orthogonal matrix such that the Laplacian matrix is diagonalized, that is, , where , is an orthogonal eigenvector of .
Using the property of Kronecker product, one obtains
Define , then Eq. 37 is expressed by
Next, we define the transition matrix and , then Eq. 37 becomes
which implies that
It holds that . Also, owing to , , we obtain the term .
In light of , there always exists a constant , such that
Define . Using the Cauchy–Schwarz inequality and Eq. 41, we have
From Lemmas 2 and 3, we obtain
Similarly, it holds that
Therefore, the constrained ICVs under -local Byzantine attacks achieve a platoon control objective with guaranteed resilience. The proof is completed.
Although most current studies on platoon control emphasize error dynamics and require vehicles to receive information from the leader, practical limitations can impede some vehicles from accessing the leader's data because of restricted communication ranges. In contrast, only a portion of the follower vehicles are required to obtain information from the leader in the proposed platoon control design, making this work more general and practical.
6. Simulation
In this section, we describe numerical simulations to verify the effectiveness of the proposed RDMP2C strategy for ICV under -local Byzantine attacks. A platoon consisting of seven vehicles moves along a single lane with a fixed distance gap d = 5 m. The longitudinal dynamics of vehicle , are given by
where includes the position , the speed and the acceleration .
where and are the sampling time and vehicle engine constant, respectively. The control input constraints are . The vehicle system constraints are given as m·s−1 and . Lead vehicle starts at a low speed, accelerates to reach a speed of m·s−1, and keeps a constant speed. That is,
with and . Only a portion of follower vehicles can receive information from the lead vehicle . The initial states of six vehicles are , , , , , and , respectively. The 2-robust communication network among ICV is described by the neighboring sets: , , , , , and .
Ensuring safety and rational driving exploration and exploitation are crucial for the online evolution of autonomous driving. These principles are the key factors affecting the safety, comfort, and trust of drivers and passengers in online autonomous driving. This section introduces the corresponding modeling methods for these two principles, including predictive safe-driving envelope modeling and a rational exploration and exploitation scheme.
The prediction horizon is chosen as and the estimation error set is , using a weighting matrix . Following the method in Ref. [44], the pre-designed consensus gain matrix is designed as .
Two Byzantine attacks, and are randomly generated and injected into follower vehicle and vehicle , respectively, as listed in Table 1. The resilience parameter is chosen as , and the maximum attack duration is . The four simulation scenarios (, , and ) listed in Table 2 [44,48] are designed to verify the platoon control performance of the proposed framework.
In the first two baseline scenarios, the ICVs are simulated without considering Byzantine attacks. In , we simulate the pre-designed consensus-based platoon control method (PCPC) [44]. The results, including the system states, system error states, and control inputs, are presented in Fig. 2. Fig. 2(a) demonstrates that follower vehicles maintain the desired relative distance and consistent speed. However, the PCPC method cannot guarantee constraint satisfaction in terms of physical constraints including the speed, acceleration, and control input constraints (Fig. 2(b), (c), and (f)).
In , we test the DMPC method [48] for a constrained ICV without Byzantine attacks, to facilitate comparison. The simulation results shown in Fig. 3 demonstrate that the DMPC method achieves the platoon control objective while guaranteeing constraint satisfaction.
In the last two scenarios, the ICVs are attacked by two types of Byzantine attackers (see Table 1). In , the DMPC method cannot achieve resilient platoon control without an attack detection mechanism. In Fig. 4(a) and (d), follower vehicles do not operate normally and stop operating. More precisely, the normal follower vehicles cannot maintain the desired spacing and stability when Byzantine attacker attacks vehicle .
In , the proposed RDMP2C framework is simulated, and the results are shown in Fig. 5. The stability and resilience of the ICV are guaranteed under the proposed RDMP2C. Because of the distributed attack detection algorithms, the adversarial information from vehicle is detected and discarded. Consequently, the following normal vehicles retain the desired resilient platoon behavior. Further, in the second verification algorithm, normal vehicles can achieve resilient platoon control when vehicle is attacked by slight attacker .
Therefore, the proposed RDMP2C algorithm achieves a trade-off between optimality and constraint satisfaction while ensuring the resilience of the ICV under -local Byzantine attacks. The main advantages of the proposed algorithm with respect to resilient control algorithms [11], [12], [13], [14], [16], [17] lie in its ability to handle Byzantine attacks on constrained vehicles. The aforementioned resilient control algorithms ensure only the resilience of the ICV under DoS or FDI attacks. Moreover, the network robustness requirement is significantly relaxed compared to MSR-type algorithms [20], [39]. Resilient platoon control is achieved over an ()-robust graph despite -local Byzantine attacks.
7. Conclusions
This paper presented a resilient DMPC-based platoon control framework for constrained ICV under -local Byzantine attacks. A distributed Byzantine attack detection mechanism was developed to enable each vehicle to detect a Byzantine attack by relying only on the ()-robust graph. Communication among ICV was classified into different types based on the attack intensity: normal, recoverable, and adversarial communication. Based on the resilience set and parameters, we developed a second verification algorithm to recover the communication channels under slight attacks, which offered the opportunity to further relax the robustness requirements of communication networks. The proposed resilient platoon control strategy, which took advantage of the predesigned optimal control and DMPC optimization, ensured robust constraint satisfaction and optimized platoon control performance. A rigorous theoretical analysis was conducted, including recursive feasibility and closed-loop stability. The simulation results verified the effectiveness of the proposed algorithm.
This study suggests several directions for future research. This study examines longitudinal ICV under local Byzantine attacks. The proposed RDMP2C framework can be extended to handle constrained ICV in more complex environments such as time-varying communication networks [26]. Also, we expect that the proposed approach can be applied to address the flexible ICV platoon problem as demonstrated in Ref. [49]. Furthermore, advanced machine learning methods like graph neural networks [50] hold promise for detecting adversarial cyberattacks on ICVs in intricate real-world situations.
Acknowledgments
The authors acknowledge the financial support from the Natural Sciences and Engineering Research Council of Canada (NSERC) and thank the anonymous reviewers for their valuable suggestions.
Compliance with ethics guidelines
Henglai Wei, Hui Zhang, Kamal AI-Haddad, and Yang Shi declare that they have no conflict of interest or financial conflicts to disclose.
S.Feng, Y.Zhang, S.E.Li, Z.Cao, H.X.Liu, L.Li. String stability for vehicular platoon control: definitions and analysis methods. Annu Rev Control, 47 (2019), pp. 81-97
[2]
Z.Ju, H.Zhang, X.Li, X.Chen, J.Han, M.Yang. A survey on attack detection and resilience for connected and automated vehicles: from vehicle dynamics and control perspective. IEEE Trans Intell Veh, 7 (4) (2022), pp. 815-837
[3]
T.Limbasiya, K.Z.Teng, S.Chattopadhyay, J.Zhou. A systematic survey of attack detection and prevention in connected and autonomous vehicles. Veh Commun, 37 (2022), Article 100515
[4]
X.Sun, F.R.Yu, P.Zhang. A survey on cyber-security of connected and autonomous vehicles (CAVs). IEEE Trans Intell Transp Syst, 23 (7) (2022), pp. 6240-6259
[5]
H.Sandberg, V.Gupta, K.H.Johansson. Secure networked control systems. Annu Rev Control Robot Auton Syst, 5 (1) (2022), pp. 445-464
[6]
D.Zhang, G.Feng, Y.Shi, D.Srinivasan. Physical safety and cyber security analysis of multi-agent systems: a survey of recent advances. IEEE/CAA J Autom Sin, 8 (2) (2021), pp. 319-333
[7]
J.Chen, Y.Shi. Stochastic model predictive control framework for resilient cyber-physical systems: review and perspectives. Phil Trans R Soc A, 379 (2207) (2021), Article 20200371
[8]
C.Zhou, B.Hu, Y.Shi, Y.C.Tian, X.Li, Y.Zhao. A unified architectural approach for cyberattack-resilient industrial control systems. Proc IEEE, 109 (4) (2021), pp. 517-541
[9]
Z. AbdollahiBiron, S.Dey, P.Pisu. Real-time detection and estimation of denial of service attack in connected vehicle systems. IEEE Trans Intell Transp Syst, 19 (12) (2018), pp. 3893-3902
[10]
R.Merco, F.Ferrante, P.Pisu. A hybrid controller for DOS-resilient string-stable vehicle platoons. IEEE Trans Intell Transp Syst, 22 (3) (2021), pp. 1697-1707
[11]
S.Xiao, X.Ge, Q.L.Han, Y.Zhang. Secure distributed adaptive platooning control of automated vehicles over vehicular ad-hoc networks under denial-of-service attacks. IEEE Trans Cybern, 52 (11) (2022), pp. 12003-12015
[12]
D.Zhang, Y.P.Shen, S.Q.Zhou, X.W.Dong, L.Yu. Distributed secure platoon control of connected vehicles subject to DoS attack: theory and application. IEEE Trans Syst Man Cybern Syst, 51 (11) (2021), pp. 7269-7278
[13]
Y.Zhao, Z.Liu, W.S.Wong. Resilient platoon control of vehicular cyber physical systems under DoS attacks and multiple disturbances. IEEE Trans Intell Transp Syst, 23 (8) (2022), pp. 10945-10956
[14]
X.Xu, X.Li, P.Dong, Y.Liu, H.Zhang. Robust reset speed synchronization control for an integrated motor-transmission powertrain system of a connected vehicle under a replay attack. IEEE Trans Veh Technol, 70 (6) (2021), pp. 5524-5536
[15]
C.Zhao, J.S.Gill, P.Pisu, G.Comert. Detection of false data injection attack in connected and automated vehicles via cloud-based sandboxing. IEEE Trans Intell Transp Syst, 23 (7) (2022), pp. 9078-9088
[16]
R.A.Biroon, Z.A.Biron, P.Pisu. False data injection attack in a platoon of CACC: real-time detection and isolation with a PDE approach. IEEE Trans Intell Transp Syst, 23 (7) (2022), pp. 8692-8703
[17]
Z.Ju, H.Zhang, Y.Tan. Distributed deception attack detection in platoon-based connected vehicle systems. IEEE Trans Veh Technol, 69 (5) (2020), pp. 4609-4620
[18]
S.Ghane, A.Jolfaei, L.Kulik, K.Ramamohanarao, D.Puthal. Preserving privacy in the internet of connected vehicles. IEEE Trans Intell Transp Syst, 22 (8) (2021), pp. 5018-5027
[19]
M.N.Aladwan, F.M.Awaysheh, S.Alawadi, M.Alazab, T.F.Pena, J.C.Cabaleiro. TrustE-VC: trustworthy evaluation framework for industrial connected vehicles in the cloud. IEEE Trans Ind Inform, 16 (9) (2020), pp. 6203-6213
[20]
S.M.Dibaji, H.Ishii. Resilient consensus of second-order agent networks: asynchronous update rules with delays. Automatica, 81 (2017), pp. 123-132
[21]
M.Ruan, H.Gao, Y.Wang. Secure and privacy-preserving consensus. IEEE Trans Autom Control, 64 (10) (2019), pp. 4035-4049
[22]
C.N.Hadjicostis, A.D.Domínguez-García. Privacy-preserving distributed averaging via homomorphically encrypted ratio consensus. IEEE Trans Autom Control, 65 (9) (2020), pp. 3887-3894
[23]
W.Fang, M.Zamani, Z.Chen. Secure and privacy preserving consensus for second-order systems based on Paillier encryption. Syst Control Lett, 148 (2021), Article 104869
H.J.LeBlanc, H.Zhang, X.Koutsoukos, S.Sundaram. Resilient asymptotic consensus in robust networks. IEEE J Sel Areas Commun, 31 (4) (2013), pp. 766-781
[26]
J.Usevitch, D.Panagou. Resilient leader-follower consensus to arbitrary reference values in time-varying graphs. IEEE Trans Autom Control, 65 (4) (2020), pp. 1755-1762
[27]
D.Fiore, G.Russo. Resilient consensus for multi-agent systems subject to differential privacy requirements. Automatica, 106 (2019), pp. 18-26
[28]
H.Wei, K.Zhang, Y.Shi. Self-triggered min-max DMPC for asynchronous multiagent systems with communication delays. IEEE Trans Ind Inform, 18 (10) (2022), pp. 6809-6817
[29]
Y.Shi, K.Zhang. Advanced model predictive control framework for autonomous intelligent mechatronic systems: a tutorial overview and perspectives. Annu Rev Control, 52 (2021), pp. 170-196
[30]
W.B.Dunbar, R.M.Murray. Distributed receding horizon control for multi-vehicle formation stabilization. Automatica, 42 (4) (2006), pp. 549-558
[31]
H.Li, Y.Shi, W.Yan, F.Liu. Receding horizon consensus of general linear multi-agent systems with input constraints: an inverse optimality approach. Automatica, 91 (2018), pp. 10-16
[32]
Q.Wang, Z.Duan, Y.Lv, Q.Wang, G.Chen. Linear quadratic optimal consensus of discrete-time multi-agent systems with optimal steady state: a distributed model predictive control approach. Automatica, 127 (2021), Article 109505
[33]
H.Ishii, Q.Zhu. Security and resilience of control systems: theory and applications. Springer, Cham (2022)
[34]
Y.Zheng, S.Li, J.Wang, D.Cao, K.Li. Stability and scalability of homogeneous vehicular platoon: study on the influence of information flow topologies. IEEE Trans Intell Transp Syst, 17 (1) (2016), pp. 14-26
[35]
C.Deng, D.Zhang, G.Feng. Resilient practical cooperative output regulation for MASs with unknown switching exosystem dynamics under DoS attacks. Automatica, 139 (2022), Article 110172
[36]
A.Y.Lu, G.H.Yang. Input-to-state stabilizing control for cyber-physical systems with multiple transmission channels under denial of service. IEEE Trans Autom Control, 63 (6) (2018), pp. 1813-1820
[37]
M.A.Müller, M.Reble, F.Allgöwer. Cooperative control of dynamically decoupled systems via distributed model predictive control. Int J Robust Nonlinear Control, 22 (12) (2012), pp. 1376-1397
[38]
Z.Wang, C.J.Ong. Distributed model predictive control of linear discrete-time systems with local and global constraints. Automatica, 81 (2017), pp. 184-195
[39]
A.Mustafa, H.Modares, R.Moghadam. Resilient synchronization of distributed multi-agent systems under attacks. Automatica, 115 (2020), Article 108869
[40]
S.M.Dibaji, H.Ishii, R.Tempo. Resilient randomized quantized consensus. IEEE Trans Autom Control, 63 (8) (2018), pp. 2508-2522
[41]
J.Usevitch, D.Panagou. Determining r- and (r, s)-robustness of digraphs using mixed integer linear programming. Automatica, 111 (2020), Article 108586
[42]
L.Chisci, J.A.Rossiter, G.Zappa. Systems with persistent disturbances: predictive control with restricted constraints. Automatica, 37 (7) (2001), pp. 1019-1028
[43]
K.You, L.Xie. Network topology and communication data rate for consensusability of discrete-time multi-agent systems. IEEE Trans Autom Control, 56 (10) (2011), pp. 2262-2275
[44]
K.H.Movric, F.L.Lewis. Cooperative optimal control for multi-agent systems on directed graph topologies. IEEE Trans Autom Control, 59 (3) (2014), pp. 769-774
[45]
A.Boccia, L.Grüne, K.Worthmann. Stability and feasibility of state constrained MPC without stabilizing terminal constraints. Syst Control Lett, 72 (2014), pp. 14-21
[46]
T.H.Chang, A.Nedić, A. Scaglione. Distributed constrained optimization by consensus-based primal-dual perturbation method. IEEE Trans Autom Control, 59 (6) (2014), pp. 1524-1538
[47]
WeiH, LiuC, ShiY. A robust distributed model predictive control framework for consensus of multi-agent systems with input constraints and varying delays. 2022. arXiv:2209.08785.
[48]
H.Wei, Q.Sun, J.Chen, Y.Shi. Robust distributed model predictive platooning control for heterogeneous autonomous surface vehicles. Control Eng Pract, 107 (2021), Article 104655
[49]
P.Liu, A.Kurt, U.Ozguner. Distributed model predictive control for cooperative and flexible vehicle platooning. IEEE Trans Control Syst Technol, 27 (3) (2019), pp. 1115-1128
[50]
Y.Wang, Y.Liu, Z.Shen. Revisiting item promotion in GNN-based collaborative filtering: a masked targeted topological attack perspective. Proc AAAI Conf Artif Intell, 37 (12) (2023), pp. 15206-15214