Compliace with ethics guidelines:Hao Zheng, Yinong Li, Ling Zheng, and Ehsan Hashemi declare that they have no conflicts of interest or financial conflicts todisclose.
Compliace with ethics guidelines:Hao Zheng, Yinong Li, Ling Zheng, and Ehsan Hashemi declare that they have no conflicts of interest or financial conflicts todisclose.
Model mismatches can cause multi-dimensional uncertainties for the receding horizon control strategies of automated vehicles (AVs). The uncertainties may lead to potentially hazardous behaviors when the AV tracks ideal trajectories that are individually optimized by the AV's planning layer. To address this issue, this study proposes a safe motion planning and control (SMPAC) framework for AVs. For the control layer, a dynamic model including multi-dimensional uncertainties is established. A zonotopic tube-based robust model predictive control scheme is proposed to constrain the uncertain system in a bounded minimum robust positive invariant set. A flexible tube with varying cross-sections is constructed to reduce the controller conservatism. For the planning layer, a concept of safety sets, representing the geometric boundaries of the ego vehicle and obstacles under uncertainties, is proposed. The safety sets provide the basis for the subsequent evaluation and ranking of the generated trajectories. An efficient collision avoidance algorithm decides the desired trajectory through the intersection detection of the safety sets between the ego vehicle and obstacles. A numerical simulation and hardware-in-the-loop experiment validate the effectiveness and real-time performance of the SMPAC. The result of two driving scenarios indicates that the SMPAC can guarantee the safety of automated driving under multi-dimensional uncertainties.
Hao Zheng, Yinong Li, Ling Zheng, Ehsan Hashemi.
Compliace with ethics guidelines:Hao Zheng, Yinong Li, Ling Zheng, and Ehsan Hashemi declare that they have no conflicts of interest or financial conflicts todisclose..
Engineering, 2024, 33(2): 161-175 DOI:10.1016/j.eng.2023.12.003
Automated vehicles (AVs) have become a critical link in the development of intelligent transportation systems (ITS) owing to their vast potential to enhance safety, reduce energy consumption, and optimize traffic flow [1], [2]. The general hierarchical scheme of an AV consists of three layers: ① perception layer, ② planning layer, and ③ control layer. These layers rely on sensing, network [3], processing of complex algorithms, and actuation implemented by electrical and/or electronic (E/E) systems. This study focuses on the planning and control layers of the AV system, which assumes that the perception layer works satisfactorily.
With the increase of advanced functionalities included in AVs, safety during their operational phase is of paramount importance for the road vehicles industry. However, there have been several fatal accidents involving AVs [4], [5], which underscore the importance and urgency of guaranteeing their safety. The reasons for the above accidents can be attributed to three typical safety issues faced by AVs: ① functional safety (ISO 26262) [6], ② safety of the intended functionality (SOTIF, ISO 21448) [7], and ③ cybersecurity (ISO 21434) [8]. Among these three, the SOTIF stands out as both a current academic research hotspot and an immediate challenge for AV applications. The SOTIF aims to handle potentially hazardous behaviors (PHBs), including insufficiencies or limitations related to the specifications, performance, and situational awareness, with or without reasonably foreseeable misuse, and surrounding impacts (e.g., other users, passive infrastructure, weather, and electromagnetic interference).
Given this consideration, this study deduced that the current motion planning and control techniques also suffer from issues that fall within the scope of the SOTIF. For example, uncertainties such as model mismatches will inevitably lead to control errors in the future while the planning layer does not consider the impact of these errors within the planning cycle. Moreover, AVs are affected by environmental uncertainty, and their actuators and sensors have performance limitations.
Fig. 1(a) shows an example scenario where uncertainties may lead to PHBs in automated driving. To date, however, most research on motion planning and control has not fully considered these uncertainties, and the desired trajectory is generally optimized individually by the planning layer. Therefore, as shown in Fig. 1(b), the main focus of this study is to reduce the possible hazardous/unknown areas in automated driving scenario categories. Specifically, this study generates and tracks a trajectory that can avoid obstacles and corresponding uncertainties, and mitigate unavoidable crashes.
1.2. Related work
The planning layer is the core that directly impacts driving safety. This layer is responsible for deciding the optimal driving behavior and generating a collision-free local trajectory to be followed at each instant. Heuristic approaches, including A* [9], Dijkstra [10], and rapidly exploring random tree (RRT) [11], were first applied to robot path planning. However, the heuristic approaches have difficulty generating smooth trajectories with continuous curvature. Therefore, curve-based methods, including the polynomial [12], Bezier-based [13], spline curve [14], and generation-selection-based [15] methods, were utilized to generate smooth trajectories. The quintic polynomials were proved as the jerk-optimal connections between a start state and an end state [12]. Moreover, the curve-based methods require a further assessment of the generated trajectories to select the optimal trajectory. Therefore, optimization-based methods, such as artificial potential field (PF) method [16], can be used to obtain smooth and curvature continuous trajectories. Nevertheless, the trajectories generated by the PF and gradient descent methods may converge toward local minima, resulting in rough and unexpected trajectories. Additionally, some artificial intelligence (AI)-based motion planning methods using historical data have emerged recently, such as reinforcement learning (RL) and deep learning (DL) [17]. The AI-based techniques are challenging to interpret and require high hardware costs for online applications. Considering the trade-off between computational cost and optimality, this study uses a quintic polynomial for smooth curve constructions and a PF function considering the obstacle sizes for discrete assessment.
The control layer is the core that directs the AV's actuators to follow the reference trajectories optimized by the planning layer. State-of-the-art approaches, such as dynamical game-based control [18], robust control [19], optimal control [20], RL-based control [21], and model predictive control (MPC) [22], [23], [24], are commonly applied to trajectory-tracking tasks. The main disadvantage of most of these approaches is that the AV's critical safety and actuator constraints are not explicitly considered. Moreover, robust control can be computationally intensive and behaves too conservatively, whereas RL-based control requires improved interpretability. By contrast, MPC has been extensively studied and applied to AV systems owing to its ability to systematically exploit prediction information and handle multiple-input multiple-output (MIMO) under constraints.
Nevertheless, the traditional MPC could not handle uncertainties such as model mismatches and sensor noises. Therefore, schemes considering the impact of uncertainties in future evolution were studied. The common approaches are robust MPC (RMPC) [25] with a bounded set description and stochastic MPC (SMPC) with a probabilistic description [26]. However, it should be noted that uncertainties such as model mismatches are difficult to describe using probability. Hence, we consider the RMPC more promising than the SMPC in AV control tasks.
The RMPC schemes address all possible uncertainties by considering the worst case. Min–max RMPC [27] was first proposed by solving dynamical programming (DP) at each time step; however, it is computationally expensive. Subsequently, a more efficient tube-based RMPC (TRMPC) [28] was developed to guarantee the robustness and stability of the constraint satisfaction with a lower computational cost. The TRMPC scheme creates a condition similar to the real state being tightened in a tube. Compared to the traditional MPC, the online computational burden of the TRMPC is slightly increased.
Therefore, the TRMPC scheme has been applied widely in the AV control field, such as lateral control for AVs [29], trajectory tracking for autonomous race cars [30], active safety control for four-wheel steering [31], fault-tolerant control [32], and platoon control [33].
However, traditional TRMPC also faces difficulties in practical applications. For example, the high cost of set operations often limits computation to only a few time steps, which prevents the evaluation of the uncertainties in future evolution.
1.3. Contribution
Inspired by the existing literature on motion planning and control, the main contribution of this study is to propose a safe motion planning and control (SMPAC) framework for AVs to guarantee the safety of automated driving under multi-dimensional uncertainties. Fig. 2 shows the overall schematic of the study.
The core idea of SMPAC can be summarized as follows:
(1) For the control layer, we develop a flexible zonotopic TRMPC (FTMPC) controller by leveraging an efficient reachability analysis on the uncertainties. The controller can converge the future evolution of all possible uncertainties into a minimal robust positive invariant (mRPI) set.
(2) For the planning layer, we propose a concept of safety sets, which describes the geometric boundaries that ego vehicle/obstacles may reach by considering the bounded multi-dimensional uncertainties from the control layer. The safety sets guarantee that the real trajectories of the ego vehicle are always constrained in a safety tube.
Furthermore, the proposed SMPAC is a general scheme with interchangeable planning methods. Therefore, we believe that SMPAC has potential applications in other robotic systems, including but not limited to mobile robots and unmanned underwater vehicles.
1.4. Paper organization
The remainder of this study is presented as follows. Section 2 introduces the preliminaries for the set operations and zonotopes. In Section 3, the dynamic model with uncertainties is developed, and the FTMPC scheme is proposed. Section 4 presents the motion planning approach with safety sets to cope with multi-uncertainties. The co-simulations (MATLAB/Simulink, R2021b, MathWorks, USA; CarSim, 2019 version, Mechanical Simulation Corporation, USA) and hardware-in-the-loop experiments (HIL) performed to validate the proposed SMPAC are described in Section 5. Finally, the conclusions are summarized in Section 6.
2. Preliminaries
2.1. Definition of set operations
This study revolves around a set theory, hence the following three basic set operations are introduced first.
For a linear matrix , sets , and elements ,
Linear map:
Minkowski sum:
Pontryagin difference:
2.2. Zonotopes
A bounded polyhedral set is a polytope. The zonotope shown in Fig. 3 (a) is a class of centrally-symmetric polytopes.
The zonotope is also an affine transformation of the hypercube. An n-order zonotope () transformed from an s-order hypercube () is described by
where is the center and is the generator. In this study, the zonotope is abbreviated as .
Moreover, zonotopes hold the following essential properties.
For , the linear map and Minkowski sum of two zonotopes are computed by
The Frobenius norm of the generator denotes the size of the zonotope :
The interval hull of a zonotope is computed by
where a diagonal matrix such that , . Fig. 3(b) illustrates the geometric interpretation of the interval hull .
The P-radius of a zonotope is defined by
where is a symmetric and positive definite matrix. is set as the identity matrix in this study, such that represents the Euclidean distance.
Furthermore, all defined sets in this study are represented by zonotopes. The main reasons are summarized as follows:
(1) Zonotopes guarantee that all sets defined in this study are compact, convex, and contain the origin in their interior.
(2) The zonotopic set operations in Eqs. (5), (6) enable an exact, fast, and visual exploration of the system evolution in the FTMPC scheme.
(3) Table 1 illustrates that the zonotopes provide higher accuracy than ellipsoids while having lower time complexity than polytopes [34].
3. Flexible zonotopic TRMPC scheme
The FTMPC controller for uncertainties is introduced in this section. The process includes modeling the AV and uncertainties, determining known constraints, evaluating the evolution of the uncertain system, and developing a varying zonotopic tube.
3.1. Dynamics and uncertainties modeling for AV
3.1.1. 3-degree of freedom vehicle model
Considering the trade-off between the model accuracy and computational cost, a simplified vehicle model consisting of a 1-degree of freedom (1-DOF) longitudinal model and a 2-DOF bicycle model is used under certain assumptions [35]. Fig. 4 depicts the vehicle model with the longitudinal, lateral, and yaw dynamics governed by
where is the inertial coordinate system for the ground and is the vehicle coordinate system. For the body-fixed coordinates, is the vehicle mass, and are the front and rear wheelbase, is the moment of inertia through the center of gravity about the yaw axis, and are the vehicle's longitudinal and lateral velocities, is the vehicle heading angle, is the steering angle of the front wheels, is the total longitudinal tire force, and and () are the longitudinal and lateral forces of the front/rear tires, respectively.
Assuming that the lateral acceleration and vehicle sideslip angle are small, and the vertical tire load is constant, for simplicity, the lateral tire forces and are considered to be linear with the tire slip angles and (rear tire):
where and are the corner-stiffnesses of the front and rear tires, respectively.
3.1.2. Error model for trajectory tracking
Leveraging an error model is a more effective approach for tracking a pre-planned trajectory. As shown in Fig. 5, , , and are the tracking errors of the longitudinal velocity, lateral distance, and heading angle with respect to the reference trajectory, respectively. According to the kinematic relationship, , , , , and are defined as
where , is the desired lateral velocity, is the desired longitudinal acceleration, is the desired yaw rate, and is the radius of the reference trajectory.
According to the state variable dynamics in Eqs. (10), (11), as well as the tracking error expression in Eq. (12), the continuous real AV model can be described as follows
where is the state, is the control input, and denotes the information from the reference trajectory. The additive disturbance generalizes the internal and external uncertainties caused by all the adverse factors. Here, the internal uncertainties mainly include the coupled dynamics of longitudinal and lateral (the term in Eq. (12)) time-varying parameters, and unmodeled dynamics. The external uncertainties mainly include sensor noises and environmental disturbances. The disturbance matrix is determined under scenarios encompassed by the operational design domain (ODD) of automated driving.
3.1.3. Zero steady-state error model
The presence of the term in Eq. (13) prevents the tracking errors from all converging to zero. Hence a feedforward term of the control inputs is designed to ensure a zero steady-state error. The steady-state and steady-input are obtained by the final value theorem,
where is the reference curvature, is the wheelbase, and is the understeer gradient.
Substitute Eq. (16) into Eq. (13) and define , . The zero steady-state error model can be described by
with the full-output , , is an identity matrix.
3.1.4. Real system
By the zero-order hold method, the discrete real AV system to be controlled can be expressed as
with the output , where , , , , , , is the sample time.
3.2. Zonotopic constraints of real system
Moreover, the real AV system in Eq. (18) is subject to zonotopic hard constraints, that is, , , , and . The zonotope generators and are known matrices determined by the characteristics of the AV system, which include the following aspects:
Trajectory tracking constraints:
where is the lane width, is the width of the ego vehicle, and are the maximum values of the velocity error () and heading angle error (), respectively.
Handling stability constraints: The vehicle sideslip angle has the empirical constrained boundary and the yaw rate has a limit:
where the tire-ground adhesion coefficient (lateral for ) is assumed to be known for the controller, and is the gravity acceleration.
Actuator constraints: The control inputs , and their increments , and have boundaries:
Furthermore, the disturbance consists of the internal disturbance and the external disturbance , that is, . Here, can be determined by comparing the responses of the real model (CarSim model) and the nominal model in Eq. (22) within the ODD.
Figs. 6 (a)–(c) show the visual projection of in three-dimensional (3D) and two-dimensional (2D) views.
Assuming that the (e.g., sensor noise boundary) is known, the generator of the can be determined. Fig. 6 (d) shows the visual relationship of , , and .
3.3. FTMPC control law and uncertainty evolution
The discrete-time real system in Eq. (18) satisfies the finite time controllability condition [36]. In this section, the real system is divided into a nominal system and an uncertain system, which are handled separately.
3.3.1. Nominal system
We extract the deterministic part of the real system in Eq. (18), and the nominal model without considering the disturbance is defined as
where all top marks represent the corresponding nominal variables. The nominal control input is obtained by solving an MPC optimization problem for the nominal dynamics.
3.3.2. Uncertain system
We remove the deterministic part (Eq. (22)) from the real system in Eq. (18), and the uncertain model composed of the disturbance can be obtained,
where , , and all top marks represent the corresponding uncertain variables. The state feedback gain solved by the linear quadratic regulator (LQR) is used to guarantee the stability of the uncertain system, that is, , . The FTMPC control law applied to the real system in Eq. (18) is then expressed as
Hence, the uncertain system in Eq. (23) is rewritten as a stable autonomous system:
where the feedback gain matrix makes Schur stable.
3.3.3. mRPI and stability of the uncertain system
The future evolution law of the uncertain system is evaluated by leveraging the reachability analysis.
According to the zonotope properties in Eqs. (5), (6), the evolution of the uncertain system (Eq. (25)), , , refer to the zero matrix) with time steps is revealed as:
Proposition 1. The control law in Eq. (24) stabilizes the uncertain system in Eq. (23).
Proof 1.Fig. 7(a) draws all zonotopes of in the finite horizon () with CORA [37] to visualize the evolution of the uncertain system in Eq. (23). In Fig. 7(a), the boundary lines of the zonotopes become denser as the time steps increase.
Moreover, based on the definition of the zonotope size in Eq. (7), the size change rate of the uncertain state constraints is defined as
Fig. 7(b) shows that the decreases with the time steps rapidly, which indicates that the difference between two adjacent zonotopes will quickly converge to zero.
Consequently, owing to the Schur matrix , the uncertain states constraints in Eq. (26) will converge rapidly in a bounded set ( ). Hence, the term in the control law (Eq. (24)) stabilizes the uncertain system in Eq. (23).
3.4. Flexible zonotopic tube for nominal system
According to the nominal model in Eq. (22), the prediction model of the nominal system over the prediction horizon can be expressed as
where is the control horizon, ,
with the evolution of the and , it yields that the MPC optimization problem for the nominal dynamics (nominal MPC) is subject to two tightened constraint sets, that is, , .
Remark 1. According to Eq. (26), as the disturbance set increases, the uncertain constraint increases, and the controller conservatism strengthens. If the disturbance set acts too significant, either or will be an empty set, rendering the controller unsolvable. For the determined in subsection 3.2, the controller is sufficient.
To increase the quadratic programming (QP) feasible region of the nominal MPC and reduce conservatism, a flexible tube with varying cross-sections is designed at a negligible increase in computational cost [29]. The state and control tubes are parameterized with matrices and as
where .
The final optimization of the nominal MPC is expressed as
where is the weight matrix of slack , , and are the weight matrices. Additionally, the final zonotopic constraint can be transformed to half-space polytopic constraints by Eq. (4) to make the QP optimization faster and more efficient [38].
Proposition 2. The control law in Eq. (24) stabilizes the nominal system in Eq. (22).
Proof 2. The nominal system in Eq. (22) has been proved to be exponentially stable under the assumption that the initial nominal state at each sample time () is optimized as a parameter of the control law [28]. The optimization problem is subject to a significant constraint of , that is, the optimal initial nominal state and optimal control sequence at time are computed by
In this study, is derived from the real state and control input of the previous time step to measure the uncertain state and determine the internal disturbance set in subsection 3.2, that is, . The uncertain state at time satisfies that . The real state at time also satisfies the above significant constraint, that is, . Hence the nominal MPC term (Eq. (32)) in the control law (Eq. (24)) stabilizes the nominal system in Eq. (22).
4. Motion planning with safety sets
This section introduces a motion planning algorithm that considers uncertainties in the Frenet Frame. The process consists of safety sets, trajectory generation, ranking, and collision detection.
4.1. Safety sets
Because the uncertain system evolution is demonstrated by reachability analysis in subsection 3.3, the mRPI can effectively describe all possible uncertainties caused by the tracking layer of the ego vehicle. Moreover, the uncertain areas of the mRPI may cause a potential collision. Therefore, a concept of safety sets is proposed to describe the geometric boundaries that the ego vehicle and obstacles may reach. The safety sets will be developed and applied in subsequent planning sections to guarantee motion planning security.
4.1.1. Ego vehicle set
Assuming that the effects of the acceleration variables are ignored, the safety set of the ego vehicle mainly considers the shape, location, and heading angle .
(1) Shape and location: The ego vehicle's shape and location set consists of the physical dimension set and the uncertainty of the tracking errors .
For the former , the zonotope shown in Fig. 8(a) is used to enclose the physical dimension of the stationary ego vehicle. This zonotope is defined as the physical dimension set , which can effectively represent the original shape and location of the ego vehicle.
For the latter, the vehicle tracking errors are constrained by the first and second dimensions of the mRPI set, a result emanating from the introduced FTMPC in Section 3. Accordingly, is defined as the reachable set of the ego vehicle’s longitudinal and lateral tracking errors. The reachable set can be computed within a finite safety horizon or an infinite horizon based on the evolution of the uncertain system.
Therefore, . Fig. 8 (b) shows the visual relationship of the , the original vehicle set , and the shape and location set .
(2) Heading angle : The heading angle should be considered in the ego vehicle set when the ego vehicle is driving. Therefore, a rotation matrix is introduced to modify the generator of the :
As shown in Fig. 9 (a), the rotation function should modify the generator of without changing its center. Thus, the ego vehicle set with a heading angle can be represented by the matrix multiplication of the rotation matrix and the generator , that is, .
>
Remark 2. Moreover, the heading angle error is constrained by the fourth dimension of the mRPI, that is, . Therefore, the ego vehicle set with the heading angle error can be simplified as the union of and :
Finally, is reduced to an interval hull and is rotated with the heading angle . The ego vehicle set is obtained and shown in Fig. 9 (b).
4.1.2. Obstacle sets
The observation (or prediction) of the th () obstacle () by the ego vehicle has a bounded error [39], which can be described by an obstacle error set . Similar to the process of the ego vehicle set, we first define a physical dimension set for the th obstacle. Afterward, the th obstacle set with uncertainties can be computed with the obstacle physical dimension set , obstacle error set , and obstacle heading angle .
4.2. Generation of candidate trajectories
In the Frenet coordinate system, the -axis is set as the centerline of the rightmost lane, and the -axis is perpendicular to the -axis. The origin is merged with the origin of the Cartesian coordinate system and moves along the -axis with the ego vehicle.
The quintic polynomial is proved as the jerk-optimal connection between the start state at and the end state at [12]. Therefore, the motions in the and directions are described by quartic and quintic polynomials:
where and are undetermined coefficients, and is the time. The start and end states are expressed as
In addition, all the start states are set to be the same as the final vehicle state of the last control cycle to ensure continuity. The end states , , and are set to zero to ensure vehicle stability. Two sequences of the end velocity and the end position are designed to ensure that the candidate trajectories can cover all lanes. The following matrix equation is then obtained by taking an orthogonal combination of the two sequences of and :
where , , and , , are presented in (Appendix A), respectively. The th () column of the matrix corresponds to the polynomial parameters of under the condition of , and . The average acceleration should satisfy comfortable acceleration limits. The th () column of the matrix corresponds to the polynomial parameters of under the condition of , and should not exceed the road boundary.
As shown in Fig. 10, a cluster of the candidate trajectories can be obtained by solving and , where .
4.3. Risk assessment and trajectory ranking
The candidate trajectories are discretely sampled and then ranked for risk assessment (), ride comfort (), and trajectory stability (). The total cost function ( ) is defined as
where , , and are the corresponding weights.
4.3.1. Risk assessment
The risk assessment index is considered from two perspectives of road boundaries (crossable or non-crossable lane lines) and obstacles of various sizes (e.g., other vehicles, accidentally dropped cargo).
(1) Road boundary description: The periodic PF of the road boundaries is generated by a trigonometric function to deal with multi-lane roads. The , and can be written as
where and are the Frenet coordinates of the ego vehicle, is the lane width, is the amplitude varying with , denotes the risk value at the crossable edge lines, and is the coordinate of the leftmost lane centerline. Fig. 11 shows the PF of the road.
(2) Obstacle description with the obstacle set : The th obstacle PF shown in Figs. 12(a) and (b) is generated by an exponential function. In which, the obstacle PF in Eq. (41) mainly considers the relative velocity and the obstacle size.
, and can be written as
where is a safety coefficient formulated to prevent a singular value, is a function of the relative distance and are the Frenet coordinates of ith obstacle, and are the width and length of the interval hull projection on the plane, respectively, and and are the shape and intensity parameters, respectively.
The worst-case caused by the velocity uncertainties of the ego vehicle and obstacle is considered. The possible maximum relative velocity is expressed by . Here, , is constrained by the first dimension of the mRPI, is the minimum obstacle velocity constrained by the corresponding dimension of the obstacle set . Fig. 12(c) shows that the higher the relative velocity, the bolder the PF energy.
Furthermore, an obstacle interval hull is used as the outer approximation of the obstacle set by Eq. (8) to simplify the effect of the obstacle size on the obstacle PF. Fig. 12(d) shows that the smaller the size, the weaker the PF energy.
Remark 3. The is set as a considerable fixed value when the perception layer determines that the obstacle is alive (human being or animal).
(3) Risk assessment index : The PFs for all the discrete sample points in each trajectory are summed and then normalized to obtain the :
where is the number of discrete sample points and is the number of obstacles.
4.3.2. Ride comfort
The ride comfort index considers the curvature and the heading angle increments for all the discrete sample points:
where , , , and prevents a singular value.
4.3.3. Trajectory stability
The trajectory stability index considers the difference () between the present candidate trajectories and desired trajectory of the last planning cycle to avoid the drastic change of the desired trajectory.
4.4. Collision avoidance with safety sets
Although the cost function in subsection 4.3 considers the risk assessment, the trajectory does not impose a hard constraint on collision avoidance. In this section, efficient collision detection is achieved by determining the presence of intersections between the ego vehicle set and the obstacle sets . Specifically, Algorithm 1 is adopted to reduce the computation burden of collision detection.
The candidate trajectories are detected in succession according to the ranking in subsection 4.3. The detection stops when there is a collision-free trajectory. If there are collisions in all trajectories, the desired trajectory is optimized by another crash mitigation cost function at crash points.
where is the crash speed, is the crash angle, is the relative volume, and , , and are the corresponding weights. The crash angle is divided into full overlap collision, overlap near collision, and overlap collision [22].
The radii of the ego vehicle set and the th obstacle are computed by the P-radius of the zonotopes in Eq. (9). For discrete sample points of the trajectory being detected, all Euclidean distances between the centers of the two sets ( and ) are computed. The detection begins when the is less than the sum of the vehicle radius and obstacle radius, that is, .
Algorithm 1. Algorithm for collision detection.
Input: Ranked candidate trajectories
Output: Desired trajectory
Initialize:
while and do
;
fortodo
fortodo
center of ego vehicle and ;
ifthen
;
;
end
end
end
;
end
ifthen
return
else
Go to crash mitigation optimization in Eq. (45)
end
After executing the process described in Section 4, Fig. 13 shows an example of the MATLAB/Simulink result of trajectory planning without control at a specific time.
5. Results and discussion
In this section, a HIL experiment platform based on the co-simulation of MATLAB/Simulink and CarSim is conducted to validate the feasibility of the proposed SMPAC framework.
5.1. HIL experiment validation
(1) Experiment platform: The real-time performance of the SMPAC scheme is validated by a HIL experiment, in which “Simulink Desktop Real-time” provides the real-time environment. Fig. 14 (a) shows the schematic diagram of the HIL platform, and Fig. 14 (b) shows the physical connection. The host computer (i7-9700 K; Intel, USA) communicates with a mobile real-time target machine (M3; Speedgoat, Switzerland) and actuators with signal transmission components. The components include a control area network (CAN) card (Leaf Light v2; Kvaser, Sweden), a data acquisition (DAQ) card (NI USB-6002; National Instruments, USA), a motor (86EBP159ALC; Shidaichaoqun, China), a motor driver (ZDM-2HA865; Shidaichaoqun, China), and a protocol conversion module (CAN to RS485; EBYTE, China).
(2) Comparisons and test scenarios: The proposed SMPAC with the FTMPC controller is compared with a zero steady-state error TRMPC controller (ZMPC) and a zero steady-state error LQR controller (ZLQR) under the same framework. The zero steady-state error refers to the feedforward term in Eq. (16). The SMPAC framework provides decision-making, planning, and tracking for the ego vehicle. Table 2 summarizes the parameters of the SMPAC, including the vehicle, planner, and controller.
Moreover, two driving scenarios are constructed for validation and evaluation. Table 3 summarizes the information of the test scenarios, including the traffic participants, start states, and end states. Table 4 compares the tracking errors of the three controllers across the two scenarios.
5.2. Scenario 1
Scenario 1 simulates that the ego vehicle faces a stationary malfunctioning car (large non-crossable obstacle) ahead and two surrounding vehicles in the left and right lanes. Additionally, the malfunctioning vehicle has contaminated a stretch of 0 to 60 m in Lane-2 with engine oil, resulting in the road surface having a friction coefficient of . The friction coefficient of the normal road surface is . In this scenario, the ego vehicle is operating at the handling limits, which is challenging for the AV's motion planning and control.
Specifically, as presented in Table 3, the ego vehicle is a car that initially drives along the centerline of Lane-2 at 20 m∙s −1. Additionally, there are three obstacles. Obstacle 1 is a truck trying to change from Lane-1 (60 m) to Lane-2, with velocities of 15 m∙s−1 and 20 m∙s−1 before and after the lane change, respectively. Obstacle 2 is the stationary vehicle located 60 m directly ahead of the ego vehicle. Obstacle 3 is a car driving along the centerline of Lane-3 at a constant velocity of 25 m∙s −1.
Figs. 15(a)–(c) show the safety sets and trajectories of the proposed SMPAC with the FTMPC, ZMPC, and ZLQR schemes. The light blue lines denote the planned trajectories (without CarSim involved) of the ego vehicle at each planning cycle. The red points, green squares, and blue diamonds represent the real trajectories (with CarSim involved) of the ego vehicle, obstacle 2, and obstacle 3, respectively. Additionally, the safety sets of the ego vehicle and obstacles are drawn as zonotopes every second, where the different colors denote the different vehicles. Fig. 15(d) shows the partially enlarged view of Fig. 15(c). Figs. 15(e)–(g) show the planned velocities (light blue lines) and real velocities (red line) of the ego vehicle at each planning cycle. Figs. 15(h)–(n) show the comparison of the three controllers in the control inputs, tracking performances, and vital dynamic states of the ego vehicle. These indexes include the total longitudinal force, steering angle, lateral error, heading angle error, velocity error, yaw rate, and lateral acceleration.
In scenario 1, the ego vehicle decides to change from Lane-2 to Lane-3 to avoid collision with the stationary obstacle 2. The lane change process can be summarized in three steps. First, the ego vehicle deviates from the Lane-2 centerline to the Lane-3 boundary, decelerates to approximately 10 m∙s−1, and prepares to change lanes. Second, after the surrounding vehicle (obstacle 3) passes, the ego vehicle completes the lane change and maintains the velocity for a while. Finally, the ego vehicle adjusts its lateral position to the Lane-3 centerline and accelerates to approximately 25 m∙s−1.
(1) Safety satisfaction: As shown in Figs. 15(a)–(b), both SMPAC with FTMPC and ZMPC could avoid collision under uncertainties. Nevertheless, the proposed SMPAC with FTMPC keeps the ego vehicle farther away from obstacles and thus safer. In Figs. 15(c)–(d), it is observed that the ZLQR scheme exhibits PHBs because of the intersection of the ego vehicle set and obstacle 2 set at 4.6 s. Consequently, the proposed SMPAC with FTMPC can guarantee safety at the handling limits, whereas conventional frameworks and controllers may exhibit PHBs.
(2) Tracking performance: Figs. 15(h)–(n) and Table 4 both illustrate that FTMPC has the best tracking performance and vehicle stability among the three controllers at the handling limits and exhibits a significant improvement over ZMPC and ZLQR. Therefore, the proposed FTMPC has better robustness.
5.3. Scenario 2
Scenario 2 simulates that the ego vehicle faces an unlawful stationary bike (small non-crossable obstacle) ahead and two surrounding vehicles in the left and right lanes. In this scenario, the vehicle is operating under normal conditions.
Specifically, as illustrated in Table 3, the ego vehicle is a car that initially drives along the centerline of Lane-2 at 20 m∙s−1. Moreover, there are three obstacles. Obstacle 1 is a truck trying to change from Lane-1 (60 m) to Lane-2, with velocities of 15 and 20 m∙s−1 before and after the lane change, respectively. Obstacle 2 is a stationary bike located 80 m in front of the ego vehicle and 1 m to the right of the Lane-2 centerline. Obstacle 3 is a car driving along the centerline of Lane-3 at a constant speed of 20 m∙s−1.
Similar to scenario 1, Fig. 16 (a) shows the safety sets of the ego vehicle and obstacles every second. Fig. 16 (b) shows the planned and real velocities of the ego vehicle at each planning cycle. However, it is noteworthy that the trajectories of all the comparison groups in Figs. 16 (a) and (b) almost overlap, hence only one group is shown. Figs. 16 (c)–(i) show the control inputs, tracking performances, and vital dynamic states of the ego vehicle.
In scenario 2, the ego vehicle decides to deviate a little distance from the Lane-2 centerline toward the Lane-3 boundary to avoid collision with the stationary obstacle 2. The collision avoidance process can be summarized in three steps. First, the ego vehicle moves a distance away from the Lane-2 centerline to the Lane-3 boundary and gradually decelerates. Second, after avoiding obstacle 2, the ego vehicle returns to the Lane-2 centerline and decelerates to approximately 10 m∙s−1. Finally, the ego vehicle drives along the Lane-2 centerline and accelerates to approximately 20 m∙s−1.
(1) Safety satisfaction: As shown in Figs. 16 (a) and (b), with the SMPAC framework, all three controllers are able to avoid collision under uncertainties. The differences between the three schemes are negligible. Therefore, the proposed SMPAC framework can guarantee safety under normal conditions.
(2) Tracking performance: As shown in Table 4, the tracking errors of FTMPC, ZMPC, and ZLQR are all minima owing to the feedforward term in Eq. (16). In addition, the differences between the three are almost negligible. Therefore, the proposed FTMPC has a high performance and less conservatism under normal conditions.
6. Conclusions
A SMPAC framework was proposed to address multi-dimensional uncertainties in autonomous driving. A dynamic model with multi-dimensional uncertainties was established for the control layer to accurately describe the real AV system. The FTMPC controller with the flexible tube was designed to guarantee robust stability and constrain the uncertain system in the bounded mRPI. For the planning layer, the safety sets were introduced to determine the geometric boundaries that the ego vehicle or obstacles possibly reach accordingly. The trajectory planning and collision avoidance with the safety sets were studied to reduce the PHBs caused by the uncertainties.
The HIL platform tested two types of scenarios: an active lane change scenario at the handling limits and a collision avoidance scenario under normal conditions. The results validated the safety, effectiveness, and real-time performance of the SMPAC scheme. Consequently, the SMPAC scheme can reduce possible hazardous/unknown areas in automated driving scenario categories for the SOTIF.
Further research directions include: ① The disturbance set can be further reduced by leveraging linearization methods for the nonlinear vehicle system to reduce the conservatism of the SMPAC framework. ② The embedding of state-of-the-art motion planning approaches can be implemented in the SMPAC framework for improved capability.
Acknowledgments
This work was supported by the National Natural Science Foundation of China (51875061) and China Scholarship Council (202206050107). Hao Zheng, Yinong Li, Ling Zheng, and Ehsan Hashemi declare that they have no conflicts of interest or financial conflicts to disclose.
Compliace with ethics guidelines
Hao Zheng, Yinong Li, Ling Zheng, and Ehsan Hashemi declare that they have no conflicts of interest or financial conflicts to disclose.
E.Yurtsever, J.Lambert, A.Carballo, K.Takeda. A survey of autonomous driving: common practices and emerging technologies. IEEE Access, 8 (2020), pp. 58443-58469
[2]
J.Wang, H.Huang, K.Li, J.Li. Towards the unified principles for level 5 autonomous vehicles. Engineering, 7 (9) (2021), pp. 1313-1325
[3]
P.E.Paré, E.Hashemi, R.Stern, H.Sandberg, K.H.Johansson. Networked model for cooperative adaptive cruise control. IFAC-PapersOnLine, 52 (20) (2019), pp. 151-156
[4]
J.Claybrook, S.Kildare. Autonomous vehicles: no driver…no regulation?. Science, 361 (6397) (2018), pp. 36-37
[5]
D.Bissell. Automation interrupted: how autonomous vehicle accidents transform the material politics of automation. Polit Geogr, 65 (2018), pp. 57-66
[6]
J.Birch, R.Rivett, I.Habli, B.Bradshaw, J.Botham, D.Higham, et al.. Safety cases and their role in ISO 26262 functional safety assessment. F. Bitsch, J. Guiochet, M. Kaâniche (Eds.), Computer safety, reliability, and security; 2020 Sep 16-18; Lisbon, Portugal, Springer, Berlin (2013), pp. 154-165
[7]
H.Wang, B.Lu, J.Li, T.Liu, Y.Xing, C.Lv, et al.. Risk assessment and mitigation in local path planning for autonomous vehicles with LSTM based predictive model. IEEE Trans Autom Sci Eng, 19 (4) (2022), pp. 2738-2749
[8]
C.Schmittner, G.Griessnig, Z.Ma. Status of the development of ISO/SAE 21434. X. Larrucea, I. Santamaria, R. O'Connor, R. Messnarz (Eds.), Systems, software and services process improvement; 2018 Sep 5-7, Springer, Cham (2018), pp. 504-513
[9]
ZieglerJ, WerlingM, SchroderJ. Navigating car-like robots in unstructured environments using an obstacle sensitive cost function. In: Processings of the 2008 IEEE Intelligent Vehicles Symposium; 2008 Jun 4-6; Eindhoven, Netherlands. Piscataway: IEEE; 2008. p. 787-91.
[10]
AndersonSJ, KarumanchiSB, IagnemmaK. Constraint-based planning and control for safe, semi-autonomous operation of vehicles. In: Proceedings of the 2012 IEEE Intelligent Vehicles Symposium; 2012 Jun 3-7; Madrid, Spain. Piscataway: IEEE; 2012. p. 383-8.
[11]
Y.Kuwata, J.Teo, G.Fiore, S.Karaman, E.Frazzoli, J.P.How. Real-time motion planning with applications to autonomous urban driving. IEEE Trans Control Syst Technol, 17 (5) (2009), pp. 1105-1118
[12]
WerlingM, ZieglerJ, KammelS, ThrunS. Optimal trajectory generation for dynamic street scenarios in a Frenét Frame. In:Proceedings of the 2010 IEEE International Conference on Robotics and Automation; 2010 May 3-7; Anchorage, AK, USA. Piscataway: IEEE; 2010. p. 987-93.
[13]
HanL, YashiroH, TehraniNik Nejad H, DoQH, MitaS. Bézier curve based path planning for autonomous vehicle in urban environment. In: Proceedings of the 2010 IEEE Intelligent Vehicles Symposium; 2010 Jun 21-24; La Jolla, CA, USA. Piscataway: IEEE; 2010. p. 1036-42.
[14]
T.Maekawa, T.Noda, S.Tamura, T.Ozaki, K.Machida. Curvature continuous path generation for autonomous vehicle using B-spline curves. Comput Aided Des, 42 (4) (2010), pp. 350-359
[15]
W.Lim, S.Lee, M.Sunwoo, K.Jo. Hierarchical trajectory planning of an autonomous car based on the integration of a sampling and an optimization method. IEEE Trans Intell Transp Syst, 19 (2) (2018), pp. 613-626
[16]
Y.Huang, H.Ding, Y.Zhang, H.Wang, D.Cao, N.Xu, et al.. A motion planning and tracking framework for autonomous vehicles based on artificial potential field elaborated resistance network approach. IEEE Trans Ind Electron, 67 (2) (2020), pp. 1376-1386
[17]
J.Wu, Z.Huang, Z.Hu, C.Lv. Toward human-in-the-loop AI: enhancing deep reinforcement learning via real-time human guidance for autonomous driving. Engineering, 21 (2023), pp. 75-91
[18]
HashemiE, HeX, JohanssonKH. A Dynamical game approach for integrated stabilization and path tracking for autonomous vehicles. In: Proceedings of the 2020 American Control Conference (ACC); 2020 Jul 1-3; Denver, CO, USA. Piscataway: IEEE; 2020. p. 4108-13.
[19]
K.Yang, X.Tang, Y.Qin, Y.Huang, H.Wang, H.Pu. Comparative study of trajectory tracking control for automated vehicles via model predictive control and robust H-infinity state feedback control. Chin J Mech Eng, 34 (1) (2021), p. 74
[20]
E.Hashemi, Y.Qin, A.Khajepour. Slip-aware driver assistance path tracking and stability control. Control Eng Pract, 118 (2022), Article 104958
[21]
L.Brunke, M.Greeff, A.W.Hall, Z.Yuan, S.Zhou, J.Panerati, et al.. Safe learning in robotics: from learning-based control to safe reinforcement learning. Annu Rev Control Robot Auton Syst, 5 (1) (2022), pp. 411-444
[22]
H.Wang, Y.Huang, A.Khajepour, Y.Zhang, Y.Rasekhipour, D.Cao. Crash mitigation in motion planning for autonomous vehicles. IEEE Trans Intell Transp Syst, 20 (9) (2019), pp. 3313-3323
[23]
Y.Qin, E.Hashemi, A.Khajepour. Integrated crash avoidance and mitigation algorithm for autonomous vehicles. IEEE Trans Ind Inform, 17 (11) (2021), pp. 7246-7255
[24]
G. CollaresPereira, B.Wahlberg, H.Pettersson, J.Mårtensson. Adaptive reference aware MPC for lateral control of autonomous vehicles. Control Eng Pract, 132 (2023), Article 105403
[25]
D.Mayne. Robust and stochastic model predictive control: are we going in the right direction?. Annu Rev Control, 41 (2016), pp. 184-192
[26]
M.Farina, L.Giulioni, R.Scattolini. Stochastic linear model predictive control with chance constraints—a review. J Process Control, 44 (2016), pp. 53-67
[27]
E.C.Kerrigan, J.M.Maciejowski. Feedback min-max model predictive control using a single linear program: robust stability and the explicit solution. Int J Robust Nonlinear Control, 14 (4) (2004), pp. 395-413
[28]
D.Q.Mayne, S.V.Raković, R.Findeisen, F.Allgöwer. Robust output feedback model predictive control of constrained linear systems. Automatica, 42 (7) (2006), pp. 1217-1222
[29]
H.Zheng, L.Zheng, Y.Li, K.Wang, Z.Zhang, M.Ding. Varying zonotopic tube RMPC with switching logic for lateral path tracking of autonomous vehicle. J Franklin Inst, 359 (7) (2022), pp. 2759-2787
[30]
A.Wischnewski, M.Euler, S.Gümüs, B.Lohmann. Tube model predictive control for an autonomous race car. Veh Syst Dyn, 60 (9) (2022), pp. 3151-3173
[31]
P.Hang, X.Xia, G.Chen, X.Chen. Active safety control of automated electric vehicles at driving limits: a tube-based MPC approach. IEEE Trans Transp Electrif, 8 (1) (2022), pp. 1338-1349
[32]
X.Wu, C.Wei, H.Tian, W.Wang, C.Jiang. Fault-tolerant control for path-following of independently actuated autonomous vehicles using tube-based model predictive control. IEEE Trans Intell Transp Syst, 23 (11) (2022), pp. 20282-20297
[33]
S.Feng, Z.Song, Z.Li, Y.Zhang, L.Li. Robust platoon control in mixed traffic flow based on tube model predictive control. IEEE Trans Intell Transp Syst, 6 (4) (2021), pp. 711-722
[34]
M.Althoff, J.J.Rath. Comparison of guaranteed state estimators for linear time-invariant systems. Automatica, 130 (2021), Article 109662
[35]
Y.Rasekhipour, A.Khajepour, S.K.Chen, B.Litkouhi. A potential field-based model predictive path-planning controller for autonomous road vehicles. IEEE Trans Intell Transp Syst, 18 (5) (2017), pp. 1255-1267
[36]
L.Grüne. Analysis and design of unconstrained nonlinear MPC schemes for finite and infinite dimensional systems. SIAM J Control Optim, 48 (2) (2009), pp. 1206-1228
[37]
AlthoffM, GrebenyukD. Implementation of interval arithmetic in CORA 2016. In:Proceedings of the 3rd International Workshop on Applied Verification for Continuous and Hybrid Systems;2016 Apr 12, Vienna, Austria. Stockport: EasyChair; 2016. p. 91-105.
[38]
StoicanF, HovdM. Efficient solution of a qp optimization problem with zonotopic constraints. In:Proceedings of the 2012 IEEE International Conference on Control Applications; 2012 Oct 3-5; Dubrovnik, Croatia. Piscataway: IEEE; 2013. p. 457-62.
[39]
J.Liu, Y.Luo, Z.Zhong, K.Li, H.Huang, H.Xiong. A probabilistic architecture of long-term vehicle trajectory prediction for autonomous driving. Engineering, 19 (2022), pp. 228-239