The continuously increasing renewable energy sources (RES) and demand response (DR) are becoming crucial sources of system flexibility. Consequently, decision-dependent uncertainties (DDUs), interchangeably referred to as endogenous uncertainties, impose new characteristics on power system dispatch. The DDUs faced by system operators originate from uncertain dispatchable resources such as RES units or DR, while reserve providers encounter DDUs from the uncertain reserve deployment. Thus, a systematic framework was established in this study to address robust dispatch problems with DDUs. The main contributions are drawn as follows. ① The robust characterization of DDUs was unfolded with a dependency decomposition structure. ② A generic DDU coping mechanism was manifested as the bilateral matching between uncertainty and flexibility. ③ The influence of DDU incorporation on the convexity/non-convexity of robust dispatch problems was analyzed. ④ Generic solution algorithms adaptive for DDUs were proposed. Under this framework, the inherent distinctions and correlations between DDUs and decision-independent uncertainties (DIUs) were revealed, laying a fundamental theoretical foundation for the economic and reliable operation of RES-dominated power systems. Illustrative applications in the source and demand sides are provided to show the significance of considering DDUs and demonstrate the proposed theoretical results.
Yunfan Zhang, Yifan Su, Feng Liu.
On Decision-Dependent Uncertainties in Power Systems with High-Share Renewables.
Engineering, 2025, 51(8): 104-124 DOI:10.1016/j.eng.2025.07.013
Driven by the urgent need to reduce greenhouse gas emissions and mitigate the impacts of climate change, recent years have witnessed a worldwide unprecedented proliferation of renewable energy sources (RES) in power systems. Alongside the remarkable benefits of the transition towards a RES-dominated power system, the inherent variability and intermittency of RES, particularly the photovoltaic (PV) and wind generations, exacerbate the varying characteristics of the power system and bring about significant challenges to ensure the reliability and economic efficiency of system operation.
Various uncertainty handling methods, such as stochastic optimization [1], robust optimization (RO) [2], distributionally RO (DRO) [3], and the information gap decision theory (IGDT) [4], have been studied to hedge against the uncertainties in power systems. Attributed to the high dispatch decision robustness and low requirement in uncertainty modeling, RO has been widely adopted in real power systems. PJM Interconnection and Alstom Grid have developed the two-stage RO (TSRO) since 2012 [5]. CAISO also incorporates heterogeneous uncertainties into its optimization framework through RO [6]. There are still some challenges on heavy computational burden and trade-off between robustness and performance, which, however, out of scope for this paper.
These optimization methods distinguish themselves in uncertainty characterization and risk management techniques. Moreover, the considered uncertain factors stemming from the inaccurate prediction of RES generations or load demand, the disruptions of network or generation units, and the variable market clearing prices, are typically exogenous variables independent of the decision-making outcome.
Decision-dependent uncertainties (DDUs), also known as endogenous uncertainties, have received increasing attention recently due to the escalating RES penetration and the emerging novel features of power systems. In real-world decision problems, uncertainties could be affected by decisions in three possible ways [7]:
Decisions alter the underlying probability distribution of the random variable. For example, the survival probability of a link in a network subject to random failures could be increased if it is strengthened by investment [8].
Decisions affect whether or when the random variable materializes, namely, retains physical meaning. For example, the uncertain output of a wind farm will materialize only if the decision is made to construct it.
Decisions influence the resolution of the uncertainty, that is, whether or when the decision maker can observe the uncertain variable. For example, the product demand curve is fixed yet unknown to the retailer, whereas the retailer can exploit and explore the characteristics of customer behavior through different pricing decisions [9].
Contrary to DDUs, uncertainties unaffected by decisions are termed decision-independent uncertainties (DIUs) or exogenous uncertainties interchangeably.
1.2. DDU in power system dispatch
DDUs in the dispatch problems of power systems typically arise from three aspects: ① the uncertain dispatchable resources on the source side, ② the uncertain dispatchable resources on the demand side, and ③ the uncertain reserve deployment from the operators.
(1) DDUs originating from uncertain dispatchable resources: source side. In high-RES-penetration power systems, the RES units, in addition to conventional synchronous generators, can serve as dispatchable resources. By incorporating frequency-related signals within the active power control loop of the wind turbine, the wind turbine can be responsive to frequency variations, contributing to the stabilization of the system deviations. However, the kinetic energy stored in the rotating mass is limited, and the discharge of energy to the grid is only available for a short period. For the sake of participating in primary, secondary, and tertiary frequency control, the wind turbine needs to retain a certain amount of spinning power reserve by deviating from the maximum power point (MPP) through rotor speed or pitch angle control to support system balance in case of frequency contingency. Similarly, PV generations can be curtailed below MPP through voltage control to provide reserve power. Alternatively, the output of a wind farm or a PV plant can be quickly regulated through controlled shutdown or start-up of the units.
It is worth noting that, the regulation effects of RES are jointly determined by the variable weather conditions and the proactive power control strategies or actions of the operators. Therefore, the available power and the reserved power of RES units manifest as DDUs. In this paper, an illustrative example was provided to exemplify the RES-induced DDUs. Specifically, the RES units generally operate in the following three de-loading schemes [[10], [11], [12]] to provide sustainable up-reserve for frequency regulations, where the decision variable denotes the de-loading ratio.
The de-rating scheme: The maximal output of the RES unit is capped at a de-rated point, which equals 1 − of the rated power.
The delta scheme: The reserve is set at a fixed amount that equals of the rated power.
The percentage scheme: The RES unit reserves a percentage of the maximum available power.
Fig. 1 reveals that the available and preserved power of a wind turbine is uncertain due to the volatile wind speed. Additionally, the decisions of the system operator, including the de-loading scheme and the reserve ratio , affected the probability distribution characteristics of these two uncertain parameters.
The DDUs of RES units have attracted increasing concerns from researchers. For instance, a day-ahead strategic wind curtailment schedule was formed to reduce wind variability, and the two-stage robust dispatch model was built to address the corresponding DDU of the real-time wind generation output [13,14]. DDUs arising from the solar feed-in curtailment were handled in a jointly chance-constrained stochastic direct current (DC) optimal power flow model, where affine decision rules were applied to adjust generator output once the uncertainties were revealed [15]. A frequency-constrained stochastic planning model [10] was presented with frequency response from de-loaded wind farms, under the consideration of the support capability uncertainty and its dependency upon the combination of different support schemes. The DDUs from frequency reserve allocation among RES units were tackled without assuming a fixed portion of power reserve used for the synthetic inertial response and the droop response during the process of modeling the post-contingency system frequency dynamics [12].
(2) DDUs originating from uncertain dispatchable resources: demand side. In the context of demand response (DR), customers adjust their electricity consumption patterns to contribute flexibility to system balance by responding to price signals or incentives. The actual DR behaviors of voluntary customers are inevitably uncertain, while closely related to price signals or other DR policies, manifesting as DDUs. The exploration of DDUs in DR is reviewed below, involving both price-elastic models [[16], [17], [18], [19]] and non-price models [[20], [21], [22], [23]].
The price-elastic models: The uncertain price–elastic demand curve was integrated into a robust unit commitment problem [16]. A deviation term was introduced to the demand–price function, as illustrated in Fig. 2 [16]. For a given price, the consumer response varies within a certain range, with this range dependent on the price decision. The uncertainty of the price–elastic demand curve through scenarios in the stochastic unit commitment problem was demonstrated [17], with each scenario corresponding to a curve. It was assumed that the uncertain price elasticity coefficients vary within a specified range, leading to a price-sensitive range within which the actual load fluctuates, as depicted in Fig. 3 [19]. The DR uncertainty model was established considering consumer psychology [18]. Specifically, as the incentive price rises, the willingness of users to participate in DR would increase, while the associated randomness of the participation would decrease. An illustrative example is provided in Fig. 4 [18].
The non-price models: A two-stage robust economic dispatch model was proposed in Ref. [20], wherein the DR setpoint determined by the system operator influences the high-dimensional box-type DDU set (DDU-S) of the load demand. Subsequently, DDUs of deferrable loads were modeled explicitly in Ref. [21] since the cross-time load shifting decisions would reshape the temporal distribution of load and the corresponding uncertainty set. Consequently, a multi-stage robust dispatch model was formulated, accompanied by the design of an enhanced constraint generation algorithm. Additionally, DDUs stemming from the cold load pickup (CLPU) phenomenon after an outage were investigated to develop a two-stage stochastic restoration model [22]. Different load pickup times result in distinguished probability distributions of the CLPU peak amplitude. DDUs emerging as uncertain consumer participation in a DR program can only be resolved upon actual deployment of the DR scheme [23]. To address this issue, a scenario-wise multi-stage stochastic planning model was proposed, incorporating DDUs through the non-anticipativity constraints in the scenario tree.
(3) DDUs originating from uncertain reserve deployment. In the reserve market or energy-reserve market, participants autonomously decide on their reserve capacity provision through strategic bidding [24,25] or price-based self-scheduling [26,27]. The uncertainty of the actual deployment of reserve power during real-time operation is determined by the occurrence of disturbances and regulation signals from the operator. However, the uncertain deployed reserve power must fall within the capacity available for dispatch, manifesting as DDUs for reserve providers. For example, commercial buildings provide frequency reserves to the power grid [28]. Thus, a robust optimal control problem with an adjustable uncertainty set was formulated to reveal the optimal offered reserve capacity. Some researchers managed the robust self-scheduling of a virtual power plant (VPP) participating in the day-ahead energy-reserve market [29], wherein DDUs pertaining to real-time reserve deployment requests were captured through a polyhedral uncertainty set with a decision-dependent right-hand-side vector.
Remark 1 (time scales of DDUs). DDU exists in optimization problems of power systems across different time scales. Day-ahead decisions of wind curtailment can lead to decision-dependent wind variability [13,14]. Deferrable loads were shifted across hours, causing intra-day DDU of power demand [21]. In the field of power system planning, monthly and yearly time-scale DDUs of wind generation were commonly considered [30,31]. Since the proposed theorems and algorithms in this paper can be applied to problems involving various time scales, the following sections of this paper will not emphasize specific time scales.
1.3. Contributions
While the DDUs in power systems have been extensively investigated, more systematic theoretical studies on this topic are needed. In our previous work [32], the solution techniques for DDU-associated RO were reviewed, involving both the static RO models [[33], [34], [35], [36], [37]] and the two-/multi-stage RO models [7,32,[38], [39], [40]]. The previous studies collectively indicate that DDUs would lead to more sophisticated optimization models, posing challenges in developing exact and efficient solution algorithms. However, the underlying reasons for these challenges and common solutions have not been thoroughly explored.
This work develops a systematic framework for two-stage robust dispatch with DDUs. The fundamental differences and relations between DDUs and DIUs are explicitly investigated from the perspectives of uncertainty characterization, coping mechanisms, problem solvability, and solution paradigms.
The main contributions of this paper are as follows.
(1) Robust characterization of DDUs. The distinctions and correlations between DDUs and DIUs are elucidated within the framework of set-based uncertainty characterization and TSRO dispatch. A novel concept, the separability of a DDU-S, is introduced to articulate the dependency structure between decision variables and random variables. The existence of separability is further investigated, revealing that any generic DDU-S can be decomposed into a decision-independent support set, pertaining to the robust formulation of uncertainty, and a coupling function that describes the dependency on decisions. This finding bridges DDUs and conventional DIUs, implying that well-developed algorithms for DIUs could be extended to DDUs.
(2) Mechanism of TSRO dispatch with DDUs. The mechanism of TSRO dispatch under DDUs is revealed within the framework of set-based uncertainty characterization and region-based flexibility characterization [41,42]. It is discovered that a TSRO dispatch problem essentially aims to obtain the optimal allocation of system flexibility to hedge against uncertainties and that DDUs enable the bi-directional matching between them, which implies impicit operational flexibility.
(3) Convexity of TSRO dispatch with DDUs. The effects of DDUs on the characteristics and solvability of TSRO dispatch problems are researched. Concerning a TSRO problem that contains only linear constraints and DIUs, its robust feasibility region (RFR) is convex [43]. Our study unveils that, in contrast to DIUs, the RFRs of TSRO dispatch problems with DDUs may be non-convex. The non-convexity, if any, is attributed to the dependency of the uncertainty set on decisions and is irrelevant to the convexity of the uncertainty set itself. With the concept of separability, the convexity of the coupling function is proved to be a sufficient condition for ensuring the convexity of the TSRO problem with DDUs.
(4) Generic solution algorithm for TSRO dispatch with DDUs. Traditional cutting-plane algorithms widely used to solve robust dispatch problems, such as Benders’ decomposition and the column-and-constraint generation (C&CG) algorithm, are not adapted to the nonconvexity arising from DDUs. The ruined robust feasibility and optimality of the solution evidence their limitations in addressing TSRO with DDUs. To fix this issue, an improved solution algorithm is proposed based on the separability of DDU-S. The convexity of the enhanced cuts therein automatically adapts to that of the TSRO problem.
1.4. Organization
The rest of this paper is organized as follows. Section 2 reveals the dependency decomposition structure of DDU-S in robust frameworks. In Section 3, the mechanism of robust dispatch with DDUs is derived. Section 4 presents the discussion on the convexity of robust dispatch problems with DDUs. In Section 5, a general improved solution strategy is designed for DDU-associated RO problems. Section 6 presents applications of robust dispatch with DDUs. Lastly, the conclusions of this study are summarized in Section 7.
2. The robust characterization of DDUs
Consider the TSRO model in Eq. (1a), (1b), (1c), (1d), (1e), which has been widely used as the dispatch model in many real systems.
where x denotes the here-and-now decision within constraint set X; represents the DDU variables affected by x; , , and are constant matrices; is a constant vector. The uncertainty set of , denoted by , is a set-valued map parameterized in , and is a set consisting of all possible realizations of . According to the set-based uncertainty representing method in RO, for any given x, characterizes the possible realizations of under a certain level of confidence. is the first-stage cost function. , which is the optimal value of a max–min optimization problem, indicates the worst-case second-stage cost. The second-stage dispatch problem upon the resolution of the uncertainty is assumed to be linear programming parameterized in and with wait-and-see decision variable , as described in Eqs. (1c), (1d). Additionally, designates the feasible region of . is the RFR.
The following mild assumptions are made for problem (1).
Assumption 1 For problem (1),
Set X is a convex set.
The function is convex on X.
Set U is a bounded polytope.
For any and , is a bounded polytope.
Remark 2 (assumption on polyhedral model). Assumption 1 restricts that sets U and are bounded polytopes, which are common in power system robust dispatch problems. Operational constraints of fuel or wind generators, energy storage, and other devices are primarily linear. Though the power flow model is nonlinear and nonconvex, the linearized models, such as the DC flow model for transmission networks [44] and the linearized distribution flow (LinDistFlow) model for distribution networks [45], have been widely applied. Therefore, Assumption 1 is practical for TSRO dispatch in power systems.
Remark 3 (tri- and multi-stage RO with DDUs). Though this paper focuses on TSRO problems like Eq. (1a), (1b), (1c), (1d), (1e), the proposed theorems and algorithms can be adopted to tri- or multi-stage problems. C&CG and Benders’ decomposition algorithms for TSRO can be nested to solve tri-stage problems. Regarding multi-stage one, affine policies are commonly employed to simplify the models, which thus can be solved by cutting-plane algorithms. Therefore, it is possible to extend the results in TSRO to tri- and multi-stage RO with DDUs.
Next, the dependency structure of DDU-S is investigated by introducing a novel concept of separability.
2.1. The complete separability of DDU-S
2.1.1. Definition
Definition 1 (complete separability of DDU-S). If a DDU-S can be equivalently rewritten into Eq. (2),
Then is called (completely) separable, where, denotes the auxiliary random variable with a decision-independent support set ; represents the coupling function parameterized in and . A DDU-S with a separable formulation like Eq. (2) is decomposed into two parts: the dependency function on decision variable and the decision-irrelevant stochasticity implied by the random variable and its support set .
2.1.2. Ubiquity
Next, the ubiquity of the separability of DDU-S is discussed in space as the decision-irrelevant support set.
Without loss of generality, a DDU-S can be denoted as the intersection of two sets:
where represents a decision-independent set in space , and denotes a set-valued map parameterized in decision . Notably, the intersecting form in Eq. (3) does not impose additional requirements onto the specific formulation of DDU-S because one can always take as and as . The following lemma holds for any DDU-S with the intersecting form of Eq. (3).
Lemma 1 Suppose for a DDU-S that can be denoted by the intersection of two sets as in Eq. (3), there exists a coupling function such that:
for any and , ;
for any and , .
Then, is completely separable with:
Proof. Define . Next, we would like to justify the equivalence of and . First, according to the property of , we have . Moreover, for any , there is . Set , then there exists such that implying that . Therefore, . This completes the proof that .
Based on Lemma 1, the ubiquity of complete separability of a DDU-S can be justified by the following corollary.
Corollary 2 For any DDU-S , it is of complete separability as in Eq. (4) by setting the as and the coupling function as:
Corollary 2 can be justified by checking whether the coupling function in Eq. (5a), (5b) satisfies the conditions in Lemma 1.
2.1.3. Examples
Example 1 The adjustable uncertainty sets in Ref. [28] are completely separable since they are restricted to having a specific family of geometric forms.
Ball DDU-S: denotes the radius, represents the ball center, and indicates the p-norm of a vector. The ball DDU-S parameterized in and is completely separable with:
where embodies the auxiliary uncertain variable, the support set is defined as , and the coupling function is defined as , where denotes an identity matrix with a proper rank.
Box DDU-S: denotes the center of the box, and represents the range of the box. The box DDU-S parameterized in and is completely separable with:
where designates the auxiliary uncertain variable with support set , and the coupling function is defined as , where represents a diagonal matrix with diagonal elements .
Ellipsoidal DDU-S: denotes the center of the ellipsoid, and represents a symmetric and positive definite matrix. The ellipsoidal DDU-S parameterized in and is completely separable with:
where indicates the auxiliary uncertain variable with support set , and the coupling function is defined as .
Polyhedral DDU-S: parameterized in is the convex hall of () vectors . Then, polyhedral DDU-S is completely separable with:
where denotes the auxiliary uncertain variable with support set , where indicates the unit vector with the ith element being 1. The coupling function is defined as .
Example 2 denotes the maximal available power of the wind turbine under the MPP tracking mode, represents the available power, is the rated power, indicates the preserved power, and embodies the uncertain wind speed. With given decisions on the loading scheme and the de-loading ratio , the relations between , , and can be captured as:
In the above formulas, designates a DIU variable solely determined by the uncertain wind speed :
where , , and are the cut-in, rated, and cut-out wind speed, respectively; is the generation parameter.
Eqs. (11a), (11b), (11c), (12) can be viewed as the function of and with arguments , , and . The compact form of this function is expressed as:
Among the arguments of coupling function , and are decision variables of the operator, and the wind speed is an exogenously stochastic variate. Then, the DDU-S of DDU variables and is completely separable with the coupling function in Eq. (13), and the uncertainty set of is denoted by :
Example 3 The DDU-S in Fig. 4 is completely separable with:
where denotes the auxiliary random variable falling into the range [0, 1], which is independent of the decision variable .
The DDU-S of the uncertain demand in Fig. 2 is also completely separable with:
The auxiliary random variable represents the deviation from the deterministic price–elastic demand curve and varies within the range , which is irrelevant to the decision .
In Fig. 3, the uncertain price–elastic coefficient is regarded as the decision-independent auxiliary random variable, and then the DDU-S of demand is completely separable with:
2.2. The partial separability of a DDU-S
2.2.1. Definition
The partial separability of a DDU-S is defined as follows.
Definition 2 (partial separability of DDU-S). If the following two conditions hold for a DDU-S , then is called partially separable.
(1) There exists a set-valued map such that the graph of is the subset of the graph of , that is,
(2) The set-valued map in condition (1) is separable:
2.2.2. Ubiquity
Considering the DDU-associated TSRO problem (1), any given DDU-S is partially separable and can be equivalently substituted by the set-valued map with complete separability.
Concerning the TSRO problem (1) and any given DDU-S , define the separable DDU-S with regard to robust feasibility and robust optimality as follows:
The DDU-S is formulated considering the robust feasibility of the TSRO problem (1):
where indicates the decision-independent support set of the auxiliary random variable :
and denotes the coupling function defined as:
The DDU-S is formulated considering the robust optimality of the TSRO problem (1):
where represents the decision-independent support set of the auxiliary random variable :
and stands for the coupling function formulated by:
Since the graph of and are the subsets of the graph of , condition (1) in Definition 2 is satisfied. Combining with the fact that and are completely separable, it is revealed that the DDU-S is partially separable regardless of the specific formulation of . This finding sets a key cornerstone for solving complex RO problems with DDUs.
Next, we justify that the DDU-S in the TSRO problem (1) can be equivalently substituted by the two separable DDU-Ss (i.e., and ).
Theorem 3 The TSRO problem (1) with an arbitrary DDU-S has a surrogate model as follows.
The RFR is expressed as:
where Eq. (20a) follows the definition of in Eq. (1e), (20b) implies the surrogate formulation of .
The robust optimality sub-function is described as
where Eq. (21a) follows the definition of in Eq. (1c), (21b) and Eq. (1c), (21b) implies the surrogate formulation of function .
Proof. Assertion (1): First, denote by the optimal value of the optimization problem and its dual formulation as follows:
where Eq. (22a) is to define value function and Eq. (22b) is from the dual transformation of the minimization problem in Eq. (22a). It is easy to verify that for any and , .
Denote by the set-valued map as follows:
For any :
where Eqs. (24a), (24f) are according to the equivalent formulation of ; Eqs. (24b), (24e) are according to the definition of ; Eq. (24d) follows the definition of .
According to the definition of in Eq. (23) and that of in Eq. (1e), (20b), the following relationship holds:
Then, robust feasibility set is with equivalent formulations as follows:
where Eq. (26b) is from the relationship in Eq. (24a), (24b), (24c), (24d), (24e), (24f), (26c) and Eq. (24a), (24b), (24c), (24d), (24e), (24f), (26c) is from Eq. (25).
Assertion (2): First, denote by the optimal solution set of for optimization problem :
where Eq. (27a) is the definition of and Eq. (27b) is according to the dual transformation on the inner minimization problem in . According to the definition of in Eq. (27a), (27b) and that of in **Eq. (19a), (19b), (19c), the following relationships are derived:
Then, assertion 2 is justified as follows
where Eq. (29a) is from the definition of in Eq. (29c), Eq. (29b) is from the definition of in Eq. (27a), (27b), and Eq. (29c) is according to the relationship in Eq. (28).
According to Theorem 3, for any DDU-S , the TSRO problem (1) is equivalent to Eq. (30a), (30b), (30c):
where and are two separable DDU-Ss.
2.2.3. Example
Next, an illustrative example is provided to demonstrate how the partial separability of DDU-S is applied to TSRO problems.
Example 4. Consider a polyhedral DDU-S given by:
where the here-and-now decision variable determines the right-hand-side vector of the polytope uncertainty set.
As observed in Fig. 5, the shape, size, and location of the DDU-S in Eq. (31) change with the different values of the decision variable .
For a TSRO problem with in Eq. (32),
an auxiliary DDU-S concerning robust feasibility is formulated as:
Both and vary with the decision variable and satisfy the conditions in Definition 2. Therefore, can be partially separated, while is completely separable.
As illustrated in Fig. 5, for any given , indicates the subset of the original DDU-S . According to Theorem 3, the RFR regarding has two surrogate formulations, one based on in Eq. (20a) and the other based on in Eq. (20b).
3. Mechanism of robust dispatch with DDUs
In this section, the surrogate model of problem (1) is first derived based on the concept of the dispatchable region [42,46] and its variants. Then, the mechanism of TSRO dispatch with DDUs is revealed.
Definition 3 (dispatchable region). The dispatchable region of problem (1), denoted by , is defined as:
The extended dispatchable region of problem (1), denoted by with arguments and , is defined as:
For any and , .
Following the definition of the extended dispatchable region, the surrogate model of Eq. (1a), (1b), (1c), (1d), (1e) is established as:
where α is an auxiliary decision variable indicating the value of function . Eq. (36b) combines the robust feasibility requirement and the robust optimality function . Notably, the equivalence between Eqs. (1a), (1b), (1c), (1d), (1e), (36a), (36b) has no relation with the specific formulation of DDU-S . Therefore, this equivalence also applies to DIU sets because DIU is a special case of DDU.
Based on problem (36), the mechanism of TSRO hedging against uncertainties can be concluded as the optimal match between the uncertainty set and the extended dispatchable region . The objective (36a) aims to minimize the matching cost, which is .
The difference in the mechanism of robust dispatch under DIUs and DDUs is illustrated in Fig. 6. In the case of DIU, the decision maker needs to find a feasible , allowing the extended dispatchable region that varies with to cover the fixed uncertainty set . This process can be concluded as unilateral matching, where the dispatchable region is adapted to suit the uncertainty set. In the case of DDUs, both the extended dispatchable region and the DDU-S vary with decision variables , and the mechanism of robust dispatch under DDUs can be summarized as the bilateral matching between the two.
Remark 4 (bilateral matching). The bilateral matching mechanism points out the crucial difference between DDU and DIU in power system robust dispatch. DDU is an active, flexible source rather than a burden. With rational decisions, the DDU-S can be reshaped so that uncertainty can be more easily admitted. In other words, the bilateral matching mechanism explores the potential flexibility hidden in DDUs, facilitating dispatch and operation in RES-dominated power systems.
According to 2.1 The complete separability of DDU-S, 2.2 The partial separability of a DDU-S, both the complete and partial separable formulations for the DDU-S exist in the problem (36). Suppose that is equivalent to or can be equivalently substituted by a separable DDU-S . Then, constraint (36b) can be transformed into:
where indicates the extended dispatchable region of the auxiliary random variable :
Therefore, the bilateral matching between the extended dispatchable region and the DDU-S can be reduced to the unilateral matching from to the fixed . An example is provided as follows.
Example 5 On the basis of Example 4, leaving the robust optimality aside, the focus shifts to how the dispatchable region and the uncertainty set match with each other.
For the DDU variable with the DDU-S in Eq. (31), the dispatchable region of is given by:
According to Example 4, can be equivalently substituted by the separable DDU-S in Eq. (33a), (33b), (33c), which reveals an auxiliary random variable with decision-independent support in Eq. (33b). The dispatchable region of , denoted by , can be obtained according to Eq. (38). Next, we show that
When , the corresponding , , and are plotted in Fig. 7(a); the corresponding and are plotted in Fig. 7(b). As observed from the figures, fails to cover neither nor , and does not cover . Thus, is not robustly feasible.
With other conditions unchanged, the DDU-S is modified into:
The dispatchable region of and the uncertainty set of remain unchanged, whereas and vary with . When , these regions are plotted in Fig. 8. In the space of u, covers both and . In the space of , covers . In other words, is robustly feasible when the DDU-S is modified into Eq. (41).
4. Convexity of robust dispatch problem with DDUs
As explained previously, DDUs can facilitate bilateral matching between the dispatchable region and the uncertainty set. However, compared with DIUs, the challenge of achieving optimal matching is heightened. This section reveals that the underlying difficulty stems from the fact that DDUs may introduce non-convexity to TSRO problems.
4.1. Case of DIUs
For a TSRO problem that contains only linear constraints and DIUs, its RFR is convex [43]. This conclusion can be extended to the convexity of the entire TSRO problem, see Lemma 4 as follows.
Lemma 4 Let Assumption 1 hold for problem (1). If and is a polyhedron, then the problem (36) is convex.
Proof. Define the set as follows:
Since and are both polyhedrons, is equivalent to:
According to Eq. (43), is the intersection of a finite number of polyhedrons. Therefore, is a polytope in the space of .
By projecting onto the subspace of , Eq. (36b) is derived. Since the projection of a polyhedron onto its subspace is still a polyhedron, Eq. (36b) is proved to be a polyhedron. This completes the proof.
Note that Lemma 4 only guarantees the convexity of the TSRO problem (36) when the uncertainty set is both decision-independent and polyhedral. Next, Corollary 6 suggests that the convexity of Eq. (36a), (36b) actually relies on the decision-independence of the uncertainty set rather than its polyhedrality.
4.2. Case of DDUs
In this subsection, we would like to prove that when the uncertainty set is decision-dependent, the convexity of the TSRO problem (36) is no longer guaranteed.
DDU-S with complete separability: without loss of generality, it is assumed that the DDU-S is separable as
Then, Theorem 5 gives a sufficient condition for the convexity of the TSRO problem (36).
Theorem 5 Let Assumption 1 hold for problem (1). If is separable, as expressed in Eq. (44), and the composite function given by Eq. (45) is convex, then the TSRO problem (36) is convex.
where denotes the matrix constant in Eq. (1d).
Proof. In this theorem, Assumption 1 holds and is convex. First, formulate the following optimization problem:
where the objective function is linear, and the feasible region consists of a polyhedron.
Next, let , , and denote the objective function, the feasible region, and the optimal value, respectively. We show that is convex with respect to , , and . For any , , and , the optimal solution of is denoted by , and the optimal solution of is denoted by . Therefore,
Since is a convex function and is a convex polyhedron, we have:
which indicates that is a feasible solution given the parameters , , and .
Therefore, the following relations hold.
where Eq. (50b) holds because and are optimal solutions to the problem given the parameters and , respectively; Eq. (50c) yields because function is linear; Eq. (50d) holds because is a feasible solution given the parameters , , and .
The above derivation justifies that is a convex function with respect to , , and .
The definition of in Eq. (35a), (35b) and the definition of yields:
Therefore, constraint (36b) equals to
Next, Eq. (36b) is proved to be convex by contradiction. Suppose there exist and satisfying Eq. (36b) and such that not satisfying Eq. (36b). This implies there exists such that
Since and satisfy Eq. (36b), it can be obtained that and . Since is convex, it is derived that
which cause a contradiction. This completes the proof that Eq. (36b) is convex.
Theorem 5 implies that, when the DDU-S is separable, the convexity of the TSRO problem (36) can be determined by the property of the coupling function and has no other requirement on the decision-independent auxiliary uncertainty set , as long as is independent of decision x.
A corollary of Theorem 5 is provided as follows.
Corollary 6 Let Assumption 1 hold for problem (1). If , then the TSRO problem (36) is convex.
Corollary 6 implies that when the uncertainty set is independent of the decision variable x, the convexity of the TSRO Eqs. (1a), (1b), (1c), (1d), (1e), (36a), (36b) hold, and this has no relation with the formulation of the DIU set .
Next, an example to illustrate Theorem 5 is provided.
Example 6. On the basis of Example 4, the DDU-S is expressed as:
where .
Since the in Eq. (55a), (55b) is separable and the coupling function is convex, according to Theorem 5, the corresponding RFR is convex, even though the DIU set is nonconvex. To verify this, by searching all over the space, the RFR that contains all robustly feasible x is plotted in Fig. 9. The result complies with Theorem 5.
Moreover, denote by and . It is observed in Fig. 9(a) that is not robustly feasible, whereas is. To verify this from another perspective, the dispatchable region and the DDU-S with different values of x are depicted in Fig. 10.
It is revealed in Fig. 10(a) that when , the dispatchable region is not able to cover the DDU-S , complying with . In Fig. 10(b), when , the DDU-S is covered by the dispatchable region , which is compatible with .
(1) DDU-S with partial separability. The TSRO problem (36) with a decision-independent polyhedral uncertainty set is guaranteed to be convex, as claimed in Lemma 4 and Theorem 5. However, the TSRO problem (36) can become nonconvex when the polytope varies with the here-and-now decision x. This is further explained as follows.
Example 7. On the basis of Example 4, the DDU-S is expressed in Eq. (56), where the here-and-now decision varies within [0.8, 2.2].
As the is defined in Eq. (32), the dispatchable region remains Eq. (39). To obtain the RFR , the graph of and are plotted in Fig. 11. Moreover, and with different values of x are shown in Fig. 12.
When , the dispatchable region fails to cover the uncertainty set . By recalling that the RFR contains all the x that makes hold, the is obtained as
which is obviously nonconvex.
The nonconvexity induced by polyhedral DDU-S can be explained from two perspectives:
(1) Consider the TSRO problem (1) with polyhedral DDU-S as follows
where are functions with respect to x. According to Section 2.2, the is proved to be partially separable by considering in Eq. (1e), (20b) and in Eq. (19a), (19b), (19c). Moreover, according to Theorem 3, the DDU-S in TSRO problem (1) can be equivalently substituted by and that are both completely separable. However, the coupling function of , which is in Eq. (18c), and the coupling function of , which is in Eq. (19c), are both nonconvex functions. Therefore, the convexity of the TSRO problem cannot be ensured by applying Theorem 5.
(2) Consider the polytope in the space of as follows:
The projection of Eq. (59) onto the space of is:
where , and are constant matrices and is a constant vector. According to Definition 3, Eq. (60) is the graph of . Then, constraint (36b) has equivalent formulations as in Eq. (61a), (61b), (61c), (61d), (61e).
where in Eq. (61b), are the jth row of , respectively, and denotes the number of rows in M; Eq. (61c) is derived by recalling Eq. (58) and applying the dual transformation to the inner maximization problem in Eq. (61b), where is the dual multiplier; Eq. (61d) is obtained by equivalently removing the minimization operator in Eq. (61c). In Eq. (61e), .
According to the transformation in Eq. (61a), (61b), (61c), (61d), (61e), constraint (36b) is equivalent to the projection of (∗) onto the space of where (∗) is defined in Eq. (61e). By noting the bilinear term and in (∗), region (∗) may be nonconvex in the space of . Therefore, constraint (36b), which is the projection of (∗), can also be nonconvex. When and are decision-independent constant matrices, region (∗) and its projection are guaranteed to be polyhedrons, justifying that constraint (36b) is convex in the case of DIUs.
5. Algorithm for robust dispatch with DDUs
Some algorithms have been proposed to solve specific robust dispatch problems with DDUs. However, the mechanism of DDU’s influence on algorithms is still unclear. Compared to these works, this paper unfolds the separable property of DDU and then designs a generic solution algorithm for DDUs based on the coupling function. The proposed algorithm is not only practical but also inspiring by revealing the essential change when DDUs are considered. It is possible to improve existing algorithms by applying the theoretical results in this section.
This section begins by reviewing two mainstream cutting-plane algorithms developed for TSRO problems and revealing their limitations in handling DDUs. Then, an improved solution strategy is proposed to solve the DDU-associated TSRO problem.
5.1. The cutting-plane algorithms for TSRO problems
Existing solution algorithms for TSRO problems, comprising the renowned Benders’ decomposition and C&CG algorithm, follow the principle of restriction and relaxation (R&R) [47,48], as illustrated in Fig. 13. Restriction indicates fixing the values of some decision variables in an optimization problem, Relaxation means dropping some of the constraints.
The basic idea of R&R is explained as follows. The TSRO problem is solved as the original problem. Without loss of generality, the original problem is assumed to be a minimization problem. The so-called equivalent master problem (EMP) is derived by applying an equivalent transformation to the original problem. A subproblem (SP) is obtained by applying restriction to the original problem, and a relaxed master problem (RMP) is derived by applying relaxation to the EMP. The RMP and EMP share the same optimization objective.
The solution algorithms based on the principle of R&R are designed to solve the SP and the RMP iteratively. The solution to SP and RMP provides an upper bound and lower bound of the optimum of original problem, respectively. Moreover, the values of the fixed decision variables in the RMP are updated by solving the RMP. By solving the SP, additional cutting-plane constraints are appended to the RMP. The iteration terminates when the optimum of SP and RMP are close enough, implying that the optimum of original problem is obtained. Under the same solution framework of R&R, the Benders’ decomposition and the C&CG algorithm mainly differ in the formulations of cutting-planes, EMP, and RMP.
(1) The Benders’ decomposition. Recalling the sets in Eq. (18b) and in Eq. (19b), the cutting planes in Benders’ decomposition are designed as:
The parameterized in and is called the feasibility cut and is a half-plane in . The parameterized in and is the optimality cut which is a half-plane in .
According to Theorem 3, the EMP in Benders’ decomposition, which is surrogate to the original TSRO problem (1), can be formulated as:
By applying partial enumeration to in , in , and in , the Benders decomposition is intended to relax constraints (64b), (64c) into linear cutting-planes. To be specific, if a tentative solution does not satisfy constraint (64b), there exists and such that . Then, in the RMP, a cutting-plane is formulated to approximate constraint (64b). Similarly, if a tentative solution does not satisfy constraint (64c), there exists and such that . Then, in the RMP, a cutting-plane is formulated to approximate constraint (64c). For details of Benders decomposition for TSRO, please refer to Refs. [[49], [50], [51]].
(2) The C&CG algorithm. Denote by the cutting-plane in the C&CG algorithm:
It is a half-plane in parameterized in . When the C&CG algorithm is applied to the TSRO problem (1), the EMP is designed as:
The equivalence between the original TSRO problem Eq. (1a), (1b), (1c), (1d), (1e) and the EMP (66) is justified by recalling problem (36). By partially enumerating the in constraint (66b), the C&CG algorithm is intended to relax constraint (66b) into linear cutting-planes. To be specific, if a tentative solution does not satisfy constraint (66b), there exists such that . Then, in the RMP, a cutting-plane is formulated to approximate constraint (66b). For details of the C&CG algorithm, please refer to Ref. [52].
5.2. Limitations of cutting-plane algorithms
The inapplicability of the aforementioned cutting-plane algorithms to DDU-associated TSRO problems is discussed from the following two perspectives.
(1) Theoretical perspective. As discussed in Section 4, DDUs may introduce nonconvexity to the original problem (1). The EMPs could also be nonconvex optimization problems because the original problem (1), the EMP (64) in Benders’ decomposition, and the EMP (66) in C&CG algorithm are equivalent. The nonconvexity of EMPs, if any, must reside in the constraints of EMP. As stated in Section 5.1, the two cutting-plane algorithms are intended to relax and approximate the feasible region of EMP by a set of cutting planes. When the feasible region of EMP becomes nonconvex due to DDUs, the RMPs formulated by cutting-plane constraints are not guaranteed to be a relaxation of the EMP, leading to degraded quality of the computation result.
(2) Physical perspective. Recalling the physical meaning of RO, the solution to the TSRO problem hedges against the worst-case scenario within the uncertainty set. As discussed in Section 5.1, additional cutting planes parameterized in are generated to handle the identified worst-case scenario when a tentative solution is not content with the constraints in EMPs under scenario . However, may reside outside the uncertainty set when takes other values, as the uncertainty set varies with decision . Therefore, the cutting planes parameterized in may bring over-conservatism to the RMP, preventing the RMP from approximating the EMP.
Next, the potential consequences of applying conventional cutting-plane algorithms to solving DDUs-integrated TSRO problems are revealed and justified by illustrative examples.
Failure in robust feasibility. The RMP, consisting of cutting planes, is not guaranteed to be a relaxation to the EMP. The over-conservative cutting-plane may be an empty set, making the RMP infeasible and interrupting the iterative algorithm. Once the decision maker observes an infeasible RMP, the original problem would be misdiagnosed as infeasible. An example of the failure in robust feasibility is detailed as follows.
Example 8. On the basis of Example 7, the TSRO problem is expressed as:
According to Example 7, the explicit formulation of is . Therefore, the optimal solution to Eq. (67a), (67b) is .
When applying Benders’ decomposition to solving Eq. (67a), (67b), the tentative solution in the first iteration round is , which corresponds to and such that . Then, a cutting-plane constraint with explicit formulation as
which is appended to the EMP. However, it can be justified that constraint (68) is an empty set that makes the RMP infeasible. As observed from an infeasible RMP, the decision maker would be under the delusion that the original problem (67) is infeasible.
When the C&CG algorithm is applied to solving Eq. (67a), (67b), there exists in the first iteration round such that . Then, a cutting-plane constraint is explicitly formulated as
which is appended to the RMP. However, constraint (69) is an empty set that makes the RMP infeasible. Similarly, the feasibility of Eq. (67a), (67b) would be misconceived by the decision maker.
Failure in robust optimality. The over-conservative cutting planes in RMPs may shrink the feasibility region of the EMP, resulting in a suboptimal solution to the original problem, as suggested by the following example.
Example 9 On the basis of Example 8, the constraints of the second-stage problem are expressed as:
The dispatchable region corresponds to in Eq. (70) is
The DDU-S in Eq. (56), the dispatchable region , and their graphs are illustrated in Fig. 14 to derive the RFR.
Fig. 14 reflects that the explicit formulation of the RFR in this example is . Therefore, the optimal solution in this example is , and the optimum is 0.1.
When the Benders’ decomposition is applied, the tentative solution in the first iteration round is , and there exists and such that . Then, a feasibility cutting-plane is explicitly formulated as
which is appended to the RMP. In the second iteration round, the RMP generates a tentative solution , which is proved to be within the RFR . Then, the iteration algorithm terminates and outturns a suboptimal solution with an objective value of 0.5.
When the C&CG algorithm is applied, the tentative solution in the first iteration round is also , and there exists such that . Then, a cutting-plane is explicitly formulated as
which is appended to the RMP. Similarly, the RMP with constraint (73) would outturn a suboptimal solution with an objective value of 0.5.
5.3. Improved solution algorithm for DDUs
In this subsection, an improved solution algorithm is proposed to solve the DDU-associated TSRO problems based on the separability of DDU-S.
(1) DDU-S with complete separability. Without loss of generality, the DDU-S is assumed to be separable as in Eq. (2). Denote by the enhanced C&CG cuts parameterized in . Then, it can be formulated as:
Then, the EMP (64) can be reformulated as
By applying partial enumeration to in Eq. (75b), the RMP is formulated as:
The RMP (76) provides a valid relaxation to the EMP (75). As the constraints in constraint (76c) accumulate, the RMP (76) is approaching the EMP (75).
(2) DDU-S with partial separability. The enhanced feasibility Benders’ cut parameterized in is formulated as:
The is a constraint in . The enhanced optimality Benders’ cut is:
which is a constraint in .
Then the EMP can be formulated as
By applying partial enumeration to in constraint (79c) and in constraint (79d), the RMP is formulated into:
6. Illustrative applications of robust dispatch with DDUs
This section presents three applications of robust dispatch with DDUs: frequency-constrained reserve allocation with wind generators’ DDUs [12], robust dispatch considering DR’s DDUs [20], and robust scheduling of VPP under both DDUs and DIUs [29]. These works have been published previously, and we briefly introduce them here only to showcase the theoretical results proposed in this paper. For detailed information, one can refer to the above references.
6.1. Source side: Frequency-constrained reserve allocation of wind farms
Through synthetic inertia and droop control, RES units such as wind generators can provide fast responses to frequency regulation by reserve allocation. In other words, wind generators can be considered a kind of frequency regulation resource. Meanwhile, the reserve allocation problem of wind generators should consider the uncertainty of wind generation power. The decision to preserve power will influence the realization of the real available wind power, resulting in DDUs.
The frequency-constrained reserve allocation problem of wind generators can be formulated as a TSRO problem. At stage one, the here-and-now decision is composed of the unit commitment decisions of synchronous generators and the energy dispatch and reserve allocation decisions of synchronous and wind generators. The reserve allocation affects the uncertainty of wind power. After the real wind power is observed, the second-stage decision , including the re-dispatch of synchronous and wind generators, is made for frequency regulation.
Example 2 considers DDUs of wind generators in different modes. The Delta mode is adopted in Ref. [12] to provide frequency reserve with a reliability guarantee, expressed as:
where , and represent the preserved power, the available power, the de-loading ratio, and the maximal available power of the wind generator at time slot , respectively; indicates a DIU variable solely determined by the uncertain wind speed; the preserved power and the available power embody DDU variables depending on the de-loading ratio decision .
By imposing a robustness guarantee on , the DDU model is further simplified into
where and denote the expected value and fluctuation level of , respectively; and denote the upper- and lower-bounds of maximal available power; represents the temporal robustness budget for the wind generator.
In the DDU model, the DDU variable is
The variable affecting the DDU in the here-and-now decision is .
Based on the separability of DDU-S, the auxiliary random variable is
The DIU support set Ξ is defined by constraints (82b)–(82d), and the coupling function is defined by Eq. (82a). It is clear that the corresponding DDU-S is completely separable. Hence, the robust reserve allocation problem can be directly solved by the improved C&CG algorithm presented in Section 7.
Numerical results of a modified PJM 5-bus system are provided to verify the significance of considering DDUs in robust dispatch. Fig. 15, Fig. 16 [12] exhibit the frequency trajectories at each time considering the DDU and DIU models, respectively. By considering the DDU model of wind power, the frequency deviation is still maintained in the expected region. On the contrary, when a DIU set is used to model wind power uncertainty, it cannot provide anticipated frequency support, leading to violations of the frequency nadir. The numerical comparison demonstrates the superiority of modeling wind generation output as DDU rather than DIU.
Numerical tests on a real regional power grid of China with 57 conventional generators and six renewable energy power plants [53] are carried out to verify the scalability of the proposed solution algorithm. Two scenarios are considered to test the effect of RESs (including wind farms and PV stations) in the TSRO model with DDUs.
(1) Compared (COMP.) Model: only synchronous generators provide frequency regulation service.
(2) Proposed (PPSD.) Model: synchronous generators and RESs all provide frequency regulation service.
The numerical results are depicted in Fig. 17. In Fig. 17(a), during 11:00–16:00, the proportion of RES generation power in the COMP. model is reduced to about 70% compared to the PPSD. Model. In Fig. 17(b), the penetration of RES decreases as the value of the contingency size increases from 0 to 3%. The curve of PPSD. Model drops much slower than that of COMP. Model. Besides, the problem of the COMP. Model becomes infeasible when the contingency size increases to 2.9%. The post-contingency frequency dynamics at different time slots are plotted in Fig. 17(c), verifying the robust feasibility. Moreover, the computational time of the PPSD. Model is 1914.22 s, which is compatible with the day-ahead dispatch problem in real-world large power systems.
6.2. Demand side: Robust dispatch with DR
DR is a promising solution to reducing operation costs and alleviating system risks by encouraging end-users to participate in system regulation. However, the demand itself is commonly stochastic. Since the decision of DR may change probability distributions or bounds of demand, the uncertainty of DR belongs to DDU.
The robust dispatch problem with DR, belonging to TSRO, has been investigated in our previous work [20]. At stage one, the here-and-now decision is composed of the nominal generations and reserve capacities of conventional units and the set-point of DR . This problem concentrates on the DDU of DR depending on the set-point . After the real loads are observed, the stage-two decision , regulated generation outputs of conventional units, is made to maintain power balance and power flow constraints.
The loads themselves own the following uncertainty
where , and denote the upper fluctuation, lower fluctuation, and the forecast value of the load.
Through DR, the forecast loads are changed to the set-point . Assuming that the fluctuations of loads are proportionally amplified with the forecast load, the new uncertainty set is defined as
where represents the amplification ratio. Hence, indicates a DDU-S depending on the here-and-now decision .
The DDU-S of DR belongs to box DDUs in Example 1, which is completely separable. Hence, the robust dispatch problem with DR is solved by using the improved C&CG algorithm proposed in Section 7.
Our previous work [20] reveals the influence of DDUs in DR. It validates the effectiveness of the enhanced C&CG algorithm in the IEEE 5-bus system with two loads participating in the DR program. Fig. 18 illustrates the iteration procedure of the improved C&CG algorithm, where Disp-Reg reflects the dispatchable region in Definition 3. Fig. 18 exhibits the bilateral matching between the DDU-S and the dispatchable region. If the uncertainty dependents on decisions, the dispatch result may fail to fulfill the robust feasibility or/and optimality. Fig. 19 demonstrates the iteration result of the standard C&CG algorithm with the DIU model. The dispatchable region covers worst-case scenarios outside the uncertainty set, implying the loss of robust optimality.
6.3. Reserve deployment: Robust scheduling of VPP
VPP can provide power systems with flexibility by aggregating renewable generation units, conventional power plants, energy storage, and flexible demands. The scenario in which a VPP participates in the day-ahead reserve market is adopted in our previous work [29]. The VPP, which does not know the real reserve deployment request in the day-ahead time scale, will provide a flexibility range. Then, the bulk grid will transport a regulating signal varying within the flexibility range. Particularly, the regulating signal is uncertain for the VPP. Meanwhile, the uncertainty depends on the flexibility range it decides. Therefore, the regulating signal from the day-ahead reserve market for the VPP belongs to DDU.
The robust scheduling problem of VPP can be formulated by a TSRO problem. At stage one, the VPP will make the here-and-now decision x composed of the traded power, the upward/downward reserve capacity in the market, and the unit commitment of conventional power plants. The VPP should consider the DDU of regulating signals and the DIU of energy market price and wind generation power. At stage two, RESs, including conventional power plants, energy storage units, and flexible demands, are employed to tackle the uncertainties.
The VPP focuses on the uncertain power exchange between it and the bulk grid, defined as
where represents the decision of power traded in the energy market at time slot ; and denote the uncertain upward and downward regulating signals to the VPP at time slot , respectively.
The uncertainties of upward and downward regulating signals are described as:
where and are the average normalized upward/downward reserve energy called on to provide at time slot ; and indicate the decisions of upward and downward reserve capacities, respectively.
The uncertainty set of is formulated by Eqs. (87), (88a), (88b), (88c), (88d). Since the set depends on the stage-one decisions , and , it belongs to DDU-S. According to Section 2, this complex DDU-S is partially separable. Section 4 demonstrates that TSRO problems with partially separable DDU-S could be nonconvex. The improved C&CG algorithm in Section 5 may fail to guarantee the robust feasibility or/and optimality. Section 5 also presents an improved Benders’ decomposition algorithm to deal with partially separable DDU-S.
The effectiveness of the improved Benders’ decomposition algorithm in solving the robust VPP scheduling problem has been verified in our previous research [29]. The standard C&CG algorithm is utilized to solve the same VPP scheduling problem. Table 1 [29] lists the outcomes of both algorithms. The net profit by the standard C&CG algorithm is much smaller than that by the improved Benders’ decomposition algorithm. This is because the feasibility cut is directly generated by the worst-case uncertainty realization, in the C&CG algorithm, ignoring the fact that the uncertainty set varies with decisions. Moreover, the improved Benders’ decomposition algorithm requires fewer iterations and less solution time, demonstrating the efficiency of the Benders-dual cutting-plane.
In this section, several applications are presented to showcase different types of DDUs in power system dispatch and how to handle them. It should be noted that the proposed theorems and algorithms are also applicable in other RESs, such as PV, energy storage units, and market participants.
7. Conclusions
This paper provides a systematic framework for two-stage robust dispatch with DDUs, highlighting the fundamental relations and distinctions between DDUs and DIUs. The structural properties of DDUs are first explored through the concept of separability, with a rigorous definition, proved existence, and illustrative examples. The results reveal that a DDU-S with an arbitrary set-valued mapping formulation can be decomposed into a coupling function parameterized in decisions and a decision-irrelevant uncertainty set. Subsequently, robust dispatch with DDUs is equivalently formulated as the bilateral matching between the DDU-S and the dispatchable region or its variant in combination with the region-based flexibility characterization. Compared with the unilateral matching under DIUs, the bi-directional matching facilitated by DDUs endows more system flexibility, despite the possibility of introducing non-convexity into the robust dispatch problem. It has been proved that non-convexity, if any, is attributed to the non-convex coupling function. Afterward, an improved algorithm is proposed to precisely and efficiently solve the generic DDU-associated TSRO dispatch, as a variant of the iterative algorithm within the framework of restriction and relaxation. Unlike traditional primal or dual cutting planes, the enhanced cuts are designed based on the separability of DDU-S and can autonomously adapt to the convexity or non-convexity of the problem. Finally, applications to robust dispatch problems considering the DDUs of wind generators, DR, and VPP are introduced. These applications emphasize the importance of considering DDUs and verifying the effectiveness of proposed algorithms in dealing with DDUs.
It should be noted that though this paper focuses on the TSRO, its key idea of DDU could still work in other optimization problems, such as multi-stage RO and two/multi-stage distributionally RO. Hopefully, this study will establish a better understanding of the characterizations of DDUs and the algorithms for robust two-stage dispatch with DDUs. We hope it could enlighten more theoretical and practical works concerning DDUs.
CRediT authorship contribution statement
Yunfan Zhang: Conceptualization, Formal analysis, Writing – original draft, Visualization, Validation, Methodology, Data curation. Yifan Su: Visualization, Validation, Methodology, Formal analysis, Data curation, Writing – original draft. Feng Liu: Project administration, Methodology, Formal analysis, Writing – review & editing, Supervision, Conceptualization.
Declaration of competing interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgments
This work was supported by the Joint Research Fund in Smart Grid (U1966601) under cooperative agreement between the National Natural Science Foundation of China (NSFC) and State Grid Corporation of China.
ChenZ, WuL, FuY.Real-time price–based demand response management for residential appliances via stochastic optimization and robust optimzation.IEEE Trans Smart Grid2012; 3(4):1822-1831.
[2]
JiangR, WangJ, GuanY.Robust unit commitment with wind power and pumped storage hydro.IEEE Trans Power Syst2012; 27(2):800-810.
[3]
XiongP, JirutitijaroenP, SinghC.A distributionally robust optimization model for unit commitment considering uncertain wind power generation.IEEE Trans Power Syst2017; 32(1):39-49.
[4]
MajidiM, Mohammadi-IvatlooB, SoroudiA.Application of information gap decision theory in practical energy problems: a comprehensive review.Appl Energy2019; 249:157-165.
[5]
WangQ, WangX, CheungK, GuanY, BreslerFSS.A two-stage robust optimization for PJM look-ahead unit commitment.In: Proceedings of 2013 IEEE Grenoble Conference; 2013 Jun 16–20; Grenoble, France. IEEE; 2013. p. 1–6.
[6]
Proposed changes to CAISO’s SOC modeling of storage. Report.Tyba Energy; 2025.
[7]
ZhangQ, FengW.A unified framework for adjustable robust optimization with endogenous uncertainty.AIChE J2020; 66(12):e17047.
[8]
ViswanathK, PeetaS, SalmanSF.Investing in the links of a stochastic network to minimize expected shortest path. Length. Report. West Lafayette: Purdue University; 2004.
[9]
BertsimasD, PhebeV.Data-driven learning in dynamic pricing using adaptive optimization. Report. Optimization Online; 2014.
[10]
LiH, QiaoY, LuZ, ZhangB, TengF.Frequency-constrained stochastic planning towards a high renewable target considering frequency response support from wind power.IEEE Trans Power Syst2021; 36(5):4632-4644.
[11]
FlemingPA, AhoJ, BuckspanA, ElaE, ZhangY, GevorgianV, et al.Effects of power reserve control on wind turbine structural loading.Wind Energy2016; 19(3):453-469.
[12]
ZhangY, WuS, LinJ, WuQ, ShenC, LiuF.Frequency reserve allocation of large-scale res considering decision-dependent uncertainties.IEEE Trans Sustain Energy2024; 15(1):339-354.
[13]
WangC, LiuF, WeiW, MeiS, QiuF, WangJ.Robust unit commitment considering strategic wind generation curtailment.In: Proceedings of 2016 IEEE Power and Energy Society General Meeting (PESGM); 2016 Jul 17–21; Boston, MA, USA. IEEE; 2016.
[14]
ChenY, WeiW.Robust generation dispatch with strategic renewable power curtailment and decision-dependent uncertainty.IEEE Trans Power Syst2023; 38(5):4640-4654.
[15]
AignerKM, ClarnerJP, LiersF, MartinA.Robust approximation of chance constrained DC optimal power flow under decision-dependent uncertainty.Eur J Oper Res2022; 301(1):318-333.
[16]
ZhaoC, WangJ, WatsonJP, GuanY.Multi-stage robust unit commitment considering wind and demand response uncertainties.IEEE Trans Power Syst2013; 28(3):2708-2717.
[17]
WangQ, WangJ, GuanY.Stochastic unit commitment with uncertain demand response.IEEE Trans Power Syst2013; 28(1):562-563.
[18]
WangL, HouC, YeB, WangX, YinC, CongH.Optimal operation analysis of integrated community energy system considering the uncertainty of demand response.IEEE Trans Power Syst2021; 36(4):3681-3691.
[19]
LiuG, TomsovicK.Robust unit commitment considering uncertain demand response.Electr Power Syst Res2015; 119:126-137.
[20]
SuY, ZhangY, LiuF, FengS, HouY, WangW.Robust dispatch with demand response under decision-dependent uncertainty.In: Proceedings of 2020 IEEE Sustainable Power and Energy Conference (iSPEC); 2020 Nov 23–25; Chengdu, China. IEEE; 2020. p. 2122–7.
[21]
SuY, LiuF, WangZ, ZhangY, LiB, ChenY.Multi-stage robust dispatch considering demand response under decision-dependent uncertainty.IEEE Trans Smart Grid2023; 14(4):2786-2797.
[22]
LiYL, SunW, YinW, LeiS, HouY.Restoration strategy for active distribution systems considering endogenous uncertainty in cold load pickup.IEEE Trans Smart Grid2022; 13(4):2690-2702.
[23]
GiannelosS, KonstantelosI, StrbacG.Option value of demand-side response schemes under decision-dependent uncertainty.IEEE Trans Power Syst2018; 33(5):5103-5113.
[24]
MashhourE, Moghaddas-TafreshiSM.Bidding strategy of virtual power plant for participating in energy and spinning reserve markets—part i: problem formulation.IEEE Trans Power Syst2011; 26(2):949-956.
[25]
MashhourE, Moghaddas-TafreshiSM.Bidding strategy of virtual power plant for participating in energy and spinning reserve markets—part ii: numerical analysis.IEEE Trans Power Syst2011; 26(2):957-964.
[26]
DabbaghSR, Sheikh-El-EslamiMK.Risk assessment of virtual power plants offering in energy and reserve markets.IEEE Trans Power Syst2016; 31(5):3572-3582.
[27]
BaringoLB, ArroyoJM.Day-ahead self-scheduling of a virtual power plant in energy and reserve electricity markets under uncertainty.IEEE Trans Power Syst2019; 34(3):1881-1894.
[28]
ZhangX, KamgarpourM, GeorghiouA, GoulartP, LygerosJ.Robust optimal control with adjustable uncertainty sets.Automatica2017; 75:249-259.
[29]
ZhangY, LiuF, WangZ, SuY, WangW, FengS.Robust scheduling of virtual power plant under exogenous and endogenous uncertainties.IEEE Trans Power Syst2022; 37(2):1311-1325.
[30]
YinW, LiY, HouJ, MiaoM, HouY.Coordinated planning of wind power generation and energy storage with decision-dependent uncertainty induced by spatial correlation.IEEE Syst J2022; 17(2):2247-2258.
[31]
YinW, FengS, HouY.Stochastic wind farm expansion planning with decision-dependent uncertainty under spatial smoothing effect.IEEE Trans Power Syst2022; 38(3):2845-2857.
PossM.Robust combinatorial optimization with cost uncertainty. Report. Optimization Online; 2013.
[35]
NohadaniO, SharmaK.Optimization under decision-dependent uncertainty.SIAM J Optim2018; 28(2):1773-1795.
[36]
LappasNH, GounarisCE.Robust optimization for decision-making under endogenous uncertainty.Comput Chem Eng2018; 111:252-266.
[37]
LappasNH, GounarisCE.The use of decision-dependent uncertainty sets in robust optimization.In: Proceedings of Foundations of Computer-Aided Process Operations/Chemical Process Control 2017; 2017 Jan 8–12; San Antonio, TX, USA.
[38]
LappasNH, GounarisCE.Multi-stage adjustable robust optimization for process scheduling under uncertainty.AIChE J2016; 62(5):1646-1667.
AvraamidouS, PistikopoulosEN.Adjustable robust optimization through multi-parametric programming.Optim Lett2020; 14(4):873-887.
[41]
WuF, KumagaiS.Steady-state security regions of power systems.IEEE Trans Circ Syst1982; 29(11):703-711.
[42]
WeiW, LiuF, MeiS.Dispatchable region of the variable wind generation.IEEE Trans Power Syst2015; 30(5):2755-2765.
[43]
WeiW.Power system robust dispatch models and applications [dissertation]. Tsinghua University, Beijing (2013)
[44]
StottB, JardimJ, AlsacO.DC power flow revisited.IEEE Trans Power Syst2009; 24(3):1290-1300.
[45]
ZhuH, LiuHJ.Fast local voltage control under limited reactive power: optimality and stability analysis.IEEE Trans Power Syst2015; 31(5):3794-3803.
[46]
WangC, LiuF, WangJ, WeiW, MeiS.Risk-based admissibility assessment of wind generation integrated into a bulk power system.IEEE Trans Sustain Energy2016; 7(1):325-336.
[47]
GeoffrionM.Elements of large-scale mathematical programming part I: concepts.Manage Sci1970; 16(11):652-675.
[48]
GeoffrionM.Elements of large-scale mathematical programming part II: synthesis of algorithms and bibliography.Manage Sci1970; 16(11):676-691.
[49]
BendersJ.Partitioning procedures for solving mixed-variables programming problems.Numer Math1962; 4(1):238-252.
[50]
JiangR, ZhangM, LiG, GuanY.Benders’ decomposition for the two-stage security constrained robust unit commitment problem.In: Proceedings of 62nd IIE Annual Conference and Expo 2012; 2012 May 19–23; Orlando, FL, USA. University of Arizona; 2012. p. 3332–41.
[51]
BertsimasD, LitvinovE, SunXA, ZhaoJ, ZhengT.Adaptive robust optimization for the security constrained unit commitment problem.IEEE Trans Power Syst2013; 28(1):52-63.
[52]
ZengB, ZhaoL.Solving two-stage robust optimization problems using a column-and-constraint generation method.Oper Res Lett2013; 41(5):457-461.
[53]
ZhuoZ, ZhangN, YangJ, KangC, SmithC, OMJ’Malley, et al.Transmission expansion planning test system for AC/DC hybrid grid with high variable renewable energy penetration.IEEE Trans Power Syst2019; 35(4):2597-2608.