Journal Home Online First Current Issue Archive For Authors Journal Information 中文版

Engineering >> 2017, Volume 3, Issue 2 doi: 10.1016/J.ENG.2017.02.014

Optimal Bidding and Operation of a Power Plant with Solvent-Based Carbon Capture under a CO2 Allowance Market: A Solution with a Reinforcement Learning-Based Sarsa Temporal-Difference Algorithm

a School of Electrical and Electronic Engineering, The University of Manchester, Manchester M13 9PL, UK
b Department of Chemical and Biological Engineering, The University of Sheffield, Sheffield S1 3JD, UK

Received: 2017-01-17 Revised: 2017-03-02 Accepted: 2017-03-10 Available online: 2017-03-24

Next Previous

Abstract

In this paper, a reinforcement learning (RL)-based Sarsa temporal-difference (TD) algorithm is applied to search for a unified bidding and operation strategy for a coal-fired power plant with monoethanolamine (MEA)-based post-combustion carbon capture under different carbon dioxide (CO2) allowance market conditions. The objective of the decision maker for the power plant is to maximize the discounted cumulative profit during the power plant lifetime. Two constraints are considered for the objective formulation. Firstly, the tradeoff between the energy-intensive carbon capture and the electricity generation should be made under presumed fixed fuel consumption. Secondly, the CO2 allowances purchased from the CO2 allowance market should be approximately equal to the quantity of CO2 emission from power generation. Three case studies are demonstrated thereafter. In the first case, we show the convergence of the Sarsa TD algorithm and find a deterministic optimal bidding and operation strategy. In the second case, compared with the independently designed operation and bidding strategies discussed in most of the relevant literature, the Sarsa TD-based unified bidding and operation strategy with time-varying flexible market-oriented CO2 capture levels is demonstrated to help the power plant decision maker gain a higher discounted cumulative profit. In the third case, a competitor operating another power plant identical to the preceding plant is considered under the same CO2 allowance market. The competitor also has carbon capture facilities but applies a different strategy to earn profits. The discounted cumulative profits of the two power plants are then compared, thus exhibiting the competitiveness of the power plant that is using the unified bidding and operation strategy explored by the Sarsa TD algorithm.

Figures

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Fig. 10

Fig. 12

Fig. 13

Fig. 14

References

[ 1 ] Lawal A, Wang M, Stephenson P, Yeung H. Dynamic modelling of CO2 absorption for post combustion capture in coal-fired power plants. Fuel 2009;88(12):2455–62 link1

[ 2 ] Wang M, Lawal A, Stephenson P, Sidders J, Ramshaw C. Post-combustion CO2 capture with chemical absorption: A state-of-the-art review. Chem Eng Res Des 2011;89(9):1609–24 link1

[ 3 ] Lin YJ, Pan TH, Wong DSH, Jang SS, Chi YW, Yeh CH. Plantwide control of CO2 capture by absorption and stripping using monoethanolamine solution. Ind Eng Chem Res 2011;50(3):1338–45 link1

[ 4 ] Lin YJ, Wong DSH, Jang SS, Ou JJ. Control strategies for flexible operation of power plant with CO2 capture plant. AIChE J 2012;58(9):2697–704 link1

[ 5 ] Luu MT, Manaf NA, Abbas A. Dynamic modelling and control strategies for flexible operation of amine-based post-combustion CO2 capture systems. Int J Greenh Gas Control 2015;39:377–89 link1

[ 6 ] Nittaya T, Douglas PL, Croiset E, Ricardez-Sandoval LA. Dynamic modelling and control of MEA absorption processes for CO2 capture from power plants. Fuel 2014;116:672–91 link1

[ 7 ] Sahraei MH, Ricardez-Sandoval L. Controllability and optimal scheduling of a CO2 capture plant using model predictive control. Int J Greenh Gas Control 2014;30:58–71 link1

[ 8 ] Luo X, Wang M. Optimal operation of MEA-based post-combustion carbon capture for natural gas combined cycle power plants under different market conditions. Int J Greenh Gas Control 2016;48(2):312–20 link1

[ 9 ] Mac Dowell N, Shah N. Identification of the cost-optimal degree of CO2 capture: An optimisation study using dynamic process models. Int J Greenh Gas Control 2013;13:44–58 link1

[10] Luckow P, Stanton EA, Fields S, Biewald B, Jackson S, Fisher J, et al. 2015 carbon dioxide price forecast. Cambridge (MA): Synapse Energy Economics, Inc; 2015 Mar.

[11] California Environmental Protection Agency.California cap on greenhouse gas emissions and market-based compliance mechanisms [Internet]. Eagan: Thomson Reuters; c2017 [cited 2016 Nov 5]. Available from: https://govt.westlaw.com/calregs/Browse/Home/California/CaliforniaCodeofRegulations?guid=I47A831C02EBC11E194EACEFFB46E37D1&originationContext=documenttoc&transitionType=Default&contextData=(sc.Default)&bhcp=1.

[12] Chen Y, Wang L. A power market model with renewable portfolio standards, green pricing and GHG emissions trading programs. In: Proceedings of the Energy 2030 Conference; 2008 Nov 17–18; Atlanta, USA.Piscataway: IEEE; 2008. p. 1–7 link1

[13] Nanduri V. Application of reinforcement learning-based algorithms in CO2 allowance and electricity markets. In: Proceedings of the 2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL); 2011 Apr 11–15; Paris: France.Piscataway: IEEE; 2011. p. 164–9.

[14] Air Resources Board. 2016 detailed auction requirements and instructions, California cap-and-trade program and Québec cap-and-trade system joint auction of greenhouse gas allowances [Internet].[cited 2016 Oct 24]. Available from: https://www.arb.ca.gov/cc/capandtrade/auction/auction.htm.

[15] AspenTech. Rate-based model of the CO2 capture process by MEA using Aspen Plus. Burlington: Aspen Technology, Inc; 2008. 23p.

[16] Dugas RE. Pilot plant study of carbon dioxide capture by aqueous monoethanolamine [dissertation]. Austin: The University of Texas at Austin; 2006.

[17] Lawal A, Wang M, Stephenson P, Obi O. Demonstrating full-scale post-combustion CO2 capture for coal-fired power plants through dynamic modelling and simulation. Fuel 2012;101:115–28 link1

[18] Agbonghae EO, Hughes KJ, Ingham DB, Ma L, Pourkashanian M. Optimal process design of commercial-scale amine-based CO2 capture plants. Ind Eng Chem Res 2014;53(38):14815–29 link1

[19] Aroonwilas A, Veawab A. Integration of CO2 capture unit using single- and blended-amines into supercritical coal-fired power plants: Implications for emission and energy management. Int J Greenh Gas Control 2007;1(2):143–50 link1

[20] Oko E, Wang M. Dynamic modelling, validation and analysis of coal-fired subcritical power plant. Fuel 2014;135:292–300 link1

[21] US Energy Information Administration.Updated capital cost estimates for utility scale electricity generating plants. Final report.Washington DC: US Energy Information Administration; 2013 Apr.

[22] Song H, Liu CC, Lawarrée J, Dahlgren RW. Optimal electricity supply bidding by Markov decision process. IEEE Trans Power Syst 2000;15(2):618–24 link1

[23] Sutton RS, Barto AG. Reinforcement learning: An introduction.Cambridge: MIT press; 1998.

[24] Busoniu L, Babuska R, De Schutter B, Ernst D. Reinforcement learning and dynamic programming using function approximators.Boca Raton: CRC press; 2010 link1

Related Research