Leveraging Battery Electric-Bus Charging Networks for Resilient Shared EV Charging via Deep Reinforcement Learning

Zhengke Liu; Yunpeng Wang; Sonia Yeh; Patrick Plötz; Bin Yu; Xiaolei Ma

doi:10.1016/j.eng.2025.09.011

Engineering ›› DOI: 10.1016/j.eng.2025.09.011

review-article

Leveraging Battery Electric-Bus Charging Networks for Resilient Shared EV Charging via Deep Reinforcement Learning

Author information +

History +

PDF (6846KB)

Abstract

The rapid electrification of urban transportation has increased dependence on public electric-vehicle (EV) charging infrastructure, making it more vulnerable to frequent and severe disruptions. To address this issue, this study proposes utilizing underused battery electric-bus (BEB) charging networks by dynamically reallocating surplus depot chargers for public EV charging. We introduce an adaptive shared-charging coordination framework to increase the resilience of public charging services. This coordination problem is formulated as a Markov decision process (MDP) that jointly optimizes BEB charging schedules and shared charger allocation under uncertainty. To enable real-time decision-making without requiring precise forecasts of future system states, an on-policy deep reinforcement-learning (DRL) approach based on the asynchronous advantage actor-critic (A3C) algorithm is developed. A case study using real-world data from Beijing during a major urban flood demonstrates the effectiveness of the proposed adaptive shared-charging coordination framework. The results reveal that our approach significantly mitigates degradation in public charging service performance, accelerates recovery to normal operating levels, enhances user accessibility, and supports grid stability. Under an extreme scenario with only 25% of public chargers operational, the proposed strategy limits revenue losses to just 3.49%, compared with losses of 53.34% under conventional operations. Additionally, the A3C-based approach demonstrates notable training efficiency and achieves a favorable balance between short-term responsiveness and long-term system performance when benchmarked against a perfect-information optimization model, proximal policy optimization (PPO), and a greedy heuristic. These findings highlight the substantial potential of BEB charging networks as critical resilience resources for urban public EV charging infrastructure during extreme disruption events.

Keywords

Battery electric-bus charging networks / Adaptive shared charging / Disruptive events / Resilience enhancement / Deep reinforcement learning

Cite this article

Download citation ▾

Zhengke Liu, Yunpeng Wang, Sonia Yeh, Patrick Plötz, Bin Yu, Xiaolei Ma. Leveraging Battery Electric-Bus Charging Networks for Resilient Shared EV Charging via Deep Reinforcement Learning. Engineering DOI:10.1016/j.eng.2025.09.011

登录浏览全文

4963

注册一个新账户忘记密码

References

Publishing order | Descend order by publishing year | Descend order by cited within

[1]	Liu Y, Liu K, Sun X.EV response capability assessment considering user travel demand and cyber system reliability.Engineering 2022; 15:186-195.

[2]	Speth D, Plötz P, Wietschel M.An optimal capacity-constrained fast charging network for battery electric trucks in Germany.Transp Res 2025; 193:104383.

[3]	Liu K, Liu Y, Si G, Lu X, Xie Y.Punctual V2G scheduling circle: evaluate and enhance transfer V2G capability through adaptive redistribution.Appl Energy 2025; 383:125290.

[4]	Liu X, Plötz P, Yeh S, Liu Z, Liu XC, Ma X.Transforming public transport depots into profitable energy hubs.Nat Energy 2024; 9(10):1206-1219.

[5]	Yeh S, Paltsev S, Reilly JM, Daniels D, Linares P.Rethinking resilience of low-carbon transportation using a multi-system dynamics approach.Joule 2025; 9(7):101999.

[6]	Zhang L, Chen T, Liu Z, Yu B, Wang Y.Analysis of multi-modal public transportation system performance under metro disruptions: a dynamic resilience assessment framework.Transp Res 2024; 183:104077.

[7]	Cheng Y, Xia J, Zhou M, Zhou Z, Lu J, Li D, et al.Modelling of flood risks to people’s life and property in the lower yellow river under different floodplain management modes.Engineering 2025; 51:240-253.

[8]	Conroy G.How Beijing’s deadly floods could be avoided [Internet].London: Nature; 2023 Aug 3 [cited 2025 Apr 12]. Available from: https://www.nature.com/articles/d41586-023-01258-9.

[9]	Kousky C.Informing climate adaptation: a review of the economic costs of natural disasters.Energy Econ 2014; 46:576-592.

[10]	Raman G, Raman G, Peng JCH.Resilience of urban public electric vehicle charging infrastructure to flooding.Nat Commun 2022; 13(1):3213.

[11]	Wang W, Tang A, Wei F, Yang H, Xinran L, Peng J.Electric vehicle charging load forecasting considering weather impact.Appl Energy 2025; 383:125337.

[12]	The 2023 annual work summary of the Beijing Municipal Commission of Transport [Internet]. Beijing: Beijing Municipal Commission of Transport; 2024 Jan 22 [cited 2025 Apr 12]. Available from: https://jtw.beijing.gov.cn/xxgk/ndzdgz/202401/t20240122_3542205.html. Chinese.

[13]	Första elbussarna i Stockholms innerstad.Report. Bussmagasinet; 2022.

[14]	Land Transport Authority.Land transport master plan 2040 [Internet].Singapore: Land Transport Authority; 2023 Oct 30 [cited 2025 Apr 12]. Available from: https://www.lta.gov.sg/content/ltagov/en/who_we_are/our_work/land_transport_master_plan_2040.html.

[15]	Beijing Daily.40 bus super charging stations open to the public 24 hours a day [Internet].Beijing: The People’s Government of Beijing Municipality; 2024 Oct 13 [cited 2025 Apr 12]. Available from: https://www.beijing.gov.cn/fuwu/bmfw/sy/jrts/202410/t20241013_3918227.html. Chinese.

[16]	Chengdu Public Transport Group Corporation Ltd.Chengdu opens 26 bus depots with over 100 chargers for public access. Report. Beijing: Chinabuses; 2024. Chinese.

[17]	Qingdao launches shared bus charging stations to ease EV charging difficulties [Internet].Beijing: Xinhuanet; 2022 May 12 [cited 2025 Apr 12]. Available from: https://www.xinhuanet.com/photo/2022-05/12/c_1128643699.htm. Chinese.

[18]	Ye Z, Yu N, Wei R, Liu XC.Decarbonizing regional multi-model transportation system with shared electric charging hubs.Transp Res 2022; 144:103881.

[19]	Ji J, Bie Y, Wang L.Optimal electric bus fleet scheduling for a route with charging facility sharing.Transp Res 2023; 147:104010.

[20]	Liu Z, Ma X, Zhuo S, Liu X.Optimizing shared charging services at sustainable bus charging hubs: a queue theory integration approach.Renew Energy 2024; 237:121860.

[21]	Jia Z, An K, Ma W.Utilizing electric bus depots for public charging: operation strategies and benefit analysis.Transp Res 2024; 130:104155.

[22]	Yan Y, Wen H, Deng Y, Chow AHF, Wu Q, Kuo YH.A mixed-integer programming-based Q-learning approach for electric bus scheduling with multiple termini and service routes.Transp Res 2024; 162:104570.

[23]	Wang W, Yu B, Zhou Y.A real-time synchronous dispatching and recharging strategy for multi-line electric bus systems.Transp Res 2024; 185:103516.

[24]	Wang B, Li Y, Ming W, Wang S.Deep reinforcement learning method for demand response management of interruptible load.IEEE Trans Smart Grid 2020; 11(4):3146-3155.

[25]	Dorokhova M, Martinson Y, Ballif C, Wyrsch N.Deep reinforcement learning control of electric vehicle charging in the presence of photovoltaic generation.Appl Energy 2021; 301:117504.

[26]	Qiu D, Ye Y, Papadaskalopoulos D, Strbac G.A deep reinforcement learning method for pricing electric vehicles with discrete charging levels.IEEE Trans Ind Appl 2020; 56(5):5901-5912.

[27]	Qiu D, Dong Z, Zhang X, Wang Y, Strbac G.Safe reinforcement learning for real-time automatic control in a smart energy-hub.Appl Energy 2022; 309:118403.

[28]	Aksoy N.Reinforcement learning-based multi-objective smart energy management for electric vehicle charging stations with priority scheduling.Energy 2025; 322:135475.

[29]	Jin J, Mao S, Xu Y.Optimal priority rule-enhanced deep reinforcement learning for charging scheduling in an electric vehicle battery swapping station.IEEE Trans Smart Grid 2023; 14(6):4581-4593.

[30]	Wang S, Bi S, Zhang Y.Angela reinforcement learning for real-time pricing and scheduling control in EV charging stations.IEEE Trans Industr Inform 2021; 17(2):849-859.

[31]	Mnih V, Badia AP, Mirza M, Graves A, Lillicrap T, Harley T, et al.Asynchronous methods for deep reinforcement learning. In: Proceedings of of the 33rd International Conference on International Conference on Machine Learning; 2016 Jun 19–24; New York City, NY, USA. JMRL; 2016. p. 1928–37.

[32]	Chen N, Kurniawan C, Nakahira Y, Chen L, Low SH.Smoothed least-laxity-first algorithm for electric vehicle charging: online decision and performance analysis with resource augmentation.IEEE Trans Smart Grid 2021; 13(3):2209-2217.

[33]	Zhang J, Guan Y, Che L, Shahidehpour M.EV charging command fast allocation approach based on deep reinforcement learning with safety modules.IEEE Trans Smart Grid 2023; 15(1):757-769.

[34]	Proxy electricity purchase prices in Beijing for August 2023. Report. Beijing: State Grid Corporation of China; 2023. Chinese.

[35]	Proxy electricity purchase prices in Beijing for July 2023. Report. Beijing: State Grid Corporation of China; 2023. Chinese.

[36]	Domínguez-Navarro JA, Dufo-López R, Yusta-Loyo JM, Artal-Sevil JS, Bernal-Agustín JL.Design of an electric vehicle fast-charging station with integration of renewable energy and storage systems.Int J Electr Power Energy Syst 2019; 105:10546-10558.

[37]	Sungwoo B, Alexis K.Spatial and temporal model of electric vehicle charging demand.IEEE Trans Smart Grid 2012; 3(1):394-403.

[38]	Schulman J, Wolski F, Dhariwal P, Radford A, Klimov O.Proximal policy optimization algorithms.2016. arXiv: 1707.06347.

[39]	Del A Rio, Jimenez D, Serrano J.Comparative analysis of A3C and PPO algorithms in reinforcement learning: a survey on general environments.IEEE Access 2024; 12:146795-146806.