Preventing the Immense Increase in the Life-Cycle Energy and Carbon Footprints of LLM-Powered Intelligent Chatbots

Peng Jiang, Christian Sonne, Wangliang Li, Fengqi You, Siming You

PDF(1540 KB)
PDF(1540 KB)
Engineering ›› 2024, Vol. 40 ›› Issue (9) : 202-210. DOI: 10.1016/j.eng.2024.04.002
Research
Perspective

Preventing the Immense Increase in the Life-Cycle Energy and Carbon Footprints of LLM-Powered Intelligent Chatbots

Author information +
History +

Abstract

Intelligent chatbots powered by large language models (LLMs) have recently been sweeping the world, with potential for a wide variety of industrial applications. Global frontier technology companies are feverishly participating in LLM-powered chatbot design and development, providing several alternatives beyond the famous ChatGPT. However, training, fine-tuning, and updating such intelligent chatbots consume substantial amounts of electricity, resulting in significant carbon emissions. The research and development of all intelligent LLMs and software, hardware manufacturing (e.g., graphics processing units and supercomputers), related data/operations management, and material recycling supporting chatbot services are associated with carbon emissions to varying extents. Attention should therefore be paid to the entire life-cycle energy and carbon footprints of LLM-powered intelligent chatbots in both the present and future in order to mitigate their climate change impact. In this work, we clarify and highlight the energy consumption and carbon emission implications of eight main phases throughout the life cycle of the development of such intelligent chatbots. Based on a life-cycle and interaction analysis of these phases, we propose a system-level solution with three strategic pathways to optimize the management of this industry and mitigate the related footprints. While anticipating the enormous potential of this advanced technology and its products, we make an appeal for a rethinking of the mitigation pathways and strategies of the life-cycle energy usage and carbon emissions of the LLM-powered intelligent chatbot industry and a reshaping of their energy and environmental implications at this early stage of development.

Graphical abstract

Keywords

Large language models / Intelligent chatbots / Carbon emissions / Energy and environmental footprints / Life-cycle assessment / Global cooperation

Cite this article

Download citation ▾
Peng Jiang, Christian Sonne, Wangliang Li, Fengqi You, Siming You. Preventing the Immense Increase in the Life-Cycle Energy and Carbon Footprints of LLM-Powered Intelligent Chatbots. Engineering, 2024, 40(9): 202‒210 https://doi.org/10.1016/j.eng.2024.04.002

References

[[1]]
Adam D. The muse in the machine. Proc Natl Acad Sci USA 2023; 120(19):e2306000120.
[[2]]
Grossmann I, Feinberg M, Parker DC, Christakis NA, Tetlock PE, Cunningham WA. AI and the transformation of social science research. Science 2023; 380 (6650):1108-9.
[[3]]
Stokel-Walker C, Van Noorden R. What ChatGPT and generative AI mean for science. Nature 2023; 614(7947):214-6.
[[4]]
Wang H, Li J, Wu H, Hovy E, Sun Y. Pre-trained language models and their applications. Engineering 2023; 25:51-65.
[[5]]
ChatGPT reaches 100 million users two months after launch. Report. Belize City: The Guardian; 2023 Feb.
[[6]]
Chat. openai. com traffic & engagement analysis. Report. New York City: Similarweb; 2023.
[[7]]
Generative AI—worldwide. Report. New York City: Statista; 2023.
[[8]]
What’s the next word in large language models? Nat Mach Intell 2023; 5 (4):331-2.
[[9]]
Epstein Z, Hertzmann A; the Investigators of Human Creativity. Art and the science of generative AI. Science 2023; 380(6650):1110-1.
[[10]]
Lin Z, Akin H, Rao R, Hie B, Zhu Z, Lu W, et al. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science 2023; 379 (6637):1123-30.
[[11]]
Singhal K, Azizi S, Tu T, Mahdavi SS, Wei J, Chung HW, et al. Large language models encode clinical knowledge. Nature 2023; 620(7972):172-80.
[[12]]
White AD. The future of chemistry is language. Nat Rev Chem 2023; 7 (7):457-8.
[[13]]
Luo B, Lau RY, Li C, Si YW. A critical review of state-of-the-art chatbot designs and applications. Wiley Interdiscip Rev Data Min Knowl Discov 2022; 12(1):e1434.
[[14]]
McTear M. Conversational AI:dialogue systems, conversational agents, and chatbots. Heidelberg: Springer Nature; 2022.
[[15]]
Bender EM, Gebru T, McMillan-Major A, Shmitchell S. On the dangers of stochastic parrots:can language models be too big? In: Proceedings of the 2021 ACM Conference on Fairness, Transparency; Mar 3-10 2021. p.Accountability, and 2021 ; Canada. New York City: ACM; 610-23.
[[16]]
An J, Ding W, Lin C. ChatGPT: tackle the growing carbon footprint of generative AI. Nature 2023; 615(7953):586.
[[17]]
Hellweg S, Milà i Canals L. Emerging approaches, challenges and opportunities in life cycle assessment. Science 2014; 344(6188):1109-13.
[[18]]
IEC 62890: 2020. Industrial-process measurement, control and automationlife- cycle-management for systems and components. Report. Geneva: International Electrotechnical Commission; 2020.
[[19]]
Luccioni AS, Viguier S, Ligozat AL.Estimating the carbon footprint of BLOOM, a 176b parameter language model. 2022. arXiv: 2211.02001.
[[20]]
Eadline D.NVIDIA H100: are 550000 GPUs enough for this year? Report. San Diego: HPC Wire; 2023 Aug.
[[21]]
NVIDIA H100 tensor core GPU. Report. Santa Clara: NVIDIA; 2023.
[[22]]
Nagapurkar P, Das S. Economic and embodied energy analysis of integrated circuit manufacturing processes. Sustainable Comput Infor Syst 2022; 35:100771.
[[23]]
Torrubia J, Valero A, Valero A. Energy and carbon footprint of metals through physical allocation: implications for energy transition. Resour Conserv Recycl 2023; 199:107281.
[[24]]
Vahidi E, Zhao F. Assessing the environmental footprint of the production of rare earth metals and alloys via molten salt electrolysis. Resour Conserv Recycl 2018; 139:178-87.
[[25]]
Zhong RY, Xu X, Klotz E, Newman ST. Intelligent manufacturing in the context of Industry 4.0: a review. Engineering 2017; 3(5):616-30.
[[26]]
Shah A. Bloomberg uses 1.3 million hours of GPU time for homegrown largelanguage model. Report. San Diego: HPC Wire; 2023 Apr.
[[27]]
NVIDIA accused of needing 50000 H100 graphics cards to train GPT-5 for a starting price of 250000 GPT-5. Report. Warsaw: Kuai Technology; 2023.
[[28]]
Wiboonrat M. Energy management in data centers from design operations and maintenance. In: Proceedings of 2020 International Conference and Utility Exhibition on Energy, Environment and Climate Change; 2020 Oct 20-22; Pattaya, Thailand. IEEE; 2020.
[[29]]
Kumar I, Tyner WE, Sinha KC. Input-output life cycle environmental assessment of greenhouse gas emissions from utility scale wind energy in the United States. Energy Policy 2016; 89:294-301.
[[30]]
Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, et al. Language models are few-shot learners. Adv Neural Inf Process Syst 2020; 33:1877-901.
[[31]]
GPT-4. Report. San Francisco: OpenAI; 2023.
[[32]]
Masanet E, Shehabi A, Lei N, Smith S, Koomey J. Recalibrating global data center energy-use estimates. Science 2020; 367(6481):984-6.
[[33]]
Inventory of U.S. greenhouse gas emissions and sinks 1990-2018. Report. Washington: U.S. Environmental Protection Agency; 2020.
[[34]]
Li P, Yang J, Islam MA, Ren S. Making AI less ‘‘thirsty”: uncovering and addressing the secret water footprint of AI models. 2023. arXiv: 2304.03271.
[[35]]
Dhar P. The carbon impact of artificial intelligence. Nat Mach Intell 2020; 2 (8):423-5.
[[36]]
Patterson D, Gonzalez J, Le Q, Liang C, Munguia LM, Rothchild D, et al. Carbon emissions and large neural network training. 2021. arXiv: 2104.10350.
[[37]]
Hao K. Training a single AI model can emit as much carbon as five cars in their lifetimes. MITS Technol Rev 2019; 75:103.
[[38]]
Power consumption when training artificial intelligence AI based large language models LLMs in 2023. Report. New York City: Statista; 2023.
[[39]]
Yeluri S.Large language models—the hardware connection. Report. South Brisbane: APNIC; 2023 Aug.
[[40]]
Klemeš JJ, Jiang P, Fan YV, Bokhari A, Wang XC.COVID-19 pandemics stage II— energy and environmental impacts of vaccination. Renew Sustain Energy Rev 2021;150:111400.
[[41]]
Zhang M, Li L. A commentary of GPT-3 in MIT technology review 2021. Fundam Res 2021; 1(6):831-3.
[[42]]
AI chatbots: energy usage of 2023’s most popular chatbots (so far). Report. Spring: TRG Datacenters; 2023.
[[43]]
According to ChatGPT, a single GPT query consumes 1567% (15x) more energy than a Google search query. Report. Reddit; 2023.
[[44]]
ChatGPT’s energy use per query. Report. Towards Data Science; 2023.
[[45]]
Akl J, Alladkani F, Calli B. Feature-driven next view planning for cutting path generation in robotic metal scrap recycling. IEEE Trans Autom Sci Eng. In press.
[[46]]
Zhao W, Xu J, Fei W, Liu Z, He W, Li G. The reuse of electronic components from waste printed circuit boards: a critical review. Environ Scie Adv 2023; 2 (2):196-214.
[[47]]
Charles RG, Douglas P, Dowling M, Liversage G, Davies ML. Towards increased recovery of critical raw materials from WEEE-evaluation of CRMs at a component level and pre-processing methods for interface optimization with recovery processes. Resour Conserv Recycling 2020; 161:104923.
[[48]]
Deng B, Wang X, Luong DX, Carter RA, Wang Z, Tomson MB, et al. Rare earth elements from waste. Sci Adv 2022; 8(6):eabm3132.
[[49]]
Reck BK, Graedel TE. Challenges in metal recycling. Science 2012; 337 (6095):690-5.
[[50]]
Jiang S, Li Y, Lu Q, Hong Y, Guan D, Xiong Y, et al. Policy assessments for the carbon emission flows and sustainability of Bitcoin blockchain operation in China. Nat Commun 2021; 12(1):1938.
[[51]]
Krause MJ, Tolaymat T. Quantification of energy and carbon costs for mining cryptocurrencies. Nat Sustain 2018; 1(11):711-8.
[[52]]
Vranken H. Sustainability of bitcoin and blockchains. Curr Opin Environ Sustain 2017; 28:1-9.
[[53]]
Rillig MC, Ågerstrand M, Bi M, Gould KA, Sauerland U. Risks and benefits of large language models for the environment. Environ Sci Technol 2023; 57 (9):3464-6.
[[54]]
Zhu JJ, Jiang J, Yang M, Ren ZJ. ChatGPT and environmental research. Environ Sci Technol 2023; 57(46):17667-70.
[[55]]
Ordieres-Meré J, Gutierrez M, Villalba-Díez J. Toward the Industry 5.0 paradigm: increasing value creation through the robust integration of humans and machines. Comput Ind 2023;150:103947.
[[56]]
Leiserson CE, Thompson NC, Emer JS, Kuszmaul BC, Lampson BW, Sanchez D, et al. There’s plenty of room at the top: what will drive computer performance after Moore’s law? Science 2020; 368(6495):eaam9744.
[[57]]
Min B, Ross H, Sulem E, Veyseh APB, Nguyen TH, Sainz O, et al. Recent advances in natural language processing via large pre-trained language models: a survey. ACM Comput Surv 2023; 56(2):1-40.
[[58]]
Ouyang L, Wu J, Jiang X, Almeida D, Wainwright C, Mishkin P, et al. Training language models to follow instructions with human feedback. Adv Neural Inf Process Syst 2022; 35:27730-44.
[[59]]
Henderson P, Hu J, Romoff J, Brunskill E, Jurafsky D, Pineau J. Towards the systematic reporting of the energy and carbon footprints of machine learning. J Mach Learn Res 2020; 21(1):10039-81.
[[60]]
Jiang P, Zhang L, You S, Fan YV, Tan RR, Klemeš JJ, et al. Blockchain technology applications in waste management: overview, challenges and opportunities. J Clean Prod 2023; 421:138466.
[[61]]
Niaz H, Shams MH, Liu JJ, You F. Mining bitcoins with carbon capture and renewable energy for carbon neutrality across states in the USA. Energy Environ Sci 2022; 15(9):3551-70.
[[62]]
Zhu D, Chen J, Shen X, Li X, Elhoseiny M. MiniGPT-4: enhancing visionlanguage understanding with advanced large language models. 2023. arXiv: 2304.10592.
[[63]]
Savage N. Drug discovery companies are customizing ChatGPT: here’s how. Nat Biotechnol 2023; 41(5):585-6.
[[64]]
Farrauto RJ, Deeba M, Alerasool S. Gasoline automobile catalysis and its historical journey to cleaner air. Nat Catal 2019; 2(7):603-13.
[[65]]
Laskurain-Iturbe I, Arana-Landín G, Heras-Saizarbitoria I, Boiral O. How does IATF 16949 add value to ISO 9001? An empirical study. Total Qual Manage Bus Excell 2021;32(11-12):1341-58.
[[66]]
Decarbonizing all means of transport key for sustainable growth, achieving net-zero emissions by 2050, secretary-general tells Beijing conference. Report. United Nations; 2021.
[[67]]
Jiang P, Sonne C, You S. Dynamic carbon-neutrality assessment needed to tackle the impacts of global crises. Environ Sci Technol 2022; 56(14):9851-3.
[[68]]
Zero waste international alliance. Report. San Diego: ZWIA; 2023.
[[69]]
23 global cities and regions advance towards zero waste. Report. C40 Cities; 2018.
[[70]]
Rastogi A. Moving towards better communication. Nature Comput Sci 2023; 3 (10):808-9.
[[71]]
Topol EJ. As artificial intelligence goes multimodal, medical applications multiply. Science 2023; 381(6663):eadk6139.
[[72]]
Larosa F, Hoyas S, García-Martínez J, Conejero JA, Fuso Nerini F, Vinuesa R. Halting generative AI advancements may slow down progress in climate research. Nat Clim Chang 2023; 13(6):497-9.
AI Summary AI Mindmap
PDF(1540 KB)

Accesses

Citations

Detail

Sections
Recommended

/