Promising Results Predict Role for Artificial Intelligence in Weather Forecasting

Mitch Leslie

Engineering ›› 2024, Vol. 39 ›› Issue (8) : 10 -12.

PDF (471KB)
Engineering ›› 2024, Vol. 39 ›› Issue (8) :10 -12. DOI: 10.1016/j.eng.2024.07.003
News & Highlights
Promising Results Predict Role for Artificial Intelligence in Weather Forecasting
Author information +
History +
PDF (471KB)

Graphical abstract

Cite this article

Download citation ▾
Mitch Leslie. Promising Results Predict Role for Artificial Intelligence in Weather Forecasting. Engineering, 2024, 39(8): 10-12 DOI:10.1016/j.eng.2024.07.003

登录浏览全文

4963

注册一个新账户 忘记密码

Artificial intelligence (AI) has already demonstrated its proficiency at difficult scientific tasks like predicting how proteins will fold and identifying new astronomical objects in masses of observational data [1]. Now, recent results suggest that AI also excels at weather forecasting. For global predictions, GraphCast, an AI system developed by Google subsidiary DeepMind (London, UK), outperforms the state-of-the-art model from the European Centre for Medium-Range Weather Forecasts (ECMWF), providing more accurate projections of variables such as temperature and humidity 90 % of the time [2,3]. Other AI systems, including Pangu-Weather from the Chinese tech company Huawei (Shenzhen, China) [4], can also match or beat traditional global forecasting models.
The speed of improvement in AI’s weather prediction ability has surprised meteorologists. "What has happened with AI is astonishing," said Dale Durran, professor of atmospheric sciences at the University of Washington, Seattle, WA, USA. As a result, it is not a question of when AI will provide forecasts for people to use. "We are already there," said Aaron Hill, an assistant professor of meteorology at the University of Oklahoma, Norman, OK, USA. Google’s nowcast feature for mobile devices, for instance, offers AI precipitation predictions for the next 12 hours [5]. And ECMWF has incorporated AI into its leading model [6]. What is uncertain, however, is how big a role AI will play in weather forecasting. Will it be one of several tools, or will it replace conventional models-or even put human forecasters out of work [7]? These questions are important because accurate weather forecasting is not just helpful for shaping day-to-day human activity; it is vital for preparing responses to mitigate the damage caused by extreme weather (Fig. 1).
Traditional weather forecasts such as those generated by the US National Weather Service (NWS) and the ECMWF rely on numerical models that use large amounts of data on current conditions to project how atmospheric conditions will evolve [8,9]. Researchers have developed many of these models that deliver results for different time and spatial scales and for a variety of applications. The atmospheric model at the heart of the ECMWF’s Integrated Forecasting System (IFS), for instance, divides the global atmosphere into a grid of several billion boxes that are 9 k m on a side and then predicts changes in variables such as wind speed and temperature in each cell [10,11]. IFS delivers a single,"high-res" ten-day forecast as well as longer-term predictions. Other models give even greater geographic precision. The High-Resolution Rapid Refresh model from the US National Oceanic and Atmospheric Administration (NOAA) offers two-day forecasts with a resolution of 3 k m [12], but it only covers the United States [12].
The accuracy of forecasts made with numerical models has increased dramatically in the last few decades. Today’s six-day forecasts, for example, are correct about as often as three-day forecasts were in the early 1990s [2]. Two reasons for this improvement are better weather models and faster, more powerful computers, said Durran.
But these advances have come at a cost. Today’s weather models are so complex that they require supercomputers to run them-which makes standard forecasting an expensive task. In 2020 the ECMWF paid more than 90 million USD for a BullSequana XH2000 supercomputer from the French company Atos (Bezons, France), and the UK Met Office doled out 1.5 billion USD for a new supercomputer built by Microsoft (Redmond, WA, USA) [13,14]. The models also take a relatively long time to produce their results. The IFS, for instance, updates its forecasts only four times a day [15]. And despite their proven abilities, numerical models still struggle to predict certain kinds of weather events, such as thunderstorms [16].
Interest in applying AI to weather forecasting is not new. For decades, academic and government scientists have been investigating the capabilities of machine learning and other types of AI, said Auroop R. Ganguly, professor of civil and environmental engineering at Northeastern University in Boston, MA, USA. However, only recently have tech powerhouses like Google, Microsoft, and Huawei become involved in the research [7]. "The industry-scale use is very new," Ganguly said, and it is the main driver of the rapid improvements in AI’s forecasting accuracy [7].
Unlike standard models, AI systems such as GraphCast and Pangu-Weather do not attempt to numerically simulate the atmosphere. Instead, researchers train the systems by feeding them large amounts of historical weather data-GraphCast learned from 39 years’ worth of data, covering 1979 to 2017 [3]. The AI systems pore over this data to identify patterns and then make predictions by comparing current conditions to past weather [7]. The resulting forecasts are faster and cheaper to generate than those made by traditional models. GraphCast can produce a ten-day forecast comparable to the IFS high-res forecast in less than a minute [3]. And once an AI system has completed its training period, it can be run on a desktop computer, dramatically reducing the costs of making forecasts [2].
Meteorologists describe a model that produces accurate predictions as skillful, and "there is a lot of skill in these AI models," said Durran. To evaluate GraphCast, which makes its predictions from the current conditions and the conditions 6 h previously, the researchers who created the model gauged its ability to forecast variables like temperature, wind direction, and humidity at 13 different levels in the atmosphere over a ten-day period. Overall, predictions from GraphCast were more accurate than those from the IFS high-res forecasts 90 % of the time [3]. In addition, GraphCast beat the ECMWF model at projecting the tracks of tropical cyclones, identifying atmospheric rivers that carry large amounts of moisture, and predicting episodes of extreme heat and cold [3]. By performing a similar analysis, researchers showed that Pangu-Weather was also superior to the IFS on the seven-day outlook [17].
AI systems still fall short of numerical models in some ways. GraphCast and Pangu-Weather only reach a resolution of about 28 k m, versus 9 k m for the IFS. And the AI models sometimes miss key weather events. For instance, a 2024 study by researchers at the University of Reading in Reading, UK, assessed whether four AI models, including GraphCast and Pangu-Weather, could forecast (retrospectively) Storm Ciarán, a hurricane-like storm that tore through Europe in late 2023, killing 16 people [18]. The models did capture some aspects of Ciarán’s structure, but all underestimated the speed of the winds, one of the most destructive features of the storm, which reached 57.5 m s - 1 [18].
Although the AI results are impressive, the models "are in their infancy," said Hill, and scientists have just begun testing them to identify their strengths and weaknesses. Researchers need to know more about their performance, and "they will not replace the traditional models soon," he said. But Durran disagreed. "It is extremely likely this is going to happen," he said. The AI models already do roughly as well as global numerical models, and developers should be able to correct the remaining deficiencies, he said.
Experts have raised several concerns about relying on AI to forecast weather. One worry is AI systems’ tendency to hallucinate, or invent results, a common problem with generative AI chatbots like ChatGPT [19]. If AI models predict non-existent weather events, the results could be disastrous. Researchers do not have enough information to say whether the models are hallucinating, said Hill. Most current models sometimes produce unrealistic results, but it is possible to create models that do not, Durran said. He said a model he and his colleagues developed can simulate weather patterns for 100 years into the future-assuming current climatic conditions hold-without hallucinating [20]. All the weather conditions the model predicts are "similar to what we see in the range of weather patterns today," he said. Another concern is whether models trained with historical weather data will be able to make accurate predictions as the climate changes [21]. However, feeding the models recent data may overcome this problem, according to some researchers [3].
Ganguly said that a key issue that will help determine whether AI models gain wider acceptance is how valuable their predictions are for users of weather information. Operators of hydroelectric dams, for example, need accurate forecasts to prepare for flooding or other weather-related threats, he said. If an AI system can provide better information and improve operators’ ability to make decisions, they will be more likely to use it.
Some experts have suggested that AI could even replace human forecasters [7], an outcome that other experts consider unlikely. To make their forecasts, humans typically weigh results from multiple models and then incorporate their knowledge of local weather patterns. AI cannot match the combination of judgment and knowledge, Hill said. "That experience cannot be replicated," he said. At least for now.

References

[1]

M. Leslie. Artificial intelligence could revolutionize science—if we can trust It. Engineering, 35 (2024), pp. 4-6.

[2]

P. Voosen. AI is set to revolutionize weather forecasts. Science, 382 (6672) (2023), pp. 748-749.

[3]

R. Lam, A. Sanchez-Gonzalez, M. Willson, P. Wirnsberger, M. Fortunato, F. Alet, et al. Learning skillful medium-range global weather forecasting. Science, 382 (6677) (2023), pp. 1416-1421.

[4]

Hekkilä M. New AI systems could speed up our ability to create weather forecasts [Internet]. Cambridge: MIT Technology Review; 2023 Jul 5 [cited 2023 Apr 30]. Available from: https://www.technologyreview.com/2023/07/05/1075897/new-ai-systems-could-speed-up-our-ability-to-create-weather-forecasts/.

[5]

About Google nowcast [Internet]. Mountain View: Google; [cited 2024 Apr 30]. Available from: https://support.google.com/websearch/answer/13692898?hl=en.

[6]

The AIFS Team. ECMWF unveils alpha version of new ML model [Internet]. Reading: European Centre for Medium-Range Weather Forecasts; 2023 Oct 13 [cited 2024 Apr 30]. Available from: https://www.ecmwf.int/en/about/media-centre/aifs-blog/2023/ECMWF-unveils-alpha-version-of-new-ML-model.

[7]

Leffer L. AI weather forecasting can’t replace humans—yet [Internet]. New York City:Scientific American; 2024 Jan 9 [cited 2024 April 30]. Available from: https://www.scientificamerican.com/article/ai-weather-forecasting-cant-replace-humans-yet/.

[8]

Durbin S. What are weather models, exactly, and how do they work? [Internet]. Washington, DC: The Washington Post; 2018 May 18 [cited 2024 Apr 30]. Available from: https://www.washingtonpost.com/news/capital-weather-gang/wp/2018/05/18/what-exactly-are-weather-models-and-how-do-they-work/.

[9]

Klesman A. How weather forecasts are made [Internet]. New York City:Discover; 2019 Aug 13 [cited 2024 Apr 30]. Available from: https://www.discovermagazine.com/planet-earth/how-weather-forecasts-are-made.

[10]

Fact sheet: Earth system modeling at ECMWF [Internet]. Reading: European Centre for Medium-Range Weather Forecasts; 2021 Mar 8 [cited 2024 Apr 30]. Available from: https://www.ecmwf.int/en/about/media-centre/focus/2021/fact-sheet-earth-system-modelling-ecmwf.

[11]

Global numerical modelling at the heart of ECMWF’s forecasts [Internet]. Reading: European Centre for Medium-Range Weather Forecasts; 2022 Apr 7 [cited 2024 Apr 30]. Available from: https://www.ecmwf.int/en/about/media-centre/focus/2022/global-numerical-modelling-heart-ecmwfs-forecasts.

[12]

The High-Resolution Rapid Refresh (HRRR) [Internet]. Washington, DC: National Oceanic and Atmospheric Administration; 2023 Mar 8 [cited 2024 Apr 30]. Available from: https://rapidrefresh.noaa.gov/hrrr/.

[13]

Supercomputer facility [Internet]. Reading: European Centre for Medium-Range Weather Forecasts; [cited 2024 Apr 30]. Available from: https://www.ecmwf.int/en/computing/our-facilities/supercomputer-facility.

[14]

Godwin C. Met Office and Microsoft to build climate supercomputer [Internet]. London: BBC; 2021 Apr 22 [cited 2024 Apr 30]. Available from: com/news/technology-56840169.

[15]

Medium-range forecasts [Internet]. Reading: European Centre for Medium-Range Weather Forecasts; [cited 2024 Apr 30]. Available from: https://www.ecmwf.int/en/forecasts/documentation-and-support/medium-range-forecasts.

[16]

Schumacher R, Hill A. AI and machine learning are improving weather forecasts, but they won’t replace human experts [Internet]. Melbourne: The Conversation; 2022 May 26 [cited 2024 Apr 30]. Available from: https://theconversation.com/ai-and-machine-learning-are-improving-weather-forecasts-but-they-wont-replace-human-experts-182498.

[17]

K. Bi, L. Xie, H. Zhang, X. Chen, X. Gu, Q. Tian. Accurate medium-range global weather forecasting with 3D neural networks. Nature, 619 (7970) (2023), pp. 533-538.

[18]

A.J. Charlton-Perez, H.F. Dacre, S. Driscoll, S.L. Gray, B. Harvey, N.J. Harvey, et al. Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciarán. NPJ Clim Atmos Sci, 7 (1) (2024), p. 93.

[19]

Lacy L. Hallucinations: why AI makes stuff up, and what’s being done about it [Internet]. San Francisco: CNET; 2024 Apr 1 [cited 2024 May 10]. Available from: https://www.cnet.com/tech/hallucinations-why-ai-makes-stuff-up-and-whats-being-done-about-it/.

[20]

Karlbauer M, Cresswell-Clay N, Durran DR, Moreno RA, Kurth T, Bonev B, et al. Advancing parsimonious deep learning weather prediction using the HEALPix mesh. ESS Open Archive. 2023 Sep 30.

[21]

Harvey C. Climate change could stump AI weather prediction [Internet]. New York City:Scientific American; 2023 Jul 12 [cited 2024 May 10]. Available from: https://www.scientificamerican.com/article/climate-change-could-stump-ai-weather-prediction/.

RIGHTS & PERMISSIONS

THE AUTHOR

PDF (471KB)

9512

Accesses

0

Citation

Detail

Sections
Recommended

/