Foundation Models for the Process Industry: Challenges and Opportunities

Lei Ren; Haiteng Wang; Yuqing Wang; Keke Huang; Lihui Wang; Bohu Li

doi:10.1016/j.eng.2025.03.023

Engineering ›› 2025, Vol. 52 ›› Issue (9) :53 -59. DOI: 10.1016/j.eng.2025.03.023

Research

Perspective

Foundation Models for the Process Industry: Challenges and Opportunities

Author information +

History +

PDF (1416KB)

Abstract

With the emergence of general foundational models, such as Chat Generative Pre-trained Transformer (ChatGPT), researchers have shown considerable interest in the potential applications of foundation models in the process industry. This paper provides a comprehensive overview of the challenges and opportunities presented by the use of foundation models in the process industry, including the frameworks, core applications, and future prospects. First, this paper proposes a framework for foundation models for the process industry. Second, it summarizes the key capabilities of industrial foundation models and their practical applications. Finally, it highlights future research directions and identifies unresolved open issues related to the use of foundation models in the process industry.

Cite this article

Download citation ▾

Lei Ren, Haiteng Wang, Yuqing Wang, Keke Huang, Lihui Wang, Bohu Li. Foundation Models for the Process Industry: Challenges and Opportunities. Engineering, 2025, 52(9): 53-59 DOI:10.1016/j.eng.2025.03.023

登录浏览全文

4963

注册一个新账户忘记密码

References

Publishing order | Descend order by publishing year | Descend order by cited within

[1]	Qian F, Zhong W, Du W. Fundamental theories and key technologies for smart and optimal manufacturing in process industry. Engineering 2017; 3 (2):154-60.

[2]	Yang T, Yi X, Lu S, Johansson KH, Chai T. Intelligent manufacturing for process industry driven by industrial artificial intelligence. Engineering 2021; 7 (9):1224-30.

[3]	Qian F. The future of smart process manufacturing. Engineering 2023; 22:20-2.

[4]	Achiam J, Adler S, Agarwal S, Ahmad L, Akkaya I, Aleman FL, et al.; OpenAI. GPT-4 technical report. 2023. arXiv:2303.08774.

[5]	Wu T, He S, Liu J, Sun S, Liu K, Han QL, et al. A brief overview of ChatGPT: the history, status quo and potential future development. IEEE/CAA J Automatica Sin 2023; 10(5):1122-36.

[6]	Rombach R, Blattmann A, Lorenz D, Esser P, Ommer B. High-resolution image synthesis with latent diffusion models. In:Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition;2022 June 19-24;New Orleans, LA, USA. Piscataway: IEEE; 2022. p. 10684-95.

[7]	Yang R, Srivastava P, Mandt S. Diffusion probabilistic modeling for video generation. Entropy 2023; 25(10):1469.

[8]

Guha N, Nyarko J, Ho DE, Ré C, Chilton A, Narayana A, et al. LegalBench:a collaboratively built benchmark for measuring legal reasoning in large language models. In: Oh A, Naumann T, Globerson A, Saenko K, Hardt M, Levine S, editors. Advances in neural information processing systems 36; 2023 Dec 10-16; New Orleans, LA, USA. NY: Curran Associates; 2023. p. 44123-279.

[9]	Moor M, Banerjee O, Abad ZSH, Krumholz HM, Leskovec J, Topol EJ, et al. Foundation models for generalist medical artificial intelligence. Nature 2023; 616(7956):259-65.

[10]	Tsai ML, Ong CW, Chen CL. Exploring the use of large language models (LLMs) in chemical engineering education: building core course problem models with Chat-GPT. Educ Chem Engineers 2023; 44:71-95.

[11]

Fakih M, Dharmaji R, Moghaddas Y, Araya GQ, Ogundare O, Faruque MA. LLM4PLC:harnessing large language models for verifiable programming of PLCs in industrial control systems. In:Proceedings of the 46th International Conference on Software Engineering: Software Engineering in Practice;2024 Apr 14-20; Lisbon, Portugal. New York: Association for Computing Machinery; 2024. p. 192-203.

[12]	figure.ai [Internet]. Sunnyvale: Figure AI, Inc.; c2024 [cited 2024 Aug 01]. Available from: https://www.figure.ai

[13]	Ren L, Wang H, Dong J, Jia Z, Li S, Wang Y, et al. Industrial foundation model: architecture, key technologies, and typical applications. Sci Sin Inform 2024; 54 (11):2606-22.

[14]	Ren L, Wang H, Dong J, Jia Z, Li S, Wang Y, et al. Industrial foundation model. IEEE Trans Cybern 2025. In press.

[15]	Zhang Y, Tang Q, Zhang Y, Wang J, Stimming U, Lee AA. Identifying degradation patterns of lithium ion batteries from impedance spectroscopy using machine learning. Nat Commun 2020; 11(1):1706.

[16]	Singh AK, Swarup A, Agarwal A, Singh D. Vision based rail track extraction and monitoring through drone imagery. ICT Exp 2019; 5(4):250-5.

[17]	Koch S, Matveev A, Jiang Z, Williams F, Artemov A, Burnaev E, et al. ABC:a big CAD model dataset for geometric deep learning. In:Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2019 Jun 15-20;Long Beach, CA, USA. Piscataway: IEEE; 2023. p. 9601-11.

[18]	Ren L, Wang H, Laili Y. Diff-MTS: temporal-augmented conditional diffusionbased AIGC for industrial time series toward the large model era. IEEE Trans Cybern 2024; 54(12):7187-97.

[19]	Bugliarello E, Cotterell R, Okazaki N, Elliott D. Multimodal pretraining unmasked: a meta-analysis and a unified framework of vision-and-language BERTs. Trans Assoc Comput Linguist 2021; 9:978-94.

[20]	Xiong J, Fink O, Zhou J, Ma Y. Controlled physics-informed data generation for deep learning-based remaining useful life prediction under unseen operation conditions. Mech Syst Signal Process 2023; 197:110359.

[21]	Liu P, Yuan W, Fu J, Jiang Z, Hayashi H, Neubig G. Pre-train,prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Comput Surv 2023; 55(9):1-35.

[22]	Xu W, Wang Y, Zhang D, Yang Z, Yuan Z, Lin Y, et al. Transparent AI-assisted chemical engineering process: machine learning modeling and multi-objective optimization for integrating process data and molecular-level reaction mechanisms. J Clean Prod 2024; 448:141412.

[23]	Wu Z, Liang C. A review and prospects of manufacturing process knowledge acquisition, representation, and application. Machines 2024; 12 (6):416.

[24]	Ren L, Dong J, Liu S, Zhang L, Wang L. Embodied intelligence toward future smart manufacturing in the era of AI foundation model. IEEE/ASME Trans Mechatron. In press.

[25]	Ren L, Jia Z, Laili Y, Huang D. Deep learning for time-series prediction in IIoT: progress, challenges, and prospects. IEEE Trans Neural Netw Learn Syst 2024; 35(11):15072-91. https://doi.org/10.1109/TNNLS.2023.3291371.

[26]	Ren L, Wang H, Mo T, Yang LT. A lightweight group transformer-based time series reduction network for edge intelligence and its application in industrial RUL prediction. IEEE Trans Neural Netw Learn Syst 2024; 36 (2):3720-4379.

[27]	Yang C, Wang Y, Lan S, Wang L, Shen W, Huang GQ. Cloud-edgedevice collaboration mechanisms of deep learning models for smart robots in mass personalization. Robot Comput-Integr Manuf 2022; 77:102351.