Data Driven Comprehensive Performance Evaluation of Aeroengines: A Network Dynamic Approach

Yuting Wang; Feng Liu; Feng Xi; Bofei Wei; Dongli Duan; Zhiqiang Cai; Shubin Si

doi:10.1016/j.eng.2024.11.024

PDF(4201 KB)

Engineering ›› 2025, Vol. 46 ›› Issue (3) : 292-305. DOI: 10.1016/j.eng.2024.11.024

Research

Article

Data Driven Comprehensive Performance Evaluation of Aeroengines: A Network Dynamic Approach

Yuting Wang^a^,^b ,
Feng Liu^c ,
Feng Xi^c ,
Bofei Wei^c ,
Dongli Duan^d ,
Zhiqiang Cai^a^,^b ,
Shubin Si^a^,^b^,^*

Author information +

History +

Abstract

Aeroengines, often regarded as the heart of aircraft, are crucial for flight safety and performance. Comprehensive performance evaluation of aeroengines supports Prognostics and Health Management (PHM) and aeroengine digital engineering. Due to their highly integrated nature, aeroengines present challenges in performance evaluation because their test-run data are high-dimensional, large-scale, and exhibit strong nonlinear correlations among test indicators. To solve this problem, this study proposes a unified framework of the comprehensive performance evaluation of aeroengines to assess performance objectively and globally. Specifically, the network model and the dynamics model of aeroengine performance are constructed driven by test-run data, which can explain the patterns of system state changes and the internal relationship, and depict the system accurately. Based on that, three perturbations in the model are used to simulate three fault modes of aeroengines. Moreover, the comprehensive performance evaluation indexes of aeroengines are proposed to evaluate the performance dynamically from two dimensions, the coupling performance and the activity performance. Thirteen test-run qualified and four test-run failed aeroengines are used to validate and establish the qualified ranges. The results demonstrate that the comprehensive evaluation indexes can distinguish test-run qualified and test-run failed aeroengines. By changing the dynamic parameters, the comprehensive performance under any thrust and inlet guide vanes (IGV) angle can be estimated, broadening the test-run scenarios beyond a few typical states. This novel approach offers significant advancements for the comprehensive performance evaluation and management of aeroengines, paving the way for future PHM and aeroengine digital engineering developments.

Graphical abstract

Keywords

Comprehensive performance evaluation / Aeroengine performance / Network / Resilience

Cite this article

EndNote

Ris (Procite)

Bibtex

Download citation ▾

Yuting Wang, Feng Liu, Feng Xi, Bofei Wei, Dongli Duan, Zhiqiang Cai, Shubin Si. Data Driven Comprehensive Performance Evaluation of Aeroengines: A Network Dynamic Approach. Engineering, 2025, 46(3): 292‒305 https://doi.org/10.1016/j.eng.2024.11.024

References

Publishing order | Descend order by publishing year | Descend order by cited within

[1]	Zuo H.Engine wear condition monitoring and fault diagnosis technology. Aviation Industry Press, Beijing (1996)

[2]	Krejsa T, Němec V, Hrdinová L.Causes of aviation accidents and incidents especially with engine failure.In: Proceedings of the 2018 International Conference; 2018 Oct 3–10; Trakai, Lithuania. Kaunas: Kaunas University of Technology; 2018.

[3]	Alford LD.The problem with aviation COTS.IEEE Aerosp Electron Syst Mag 2001; 16(2):33-37.

[4]	Chen L, Zhou Z, Han X, Zhang C, Ning P.A robust performance evaluation method based on interval evidential reasoning approach under uncertainty.ISA Trans 2023; 139:448-462.

[5]	Huang W, Li F, Qi H.Preliminary investigation and thoughts on aero-engine digital engineering development.Acta Aeronaut Astronaut Sin 2024; 45(5):529693.

[6]

Jaw

.Recent advancements in aircraft engine health management (EHM) technologies and recommendations for the next step.In: Proceedings of GT2005 ASME Turbo Expo 2005: Power for Land, Sea and Air; 2005 Jun 6–9; Reno, NV, USA. New York City: The American Society of Mechanical Engineers (ASME); 2005.

[7]	Saaty TL, Tran LT.On the invalidity of fuzzifying numerical judgments in the Analytic Hierarchy Process.Math Comput Model 2007; 46(7–8):962-975.

[8]	Yang JB, Sen P.A general multi-level evaluation process for hybrid MADM with uncertainty.IEEE Trans Syst Man Cybern Syst 1994; 24(10):1458-1473.

[9]	Yang JB, Xu DL.Evidential reasoning rule for evidence combination.Artif Intell 2013; 205:1-29.

[10]	Hsu CC.Evaluation criteria for blog design and analysis of causal relationships using factor analysis and DEMATEL.Expert Syst Appl 2012; 39(1):187-193.

[11]	Du RY, Kamakura WA.Improving the statistical performance of tracking studies based on repeated cross-sections with primary dynamic factor analysis.Int J Res Mark 2015; 32(1):94-112.

[12]	Charnes A, Cooper WW, Rhodes E.Evaluating program and managerial efficiency: an application of data envelopment analysis to program follow through.Manage Sci 1981; 27(6):668-697.

[13]	Berger J, Harbring C, Sliwka D.Performance appraisals and the impact of forced distribution—an experimental investigation.Manage Sci 2013; 59(1):54-68.

[14]	Atici KB, Podinovski VV.Using data envelopment analysis for the assessment of technical efficiency of units with difference specialization: an application to agriculture.Omega 2015; 54:72-83.

[15]	Shyur HJ.COTS evaluation using modified TOPSIS and ANP.Appl Math Comput 2006; 177(1):251-259.

[16]	Gumus AT.Evaluation of hazardous waste transportation firms by using a two step fuzzy-AHP and TOPSIS methodology.Expert Syst Appl 2009; 36(2):4067-4074.

[17]	Torfi F, Farahani RZ, Rezapour S.Fuzzy AHP to determine the relative weights of evaluation criteria and fuzzy TOPSIS to rank the alternatives.Appl Soft Comput 2010; 10(2):520-528.

[18]	Applebaum E.Fuzzy classification for fault isolation in gas turbine engines.In: Proceedings of the 9th IFSA World Congress and 20th NAFIPS International Conference; 2001 Jul 25–28; Vancouver, BC, Canada. New York City: IEEE; 2002.

[19]	Hou S, Hu J, Li Y.Aeroengine performance monitoring and fault diagnosis based on chaos variable.J Aerosp Power 2005; 20(2):314-317.

[20]	Demirci S, Hajiyev C, Schwenke A.Fuzzy logic-based automated engine health monitoring for commercial aircraft.Aircr Eng Aerosp Technol 2008; 80(5):516-525.

[21]	Wang J, Fan K, Wang W.Integration of fuzzy AHP and FPP with TOPSIS methodology for aeroengine health assessment.Expert Syst Appl 2010; 37(12):8516-8526.

[22]	Huang CG, Huang HZ, Peng W, Huang T.Improved trajectory similarity-based approach for turbofan engine prognostics.J Mech Sci Technol 2019; 33(10):4877-4890.

[23]	Cai H, Jia X, Feng J, Li W, Pahren L, Lee J.A similarity-based methodology for machine prognostics by using kernel two-sample test.ISA Trans 2020; 103:112-121.

[24]	Li YG.Performance-analysis-based gas turbine diagnostics: a review.Proc Inst Mech Eng, A J Power Energy 2002; 216(5):363-377.

[25]	Marinai L, Probert D, Singh R.Prospects for aero gas-turbine diagnostics: a review.Appl Energy 2004; 79(1):109-126.

[26]	Bettocchi R, Pinelli M, Spina PR, Venturini M.Artificial intelligence for the diagnostics of gas turbines—part I: neural network approach.J Eng Gas Turbine Power 2007; 129(3):711-719.

[27]	Bettocchi R, Pinelli M, Spina PR, Venturini M.Artificial intelligence for the diagnostics of gas turbines—part II: neuro-fuzzy approach.J Eng Gas Turbine Power 2007; 129(3):720-729.

[28]	Zhou D, Zhang H, Weng S.A new gas path fault diagnostic method of gas turbine based on Support Vector Machine.J Eng Gas Turbine Power 2015; 137(10):102605.

[29]	Ma N, Yang F, Tao L, Suo M.State-of-health assessment for aero-engine based on density-distance clustering and fuzzy Bayesian risk.IEEE Access 2021; 9:9996-10011.

[30]	Xiang S, Qin Y, Luo J, Pu H, Tang B.Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction.Reliab Eng Syst Saf 2021; 216:107927.

[31]	De Pater I, Mitici M.Developing health indicators and RUL prognostics for systems with few failure instances and varying operating conditions using an LSTM autoencoder.Eng Appl Artif Intell 2023; 117:105582.

[32]	Pan WH, Feng YW, Lu C, Liu JQ.Analyzing the operation reliability of aeroengine using Quick Access Recorder flight data.Reliab Eng Syst Saf 2023; 235:109193.

[33]	Urban LA.Gas turbine engine parameter interrelationships.Los Angeles: Hamilton Standard Division of United Aircraft Corporation; 1969.

[34]

Niedler

, Fiedler

.The influence of serial performance deviation of military jet engines on the diagnostic quality of the Gas Path Analysis.In: Proceedings of the 14th International Symposium on Air Breathing Engines; 1999 Sept 5–10; Florence, Italy. Washington, DC: National Aeronautics and Space Administration; 1999.

[35]	Simani S, Patton RJ, Daley S, Pike A.Identification and fault diagnosis of an industrial gas turbine prototype model.In: Proceedings of the 39th IEEE Conference on Decision and Control; 2000 Dec 12–15; Sydney, Australia. New York City: IEEE; 2002.

[36]

Escher

, Singh

.An object-oriented diagnostics computer program suitable for industrial gas turbines.In: Proceedings of the 21st (CIMAC) International Congress on Combustion Engines; 1998 May 18–21; Copenhagen, Denmark. Washington, DC: US Department of Energy Office of Scientific and Technical Information; 1998.

[37]	Li J, Ying Y.Gas turbine gas path diagnosis under transient operating conditions: a steady state performance model based local optimization approach.Appl Therm Eng 2020; 170:115025.

[38]	Erdös P, Rényi A.On the evolution of random graphs. Publications of the Mathematical Institute of the Hungarian Academy of Sciences, Hungary (1960)

[39]	Milgram S.The small world problem.Psychol Today 1967; 2(1):60-67.

[40]	Gao J, Barzel B, Barabási AL.Universal resilience patterns in complex networks.Nature 2016; 530(7590):307-312.

[41]	Bhamra R, Dani S, Burnard K.Resilience: the concept, a literature review and future directions.Int J Prod Res 2011; 49(18):5375-5393.

[42]	Fraccascia L, Giannoccaro I, Albino V.Resilience of complex systems: state of the art and directions for future research.Complexity 2018; 2018(1):3421529.

[43]	Noy-Meir I.Stability of grazing systems: an application of predator–prey graphs.J Ecol 1975; 53(2):459-481.

[44]	Scheffer M, Carpenter S, Foley JA, Folke C, Walker B.Catastrophic shifts in ecosystems.Nature 2001; 413(6856):591-596.

[45]	Dai L, Korolev KS, Gore J.Slower recovery in space before collapse of connected populations.Nature 2013; 496(7445):355-358.

[46]	Barabási AL, Albert R.Emergence of scaling in random networks.Science 1999; 286(5439):509-512.

[47]	Strogatz SH.Exploring complex networks.Nature 2001; 410(6825):268-276.

[48]	Wang WX, Lai YC, Grebogi C.Data based identification and prediction of nonlinear and complex dynamical systems.Phys Rep 2016; 644:1-76.

[49]	Wang WX, Yang R, Lai YC, Kovanis V, Grebogi C.Predicting catastrophes in nonlinear dynamical systems by compressive sensing.Phys Rev Lett 2011; 106(15):154101.

[50]	Yang R, Lai YC, Grebogi C.Forecasting the future: is it possible for adiabatically time-varying nonlinear dynamical systems?.Chaos 2012; 22(3):033119.

[51]	Tu C, Grilli J, Schuessler F, Suweis S.Collapse of resilience patterns in generalized Lotka–Volterra dynamics and beyond.Phys Rev E 2017; 95(6):062307.

[52]	Hou G, Chen Y, Liu X, Zhang D, Geng Z, Si S.A resilience approach for diagnosing and predicting HBV-related diseases based on blood tests.Engineering 2024; 32:174-185.

[53]	Si S, Lv C, Cai Z, Duan D, Kurths J, Wang Z.Fractional core-based collapse mechanism and structural optimization in complex systems.Sci China Inf Sci 2023; 66(9):192202.

[54]	Guo Z, Zhang Y, Liu S, Wang XV, Wang L.Exploring self-organization and self-adaption for smart manufacturing complex networks.Front Eng Manag 2023; 10(2):206-222.

[55]	Gómez-Gardeñes J, Moreno Y, Floría LM.Michaelis-Menten dynamics in complex heterogeneous networks.Physica A 2005; 352(2–4):265-281.

[56]	Barzel B, Barabási AL.Universality in network dynamics.Nat Phys 2013; 9(10):673-681.

[57]	Wu J, Barahona M, Tan YJ, Deng HZ.Natural connectivity of complex networks.Chin Phys Lett 2010; 27(7):078902.

[58]	Xiao D, Xiao H, Li R, Wang Z.Application of physical-structure-driven deep learning and compensation methods in aircraft engine health management.Eng Appl Artif Intell 2024; 136:109024.

[59]	Loboda I, González Castillo I, Yepifanov S, Zelenskyi R.Nonlinear surrogate models for gas turbine diagnosis.In: Proceedings of ASME Turbo Expo 2022: Power for Land, Sea and Air; 2022 Jun 13–17; Rotterdam, Netherlands. New York City: The American Society of Mechanical Engineers (ASME); 2022.

[60]	Ullah S, Li S, Khan K, Khan S, Khan I, Eldin SM.An investigation of exhaust gas temperature of aircraft engine using LSTM.IEEE Access 2023; 11:5168-5177.

[61]	Lu F, Wu J, Huang J, Qiu X, Wang Z.Novel extreme learning machine using Kalman filter for performance prediction of aircraft engine in dynamic behavior.J Aerosp Eng 2020; 33(5):04020053.