2021, Volume 7, Issue 6
Engineering >> 2021, Volume 7, Issue 6 doi: 10.1016/j.eng.2020.08.026
Automatic Visual Leakage Detection and Localization from Pipelines in Chemical Process Plants Using Machine Vision Techniques
a Institute of Automation and Information Systems, Technical University of Munich, Garching 85748, Germany
b Evonik Technology and Infrastructure GmbH, Hanau 63450, Germany
Next Previous
Abstract
Liquid leakage from pipelines is a critical issue in large-scale process plants. Damage in pipelines affects the normal operation of the plant and increases maintenance costs. Furthermore, it causes unsafe and hazardous situations for operators. Therefore, the detection and localization of leakages is a crucial task for maintenance and condition monitoring. Recently, the use of infrared (IR) cameras was found to be a promising approach for leakage detection in large-scale plants. IR cameras can capture leaking liquid if it has a higher (or lower) temperature than its surroundings. In this paper, a method based on IR video data and machine vision techniques is proposed to detect and localize liquid leakages in a chemical process plant. Since the proposed method is a vision-based method and does not consider the physical properties of the leaking liquid, it is applicable for any type of liquid leakage (i.e., water, oil, etc.). In this method, subsequent frames are subtracted and divided into blocks. Then, principle component analysis is performed in each block to extract features from the blocks. All subtracted frames within the blocks are individually transferred to feature vectors, which are used as a basis for classifying the blocks. The k-nearest neighbor algorithm is used to classify the blocks as normal (without leakage) or anomalous (with leakage). Finally, the positions of the leakages are determined in each anomalous block. In order to evaluate the approach, two datasets with two different formats, consisting of video footage of a laboratory demonstrator plant captured by an IR camera, are considered. The results show that the proposed method is a promising approach to detect and localize leakages from pipelines using IR videos. The proposed method has high accuracy and a reasonable detection time for leakage detection. The possibility of extending the proposed method to a real industrial plant and the limitations of this method are discussed at the end.
Keywords
Leakage detection and localization ; Image analysis ; Image pre-processing ; Principle component analysis ; k-nearest neighbor classification
Figures
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
References
[ 1 ] Patterson LA, Konschnik KE, Wiseman H, Fargione J, Maloney KO, Kiesecker J, et al. Unconventional oil and gas spills: risks, mitigation priorities, and state reporting requirements. Environ Sci Technol 2017;51(5):2563–73. link1
[ 2 ] Si H, Ji H, Zeng X. Quantitative risk assessment model of hazardous chemicals leakage and application. Saf Sci 2012;50(7):1452–61. link1
[ 3 ] Scott SL, Barrufet MA. Worldwide assessment of industry leak detection capabilities for single and multiphase pipelines. Report. College Station: Offshore Technology Research Center; 2003. link1
[ 4 ] Chen X, Wu Z, Chen W, Kang R, Wang S, Sang H, et al. A methodology for overall consequence assessment in oil and gas pipeline industry. Process Saf Prog 2019;38(3):e12050. link1
[ 5 ] Barz T, Bonow G, Hegenberg J, Habib K, Gramar L, Welle J, et al. Unmanned inspection of large industrial environments. In: Aschenbruck N, Martini P, Meier M, Tölle J, editors. Future security. Heidelberg: Springer; 2012. link1
[ 6 ] Datta S, Sarkar S. A review on different pipeline fault detection methods. J Loss Prev Process Ind 2016;41:97–106. link1
[ 7 ] Sun L, Chang N. Integrated-signal-based leak location method for liquid pipelines. J Loss Prev Process Ind 2014;32:311–8. link1
[ 8 ] Aamo OM. Leak detection, size estimation and localization in pipe flows. IEEE Trans Autom Control 2016;61(1):246–51. link1
[ 9 ] Liu C, Li Y, Xu M. An integrated detection and location model for leakages in liquid pipelines. J Pet Sci Eng 2019;175:852–67. link1
[10] Abhulimen KE, Susu AA. Liquid pipeline leak detection system: model development and numerical simulation. Chem Eng J 2004;97(1):47–67. link1
[11] Verde C. Accommodation of multi-leak location in a pipeline. Control Eng Pract 2005;13(8):1071–8. link1
[12] Magnis L, Petit N. Impact of measurement dating inaccuracies in the monitoring of bulk flows. Adv Electr Electron Eng 2015;13(1):30–8. link1
[13] Leo Kumar SP. State of the art-intense review on artificial intelligence systems application in process planning and manufacturing. Eng Appl Artif Intell 2017;65:294–329. link1
[14] Golnabi H, Asadpour A. Design and application of industrial machine vision systems. Robot Comput Integr Manuf 2007;23(6):630–7. link1
[15] Kurada S, Bradley C. A review of machine vision sensors for tool condition monitoring. Comput Ind 1997;34(1):55–72. link1
[16] Li R, Huang H, Xin K, Tao T. A review of methods for burst/leakage detection and location in water distribution systems. Water Sci Technol Water Supply 2015;15(3):429–41. link1
[17] Zhu P, Wen L, Bian X, Ling H, Hu Q. Vision meets drones: a challenge. 2018. arXiv:1804.07437.
[18] Nouacer R, Espinoza H, Ouhammou Y, Castineira Gonzalez R. Framework of key enabling technologies for safe and autonomous drones’ applications. In: Proceedings of the 22nd Euromicro Conference on Digital System Design; 2019 Aug 28–30; Kallithea, Greece; 2019. p. 420–27.
[19] Lamb T. Developing a safety culture for remotely piloted aircraft systems operations: to boldly go where no drone has gone before. In: Proceedings of SPE Health, Safety, Security, Environment, & Social Responsibility Conference— North America; 2017 Apr 18–20; New Orleans, LA, USA; 2017.
[20] Vollmer M, Möllmann KP. Infrared thermal imaging: fundamentals, research and applications. Weinheim: Wiley-VCH; 2018. link1
[21] Nof SY. Springer handbook of automation. Heidelberg: Springer-Verlag, Berlin Heidelberg; 2009. link1
[22] Yin S, Li X, Gao H, Kaynak O. Data-based techniques focused on modern industry: an overview. IEEE Trans Ind Electron 2015;62(1):657–67. link1
[23] Ostapkowicz P. Leak detection in liquid transmission pipelines using simplified pressure analysis techniques employing a minimum of standard and non-standard measuring devices. Eng Struct 2016;113:194–205. link1
[24] He G, Liang Y, Li Y, Wu M, Sun L, Xie C, et al. A method for simulating the entire leaking process and calculating the liquid leakage volume of a damaged pressurized pipeline. J Hazard Mater 2017;332:19–32. link1
[25] Rubinstein A, inventor; Hamut—Mechanics and Technology Compny Ltd., assignee. Fluid leakage detection system. United States patent US9939345B2. 2018 Apr 10.
[26] Ozevin D. Geometry-based spatial acoustic source location for spaced structures. Struct Health Monit 2011;10(5):503–10. link1
[27] Ozevin D, Harding J. Novel leak localization in pressurized pipeline networks using acoustic emission and geometric connectivity. Int J Press Vessel Pip 2012;92:63–9. link1
[28] Zhang H, Liang Y, Zhang W, Xu N, Guo Z, Wu G. Improved PSO-based method for leak detection and localization in liquid pipelines. IEEE Trans Ind Inform 2018;14(7):3143–54. link1
[29] Delgado-Aguiñaga JA, Besançon G, Begovich O, Carvajal JE. Multi-leak diagnosis in pipelines based on extended Kalman filter. Control Eng Pract 2016;49:139–48. link1
[30] Qu Z, Feng H, Zeng Z, Zhuge J, Jin S. A SVM-based pipeline leakage detection and pre-warning system. Measurement 2010;43(4):513–9. link1
[31] Da Silva HV, Morooka CK, Guilherme IR, da Fonseca TC, Mendes JRP. Leak detection in petroleum pipelines using a fuzzy system. J Pet Sci Eng 2005;49 (3–4):223–38. link1
[32] Wachla D, Przystalka P, Moczulski W. A method of leakage location in water distribution networks using artificial neuro-fuzzy system. IFAC-PapersOnLine 2015;48(21):1216–23. link1
[33] Nellis MD. Application of thermal infrared imagery to canal leakage detection. Remote Sense Environ 1982;12(3):229–34. link1
[34] Adefila K, Yan Y, Wang T. Leakage detection of gaseous CO2 through thermal imaging. In: Proceedings of IEEE International Instrumentation andMeasurement Technology Conference; 2015 May 11–14; Pisa, Italy; 2015. p. 261–65.
[35] Atef A, Zayed T, Hawari A, Khader M, Moselhi O. Multi-tier method using infrared photography and GPR to detect and locate water leaks. Autom Constr 2016;61:162–70. link1
[36] Dai D, Wang X, Zhang Y, Zhao L, Li J. Leakage region detection of gas insulated equipment by applying infrared image processing technique. In: Proceedings of the 9th International Conference on Measuring Technology and Mechatronics Automation; 2017 Jan 14–15; Changsha, China; 2017. p. 94–8.
[37] Kroll A, Baetz W, Peretzki D. On autonomous detection of pressured air and gas leaks using passive IR-thermography for mobile robot application. In: Proceedings of 2009 IEEE International Conference on Robotics and Automation; 2009 May 12–17; Kobe, Japan; 2009. p. 921–26.
[38] Wang J, Tchapmi LP, Ravikumar AP, McGuire M, Bell CS, Zimmerle D, et al. Machine vision for natural gas methane emissions detection using an infrared camera. Appl Energy 2020;257:113998. link1
[39] Araujo MS, Blaisdell SG, Davila DS, Dupont EM, Baldor SA, Siebenaler SP, inventors; Southwest Research Institute, assignee. Detection of hazardous leaks from pipelines using optical imaging and neural network. United States patent US20180341859. 2020 May 19.
[40] Fahimipirehgalin M, Trunzer E, Odenweller M, Vogel-Heuser B. Automatic visual leakage inspection by using thermographic video and image analysis. In: Proceedings of 2019 IEEE 15th International Conference on Automation Science and Engineering; 2019 Aug 22–26; Vancouver, BC, Canada; 2019. p. 1282–8.
[41] Partridge M, Calvo RA. Fast dimensionality reduction and simple PCA. Intell Data Anal 1998;2(1–4):203–14. link1
[42] Qiu B, Prinet V, Perrier E, Monga O. Multi-block PCA method for image change detection. In: Proceedings of the 12th International Conference on Image Analysis and Processing; 2003 Sep 17–19; Mantova, Italy; 2003. p. 385–90.
[43] Cunningham P, Delany SJ. k-nearest neighbour classifiers. Mult Classif Syst 2020. arXiv:2004.04523.
[44] Golub GH, Van Loan CF. Matrix computations. 4th ed. Baltimore: The Johns Hopkins University Press; 2013. link1
[45] Ravikumar AP, Sreedhara S, Wang J, Englander J, Roda-Stuart D, Bell C, et al. Single-blind inter-comparison of methane detection technologies—results from the Stanford/EDF mobile monitoring challenge. Elementa 2019;7:37. link1
京公网安备 11010502051620号
