Journal Home Online First Current Issue Archive For Authors Journal Information 中文版

Engineering >> 2021, Volume 7, Issue 4 doi: 10.1016/j.eng.2020.08.024

Characterizing Flight Delay Profiles with a Tensor Factorization Framework

a School of Electronic and Information Engineering, Beihang University, Beijing 100191, China
b National Engineering Laboratory for Comprehensive Transportation Big Data Application Technology, Beijing 100191, China
c Department of Civil Engineering and Applied Mechanics, McGill University, Montreal, QC H3A 0C3, Canada

Received: 2020-04-10 Revised: 2020-07-21 Accepted: 2020-08-03 Available online: 2021-03-19

Next Previous

Abstract

In air traffic and airport management, experience gained from past operations is crucial in designing appropriate strategies when facing a new scenario. Therefore, this paper uses massive spatiotemporal flight data to identify similar traffic and delay patterns, which become critical for gaining a better understanding of the aviation system and relevant decision-making. However, as the datasets imply complex dependence and higher-order interactions between space and time, retrieving significant features and patterns can be very challenging. In this paper, we propose a probabilistic framework for high-dimensional historical flight data. We apply a latent class model and demonstrate the effectiveness of this framework using air traffic data from 224 airports in China during 2014–2017. We find that profiles of each dimension can be clearly divided into various patterns representing different regular operations. To prove the effectiveness of these patterns, we then create an estimation model that provides preliminary judgment on the airport delay level. The outcomes of this study can help airport operators and air traffic managers better understand air traffic and delay patterns according to the experience gained from historical scenarios.

Figures

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

References

[ 1 ] Folkes VS, Koletsky S, Graham JL. A field study of causal inferences and consumer reaction: the view from the airport. J Consum Res 1987;13 (4):534–9. link1

[ 2 ] Britto R, Dresner M, Voltes A. The impact of flight delays on passenger demand and societal welfare. Transp Res Part E Logist Trans Rev 2012;48(2):460–9. link1

[ 3 ] Ferrer JC, e Oliveira PR, Parasuraman A. The behavioral consequences of repeated flight delays. J Air Transp Manage 2012;20(3):35–8. link1

[ 4 ] Vlachos I, Lin Z. Drivers of airline loyalty: evidence from the business travelers in China. Transp Res Part E Logist Trans Rev 2014;71:1–17. link1

[ 5 ] Cook AJ, Tanner G. European airline delay cost reference values. Report. London: University of Westminster; 2011 Mar.

[ 6 ] Pejovic T, Noland RB, Williams V, Toumi R. A tentative analysis of the impacts of an airport closure. J Air Transp Manage 2009;15(5):241–8. link1

[ 7 ] Ryerson MS, Hansen M, Bonn J. Time to burn: flight delay, terminal efficiency, and fuel consumption in the National Airspace System. Transp Res Part A Policy Pract 2014;69:286–98. link1

[ 8 ] Ball M, Barnhart C, Dresner M, Hansen M, Neels K, Odoni A, et al. Total delay impact study: a comprehensive assessment of the costs and impacts of flight delay in the United States. Report. National Center of Excellence for Aviation Operations Research; 2010. link1

[ 9 ] Abdelghany KF, Shah SS, Raina S, Abdelghany AF. A model for projecting flight delays during irregular operation conditions. J Air Transp Manage 2004;10 (6):385–94. link1

[10] Robinson PJ. The influence of weather on flight operations at the Atlanta Hartsfield International Airport. Weather Forecast 1989;4(4):461–8. link1

[11] Reynolds-Feighan AJ, Button KJ. An assessment of the capacity and congestion levels at European airports. J Air Transp Manage 1999;5(3):113–34. link1

[12] Wong JT, Li SL, Gillingwater D. An optimization model for assessing flight technical delay. Transp Plann Technol 2002;25(2):121–53. link1

[13] Mueller ER, Chatterji G. Analysis of aircraft arrival and departure delay characteristics. In: Proceedings of the AIAA’s Aircraft Technology, Integration, and Operations (ATIO) 2002 Technical Forum; 2002 Oct 1–3; Los Angeles, CA, USA; 2002. link1

[14] Wu CL. Inherent delays and operational reliability of airline schedules. J Air Transp Manage 2005;11(4):273–82. link1

[15] Schaefer L, Millner D. Flight delay propagation analysis with the detailed policy assessment tool. In: Proceedings of the 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace; 2001 Oct 7–10; Tucson, AZ, USA; 2001. link1

[16] Han Y, Moutarde F. Analysis of large-scale traffic dynamics in an urban transportation network using non-negative tensor factorization. Int J Intell Transp Syst Res 2016;14:36–49. link1

[17] Gorripaty S, Liu Y, Hansen M, Pozdnukhov A. Identifying similar days for air traffic management. J Air Transp Manage 2017;65:144–55. link1

[18] Hoffman B, Krozel J, Penny S, Roy A, Roth K. A cluster analysis to classify days in the National Airspace System. In: Proceedings of the AIAA Guidance, Navigation, and Control Conference and Exhibit; 2003 Aug 11–14; Austin, TX, USA; 2003. link1

[19] Liu Y, Seelhorst M, Pozdnukhov A, Hansen M, Ball MO. Assessing terminal weather forecast similarity for strategic air traffic management. In: Proceedings of the 6th International Conference on Research in Air Transportation; 2014 May 26–30; Istanbul, Turkey; 2014.

[20] Mukherjee A, Grabbe SR, Sridhar B. Classification of days using weather impacted traffic in the National Airspace System. In: Proceedings of the 2013 Aviation Technology, Integration, and Operations Conference; 2013 Aug 12– 14; Los Angeles, CA, USA; 2013.

[21] Grabbe SR, Sridhar B, Mukherjee A. Clustering days with similar airport weather conditions. In: Proceedings of the 14th AIAA Aviation Technology, Integration, and Operations Conference; 2014 Jun 16–20; Atlanta, GA, USA; 2014.

[22] Bloem M, Bambos N. Ground delay program analytics with behavioral cloning and inverse reinforcement learning. In: Proceedings of the 14th AIAA Aviation Technology, Integration, and Operations Conference; 2014 Jun 16–20; Atlanta, GA, USA; 2014.

[23] Sternberg A, Carvalho D, Murta L, Soares J, Ogasawara E. An analysis of Brazilian flight delays based on frequent patterns. Transp Res Part E Logist Trans Rev 2016;95:282–98. link1

[24] Zhou G, Cichocki A, Zhao Q, Xie S. Efficient nonnegative tucker decompositions: algorithms and uniqueness. IEEE Trans Image Process 2015;24(12):4990–5003. link1

[25] Abdel-Aty M, Lee C, Bai Y, Li X, Michalak M. Detecting periodic patterns of arrival delay. J Air Transp Manage 2007;13(6):355–61. link1

[26] Zhou X, List GF. An information-theoretic sensor location model for traffic origin-destination demand estimation applications. Transp Sci 2010;44 (2):254–73. link1

[27] Huang J, Levinson D, Wang J, Zhou J, Wang ZJ. Tracking job and housing dynamics with smartcard data. Proc Natl Acad Sci USA 2018;115(50):12710–5. link1

[28] Du WB, Zhang MY, Zhang Y, Cao XB, Zhang J. Delay causality network in air transport systems. Transp Res Part E Logist Trans Rev 2018;118:466–76. link1

[29] Mislevy RJ. Estimating latent distributions. Psychometrika 1984;49 (3):359–81. link1

[30] Woodbury MA, Manton KG. Grade of membership analysis of depressionrelated psychiatric disorders. Sociol Methods Res 1989;18(1):126–63. link1

[31] Sun L, Axhausen KW, Lee DH, Huang X. Understanding metropolitan patterns of daily encounters. Proc Natl Acad Sci USA 2013;110(34):13774–9. link1

[32] Zhang F, Wilkie D, Zheng Y, Xie X. Sensing the pulse of urban refueling behavior. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing; 2013 Sep 8–12; Zurich, Switzerland; 2013. p. 13–22.

[33] Yuan J, Zheng Y, Xie X. Discovering regions of different functions in a city using human mobility and POIs. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2012 Aug 12–16; Beijing, China; 2012. p. 186–94.

[34] Ma X, Wu YJ, Wang Y, Chen F, Liu J. Mining smart card data for transit riders’ travel patterns. Transp Res Part C Emerg Technol 2013;36:1–12. link1

[35] Dauwels J, Aslam A, Asif MT, Zhao X, Vie NM, Cichocki A, et al. Predicting traffic speed in urban transportation subnetworks for multiple horizons. In: Proceedings of the 13th International Conference on Control Automation Robotics & Vision; 2014 Dec 10–12; Singapore; 2014. p. 547–52.

[36] Ran B, Tan H, Wu Y, Jin PJ. Tensor based missing traffic data completion with spatial–temporal correlation. Physica A Stat Mech Its Appl 2016;446:54–63. link1

[37] Asif MT, Mitrovic N, Dauwels J, Jaillet P. Matrix and tensor based methods for missing data estimation in large traffic networks. IEEE Trans Intell Transp Syst 2016;17(7):1816–25. link1

[38] Liu C, Chen X. Vessel track recovery with incomplete AIS data using tensor CANDECOM/PARAFAC decomposition. J Navig 2014;67(1):83–99. link1

[39] Gaussier E, Goutte C. Relation between PLSA and NMF and implications. In: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval; 2005 Aug 15–19; Salvador, Brazil; 2005. p. 601–2.

[40] Tucker LR. Implications of factor analysis of three-way matrices for measurement of change. In: Harris CW, editor. Problems in measuring change. Madison: University of Wisconsin Press; 1963. p. 122–37. link1

[41] De Lathauwer L, De Moor B, Vandewalle J. A multilinear singular value decomposition. SIAM J Matrix Anal Appl 2000;21(4):1253–78. link1

[42] Lee DD, Seung HS. Learning the parts of objects by non-negative matrix factorization. Nature 1999;401(6755):788–91. link1

[43] Hagenaars JA, McCutcheon AL. Applied latent class analysis. Cambridge: Cambridge University Press; 2002. link1

[44] McCutcheon AL. Latent class analysis. Newbary Park: Sage Publications, Inc.; 1987.

[45] Peng W, Li T. On the equivalence between nonnegative tensor factorization and tensorial probabilistic latent semantic analysis. Appl Intell 2011;35 (2):285–95. link1

[46] Ding C, Li T, Peng W. On the equivalence between non-negative matrix factorization and probabilistic latent semantic indexing. Comput Stat Data Anal 2008;52(8):3913–27. link1

[47] McLachlan GJ, Krishnan T. The EM algorithm and extensions. 2nd ed. Hoboken: John Wiley & Sons; 2008. link1

[48] Sun L, Axhausen KW. Understanding urban mobility patterns with a probabilistic tensor factorization framework. Transp Res Part B Methodol 2016;91:511–24. link1

[49] Hao L, Hansen M, Zhang Y, Post J. New York, New York: two ways of estimating the delay impact of New York airports. Transp Res Part E Logist Trans Rev 2014;70:245–60. link1

[50] Breiman L. Random forests. Mach Learn 2001;45:5–32. link1

[51] Cutler DR, Edwards TC Jr, Beard KH, Cutler A, Hess KT, Gibson J, et al. Random forests for classification in ecology. Ecology 2007;88(11): 2783–92. link1

[52] Gislason PO, Benediktsson JA, Sveinsson JR. Random forests for land cover classification. Pattern Recognit Lett 2006;27(4):294–300. link1

[53] Rebollo JJ, Balakrishnan H. Characterization and prediction of air traffic delays. Transp Res Part C Emerg Technol 2014;44:231–41. link1

[54] Sternberg A, Soares J, Carvalho D, Ogasawara E. A review on flight delay prediction. 2017. arXiv:1703.06118.

Related Research