Search scope:
排序: Display mode:
Intelligent data analytics is here to change engineering management
Jonathan Jingsheng SHI, Saixing ZENG, Xiaohua MENG
Frontiers of Engineering Management 2017, Volume 4, Issue 1, Pages 41-48 doi: 10.15302/J-FEM-2017003
Keywords: engineering management project management big data data analytics planning execution
TEES: topology-aware execution environment service for fast and agile application deployment in HPC Research Article
Mingtian SHAO, Kai LU, Wanqing CHI, Ruibo WANG, Yiqin DAI, Wenzhe ZHANG
Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 11, Pages 1631-1645 doi: 10.1631/FITEE.2100284
systems are about to reach a new height: exascale. is becoming an increasingly prominent problem. technology solves the problems of encapsulation and migration of applications and their . However, the image is too large, and deploying the image to a large number of compute nodes is time-consuming. Although the approach brings higher transmission efficiency, it introduces larger network load. All of these issues lead to high startup latency of the application. To solve these problems, we propose the topology-aware service (TEES) for fast and agile on HPC systems. TEES creates a more lightweight for users, and uses a more efficient topology-aware P2P approach to reduce deployment time. Combined with a split-step transport and launch-in-advance mechanism, TEES reduces application startup latency. In the Tianhe HPC system, TEES realizes the deployment and startup of a typical application on 17 560 compute nodes within 3 s. Compared to -based , the speed is increased by 12-fold, and the network load is reduced by 85%.
Keywords: Execution environment Application deployment High-performance computing (HPC) Container Peer-to-peer
Self-deployed execution environment for high performance computing Research Articles
Mingtian SHAO, Kai LU, Wenzhe ZHANG
Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 6, Pages 845-857 doi: 10.1631/FITEE.2100016
Traditional (HPC) systems provide a standard preset environment to support scientific computation. However, HPC development needs to provide support for more and more diverse applications, such as artificial intelligence and big data. The standard preset environment can no longer meet these diverse requirements. If users still run these emerging applications on HPC systems, they need to manually maintain the specific dependencies (libraries, environment variables, and so on) of their applications. This increases the development and deployment burden for users. Moreover, the multi-user mode brings about privacy problems among users. Containers like Docker and Singularity can encapsulate the job's , but in a highly customized HPC system, cross-environment application deployment of Docker and Singularity is limited. The introduction of container images also imposes a maintenance burden on system administrators. Facing the above-mentioned problems, in this paper we propose a self-deployed (SDEE) for HPC. SDEE combines the advantages of traditional virtualization and modern containers. SDEE provides an isolated and customizable environment (similar to a virtual machine) to the user. The user is the root user in this environment. The user develops and debugs the application and deploys its special dependencies in this environment. Then the user can load the job to compute nodes directly through the traditional HPC job management system. The job and its dependencies are analyzed, packaged, deployed, and executed automatically. This process enables transparent and rapid job deployment, which not only reduces the burden on users, but also protects user privacy. Experiments show that the overhead introduced by SDEE is negligible and lower than those of both Docker and Singularity.
Keywords: Execution environment High performance computing Light-weight Isolation Overlay
Zhen-you Li,Ji-shan He,Meng-jun Wang
Frontiers of Engineering Management 2016, Volume 3, Issue 3, Pages 231-238 doi: 10.15302/J-FEM-2016032
Keywords: project management project strategic planning decision-making project supervision and controls project execution
Using information flowanalysis to detect implicit information leaks forweb service composition None
Jia-xin JIANG, Zhi-qiu HUANG, Wei-wei MA, Yan CAO
Frontiers of Information Technology & Electronic Engineering 2018, Volume 19, Issue 4, Pages 494-502 doi: 10.1631/FITEE.1601371
Keywords: Information flow analysis Business process execution language Petri net Interference
An execution control method for the Aerostack aerial robotics framework None
Martin MOLINA, Alberto CAMPORREDONDO, Hriday BAVLE, Alejandro RODRIGUEZ-RAMOS, Pascual CAMPOY
Frontiers of Information Technology & Electronic Engineering 2019, Volume 20, Issue 1, Pages 60-75 doi: 10.1631/FITEE.1800552
Execution control is a critical task of robot architectures which has a deep impact on the qualityIn this study, we describe a general method for execution control, which is a part of the Aerostack softwareframework for aerial robotics, and present technical challenges for execution control and design decisionsThe proposed method has an original design combining a distributed approach for execution control ofchecking and performance monitoring) and centralizes coordination to ensure consistency of the concurrent execution
Keywords: Aerial robotics Control architecture Behavior-based control Executive system
Scientific workflow execution system based on mimic defense in the cloud environment Research Article
Ya-wen WANG, Jiang-xing WU, Yun-fei GUO, Hong-chao HU, Wen-yan LIU, Guo-zhen CHENG
Frontiers of Information Technology & Electronic Engineering 2018, Volume 19, Issue 12, Pages 1522-1536 doi: 10.1631/FITEE.1800621
Keywords: Scientific workflow Mimic defense Cloud security Intrusion tolerance
Title Author Date Type Operation
Intelligent data analytics is here to change engineering management
Jonathan Jingsheng SHI, Saixing ZENG, Xiaohua MENG
Journal Article
TEES: topology-aware execution environment service for fast and agile application deployment in HPC
Mingtian SHAO, Kai LU, Wanqing CHI, Ruibo WANG, Yiqin DAI, Wenzhe ZHANG
Journal Article
Self-deployed execution environment for high performance computing
Mingtian SHAO, Kai LU, Wenzhe ZHANG
Journal Article
Improving Internationally Core Competences Based on the Capabilities of Precise and Accurate Project Management
Zhen-you Li,Ji-shan He,Meng-jun Wang
Journal Article
Using information flowanalysis to detect implicit information leaks forweb service composition
Jia-xin JIANG, Zhi-qiu HUANG, Wei-wei MA, Yan CAO
Journal Article
An execution control method for the Aerostack aerial robotics framework
Martin MOLINA, Alberto CAMPORREDONDO, Hriday BAVLE, Alejandro RODRIGUEZ-RAMOS, Pascual CAMPOY
Journal Article