Search scope:
排序: Display mode:
MDLB: a metadata dynamic load balancing mechanism based on reinforcement learning Research Articles
Zhao-qi Wu, Jin Wei, Fan Zhang, Wei Guo, Guang-wei Xie,17034203@qq.com
Frontiers of Information Technology & Electronic Engineering 2020, Volume 21, Issue 7, Pages 963-1118 doi: 10.1631/FITEE.1900121
Keywords: 面向对象的存储系统;元数据;动态负载均衡;强化学习;Q_learning
Anovel non-volatile memory storage system for I/O-intensive applications None
Wen-bing HAN, Xiao-gang CHEN, Shun-fen LI, Ge-zi LI, Zhi-tang SONG, Da-gang LI, Shi-yan CHEN
Frontiers of Information Technology & Electronic Engineering 2018, Volume 19, Issue 10, Pages 1291-1302 doi: 10.1631/FITEE.1700061
The emerging memory technologies, such as phase change memory (PCM), provide chances for highperformance storage of I/O-intensive applications. However, traditional software stack and hardware architecture need to be optimized to enhance I/O efficiency. In addition, narrowing the distance between computation and storage reduces the number of I/O requests and has become a popular research direction. This paper presents a novel PCMbased storage system. It consists of the in-storage processing enabled file system (ISPFS) and the configurable parallel computation fabric in storage, which is called an in-storage processing (ISP) engine. On one hand, ISPFS takes full advantage of non-volatile memory (NVM)’s characteristics, and reduces software overhead and data copies to provide low-latency high-performance random access. On the other hand, ISPFS passes ISP instructions through a command file and invokes the ISP engine to deal with I/O-intensive tasks. Extensive experiments are performed on the prototype system. The results indicate that ISPFS achieves 2 to 10 times throughput compared to EXT4. Our ISP solution also reduces the number of I/O requests by 97% and is 19 times more efficient than software implementation for I/O-intensive applications.
Keywords: In-storage processing File system Non-volatile memory (NVM) Storage system I/O-intensive applications
Areliable power management scheme for consistent hashing based distributed key value storage systems Article
Nan-nan ZHAO,Ji-guang WAN,Jun WANG,Chang-sheng XIE
Frontiers of Information Technology & Electronic Engineering 2016, Volume 17, Issue 10, Pages 994-1007 doi: 10.1631/FITEE.1601162
Keywords: Consistent hash table (CHT) Replication Power management Key value storage system Reliability
ShortTail: taming tail latency for erasure-code-based in-memory systems Research Article
Yun TENG, Zhiyue LI, Jing HUANG, Guangyan ZHANG
Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 11, Pages 1646-1657 doi: 10.1631/FITEE.2100566
s with erasure coding (EC) enabled are widely used to achieve high performance and data availability. However, as the scale of clusters grows, the server-level fail-slow problem is becoming increasingly frequent, which can create long . The influence of long is further amplified in EC-based systems due to the synchronous nature of multiple EC sub-operations. In this paper, we propose an EC-enabled in-memory storage system called ShortTail, which can achieve consistent performance and low latency for both reads and writes. First, ShortTail uses a lightweight request monitor to track the performance of each memory node and identify any fail-slow node. Second, ShortTail selectively performs degraded reads and redirected writes to avoid accessing fail-slow nodes. Finally, ShortTail posts an adaptive write strategy to reduce write amplification of s. We implement ShortTail on top of Memcached and compare it with two baseline systems. The experimental results show that ShortTail can reduce the P99 by up to 63.77%; it also brings significant improvements in the median latency and average latency.
Keywords: Erasure code In-memory system Node fail-slow Small write Tail latency
TextGen: a realistic text data content generation method for modern storage system benchmarks Article
Long-xiang WANG,Xiao-she DONG,Xing-jun ZHANG,Yin-feng WANG,Tao JU,Guo-fu FENG
Frontiers of Information Technology & Electronic Engineering 2016, Volume 17, Issue 10, Pages 982-993 doi: 10.1631/FITEE.1500332
Keywords: Benchmark Storage system Word-based compression
Areliable and energy-efficient storage systemwith erasure coding cache Article
Ji-guang WAN, Da-ping LI, Xiao-yang QU, Chao YIN, Jun WANG, Chang-sheng XIE
Frontiers of Information Technology & Electronic Engineering 2017, Volume 18, Issue 9, Pages 1370-1384 doi: 10.1631/FITEE.1600972
Keywords: Reliability Energy-efficient Storage system Erasure coding Cache management
Engineering DNA Materials for Sustainable Data Storage Using a DNA Movable-Type System Article
Zi-Yi Gong, Li-Fu Song, Guang-Sheng Pei, Yu-Fei Dong, Bing-Zhi Li, Ying-Jin Yuan
Engineering 2023, Volume 29, Issue 10, Pages 130-136 doi: 10.1016/j.eng.2022.05.023
DNA molecules are green materials with great potential for high-density and long-term data storage. However, the current data-writing process of DNA data storage via DNA synthesis suffers from high costs and the production of hazards, limiting its practical applications. Here, we developed a DNA movable-type storage system that can utilize DNA fragments pre-produced by cell factories for data writing. In this system, these pre-generated DNA fragments, referred to herein as "DNA movable types," are used as basic writing units in a repetitive way. The process of data writing is achieved by the rapid assembly of these DNA movable types, thereby avoiding the costly and environmentally hazardous process of de novo DNA synthesis. With this system, we successfully encoded 24 bytes of digital information in DNA and read it back accurately by means of high-throughput sequencing and decoding, thereby demonstrating the feasibility of this system. Through its repetitive usage and biological assembly of DNA movable-type fragments, this system exhibits excellent potential for writing cost reduction, opening up a novel route toward an economical and sustainable digital data-storage technology.
Keywords: 合成生物学 DNA信息存储 DNA活字存储系统 经济性DNA数据存储
ONFS: a hierarchical hybrid file system based on memory, SSD, andHDDfor high performance computers Article
Xin LIU, Yu-tong LU, Jie YU, Peng-fei WANG, Jie-ting WU, Ying LU
Frontiers of Information Technology & Electronic Engineering 2017, Volume 18, Issue 12, Pages 1940-1971 doi: 10.1631/FITEE.1700626
Keywords: High performance computing Hierarchical hybrid storage system Distributed metadata management Data migration
SA-RSR: a read-optimal data recovery strategy for XOR-coded distributed storage systems Research Articles
Xingjun ZHANG, Ningjing LIANG, Yunfei LIU, Changjiang ZHANG, Yang LI
Frontiers of Information Technology & Electronic Engineering 2022, Volume 23, Issue 6, Pages 858-875 doi: 10.1631/FITEE.2100242
To ensure the reliability and availability of data, redundancy strategies are always required for s. Erasure coding, one of the representative redundancy strategies, has the advantage of low storage overhead, which facilitates its employment in s. Among the various erasure coding schemes, are becoming popular due to their high computing speed. When a occurs in such coding schemes, a process called takes place to retrieve the failed node's lost data from surviving nodes. However, data transmission during the process usually requires a considerable amount of time. Current research has focused mainly on reducing the amount of data needed for to reduce the time required for data transmission, but it has encountered problems such as significant complexity and local optima. In this paper, we propose a random search recovery algorithm, named SA-RSR, to speed up recovery of . SA-RSR uses a simulated annealing technique to search for an optimal recovery solution that reads and transmits a minimum amount of data. In addition, this search process can be done in polynomial time. We evaluate SA-RSR with a variety of in simulations and in a real storage system, Ceph. Experimental results in Ceph show that SA-RSR reduces the amount of data required for recovery by up to 30.0% and improves the performance of by up to 20.36% compared to the conventional recovery method.
Keywords: Distributed storage system Data reliability and availability XOR-based erasure codes Single-node failure Data recovery
SoftSSD: enabling rapid flash firmware prototyping for solid-state drives Research Article
Jin XUE, Renhai CHEN, Tianyu WANG, Zili SHAO,jinxue@cse.cuhk.edu.hk,renhai.chen@tju.edu.cn,tywang@cse.cuhk.edu.hk,shao@cse.cuhk.edu.hk
Frontiers of Information Technology & Electronic Engineering 2023, Volume 24, Issue 5, Pages 659-674 doi: 10.1631/FITEE.2200456
Keywords: Solid-state drives Storage system Software hardware co-design
A disk failure prediction model for multiple issues Research Article
Yunchuan GUAN, Yu LIU, Ke ZHOU, Qiang LI, Tuanjie WANG, Hui LI,hustgyc@hust.edu.cn,liu_yu@hust.edu.cn
Frontiers of Information Technology & Electronic Engineering 2023, Volume 24, Issue 7, Pages 964-979 doi: 10.1631/FITEE.2200488
Keywords: Storage system reliability Disk failure prediction Self-monitoring analysis and reporting technology (SMART) Machine learning
Generic user revocation systems for attribute-based encryption in cloud storage None
Genlang CHEN, Zhiqian XU, Hai JIANG, Kuan-ching LI
Frontiers of Information Technology & Electronic Engineering 2018, Volume 19, Issue 11, Pages 1362-1384 doi: 10.1631/FITEE.1800405
Cloud-based storage is a service model for businesses and individual users that involves paid or free storage resources. This service model enables on-demand storage capacity and management to users anywhere via the Internet. Because most cloud storage is provided by third-party service providers, the trust required for the cloud storage providers and the shared multi-tenant environment present special challenges for data protection and access control. Attribute-based encryption (ABE) not only protects data secrecy, but also has ciphertexts or decryption keys associated with fine-grained access policies that are automatically enforced during the decryption process. This enforcement puts data access under control at each data item level. However, ABE schemes have practical limitations on dynamic user revocation. In this paper, we propose two generic user revocation systems for ABE with user privacy protection, user revocation via ciphertext re-encryption (UR-CRE) and user revocation via cloud storage providers (UR-CSP), which work with any type of ABE scheme to dynamically revoke users.
Keywords: Attribute-based encryption Generic user revocation User privacy Cloud storage Access control
Storagewall for exascale supercomputing Article
Wei HU,Guang-ming LIU,Qiong LI,Yan-huang JIANG,Gui-lin CAI
Frontiers of Information Technology & Electronic Engineering 2016, Volume 17, Issue 11, Pages 1154-1175 doi: 10.1631/FITEE.1601336
Keywords: Storage-bounded speedup Storage wall High performance computing Exascale computing
Wang Zhan,Zhao Yanli,Liu Fengyu,Zhang Hong
Strategic Study of CAE 2008, Volume 10, Issue 7, Pages 158-164
In order to enlarge the field of application, reduce the cost of software rejuvenation and improve software availability and reliability,the adaptive software rejuvenation with fine rejuvenation granularity of object-oriented software system would be put forward. Based on the characteristics of the component and coupling relation between the components of the system, this paper determines the finest rejuvenation granularity, analyzes the degree of the coupling relation,sets down a method to calculate the restart dependence and its degree of the components,so that determines the restart reachable set of each component and gets the restart gather of the components at every granularity,and finally sets down and models the adaptive nested software rejuvenation policy. So executing intelligent software rejuvenation at fine rejuvenation granularity in the object-oriented software system can be supported.
Keywords: software rejuvenation restart dependence restart reachable set rejuvenation granularity SHLPN
& Research Article
Yaofeng TU, Rong XIAO, Yinjun HAN, Zhenghua CHEN, Hao JIN, Xuecheng QI, Xinyuan SUN,tu.yaofeng@zte.com.cn,xiao.rong1@zte.com.cn,han.yinjun@zte.com.cn,chen.zhenghua@zte.com.cn,jin.hao1@zte.com.cn,qi.xuecheng@zte.com.cn,sun.xinyuan@zte.com.cn
Frontiers of Information Technology & Electronic Engineering 2023, Volume 24, Issue 5, Pages 716-730 doi: 10.1631/FITEE.2200466
Keywords: Concurrent update High reliability Erasure code Consistency Distributed storage system
Title Author Date Type Operation
MDLB: a metadata dynamic load balancing mechanism based on reinforcement learning
Zhao-qi Wu, Jin Wei, Fan Zhang, Wei Guo, Guang-wei Xie,17034203@qq.com
Journal Article
Anovel non-volatile memory storage system for I/O-intensive applications
Wen-bing HAN, Xiao-gang CHEN, Shun-fen LI, Ge-zi LI, Zhi-tang SONG, Da-gang LI, Shi-yan CHEN
Journal Article
Areliable power management scheme for consistent hashing based distributed key value storage systems
Nan-nan ZHAO,Ji-guang WAN,Jun WANG,Chang-sheng XIE
Journal Article
ShortTail: taming tail latency for erasure-code-based in-memory systems
Yun TENG, Zhiyue LI, Jing HUANG, Guangyan ZHANG
Journal Article
TextGen: a realistic text data content generation method for modern storage system benchmarks
Long-xiang WANG,Xiao-she DONG,Xing-jun ZHANG,Yin-feng WANG,Tao JU,Guo-fu FENG
Journal Article
Areliable and energy-efficient storage systemwith erasure coding cache
Ji-guang WAN, Da-ping LI, Xiao-yang QU, Chao YIN, Jun WANG, Chang-sheng XIE
Journal Article
Engineering DNA Materials for Sustainable Data Storage Using a DNA Movable-Type System
Zi-Yi Gong, Li-Fu Song, Guang-Sheng Pei, Yu-Fei Dong, Bing-Zhi Li, Ying-Jin Yuan
Journal Article
ONFS: a hierarchical hybrid file system based on memory, SSD, andHDDfor high performance computers
Xin LIU, Yu-tong LU, Jie YU, Peng-fei WANG, Jie-ting WU, Ying LU
Journal Article
SA-RSR: a read-optimal data recovery strategy for XOR-coded distributed storage systems
Xingjun ZHANG, Ningjing LIANG, Yunfei LIU, Changjiang ZHANG, Yang LI
Journal Article
SoftSSD: enabling rapid flash firmware prototyping for solid-state drives
Jin XUE, Renhai CHEN, Tianyu WANG, Zili SHAO,jinxue@cse.cuhk.edu.hk,renhai.chen@tju.edu.cn,tywang@cse.cuhk.edu.hk,shao@cse.cuhk.edu.hk
Journal Article
A disk failure prediction model for multiple issues
Yunchuan GUAN, Yu LIU, Ke ZHOU, Qiang LI, Tuanjie WANG, Hui LI,hustgyc@hust.edu.cn,liu_yu@hust.edu.cn
Journal Article
Generic user revocation systems for attribute-based encryption in cloud storage
Genlang CHEN, Zhiqian XU, Hai JIANG, Kuan-ching LI
Journal Article
Storagewall for exascale supercomputing
Wei HU,Guang-ming LIU,Qiong LI,Yan-huang JIANG,Gui-lin CAI
Journal Article
Research and modeling analysis on adaptive nested fine-grainedsoftware rejuvenation of object-oriented software system
Wang Zhan,Zhao Yanli,Liu Fengyu,Zhang Hong
Journal Article