面向海量视频数据处理的混合存储系统关键技术研究

批准号:
61972311
项目类别:
面上项目
资助金额:
60.0 万元
负责人:
伍卫国
依托单位:
学科分类:
计算机系统结构与硬件技术
结题年份:
2023
批准年份:
2019
项目状态:
已结题
项目参与者:
伍卫国
国基评审专家1V1指导 中标率高出同行96.8%
结合最新热点,提供专业选题建议
深度指导申报书撰写,确保创新可行
指导项目中标800+,快速提高中标率
微信扫码咨询
中文摘要
传统的存储系统架构在处理日益增长的海量视频数据时,存储和管理数据低效,难以发挥主机端计算性能和存储介质特性。本项目针对该问题,提出一种基于开放通道固态硬盘和主机感知叠瓦式(SMR)磁盘的大容量、低成本、高性能混合存储系统,围绕存储介质特性和视频存储场景,拟在主机端展开以下研究:1.研究适用于非结构化视频数据的键值存储数据组织形式和符合应用特点的冷热数据分离策略,构建弹性的数据管理框架;2.研究混合存储系统中协作式垃圾回收策略,降低垃圾回收期间外部应用请求延迟和垃圾回收代价;3.研究抑制SMR写放大现象的粗粒度缓存替换算法,优化读写命中率,降低替换开销;4.研究适配混合存储系统的并行I/O调度方案,加速应用请求响应,提高服务质量。本研究有利于实现经济、高效的海量视频数据存储,丰富大数据存储管理的解决方案,促进存储设备主控算法的国产化发展,提高我国视频存储领域的自主化技术水平。
英文摘要
Traditional storage system architectures are low efficient in storing and managing the growing massive video data, which is difficult to fully utilize the computing performance of host-side and the media characteristics of storage system. Aiming at this problem, our project proposes a high-capacity, low-cost, and high-performance hybrid storage system based on open-channel solid-state disks and host-aware shingled magnetic recording (SMR) disks. Based on the storage media characteristics and the video storage scenarios, our project is going to carry out the following research: 1. Studying the key-value store-based data organization which is applicable to unstructured video data and cold / hot data-oriented distribution strategy, and building a flexible data management framework; 2. Studying the collaborative garbage collection strategy in the hybrid storage system to reduce the request delays from external applications and lower the cost of garbage collection; 3. Studying the coarse-grained cache replacement algorithm that mitigates the SMR write amplification to optimize read/write cache hit ratio and to reduce replacement overhead; 4. Studying the efficient parallel I/O scheduling scheme that is appropriately adapted to the hybrid storage system to accelerate the responses of application requests and improve the quality of service. The research of our project will be conducive to realizing the economical and efficient storage of massive video data, enriching the big data solution, promoting the localization development of control algorithm in storage devices, and raising the autonomous technical level in domestic video data storage field.
期刊论文列表
专著列表
科研奖励列表
会议论文列表
专利列表
DOI:10.3390/app13179767
发表时间:2023-08
期刊:Applied Sciences
影响因子:--
作者:Chi Zhang;Song Liu;Fangxing Yu;Menghan Li;Wei Tang;Fei Liu;Weiguo Wu
通讯作者:Chi Zhang;Song Liu;Fangxing Yu;Menghan Li;Wei Tang;Fei Liu;Weiguo Wu
DOI:10.1109/tvt.2023.3270967
发表时间:2023-09
期刊:IEEE Transactions on Vehicular Technology
影响因子:6.8
作者:Xiangjun Zhang;Weiguo Wu;Zhihe Zhao;Jinyu Wang;Song Liu
通讯作者:Xiangjun Zhang;Weiguo Wu;Zhihe Zhao;Jinyu Wang;Song Liu
DOI:10.1145/3477000
发表时间:2021-09
期刊:ACM Transactions on Embedded Computing Systems (TECS)
影响因子:--
作者:Shiqiang Nie;Weiguo Wu;Chi Zhang
通讯作者:Shiqiang Nie;Weiguo Wu;Chi Zhang
DOI:10.1016/j.future.2023.04.019
发表时间:2023-04
期刊:Future Gener. Comput. Syst.
影响因子:--
作者:Song Liu;Xinhe Wan;Zengyuan Zhang;Bo Zhao;Weiguo Wu
通讯作者:Song Liu;Xinhe Wan;Zengyuan Zhang;Bo Zhao;Weiguo Wu
DOI:10.3390/app14020630
发表时间:2024-01
期刊:Applied Sciences
影响因子:--
作者:Chi Zhang;Fangxing Yu;Shiqiang Nie;Wei Tang;Fei Liu;Song Liu;Weiguo Wu
通讯作者:Chi Zhang;Fangxing Yu;Shiqiang Nie;Wei Tang;Fei Liu;Song Liu;Weiguo Wu
基于FPGA的实时动态可重构系统关键技术研究
- 批准号:61672423
- 项目类别:面上项目
- 资助金额:63.0万元
- 批准年份:2016
- 负责人:伍卫国
- 依托单位:
面向P量级系统计算节点层次存储架构和并行粒度优化的多级循环分块方法研究
- 批准号:91330117
- 项目类别:重大研究计划
- 资助金额:65.0万元
- 批准年份:2013
- 负责人:伍卫国
- 依托单位:
国内基金
海外基金
