HECURA: Microdata Storage Systems for High-End Computing
HECURA: Microdata Storage Systems for High-End Computing
批准号:
0621511
负责人:
Charles Leiserson
金额:
$0.0万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2006
资助国家:
美国
项目状态:
已结题
起止时间:
2006-10-01 至 2010-09-30
中文摘要
该研究项目旨在了解和开发微数据存储系统,这是包括基因组处理和雷达知识形成在内的许多应用领域所需的技术。微数据存储系统被设计成对小文件(微文件)和大文件(宏文件)都有很好的性能。目前的文件系统针对大块数据的读写进行了优化,但在处理大量微数据时性能很差。研究集中在三种有前途的技术上:-微数据存储结构,如缓冲储存库B-树,它可以在保持宏文件高性能的同时,将微文件的插入和范围查询的性能提高到传统B-树的数量级。-缓存无关数据结构,提供文件组织的被动自我调整,实际上可能会超过磁盘文件系统的缓存感知数据结构。-基于虚拟内存的事务内存,允许程序员以简单的方式实现复杂的文件结构,同时提供无锁编程和自动崩溃恢复。调查人员使用基准测试,如DARPA HPC SSCA#3基准(他们开发的仅I/O版本),来评估微数据存储系统对高端计算的影响。研究人员还在开发有关微数据存储系统的课程材料,这些材料将在麻省理工学院开放课程计划http://ocw.mit.edu.下免费提供
英文摘要
This research project is aimed at understanding and developing microdata storage systems, a technology which is needed for many application ares, including genome processing and radar knowledge formation. Microdata storage systems are designed to perform well for small files (microfiles), as well as for large files (macrofiles).Today's filesystems are optimized for reading and writing data in large blocks, but they perform poorly when dealing with large volumes of microdata.The research focuses on three promising technologies: - Microdata storage structures, such as buffered repository B-trees, which can improve the performance of insertions and range queries of microfiles by orders of magnitude over traditional B-trees, while still preserving high performance on macrofiles. - Cache-oblivious data structures, which provide passive self-tuning of the file organization and may actually outperform tuned cache-aware data structures for disk file systems. - Virtual-memory-based transactional memory, which allows programmers to implement complex file structures in a straightforward manner, while providing lock-free programming and automatic crash recovery.The investigators employ benchmarks, such as the DARPA HPC SSCA#3 benchmark (an I/O-only version of which they developed), to evaluate the impact of microdata storage systems on high-end computing. The investigators are also developing course materials on microdata storage systems which will be made freely available under the MIT OpenCourseware initiative http://ocw.mit.edu.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
POSE: Phase I: Open Source Ecosystem for OpenCilk
-
批准号:2229704
-
项目类别:Standard Grant
-
资助金额:$30.0万
-
财政年份:2022
-
负责人:Charles Leiserson
-
依托单位:
CCRI: Medium: Cilk Infrastructure for Next-Generation Parallel-Programming Research
-
批准号:1925609
-
项目类别:Standard Grant
-
资助金额:$150.0万
-
财政年份:2019
-
负责人:Charles Leiserson
-
依托单位:
XPS: FULL: FP: A profile-centric IDE for science-based performance engineering in the cloud
-
批准号:1533644
-
项目类别:Standard Grant
-
资助金额:$75.0万
-
财政年份:2015
-
负责人:Charles Leiserson
-
依托单位:
SHF: AF: Large: Collaborative Research: Parallelism without Concurrency
-
批准号:1314547
-
项目类别:Continuing Grant
-
资助金额:$100.0万
-
财政年份:2013
-
负责人:Charles Leiserson
-
依托单位:
SHF: AF: Medium: Collaborative Research:The Ponchoir Stencil Complier
-
批准号:1162148
-
项目类别:Continuing Grant
-
资助金额:$80.94万
-
财政年份:2012
-
负责人:Charles Leiserson
-
依托单位:
CSR: Small: Using Thread-Local Memory Mapping to Support Memory Abstractions for Dynamic Multithreading
-
批准号:1017058
-
项目类别:Standard Grant
-
资助金额:$50.0万
-
财政年份:2010
-
负责人:Charles Leiserson
-
依托单位:
HECURA: Colaborative: Multidimensional and String Indexes for Streaming Data
-
批准号:0937860
-
项目类别:Standard Grant
-
资助金额:$60.0万
-
财政年份:2009
-
负责人:Charles Leiserson
-
依托单位:
SBIR Phase I: Cilk++
-
批准号:0712243
-
项目类别:Standard Grant
-
资助金额:$0.0万
-
财政年份:2007
-
负责人:Charles Leiserson
-
依托单位:
CSR-AES: Feedback-Driven Adaptive Multithreading
-
批准号:0615215
-
项目类别:Continuing Grant
-
资助金额:$48.4万
-
财政年份:2006
-
负责人:Charles Leiserson
-
依托单位:
CPA: Practical Cache-Oblivious B-Trees
-
批准号:0541209
-
项目类别:Standard Grant
-
资助金额:$27.5万
-
财政年份:2006
-
负责人:Charles Leiserson
-
依托单位:
DDDAS-TMRP: Planet-in-a-Bottle: A Numerical Fluid-Laboratory System
-
批准号:0540248
-
项目类别:Standard Grant
-
资助金额:$60.0万
-
财政年份:2006
-
负责人:Charles Leiserson
-
依托单位:
NGS: A Computing Environment Based on Hardware Transactional Memory
-
批准号:0305606
-
项目类别:Continuing Grant
-
资助金额:$40.0万
-
财政年份:2004
-
负责人:Charles Leiserson
-
依托单位:
ITR/NGS: Transactions Everywhere
-
批准号:0324974
-
项目类别:Continuing Grant
-
资助金额:$65.0万
-
财政年份:2003
-
负责人:Charles Leiserson
-
依托单位:
Next Generation Software: A Computing Environment for Adaptively Parallel Multithreading
-
批准号:9975036
-
项目类别:Standard Grant
-
资助金额:$10.0万
-
财政年份:2000
-
负责人:Charles Leiserson
-
依托单位:
1992 Brown/MIT Conference on Advanced Research in VLSI and Parallel Systems, March 25-27, 1992, Providence, Rhode Island
-
批准号:9200486
-
项目类别:Standard Grant
-
资助金额:$1.1万
-
财政年份:1992
-
负责人:Charles Leiserson
-
依托单位:
Fourth MIT Conference on Advanced Research in VLSI, Massachusetts Institute of Technology, Cambridge, Massachusetts, April 7-9, 1986
-
批准号:8519180
-
项目类别:Standard Grant
-
资助金额:$2.5万
-
财政年份:1986
-
负责人:Charles Leiserson
-
依托单位:
Presidential Young Investigator Award: Theory of Computing Machinery
-
批准号:8451995
-
项目类别:Continuing Grant
-
资助金额:$31.25万
-
财政年份:1985
-
负责人:Charles Leiserson
-
依托单位:
海外基金