CAREER: Data-aware Distributed Computing for Enabling Large-scale Collaborative Science

职业：数据感知分布式计算支持大规模协作科学

• 批准号: 1131889
• 负责人: Tevfik Kosar
• 金额: $ 32.18万
• 依托单位: SUNY at Buffalo
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-04-15 至 2016-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1131889&HistoricalAwards=false
• 关键词: CAREER; Data; aware; Distributed; Computing

CAREER: Data-aware Distributed Computing for EnablingLarge-scale Collaborative SciencePI: Tevfik Kosar, Louisiana State UniversityAbstractApplications and experiments in all areas of science are becoming increasingly complex and more demanding in terms of their computational and data requirements. Some applications generate data volumes reaching petabytes. Sharing, disseminating, and analyzing these large data sets becomes a big challenge, especially when distributed resources are used. This Faculty Early Career Development (CAREER) project proposes a new distributed computing paradigm called ?data-aware distributed computing?, which will include a diverse set of algorithms, models, and tools for mitigating the data bottleneck in distributed computing systems; and will support a broad range of data-intensive as well as dynamic data-driven applications. As part of this project, research and development will be performed on three main components: i) a data-aware scheduler which will provide capabilities such as planning, scheduling, resource reservation, job execution, and error recovery for data movement tasks; ii) integration of these capabilities to the other layers in distributed computing such as workflow planning, resource brokering, and storage management; and iii) further optimization of data movement tasks via dynamically tuning of underlying protocol transfer parameters. Research will be integrated to literally all levels of education which will include science projects, seminars and summer camps on data-intensive computing with K-12 students (where 99% is minority); curriculum development, mentoring, and international student/intern exchange programs for undergraduate and graduate students; summer internships and workshops specifically for HBCU community including faculty members. The tools and software developed in this project will be available to public via open-source distribution.

职业：数据感知分布式计算支持大规模协作科学PI：Tevfik Kosar，路易斯安那州立大学摘要在所有科学领域的应用和实验都变得越来越复杂，对计算和数据的要求也越来越高。一些应用程序生成的数据量达到PB。共享、传播和分析这些大型数据集成为一个巨大的挑战，特别是在使用分布式资源时。这个教师早期职业发展（CAREER）项目提出了一个新的分布式计算模式，称为？数据感知分布式计算它将包括一组不同的算法、模型和工具，用于缓解分布式计算系统中的数据瓶颈;并将支持广泛的数据密集型和动态数据驱动的应用程序。作为该项目的一部分，将对三个主要组成部分进行研究和开发：i）数据感知调度程序，该程序将为数据移动任务提供规划、调度、资源预留、作业执行和错误恢复等功能; ii）将这些功能集成到分布式计算的其他层，如工作流程规划、资源调配和存储管理;以及iii）通过动态调整底层协议传输参数来进一步优化数据移动任务。研究将被整合到几乎所有级别的教育，这将包括科学项目，研讨会和夏令营的数据密集型计算与K-12学生（其中99%是少数民族）;课程开发，指导和国际学生/实习生交流计划本科生和研究生;暑期实习和研讨会专门为HBCU社区，包括教师。该项目开发的工具和软件将通过开源分发向公众提供。