Coordination
Coordination
批准号:
174427177
负责人:
Professor Dr. Volker Markl
金额:
$0.0万
依托单位国家:
德国
项目类别:
Research Units
财政年份:
2010
资助国家:
德国
项目状态:
已结题
起止时间:
2009-12-31 至 2018-12-31
关键词:
中文摘要
Stratosphere的总体科学目标是研究和原型开发一种新颖的、受数据库启发的云信息管理系统,用于分析、聚合和查询由文本或(半)结构化数据组成的非常大的数据集合。为了实现这一目标,提议的研究单位由分布式系统、查询处理、查询优化、信息提取、信息集成和清理、安全和隐私等领域的世界级专家组成。通过其许多成员的跨学科方向,该研究单位与潜在用户有密切联系,因此可以验证发明的技术在若干应用领域的实际相关性,例如生命科学、科学应用和关联数据。所有研究小组成员的地理位置接近,极大地促进了合作,并能够建立定期的联合研讨会。若干研究单位成员将通过引进自己的研究人员或设备,为研究单位提供额外资源。此外,该研究单位将能够依靠柏林工业大学和Humboldt-Universität zu Berlin提供的云测试平台。对于大规模的演示,该研究单位还可以在雅虎、惠普和英特尔的支持下访问KIT的完整云系统设置。该研究单位将能够使用Hadoop,云平台数据处理器的开源实现,以及JAQL查询语言的开源实现,作为其研究的起点。IBM的信息管理基础设施研究人员、KIT的云提供商和波茨坦研究所(Potsdam institute fr Klimafolgenforschung, PIK)的用户已经表示,如果该研究单位成立,他们有兴趣与之合作,以评估云计算在信息管理方面的潜力。我们设想,Stratosphere Cloud信息管理系统研究将作为信息管理高级领域后续研究活动的基础,例如科学计算、web分析或下一代商业智能。Stratosphere将利用和扩展像Hadoop和JAQL这样的开源成果。我们的目标是通过将我们开发的代码捐赠给开源社区,从而使我们的研究产生持久的影响。我们的努力将使其他研究人员和实践者能够使用我们的实现并以我们的工作为基础。在成功完成研究单元后,主要研究人员计划通过合作研究中心(SFB)继续和扩展研究,该中心可以在我们的研究成果的基础上,结合商业模式、隐私、编程范例和应用程序,在并行环境中对流数据集提供近乎实时的处理。我们设想我们的研究也将影响数据库和分布式系统课程。总的来说,我们期望同温层研究活动将为柏林-勃兰登堡信息管理小组奠定基础,该小组将在参与的大学之间进行长期的研究合作、统一的课程和共享的讲座。
英文摘要
The overall scientific goal of Stratosphere is to research and prototypically develop a novel, database-inspired information management system for the Cloud, for analyzing, aggregating, and querying very large data collections, made of either textual or (semi-) structured data. In order to achieve this goal, the proposed research unit is comprised of world-class experts in the areas of distributed systems, query processing, query optimization, information extraction, information integration and cleansing, security, and privacy. Through interdisciplinary orientation of many of its members, the research unit has close ties to potential users and can therefore validate the practical relevance of the invented technologies for several application domains, e.g., life-sciences, scientific applications, and for linked data. The geographical proximity of all research group members greatly facilitates collaboration and enables the establishment of regular joint seminars. Several research unit members will augment the research unit with additional resources, by bringing in own research staff or equipment. In addition, the research unit will be able to rely on a Cloud test-bed provided by TU Berlin and Humboldt-Universität zu Berlin. For large-scale demonstrations, the research unit will also have access to a full Cloud system setup at KIT with the support of Yahoo, HP, and Intel. The research unit will be able to use Hadoop, the open-source implementation of a data processor for a Cloud platform, as well as the opensource implementation of the JAQL query language, as a starting point for its research. Information management infrastructure researchers at IBM, Cloud providers at KIT, and users at the Potsdam Institut für Klimafolgenforschung (PIK) have already expressed interest in collaborating with the research unit if it is established, in order to assess the potential of Cloud computing for information management. We envision that the Stratosphere Cloud information management system research will serve as a basis for subsequent research activities in advanced areas of information management, such as scientific computing, web analysis, or next generation business intelligence. Stratosphere will leverage and extend open-source efforts like Hadoop and JAQL. We aim for lasting impact of our research by donating the code we develop to the opensource community. Our effort will enable other researchers and practitioners to use our implementations and to build on our work. After successful completion of the research unit, the principal investigators plan to continue and extend the research through a collaborative research center (SFB), which could build on our research results to provide near real-time processing on streaming data sets in a parallel environment in conjunction with considerations on business models, privacy, programming paradigms, and applications. We envision that our research will also impact the curriculum of database and distributed system classes. Overall, we expect that the Stratosphere research activities will lay the foundation for a Berlin-Brandenburg Information Management Group with long-term research collaboration, aligned curricula, and shared lectures among the participating universities.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Query Compilation for the Heterogeneous Many Core Age
-
批准号:361497736
-
项目类别:Priority Programmes
-
资助金额:$0.0万
-
财政年份:2017
-
负责人:Professor Dr. Volker Markl
-
依托单位:
Compiling and Optimizing Iterative Data Analysis Programs with Shared State on Evolving Datasets
-
批准号:248356729
-
项目类别:Research Units
-
资助金额:$0.0万
-
财政年份:2013
-
负责人:Professor Dr. Volker Markl
-
依托单位:
Stratosphere Data and Processing Model, its Optimization and Parallelization
-
批准号:174426733
-
项目类别:Research Units
-
资助金额:$0.0万
-
财政年份:2010
-
负责人:Professor Dr. Volker Markl
-
依托单位:
Adaptive Query Compilation for Stream Processing
-
批准号:447268056
-
项目类别:Priority Programmes
-
资助金额:$0.0万
-
财政年份:--
-
负责人:Professor Dr. Volker Markl
-
依托单位:
海外基金