Eager Maps and Lazy Folds for Graph-Structured Applications

这个项目正在研究用于大规模分布式系统编程的映射/减少抽象的语言扩展，特别关注处理大型非结构化图的应用程序。它的目标是在生物网络的比较分析中发现的真实世界的图形分析任务作为一个重要的案例研究。该项目正在调查以下具体问题：(i)如何在map/reduce框架中投射高度非结构化的基于图形的形式化？（ii）这些规范如何有效地利用现有的map/reduce基础设施？（iii）如何增强这些抽象及其执行环境，以提供可编程性和可扩展性能所必需的语义表达性？（iv）如何将这些分析任务整合到广泛应用社区可用的综合科学资源中？要回答这些问题，需要探索现有map/reduce抽象的语言扩展，在广域多核/SMP平台上定义新的实现，并制作适合在系统生物学等重要领域实际部署的表达性图分析工具包。从这个项目中产生的结果推动了大型稀疏非结构化图分析的最新技术，并直接影响了非常广泛的科学应用。除了在生物学中的特定目标应用之外，基于图形的形式化在社会科学（社会网络）、推荐系统和商业（交易网络）中也有直接的应用。

This project is investigating linguistic extensions to map/reduce abstractions for programming large-scale distributed systems, with special focus on applications that manipulate large, unstructured graphs. It targets real-world graph analysis tasks found in comparative analysis of biological networks as an important case study.The project is investigating the following specific questions: (i) how can highly unstructured graph-based formalisms be cast in the map/reduce framework? (ii) how effectively can these specifications leverage existing map/reduce infrastructure? (iii) how can these abstractions and their execution environments be enhanced to provide the semantic expressiveness necessary for programmability and scalable performance? (iv) how can these analysis tasks be integrated into comprehensive scientific resources usable by the wider applications community? Answers to these questions entails exploring linguistic extensions to existing map/reduce abstractions, defining new implementations on wide-area multicore/SMP platforms, and crafting an expressive graph analysis toolkit suitable for realistic deployment in important domains such as systems biology.Results that arise from this project advance the state-of-the-art in analysis of large sparse unstructured graphs and directly impact a very broad class of scientific applications. Beyond specific target applications in biology, graph-based formalisms find direct applications in social sciences (social networks), recommender systems, and commerce (networks of transactions).