BIGDATA: IA: Collaborative Research: Asynchronous Distributed Machine Learning Framework for Multi-Site Collaborative Brain Big Data Mining

BIGDATA：IA：协作研究：用于多站点协作大脑大数据挖掘的异步分布式机器学习框架

• 批准号: 2348159
• 负责人: Heng Huang
• 金额: $ 78万
• 依托单位: University of Maryland, College Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-09-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2348159&HistoricalAwards=false
• 关键词: BIGDATA; IA; Collaborative; Research; Asynchronous

Recent advances in multimodal brain imaging and high throughput genotyping and sequencing techniques provide exciting new opportunities to ultimately improve our understanding of brain structure and neural dynamics, their genetic architecture, and their influences on cognition and behavior. However, data privacy and security issues have inhibited data sharing across institutes. Emerging multi-site collaborative data analysis can address these issues and facilitate data and computing resource sharing. In collaborative data analysis, the participating institutes keep their own data, which are analyzed and computed locally, and only share the computed results by communicating with a server. The server communicates with all institutes and updates the local models such that the trained machine learning models indirectly use all data and are shared with all institutes. Although some distributed/parallel computation techniques were recently proposed to address big data mining problems, most of them are synchronous models. Asynchronous distributed learning methods are much more efficient, because they allow the server to update the model with information from only one worker node without waiting for slow worker nodes in each round. However, the convergence analysis for the asynchronous distributed algorithms is much more difficult due to the inconsistent variables update across nodes. Thus, it is challenging to design efficient distributed machine learning algorithms for collaborative big data analysis. The research objective of this project is to address the computational challenges in the emerging multi-site collaborative data mining for brain big data. This project seeks to harness the opportunities of designing new efficient asynchronous distributed machine learning algorithms with rigorous theoretical foundations for multi-site collaborative brain big data mining, creating large-scale computational strategies and effective software tools to reveal sophisticated relationships among heterogeneous brain data. This project designs the asynchronous distributed machine learning and principled big data mining models to conduct the comprehensive study of brain imaging genomics and connectomics. Specifically, the principal investigators investigate: 1) collaborative genotype and phenotype association study using new asynchronous doubly stochastic proximal gradient algorithms; 2) communication-efficient multi-site collaborative data integration models to integrate imaging genomics data for predicting outcomes of interest; 3) collaborative deep learning algorithm speedup by the asynchronous distributed algorithms with applications in temporal cognitive change prediction; and 4) new graph convolutional deep learning models for brain network mining. It is innovative to integrate new distributed machine learning and data-intensive computing with brain imaging genomics and connectomics that hold great promise for a systems biology of the brain. The developed methods and tools impact other neuroimaging, genomics, and neuroscience research, and enable investigators working on brain science to effectively test their scientific hypotheses. This project will also facilitate the development of novel educational tools.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

多模式脑成像和高通量基因分型和测序技术的最新进展为最终提高了我们对大脑结构和神经动态的理解，遗传结构以及它们对认知和行为的影响提供了令人兴奋的新机会。但是，数据隐私和安全问题已抑制了整个研究所的数据共享。新兴的多站点协作数据分析可以解决这些问题，并促进数据和计算资源共享。在协作数据分析中，参与的机构保留了自己的数据，这些数据将在本地进行分析和计算，仅通过与服务器进行通信分享计算的结果。服务器与所有机构进行通信，并更新本地模型，以便间接使用训练有素的机器学习模型，并与所有机构共享。尽管最近提出了一些分布式/并行计算技术来解决大数据挖掘问题，但其中大多数是同步模型。异步分布式学习方法效率要高得多，因为它们允许服务器仅在每个回合中等待一个工作的慢速工作节点的信息来更新模型。但是，由于跨节点的变量不一致，因此异步分布式算法的收敛分析要困难得多。因此，设计有效的分布式机器学习算法以进行协作大数据分析是一项挑战。该项目的研究目标是解决针对大脑大数据的新兴多站点协作数据挖掘的计算挑战。该项目旨在利用设计新高效的异步分布式机器学习算法的机会，并具有严格的理论基础，用于多站点协作大脑大数据挖掘，创建大规模的计算策略和有效的软件工具，以揭示异质大脑数据之间的复杂关系。该项目设计了异步分布式机器学习和原则上的大数据挖掘模型，以对脑成像基因组学和连接组学进行全面研究。具体而言，首席研究人员研究：1）使用新的异步双同步随机近端梯度算法进行协作基因型和表型关联研究； 2）沟通高效的多站点协作数据集成模型，以整合成像基因组学数据以预测感兴趣的结果； 3）与时间认知变化预测中应用的异步分布式算法的协作深度学习算法加速； 4）用于大脑网络挖掘的新图形卷积深度学习模型。将新的分布式机器学习和数据密集型计算与脑成像基因组学和连接组学相结合，这对大脑的系统生物学充满希望是创新的。开发的方法和工具会影响其他神经影像学，基因组学和神经科学研究，并使研究脑科学的研究人员能够有效地检验其科学假设。该项目还将促进开发新颖的教育工具。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子优点和更广泛影响的评论标准来评估值得支持的。