XTRIPODS: Algorithms and Machine Learning in Data Intensive Models

在许多科学学科中出现了大型数据集，揭示了有价值的见解，并帮助开发了各种有用的应用程序。然而，由于它们不断增长的规模和动态性，它们也带来了一些挑战。通常，这些数据集作为数据流处理或分布在多台机器上。素描和流算法已经成功地解决了这些环境中的许多问题，从数据分析、网络算法到优化。这个项目的一个研究目标是在机器学习预测的帮助下，在时间和内存效率方面进一步改进这些算法。该项目还将应用草图技术来开发联邦机器学习算法，其中数据分布在机器或设备上，由于其分散的性质而提供隐私优势。该项目还旨在通过与加州大学圣地亚哥分校的TRIPODS EnCore研究所合作，改善圣地亚哥州立大学和整个社区的数据科学和计算机科学教育基础。与传统的最坏情况分析不同，通过结合机器学习来揭示数据的底层结构，在许多情况下，设计更好的算法成为可能。研究人员计划使用机器学习来提高现有素描和流算法的效率。这些改进是在空间和时间复杂性以及近似质量方面。广泛的问题在这个范例中，包括数据总结，图论，和组合优化将被考虑。此外，研究人员计划利用草图来帮助设计分布式和联邦设置中的机器学习算法。数据草图为这项任务提供了几个优势。它们占用的内存很小，并且可以合并以形成组合数据的草图。此外，它们显示的本地数据信息最少，有利于保护隐私。研究者的目标是在各种问题上使用草图算法，比如为分类和回归构建增强的决策树，以及学习贝叶斯网络来解释数据。研究人员还将在圣地亚哥州立大学开发新的计算机科学课程，以改善数据科学教育，并与加州大学圣地亚哥分校的TRIPODS EnCORE研究所合作，为专注于数据科学的高中生扩大暑期训练营。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Large datasets have emerged within numerous scientific disciplines, unveiling valuable insights and helping to develop various useful applications. However, they also pose several challenges due to their ever-growing size and dynamic nature. Often, these data sets are processed as data streams or distributed across multiple machines. Sketching and streaming algorithms have been successful in tackling many problems in these settings, ranging from data analysis, network algorithms, to optimization. One research objective of this project is to further improve these algorithms, in terms of time and memory efficiency, with the aid of machine learning predictions. This project will also apply sketching techniques to develop federated machine learning algorithms where data is distributed across machines or devices, offering privacy advantages due to their decentralized nature. The project also aims to improve the foundation of data science and computer science education at San Diego State University and in the community at large through collaboration with the TRIPODS EnCore Institute at UC San Diego.Unlike traditional worst-case analysis, by incorporating machine learning to unravel the underlying structure of the data, it becomes possible in many cases to design better algorithms. The investigator plans to improve the efficiency of existing sketching and streaming algorithms using machine learning. These improvements are in terms of space and time complexity as well as approximation quality. A wide range of problems in this paradigm including data summarization, graph theory, and combinatorial optimization will be considered. Additionally, the investigator plans to utilize sketching to aid the design of machine learning algorithms in distributed and federated settings. Data sketches offer several advantages for this task. They have a small memory footprint and can be merged to form a sketch of the combined data. Additionally, they reveal minimal information about local data, benefiting privacy. The investigator aims to employ sketching algorithms on various problems such as building boosted decision trees for classification and regression, and learning a Bayesian network to explain the data. The investigator will also develop new computer science courses at San Diego State University to improve data science education and collaborate with the TRIPODS EnCORE Institute at UC San Diego, to expand a summer boot camp for high school students focusing on data science.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.