XTRIPODS: Algorithms and Machine Learning in Data Intensive Models

在众多科学学科中出现了大型数据集，揭示了有价值的见解，并帮助开发了各种有用的应用程序。然而，由于它们不断增长的规模和动态性质，它们也构成了几个挑战。通常，这些数据集作为数据流处理或分布在多台机器上。草图和流媒体算法已经成功地解决了这些环境中的许多问题，从数据分析、网络算法到优化。本项目的研究目标之一是借助机器学习预测，在时间和内存效率方面进一步改进这些算法。该项目还将应用草图技术来开发联合机器学习算法，其中数据跨机器或设备分布，由于其分散的性质而提供隐私优势。该项目还旨在通过与加州大学圣迭戈分校的三脚架安可研究所合作，改善圣地亚哥州立大学和整个社区的数据科学和计算机科学教育的基础。与传统的最坏情况分析不同，通过结合机器学习来解开数据的底层结构，在许多情况下可以设计更好的算法。这位研究人员计划使用机器学习来提高现有草图绘制和流媒体算法的效率。这些改进是在空间和时间复杂度以及近似质量方面的。这一范例中的广泛问题将被考虑，包括数据汇总、图论和组合优化。此外，研究人员计划利用草图来帮助设计分布式和联合环境中的机器学习算法。数据草图为这项任务提供了几个优势。它们占用的内存很小，可以合并以形成组合数据的草图。此外，它们披露的有关本地数据的信息最少，有利于隐私。这位研究人员的目标是在各种问题上使用草图算法，例如为分类和回归构建增强型决策树，以及学习贝叶斯网络来解释数据。这位研究人员还将在圣地亚哥州立大学开发新的计算机科学课程，以改善数据科学教育，并与加州大学圣地亚哥分校的三脚架安可研究所合作，为专注于数据科学的高中生扩大夏季新兵训练营。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Large datasets have emerged within numerous scientific disciplines, unveiling valuable insights and helping to develop various useful applications. However, they also pose several challenges due to their ever-growing size and dynamic nature. Often, these data sets are processed as data streams or distributed across multiple machines. Sketching and streaming algorithms have been successful in tackling many problems in these settings, ranging from data analysis, network algorithms, to optimization. One research objective of this project is to further improve these algorithms, in terms of time and memory efficiency, with the aid of machine learning predictions. This project will also apply sketching techniques to develop federated machine learning algorithms where data is distributed across machines or devices, offering privacy advantages due to their decentralized nature. The project also aims to improve the foundation of data science and computer science education at San Diego State University and in the community at large through collaboration with the TRIPODS EnCore Institute at UC San Diego.Unlike traditional worst-case analysis, by incorporating machine learning to unravel the underlying structure of the data, it becomes possible in many cases to design better algorithms. The investigator plans to improve the efficiency of existing sketching and streaming algorithms using machine learning. These improvements are in terms of space and time complexity as well as approximation quality. A wide range of problems in this paradigm including data summarization, graph theory, and combinatorial optimization will be considered. Additionally, the investigator plans to utilize sketching to aid the design of machine learning algorithms in distributed and federated settings. Data sketches offer several advantages for this task. They have a small memory footprint and can be merged to form a sketch of the combined data. Additionally, they reveal minimal information about local data, benefiting privacy. The investigator aims to employ sketching algorithms on various problems such as building boosted decision trees for classification and regression, and learning a Bayesian network to explain the data. The investigator will also develop new computer science courses at San Diego State University to improve data science education and collaborate with the TRIPODS EnCORE Institute at UC San Diego, to expand a summer boot camp for high school students focusing on data science.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.