TensorLABE - Robust Characterization of Data Tensors and Synthetic Data Generation

现代计算方法，如基于机器学习（ML）的方法，在效率和性能方面取得了令人印象深刻的进步，但越来越依赖于大量数据。这些数据驱动的方法从人类工程源代码的经典技术过渡到在数据集上训练的算法，以产生所需的解决方案，将数据放在驾驶员的座位上。这些数据驱动技术的扩散正在通过专门设计用于支持与这些算法相关的复杂数据驱动计算以及伴随它们的大量数据的新硬件和软件系统来实现和加速。但是，尽管这些新的硬件和软件系统的性能令人印象深刻的增益，了解他们的设计的数据组件已经萎缩，有利于性能驱动的软件和基于硬件的解决方案的进步。缺乏对数据的理解导致了许多不期望的结果，例如数据驱动解决方案中的不希望的偏差，无法提前确定数据集对解决给定问题的实际适用性，无法确定数据集是否已被操纵或损坏，以及不能产生可用于训练和测试这些软件和硬件系统的性能的准确合成数据。该项目旨在为大规模基于张量的数据集的特征化提供一个强大的框架，以提高对数据本身的理解，并使合成数据的生产能够更准确地复制真实世界的数据，用于系统设计测试和验证。具体来说，该项目提出在多线性代数，大规模数据分析，机器学习，和人工智能，通过将各种张量方法用于统计，结构和表演数据分析，以实现更强大的数据表征。一套更全面的数据表征将能够更好地评估数据的偏倚，并评估数据集是否适合特定任务。它还将允许对数据集进行比较，以了解它们的差异，并评估数据的腐败或操纵。将通过将项目中开发的数据表征方法纳入生成比传统方法更真实的合成数据，来建立概念证明。该方法将通过测试合成数据的能力，以表征软件/硬件系统的性能更accurates.This奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

Modern computational methods, such as Machine Learning (ML) based approaches, have produced impressive gains in efficiency and performance but are increasingly dependent on massive amounts of data. These data-driven approaches transition from the classical techniques of human-engineered source code to algorithms trained on a dataset to produce the desired solution, placing the data in the driver's seat. The proliferation of these data-driven technologies is being enabled and hastened by new hardware and software systems specifically designed to support the complex data-driven computation associated with these algorithms and the massive volumes of data accompanying them. But despite the impressive performance gains of these new hardware and software systems, understanding their design's data component has languished in favor of performance-driven advances in software and hardware-based solutions. The lack of data understanding has led to a number of undesirable outcomes such as unwanted bias in the data-driven solution, an inability to determine the actual suitability of a data set to solving a given problem ahead of time, an inability to determine if a data set has been manipulated or corrupted, and an inability to produce accurate synthetic data that can be used to train and test the performance of these software and hardware systems. This project aims to provide a robust framework for the characterization of large-scale tensor-based datasets to improve understanding of the data itself and enable the production of synthetic data that more accurately replicates real-world data for use in system design testing and validation.Specifically, this project proposes to advance knowledge in the fields of multilinear algebra, large-scale data analytics, machine learning, and artificial intelligence by incorporating a variety of tensor methods for statistical, structural, and performative data analyses to achieve more robust data characterization. A more holistic set of data characterizations will enable better assessment of data for bias and evaluation of datasets for suitability for a particular task. It will also allow the comparison of datasets to understand their differences and assess data for corruption or manipulation. A proof of concept will be established by incorporating the data characterization methods developed in the project into generating synthetic data with higher degrees of realism than conventional methods. The approach will be validated by testing the ability of the synthetic data to characterize software/hardware system performance more accurately.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.