Functional data analysis methods for genomics and financial data

最近，许多领域的数据量和复杂性迅速增加。高维数据在科学、工程和现代工业世界中已经变得无处不在。有效的数据分析和解释仍然是学术界和工业界在许多研究领域推进知识的瓶颈。因此，迫切需要新的统计学上合理的技术，专门为高维数据的分析量身定制。我的研究将通过开发功能数据的统计工具来解决这一需求，即在连续体上变化并可以表示为曲线的数据。函数数据分析通常被用作一种完全非参数的方法来建模随时间变化的数据，如时间序列和纵向数据。一个不太受欢迎但非常有前途的应用领域是所谓的“组学”科学（基因组学，表观基因组学）。- 其中现代高通量测序技术产生可以表示为基因组上的曲线的高维数据。我的研究计划的长期目标是开发新的统计方法来分析功能数据，并提供这种方法的计算效率的实现。特别是，我在未来几年的研究将集中在发现功能图案的问题上，即典型的“形状”，它可能沿着沿着和穿过一组曲线重复出现几次，捕捉重要的局部特征。我最近开发了概率K均值与局部对齐（probKMA），一种能够在一组曲线中识别K个候选功能基序的聚类方法。我的研究计划打算建立在这一最新的发展，并将追求几个方法和应用方向。我的第一个重点将是开发一个新的基序发现技术的基础上双聚类。我还将扩展这些方法，以检测图案在一个单一的曲线，以及图案的实例具有相似的形状，但不同的长度，我将开发一个严格的评估图案的统计意义发现，这是至关重要的区分真实的图案和图案是随机存在的背景曲线。之后，我将把开发出来的方法应用于现实世界中的问题，特别是对“组学”数据和资产价格时间序列的分析。拟议的研究将产生用户友好和快速的软件，将免费提供给公众，并将能够从曲线中提取相关信息。这项研究的多学科性质将转化为参与我的研究的学生广泛的培训机会。我的项目在几个STEM学科的边界上提供的培训将有助于数据科学家的教育，他们对公司和大学都至关重要。

Many fields have recently seen a rapid increase in data volume and complexity. High-dimensional data have become pervasive in the sciences, in engineering, and in the modern industrial world. Effective data analysis and interpretation still represent the bottleneck in advancing knowledge in many areas of research, in both academia and industry. Hence, there is an urgency for novel statistically sound techniques, specifically tailored for the analysis of high-dimensional data. My research will address this need by developing statistical tools for functional data, i.e. data that vary over a continuum and can be represented as curves. Functional data analysis is often employed as a fully nonparametric approach for the modeling of data varying over time, such as time series and longitudinal data. A less popular but very promising application area is represented by the so-called "Omics" sciences (genomics, epigenomics.) - in which the modern high-throughput sequencing technologies produce high-dimensional data that can be represented as curves over the genome. The long-term objective of my research program is to develop novel statistical methods to analyze functional data and to provide computationally efficient implementations of such methods. In particular, my research over the next few years will focus on the problem of discovering functional motifs, i.e. typical "shapes" that may recur several times along and across a set of curves, capturing important local characteristics. I recently developed probabilistic K-mean with local alignment (probKMA), a clustering method able to identify K candidate functional motifs in a set of curves. My research program intends to build upon this recent development and will pursue several methodological and applied directions. My first focus will be to develop a new motif discovery technique based on biclustering. I will also extend these methods to detect motifs in a single curve as well as motifs whose instances have similar shapes but different lengths, and I will develop a rigorous assessment of the statistical significance of motifs found, that is critical to distinguish between real motifs and motifs that are randomly present in the background of curves. Afterward, I will apply the developed methods to the real-world problems that motivate them - in particular to the analysis of "Omics" data and time series of asset prices. The proposed research will result in user-friendly and fast software that will be freely available to the general public and will enable the extraction of relevant information from curves. The multidisciplinary nature of this research will translate into a broad training opportunity for students involved in my research. The training provided by my program, at the boundaries of several STEM disciplines, will contribute to the education of data scientists, who are becoming vital for both companies and universities.