Statistical learning algorithms for high-dimensional non-normally distributed data

高维非正态分布数据的统计学习算法

• 批准号: RGPIN-2018-06787
• 负责人: Shaikh, Mateen
• 金额: $ 1.17万
• 依托单位: Thompson Rivers University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=759122
• 关键词: Statistical; learning; algorithms; dimensional; non

Computational methods to reflect a variety of data are continuing to improve. This proposal suggests three main threads of addressing issues with modelling and discovering patterns in data with statistical learning techniques.The first thread of research considers binary data bases. From records of receipts keeping track of what customers purchase to observations indicating the factors involved in an accident, binary data bases are both common, and can be very large. Summarizing associations in these data bases is a useful task for a variety of reasons. Many possible associations exist and comparing them to each other is important. Numerically comparing these associations is particularly valuable as this can be automated by the computer in large scales. However, the choice of numerical summary is important. This proposal suggests methods of improving numerical summaries of associations in binary data to elucidate patterns. One of these methods is on how to summarize data when some of the binary variables are actually elements of a categorical variable, and another is to consider how noteworthy these values are in light of the distribution of the data. A second thread of the proposal addresses the complexity of models. Although very complex models can accurately model some data, this is undesirable for a variety of reasons including interpretability, robustness, and computational challenges. Some complex models can be simplified by considering when certain parameters, quantities which define a model, are constrained to be the same as other parameters of the model. This relates whatever the parameters represent, reduces the number of estimates the computer requires, and make the model easier to interpret. This proposal suggests explores a recently proposed method of discovering these constraints for a variety of statistical models. The final thread of this proposal addresses the realistic issue of the assumptions made when modelling what are often considered to be "continuous" variables. These data are often modeled as truly continuous, following a particular distribution (the normal distribution), or both. In this thread, more flexible assumptions are considered and accommodates the situation that data representing continuous variables are actually only known up to a limited precision which can influence results. The exploration will determine in which scenarios this limited precision matters and how accurate answers are when accounting for the limited precision and less stringent assumptions. All of these issues will be addressed as highly qualified personnel develop and apply new skills, trained in the analysis of realistic, sometimes inconvenient, and big data. This is a skillset that has been identified as a "talent gap" within Canada and will be addressed with this proposal.

反映各种数据的计算方法正在不断改进。这个建议提出了三个主要的线索，解决问题的建模和发现模式的数据与统计学习技术。从记录客户购买的收据记录到指示事故所涉及的因素的观察结果，二进制数据库都很常见，而且可能非常大。由于各种原因，总结这些数据库中的关联是一项有用的任务。存在许多可能的关联，将它们相互比较很重要。在数字上比较这些关联是特别有价值的，因为这可以由计算机大规模自动化。然而，数字摘要的选择很重要。该建议提出了改进二进制数据中关联的数值总结以阐明模式的方法。其中一种方法是当一些二进制变量实际上是分类变量的元素时如何总结数据，另一种方法是考虑这些值在数据分布中的重要性。该提案的第二个主题涉及模型的复杂性。尽管非常复杂的模型可以准确地对某些数据进行建模，但由于各种原因，包括可解释性，鲁棒性和计算挑战，这是不可取的。一些复杂的模型可以通过考虑某些参数（定义模型的量）何时被约束为与模型的其他参数相同来简化。这与参数所代表的任何内容相关，减少了计算机所需的估计数量，并使模型更容易解释。该建议建议探索了最近提出的发现各种统计模型的这些约束的方法。本提案的最后一条主线涉及在对通常被认为是“连续”变量的内容进行建模时所作假设的现实问题。这些数据通常被建模为真正连续的，遵循特定的分布（正态分布），或两者兼而有之。在这个线程中，考虑了更灵活的假设，并适应了表示连续变量的数据实际上只知道有限的精度，这可能会影响结果的情况。探索将确定在哪些情况下，这种有限的精度很重要，以及在考虑有限的精度和不太严格的假设时，答案的准确性如何。所有这些问题都将得到解决，因为高素质的人员开发和应用新的技能，在分析现实的，有时不方便的，和大数据的培训。这一技能组合已被确定为加拿大境内的“人才缺口”，本提案将解决这一问题。