Robust methods for complex data

适用于复杂数据的稳健方法

• 批准号: RGPIN-2016-04288
• 负责人: SalibianBarrera, Matias
• 金额: $ 2.4万
• 依托单位: University of British Columbia
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=664153
• 关键词: Robust; methods; complex; data

Private and public companies, all levels of government, public policy makers, and even NGO's are currently awash with data, and under increasing pressure to utilize it efficiently. Making sense of all the available information is an ongoing critical challenge, and Statistics has a fundamental role to play in translating this growing influx of data into useful information. A large proportion of these data are being collected without following established experimental protocols. As a result, users face the difficult problem of having data that may not represent a single well-defined population. This means that the results of analyzing these data may be biased because the proposed models might not apply to all the observations. To perform reliable and informative inference based on such heterogeneous data sets, we need statistical methods that can fit models to (and identify patterns on) a dominant homogeneous subset of the data without being affected by structurally different smaller subgroups of them. Robust Statistics does exactly this. I plan to develop new robust statistical methods that can be applied to the large and complex data sets that are currently predominant in many scientific disciplines. Consider, for example, data collected by tags mounted on marine mammals. These data sets are typically large, complex (high frequency, some, like 3D acceleration, observed indirectly) and noisy (e.g. location from Argos satellite tags). These data are collected by scientists interested in understanding the animals' movement and behavior, and determining their habitat. These questions and data raise challenging statistical problems. For example, the movement of the tagged animals may be influenced by the variables being measured, in such a way that the resulting observations do not constitute a random sample as it is usually understood. Furthermore, it is not uncommon for these data to contain spurious or erroneous points (poor satellite links or other sporadic equipment failures). This type of data are being collected in similar situations (e.g. personalized environmental information collected from sensors on smartphones), so my research will be applicable to a variety of different situations.**

私营和公共公司、各级政府、公共政策制定者，甚至非政府组织目前都充斥着数据，并面临着越来越大的压力，要求有效地利用这些数据。理解所有可用的信息是一个持续的关键挑战，统计在将越来越多的数据转化为有用的信息方面发挥着重要作用。这些数据中有很大一部分是在没有遵循既定实验方案的情况下收集的。因此，用户面临的困难问题是，数据可能不代表一个明确定义的群体。这意味着分析这些数据的结果可能会有偏差，因为所提出的模型可能不适用于所有观测。为了基于这种异构数据集进行可靠和信息丰富的推断，我们需要统计方法，可以将模型拟合到数据的主要同质子集（并识别其模式），而不会受到结构上不同的较小子组的影响。稳健的统计学正是这样做的。我计划开发新的强大的统计方法，可应用于目前在许多科学学科中占主导地位的大型复杂数据集。例如，考虑安装在海洋哺乳动物身上的标签收集的数据。这些数据集通常很大，复杂（高频，有些，如3D加速度，间接观察）和嘈杂（例如Argos卫星标签的位置）。这些数据是由有兴趣了解动物运动和行为并确定其栖息地的科学家收集的。这些问题和数据提出了具有挑战性的统计问题。例如，被标记的动物的运动可能会受到被测量的变量的影响，以这种方式，所得到的观察结果并不像通常理解的那样构成随机样本。此外，这些数据包含虚假或错误的点（不良的卫星链路或其他零星的设备故障）并不罕见。这种类型的数据是在类似的情况下收集的（例如从智能手机上的传感器收集的个性化环境信息），因此我的研究将适用于各种不同的情况。