课题基金 / 基金详情

Learning Highly Structured Sparse Latent Variable Models

Learning Highly Structured Sparse Latent Variable Models
学习高度结构化的稀疏潜变量模型
批准号:
EP/J013293/1
负责人:
Ricardo Silva
金额:
$12.68万
依托单位:
依托单位国家:
英国
项目类别:
Research Grant
财政年份:
2012
资助国家:
英国
项目状态:
已结题
起止时间:
2012 至 --

项目摘要

项目成果

Ricardo Silva的其他基金

相似基金

相关文献

中文摘要
翻译
技术进步带来了在高维数据库中收集和分析模式的能力。一种特殊类型的分析涉及的问题是,记录的变量间接地测量了解释观察到的关联的隐藏因素。例如,最近的2009年全国国民医疗服务体系员工调查,对10万多名员工进行了调查,其中包含了几个关于工作满意度的问题。观察到的答案模式是一些未被记录的常见隐藏因素的结果,这是很自然的。特别是,这些答案可以根据诸如对工作实践质量的看法、同事的支持等因素进行分组,而这些因素只能间接衡量。在实践中,在理解高维数据源时,将观察值减少到少量的公共因子是有用的。由于记录受到与实际因素无关的可变性来源的影响(想想某人有糟糕的一天,或者甚至错误地输入了错误的信息),删除这些人为因素也是统计问题的一部分。估计这种转换的模型被称为执行“降维”和“平滑”。有各种各样的方法来完成这些任务。在光谱的一端,有一些模型假设数据符合一些非常简单的模式,如钟形曲线和预先确定的因素。另一些则非常强大,允许灵活的模式,甚至在一些非常温和的假设下从数据推断出无限数量的因素。拟议的工作试图弥合这两个极端:非常灵活的模型的缺点是微妙的,但很重要。特别是,它们可能对数据的变化非常敏感——这意味着如果提供一组稍微不同的观察结果,可能会得出一些关于隐藏因素的非常不同的结论。此外,还有计算方面的问题:计算期望的估计通常需要一个迭代的过程,这个过程需要对这些估计进行一些初步的猜测。因此,即使对于固定的数据集,如果没有仔细选择这样的初始猜测,结果也会有很大的不同。我们的动机是,如果一个人确实有这些顾虑,那么他可能会麻烦地将有关该领域的领域知识结合起来。结果是:我们的目标不是通用的,而是针对存在一些合理领域知识的应用程序。特别地,我们关注的问题是,感兴趣的隐藏目标是预先指定的,但可能存在无限多个其他目标。当我们将数据映射到隐藏变量的固定空间时,我们提供了一种方法,该方法对于存在无限大数量的其他隐式公共因子具有鲁棒性。所提出的模型是自适应的:它们解释了给定隐藏因素之间可能存在的额外可变性,这些因素可能被更简单的模型忽略。同时,它们被设计成对初始条件不太敏感,同时对数据集的微小变化不太敏感。
英文摘要
Technological advances have brought the ability of collecting and analysing patterns in high-dimensional databases. One particular type of analysis concerns problems where the recorded variables indirectly measure hidden factors that explain away observed associations. For instance, the recent National NHS Staff Survey of 2009, taken by over one hundred thousand staff members, contained several questions on job satisfaction. It is only natural that the patterns of observed answers are the result of some common hidden factors that remain unrecorded. In particular, such answers could arguably be grouped by factors such as perceptions of the quality of work practice, support of colleagues and so on, that are only indirectly measured.In practice, when making sense out of a high-dimensional data source, it is useful to reduce the observations to a small number of common factors. Since records are affected by sources of variability that are unrelated to the actual factors (think of someone having a bad day, or even typing wrong information by mistake), removing such artifacts is also part of the statistical problem. A model that estimates such transformations is said to perform "dimensionality reduction" and "smoothing".There are a variety of methods to accomplish such tasks. At one end of the spectrum, there are models that assume the data match some very simple patterns such as bell curves and pre-determined factors. Others are very powerful, allowing for flexible patterns and even an infinite number of factors that are inferred from data under some very mild assumptions. The proposed work tries to bridge these extremes: the shortcomings of the very flexible models are subtle but important. In particular, they can be very sensitive to changes in the data - meaning some very different conclusions about the hidden factors might be achieved if a slightly different set of observations is provided. Moreover there are computational concerns: calculating the desired estimates usually requires an iterative process, a process that needs some initial guess about these estimates. So, even for a fixed dataset, results can vary considerably if such an initial guess is not carefully chosen. Our motivation is that if one does have these concerns, one might as well take the trouble of incorporating domain knowledge about the domain. The upshot: we do not aim to be general, and instead target applications where some reasonable domain knowledge exists. In particular, we focus on problems where the hidden targets of interest are pre-specified, but infinitely many others might exist. While we map our data to a fixed space of hidden variables, we provide an approach that is robust to the presence of an unbounded number of other, implicit, common factors. The proposed models are adaptive: they account for possible extra variability between the given hidden factors that would be missed by the simpler models. At the same time, they are designed to be less sensitive to initial conditions while being less sensitive to small changes in the datasets.
期刊论文(3)
专著(0)
科研奖励(0)
会议论文
DOI: 10.1007/s11222-015-9557-6
发表时间: 2015-06
期刊: Statistics and Computing
影响因子: 2.2
作者: [Ricardo Silva;Freddie Kalaitzis]
通讯作者: Ricardo Silva;Freddie Kalaitzis
Interdisciplinary Bayesian Statistics - EBEB 2014
跨学科贝叶斯统计 - EBEB 2014
DOI: 10.1007/978-3-319-12454-4_7
发表时间: 2015
期刊:
影响因子: --
作者: [Silva R]
通讯作者: Silva R
DOI: --
发表时间: 2013-06
期刊:
影响因子: --
作者: [Freddie Kalaitzis;Ricardo Silva]
通讯作者: Freddie Kalaitzis;Ricardo Silva
The Causal Continuum - Transforming Modelling and Computation in Causal Inference
  • 批准号:
    EP/W024330/1
  • 项目类别:
    Fellowship
  • 资助金额:
    $171.2万
  • 财政年份:
    2022
  • 负责人:
    Ricardo Silva
  • 依托单位:
Nodes from the Underground: Causal and Probabilistic Approaches for Complex Transportation Networks
  • 批准号:
    EP/N020723/1
  • 项目类别:
    Research Grant
  • 资助金额:
    $50.32万
  • 财政年份:
    2016
  • 负责人:
    Ricardo Silva
  • 依托单位:
海外基金