Monte Carlo Methods for Analysis of Large Spatial Data
Monte Carlo Methods for Analysis of Large Spatial Data
批准号:
1106494
负责人:
Faming Liang
金额:
$19.0万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2011
资助国家:
美国
项目状态:
已结题
起止时间:
2011-08-01 至 2015-06-30
中文摘要
空间数据集在许多科学学科中进行分析,例如生态学,地质学和环境科学。 然而,经典的方法,如克里格和贝叶斯分层高斯建模,往往会因为昂贵的矩阵求逆运算而无法处理大数据集,其计算复杂度随着空间位置的数量呈立方级增加。为了缓解这一困难,各种近似方法,如协方差锥形,低维空间的空间过程近似,似然近似和马尔可夫随机场近似,已被提出的一般思想下,近似的原始空间模型与计算方便的模型。对这些方法的普遍关注是近似的充分性。在这个方案中,研究者提出了三种新的方法,贝叶斯辅助格方法,贝叶斯选址方法和边际推理方法。贝叶斯辅助格方法在观测空间中引入一个辅助格,并在辅助格上定义一个隐高斯马尔可夫随机场。 贝叶斯辅助格方法利用高斯马尔可夫随机场的一些分析结果,完全避免了似然估计中的矩阵求逆问题。贝叶斯选址方法将空间模型估计问题转化为贝叶斯变量选择问题。它在每次迭代中只处理一小部分数据,从而显著降低了数据的维度。基于Bootstrap响应的思想,提出了边缘推理方法。与贝叶斯站点选择方法一样,它在每次迭代中只处理一小部分数据,从而显著降低了数据的维度。值得注意的是,贝叶斯选址和边际推理方法在概念上与文献中存在的近似方法非常不同。现有的近似方法是使用计算方便的模型来近似原始模型。相反,贝叶斯选址和边际推理方法寻求减少数据的维度,同时不牺牲原始模型的复杂性。在这一建议中,研究人员还将所提出的方法扩展到时空模型,并将其应用于卫星气候数据。研究了时空模型中缺失数据的处理问题,为海量空间数据的统计分析提供了计算效率高或数据降维的方法。新方法解决了空间数据分析中的一些核心问题,如大矩阵求逆和缺失数据填补。预计新方法将在地质统计数据、卫星气候数据和其他大型空间数据的统计分析中发挥重要作用。该项目将在空间统计和计算大气科学领域产生更广泛的影响。研究成果将通过与其他学科研究人员的直接合作、会议报告、书籍和在学术期刊上发表的论文传播给社区。 该项目还将通过研究生直接参与项目并将成果纳入本科生和研究生课程,对教育产生重大影响。
英文摘要
Spatial data sets are analyzed in many scientific disciplines, such as ecology, geology, and environmental sciences. However, the classical approaches, such as Kriging and Bayesian hierarchical Gaussian modeling, often break down for large data sets due to expensive matrix inverse operations, whose computational complexity increases in cubic order with the number of spatial locations. To alleviate this difficulty, various approximation approaches, such as covariance tapering, lower-dimensional space spatial process approximation, likelihood approximation and Markov random field approximations, have been proposed under the general idea of approximating the original spatial model with a computationally convenient model. A general concern on these approaches is the adequacy of approximation. In this proposal, the investigators propose three new approaches, Bayesian auxiliary lattice approach, Bayesian site selection approach and marginal inference approach. The Bayesian auxiliary lattice approach introduces an auxiliary lattice to the space of observations and defines a hidden Gaussian Markov random field on the auxiliary lattice. By using some analytical results of Gaussian Markov random fields, the Bayesian auxiliary lattice approach completely avoids the problem of matrix inversion in likelihood evaluation. The Bayesian site selection approach reformulates the problem of spatial model estimation as a problem of Bayesian variable selection. It works with only a small proportion of the data at each iteration and thus significantly reduces the dimension of the data. The marginal inference approach is proposed based on the idea of bootstrap resampling. Like the Bayesian site selection approach, it works with only a small proportion of the data at each iteration and thus significantly reduces the dimension of the data. It is worth noting that the Bayesian site selection and marginal inference approaches are conceptually very different from the approximation approaches existing in the literature. The existing approximation approaches are to approximate the original model using a computationally convenient model. Instead, the Bayesian site selection and marginal inference approaches seek to reduce the dimension of the data, while not sacrificing the complexity of the original model. In this proposal, the investigators also extend the proposed approaches to spatio-temporal models with applications to satellite climate data. How to deal with missing data for spatio-temporal models are addressed.The intellectual merit of this project is to provide some computationally efficient or data dimension reduction approaches for statistical analysis of large spatial data. The new approaches address some core problems in spatial data analysis, such as large matrix inversion and missing data imputation. The new approaches are expected to play a major role in statistical analysis of geostatistical data, satellite climate data and other large spatial data. This project will have broader impacts in both communities of spatial statistics and computational atmospheric sciences. The research results will be disseminated to the communities via direct collaboration with researchers in other disciplines, conference presentations, books, and papers to be published in academic journals. The project will have also significant impacts on education through direct involvement of graduate students in the project and incorporation of results into undergraduate and graduate courses.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
A New Stochastic Neural Network: Statistical Perspectives and Applications
-
批准号:2210819
-
项目类别:Standard Grant
-
资助金额:$33.0万
-
财政年份:2022
-
负责人:Faming Liang
-
依托单位:
Scalable Algorithms for Bayesian On-Line Learning with Large-Scale Dynamic Data
-
批准号:2015498
-
项目类别:Standard Grant
-
资助金额:$25.0万
-
财政年份:2020
-
负责人:Faming Liang
-
依托单位:
Statistical Inference for Biomedical Big Data: Theory, Methods, and Tools
-
批准号:1703077
-
项目类别:Standard Grant
-
资助金额:$2.0万
-
财政年份:2017
-
负责人:Faming Liang
-
依托单位:
On Statistical Modeling and Parameter Estimation for High Dimensional Systems
-
批准号:1818674
-
项目类别:Standard Grant
-
资助金额:$12.07万
-
财政年份:2017
-
负责人:Faming Liang
-
依托单位:
On Statistical Modeling and Parameter Estimation for High Dimensional Systems
-
批准号:1612924
-
项目类别:Standard Grant
-
资助金额:$15.0万
-
财政年份:2016
-
负责人:Faming Liang
-
依托单位:
Monte Carlo Methods for Analysis of Large Spatial Data
-
批准号:1545738
-
项目类别:Standard Grant
-
资助金额:$3.88万
-
财政年份:2015
-
负责人:Faming Liang
-
依托单位:
Collaborative Research: Efficient Parallel Iterative Monte Carlo Methods for Statistical Analysis of Big Data
-
批准号:1545202
-
项目类别:Standard Grant
-
资助金额:$20.05万
-
财政年份:2015
-
负责人:Faming Liang
-
依托单位:
Collaborative Research: Efficient Parallel Iterative Monte Carlo Methods for Statistical Analysis of Big Data
-
批准号:1317131
-
项目类别:Standard Grant
-
资助金额:$22.0万
-
财政年份:2013
-
负责人:Faming Liang
-
依托单位:
Sampling from Distributions with Intractable Integrals
-
批准号:1007457
-
项目类别:Continuing Grant
-
资助金额:$10.0万
-
财政年份:2010
-
负责人:Faming Liang
-
依托单位:
Development of Stochastic Approximation Monte Carlo Methods
-
批准号:0706755
-
项目类别:Standard Grant
-
资助金额:$14.0万
-
财政年份:2007
-
负责人:Faming Liang
-
依托单位:
A Contour Based Monte Carlo Algorithm with Applications to Computational Statistics and Bioinformatics
-
批准号:0405748
-
项目类别:Standard Grant
-
资助金额:$9.0万
-
财政年份:2004
-
负责人:Faming Liang
-
依托单位:
国内基金
海外基金
登录
查看更多内容
DDH头臼匹配性三维空间形态表征及PAO
手术髋臼重定向Monte Carlo随机最优控
制
-
批准号:
-
项目类别:省市级项目
-
资助金额:10.0万元
-
批准年份:2025
-
负责人:杨鹏
-
依托单位:
复杂空间上具有特殊约束的Monte Carlo方法
-
批准号:12371269
-
项目类别:面上项目
-
资助金额:43.5万元
-
批准年份:2023
-
负责人:邓柯
-
依托单位:
基于鞘层Monte Carlo粒子仿真模型的非稳态真空弧等离子体羽流的内外流一体化数值模拟研究
-
批准号:12372297
-
项目类别:面上项目
-
资助金额:53万元
-
批准年份:2023
-
负责人:李洁
-
依托单位:
基于格子Boltzmann和Monte Carlo方法的中子输运本构关系及低维控制方程研究
-
批准号:--
-
项目类别:青年科学基金项目
-
资助金额:30万元
-
批准年份:2022
-
负责人:王亚辉
-
依托单位:
在大数据和复杂模型背景下探究更有效的Markov chain Monte Carlo算法
-
批准号:
-
项目类别:省市级项目
-
资助金额:10.0万元
-
批准年份:2022
-
负责人:焦熙云
-
依托单位:
基于Monte Carlo模拟的铒基稀土高掺杂纳米材料上转换发光过程的机理研究
-
批准号:12104179
-
项目类别:青年科学基金项目(C类)
-
资助金额:30.0万元
-
批准年份:2021
-
负责人:佐婧
-
依托单位:
嵌段共聚物在软硬壁组成的受限空间中的诱导自组装行为的Monte Carlo 研究
-
批准号:21863010
-
项目类别:地区科学基金项目
-
资助金额:41.0万元
-
批准年份:2018
-
负责人:孔维新
-
依托单位:
间接优化的高效Monte Carlo声传播研究
-
批准号:61772458
-
项目类别:面上项目
-
资助金额:16.0万元
-
批准年份:2017
-
负责人:任重
-
依托单位:
基于Monte Carlo法强化管表面颗粒-析晶垢形成机理及预测模型研究
-
批准号:51606049
-
项目类别:青年科学基金项目
-
资助金额:21.0万元
-
批准年份:2016
-
负责人:沈朝
-
依托单位:
任意各向异性三维直流电阻率巷道超前探测的并行Monte Carlo方法研究
-
批准号:41674076
-
项目类别:面上项目
-
资助金额:70.0万元
-
批准年份:2016
-
负责人:吴小平
-
依托单位: