DMS-EPSRC: Certifying Accuracy of Randomized Algorithms in Numerical Linear Algebra
DMS-EPSRC:验证数值线性代数中随机算法的准确性
基本信息
- 批准号:EP/Y030990/1
- 负责人:
- 金额:$ 38.14万
- 依托单位:
- 依托单位国家:英国
- 项目类别:Research Grant
- 财政年份:2024
- 资助国家:英国
- 起止时间:2024 至 无数据
- 项目状态:未结题
- 来源:
- 关键词:
项目摘要
Among the most exciting developments over the last two decades is the rapid advances in randomized numerical linear algebra (RNLA). This has caused a paradigmatic shift in the computational sciences, and has enabled matrix computations of unprecedented scale. In addition to speed, RNLA often provides solutions with exceptional accuracy and robustness. Success stories in RNLA include low-rank approximation, least-squares problems, and trace estimation. In addition, the field has witnessed recent progress in linear systems, eigenvalue problems, and tensor approximation. Despite these success stories, there is often a wide gap between theory and practice. To illustrate, consider the task of "subspace sketching", which is a key idea in RNLA. There is theory to support a claim that structured embeddings (aka "fast Johnson-Lindenstrauss transforms") based on FFTs provide a geometry preserving subspace embedding if O(dlogd) samples are used for a d-dimensional subspace. However, this is usually a pessimistic estimate, and O(d), say 2d samples, is known to suffice in most problems that arise in practice. A similar story holds for sparse sketches, for which beautiful theory is available, but in practice they often perform much better for a particular instance. The same is true even of deterministic algorithms, such as the column-pivoted QR factorization, specifically whether it gives a rank-revealing QR factorization. While the worst-case analysis suggests the algorithm can be exponentially unstable, decades of practical computation has shown that such examples are vanishingly rare. Clearly, in any of these problems, it would be highly useful to have a methodology to assess the correctness of a solution computed for the particular problem at hand.The objective of this proposal is to develop techniques for computing upper bounds on the error incurred by a particular instantiation of a randomized algorithm for solving a linear algebraic problem. Such bounds would allow users to combine the computational speed of randomized algorithms with the reliability of classical deterministic methods. It would also help users in safely balancing the needs of speed and precision. The approach we propose to follow here is close in spirit to the notion of "responsibly reckless" algorithms, recently coined by Jack Dongarra, the latest Turing Award laureate. The idea is to try a fast, but potentially unstable, algorithm, to obtain a potential solution. Then we assess the quality of the solution in a reliable fashion. Specifically, the purpose of this proposal is to develop fast and robust algorithms for this assessment, thereby certifying the correctness of the solution, or otherwise output a warning that the solution may be inaccurate. We will design algorithms, develop theory, and implement them in open-source software optimised for modern computing platforms.The historical development of finite element methods would help put our project in context. A priori analysis came first, and error bounds that were invaluable in guiding the design of finite element spaces were proven. However, these bounds were too pessimistic to usefully assess the error incurred in any particular instantiation, since the bound had to cover the most adversarial input. A posteriori analysis then emerged in response, as it applies specifically to a problem at hand and can, by drawing on quantities available post-computation, provide accurate estimates or bounds on the error. In this project we aim to achieve the same in the RNLA context.Specific directions we will pursue include: Subspace embedding, low-rank approximation, column-pivoted QR factorization, linear systems, eigenvalue problems and SVD, least-squares problems, and building Krylov subspaces efficiently.
在过去的二十年中,最令人兴奋的发展之一是随机数值线性代数(RNLA)的快速发展。这导致了计算科学的范式转变,并使矩阵计算达到了前所未有的规模。除了速度之外,RNLA通常还提供具有出色准确性和鲁棒性的解决方案。RNLA的成功案例包括低秩近似、最小二乘问题和迹估计。此外,该领域在线性系统、本征值问题和张量近似方面也取得了新的进展。尽管有这些成功的故事,但理论和实践之间往往存在巨大差距。为了说明,考虑“子空间草图”的任务,这是RNLA中的一个关键思想。有理论支持基于FFT的结构化嵌入(又名“快速约翰逊-林登施特劳斯变换”)提供几何保持子空间嵌入,如果O(dlogd)样本用于d维子空间。然而,这通常是一个悲观的估计,并且O(d),比如2d个样本,在实践中出现的大多数问题中已经足够了。类似的情况也适用于稀疏的草图,对于稀疏的草图,漂亮的理论是可用的,但在实践中,它们通常在特定的实例中表现得更好。即使是确定性算法也是如此,比如列枢轴QR分解,特别是它是否给出了一个显示秩的QR分解。虽然最坏情况分析表明该算法可能是指数不稳定的,但数十年的实际计算表明,这样的例子非常罕见。显然,在任何这些问题中,这将是非常有用的,有一种方法来评估的正确性的解决方案计算的特定problem hand.The目标的建议是开发技术计算上界的错误由一个特定的实例的随机算法解决线性代数问题。这样的界限将允许用户将随机算法的计算速度与经典确定性方法的可靠性联合收割机结合起来。它还将帮助用户安全地平衡速度和精度的需求。我们在这里提出的方法在精神上接近“负责任的鲁莽”算法的概念,最近由最新的图灵奖获得者Jack Dongarra创造。这个想法是尝试一种快速但可能不稳定的算法,以获得潜在的解决方案。然后我们以可靠的方式评估解决方案的质量。具体而言,该提案的目的是为该评估开发快速和鲁棒的算法,从而证明解决方案的正确性,或者以其他方式输出解决方案可能不准确的警告。我们将设计算法,开发理论,并在为现代计算平台优化的开源软件中实现它们。有限元方法的历史发展将有助于我们的项目。先验分析是第一位的,并且证明了在指导有限元空间的设计中非常宝贵的误差界限。然而,这些界限过于悲观,无法有效地评估任何特定实例化中产生的错误,因为界限必须覆盖最具对抗性的输入。随后出现了后验分析,因为它专门适用于手头的问题,并且可以通过利用计算后可用的数量来提供准确的估计或误差范围。在这个项目中,我们的目标是在RNLA上下文中实现同样的目标。我们将追求的具体方向包括:子空间嵌入,低秩近似,列枢轴QR分解,线性系统,特征值问题和SVD,最小二乘问题,以及有效地构建Krylov子空间。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Yuji Nakatsukasa其他文献
Asymptotic expansion and estimation of volatility
渐近展开和波动率估计
- DOI:
- 发表时间:
2016 - 期刊:
- 影响因子:0
- 作者:
Satoru Adachi;Satoru Iwata;Yuji Nakatsukasa;and Akiko Takeda;吉田朋広 - 通讯作者:
吉田朋広
Global Optimization via Eigenvalues
通过特征值进行全局优化
- DOI:
- 发表时间:
2016 - 期刊:
- 影响因子:0
- 作者:
Satoru Iwata;Yuji Nakatsukasa;Akiko Takeda;中務佑治 - 通讯作者:
中務佑治
Ultra high frequency data: construction of quasi likelihood analysis, and some data analysis
超高频数据:拟似然分析的构建,以及一些数据分析
- DOI:
- 发表时间:
2015 - 期刊:
- 影响因子:0
- 作者:
Satoru Iwata;Yuji Nakatsukasa;Akiko Takeda;中務佑治;Nakahiro Yoshida;Nakahiro Yoshida;中務佑治;Nakahiro Yoshida - 通讯作者:
Nakahiro Yoshida
Shifted Cholesky QR algorithm for computing the QR factorization of ill-conditioned matrices
用于计算病态矩阵 QR 分解的移位 Cholesky QR 算法
- DOI:
- 发表时间:
2019 - 期刊:
- 影响因子:0
- 作者:
Takeshi Fukaya;Ramaseshan Kannan;Yuji Nakatsukasa;Yusaku Yamamoto;Yuka Yanagisawa - 通讯作者:
Yuka Yanagisawa
Shifted Cholesky QR for Computing the QR Factorization of Ill-Conditioned Matrices
用于计算病态矩阵 QR 分解的平移 Cholesky QR
- DOI:
10.1137/18m1218212 - 发表时间:
2020 - 期刊:
- 影响因子:3.1
- 作者:
Takeshi Fukaya;Ramaseshan Kannan;Yuji Nakatsukasa;Yusaku Yamamoto;Yuka Yanagisawa - 通讯作者:
Yuka Yanagisawa
Yuji Nakatsukasa的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
相似海外基金
DMS-EPSRC: Asymptotic Analysis of Online Training Algorithms in Machine Learning: Recurrent, Graphical, and Deep Neural Networks
DMS-EPSRC:机器学习中在线训练算法的渐近分析:循环、图形和深度神经网络
- 批准号:
EP/Y029089/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
CMMI-EPSRC: Damage Tolerant 3D micro-architectured brittle materials
CMMI-EPSRC:耐损伤 3D 微结构脆性材料
- 批准号:
EP/Y032489/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
ECCS-EPSRC Micromechanical Elements for Photonic Reconfigurable Zero-Static-Power Modules
用于光子可重构零静态功率模块的 ECCS-EPSRC 微机械元件
- 批准号:
EP/X025381/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
EPSRC-SFI: Developing a Quantum Bus for germanium hole-based spin qubits on silicon (GeQuantumBus)
EPSRC-SFI:为硅上基于锗空穴的自旋量子位开发量子总线 (GeQuantumBus)
- 批准号:
EP/X039889/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
EPSRC-SFI: Developing a Quantum Bus for germanium hole based spin qubits on silicon (Quantum Bus)
EPSRC-SFI:为硅上基于锗空穴的自旋量子位开发量子总线(量子总线)
- 批准号:
EP/X040380/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
CBET-EPSRC: TECAN - Telemetry-Enabled Carbon Aware Networking
CBET-EPSRC:TECAN - 支持遥测的碳感知网络
- 批准号:
EP/X040828/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
EPSRC-SFI:Towards power efficient microresonator frequency combs
EPSRC-SFI:迈向节能微谐振器频率梳
- 批准号:
EP/X040844/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
EPSRC Centre for Future PCI Planning
EPSRC 未来 PCI 规划中心
- 批准号:
EP/Z531182/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
EPSRC-SFI: Supercoiling-driven gene control in synthetic DNA circuits
EPSRC-SFI:合成 DNA 电路中超螺旋驱动的基因控制
- 批准号:
EP/V027395/2 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant
STREAM 2: EPSRC Place Based IAA (PB-IAA);Northern Net Zero Accelerator - Energy Systems Integration for a Decarbonised Economy
流 2:EPSRC 地方基础 IAA (PB-IAA);北方净零加速器 - 脱碳经济的能源系统集成
- 批准号:
EP/Y024052/1 - 财政年份:2024
- 资助金额:
$ 38.14万 - 项目类别:
Research Grant