Flight-Worthy Condor: Enabling Scientific Discovery
适合飞行的秃鹰:实现科学发现
基本信息
- 批准号:0850745
- 负责人:
- 金额:$ 270万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2009
- 资助国家:美国
- 起止时间:2009-06-01 至 2013-05-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
"This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5)."Dependable and effective access to large amounts of sustained computing power is strategic to scientific discovery in a vast range of disciplines. An ever expanding number of science communities worldwide rely on Condor software tools to harness the power of shared computing resources. Closer to home, over 100 US universities have installed these tools on their campus, and downloads of the software surpass 2,000 per month. From fulfilling a strategic role of managing high-energy physics computing resources at Brookhaven and Fermi National Labs to enabling research computing at smaller under-represented institutions, Condor technology represents the culmination of 20 years of distributed computing research. The efforts outlined in this proposal allow the research contributions of this software to continue, and strengthen the momentum to enable academia and industry to leverage the power of effective distributed computing. The intellectual merit of the proposed effort lies within the novelty of the distributed mechanisms implemented and the software engineering challenges the team faces in developing, maintaining and supporting nearly one million lines of code in an academic setting. As a leading provider of open-source distributed computing capabilities, the software plays an important role as a primary ?building block? in many campus grids as well as community, national and international cyber-infrastructure initiatives. The size, complexity, diversity and quality assurance requirements of the software also lead to challenges in the area of software engineering and integration. Daily builds and testing, version control, software tracking and distributed troubleshooting of multi-layer software stacks are examples of the ongoing challenges. The broader impacts of this effort are interdisciplinary and span both academia and industry. Researchers who use Condor tools are able to greatly increase their computing throughput, and consequently increase the size and complexity of the problems they study. The software is widely used in many compute-intensive disciplines, including Art, Biotechnology, Economics, Chemistry, Medical, High Energy and Nuclear Physics, and Computer Science, and has been adopted by both universities and government labs. Furthermore, the software plays a critical role by managing the majority of the compute resources for the US Large Hadron Collider experiments, as well as serving 250 LIGO scientists studying gravitational waves. Condor technology fuels new commercial offerings, such as Red Hat's MRG and Cycle Computing's CycleServer in the past year. These technologies are also used for mission-critical tasks in industry; e.g., Micron Technology uses Condor on 15,000 CPUs worldwide to validate memory chip manufacturing, J.P. Morgan uses Condor on 5,000 CPUs for real-time financial portfolio analysis, and Disney's fully animated film "The Wild" used Condor to render more than 70 million frames. Because the high throughput computing capabilities we offer effectively harness even desktop machines running Windows, it enables students and scientists at underrepresented institutions to pursue research and instruction requiring considerable computing in the absence of access to traditional high-end computing facilities. This proposal directly funds five students, and through GLOW it will provide an excellent training environment to new generations of interdisciplinary professionals.
“该奖项是根据2009年美国复苏和再投资法案(公法111-5)资助的。“可靠和有效地获得大量持续的计算能力对广泛学科的科学发现具有战略意义。全球越来越多的科学界依靠Condor软件工具来利用共享计算资源的力量。在美国,超过100所大学在校园内安装了这些工具,每月下载量超过2,000次。从在布鲁克海文和费米国家实验室管理高能物理计算资源的战略角色,到在规模较小的代表性不足的机构实现研究计算,Condor技术代表了20年分布式计算研究的顶峰。本提案中概述的努力使该软件的研究贡献得以继续,并加强了使学术界和工业界能够利用有效分布式计算的动力的势头。所提出的努力的智力价值在于所实现的分布式机制的新奇,以及团队在学术环境中开发、维护和支持近100万行代码所面临的软件工程挑战。作为开源分布式计算能力的领先提供商,该软件作为主要的?积木?在许多校园网格以及社区,国家和国际网络基础设施的倡议。软件的规模、复杂性、多样性和质量保证要求也给软件工程和集成领域带来了挑战。日常构建和测试、版本控制、软件跟踪以及多层软件堆栈的分布式故障排除都是持续挑战的例子。 这一努力的更广泛影响是跨学科的,跨越学术界和工业界。使用Condor工具的研究人员能够大大提高他们的计算吞吐量,从而增加他们研究的问题的规模和复杂性。该软件广泛应用于许多计算密集型学科,包括艺术,生物技术,经济学,化学,医学,高能和核物理以及计算机科学,并已被大学和政府实验室采用。此外,该软件通过管理美国大型强子对撞机实验的大部分计算资源以及为250名研究引力波的LIGO科学家提供服务而发挥着关键作用。秃鹰技术推动了新的商业产品,如红帽的MRG和循环计算的循环服务器在过去的一年。这些技术也用于工业中的关键任务;例如,美光科技在全球15,000个CPU上使用Condor来验证存储芯片制造,J. P. Morgan在5,000个CPU上使用Condor进行实时金融投资组合分析,迪士尼的全动画电影《荒野》使用Condor渲染了7000多万帧。由于我们提供的高吞吐量计算能力甚至可以有效利用运行Windows的台式机,因此它使代表性不足的机构的学生和科学家能够在无法访问传统高端计算设施的情况下进行需要大量计算的研究和教学。该提案直接资助五名学生,通过GLOW,它将为新一代跨学科专业人员提供良好的培训环境。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Miron Livny其他文献
Seeking the truth about ad hoc join costs
- DOI:
10.1007/s007780050043 - 发表时间:
1997-08-01 - 期刊:
- 影响因子:3.800
- 作者:
Laura M. Haas;Michael J. Carey;Miron Livny;Amit Shukla - 通讯作者:
Amit Shukla
Condor-G: A Computation Management Agent for Multi-Institutional Grids
- DOI:
10.1023/a:1015617019423 - 发表时间:
2002-07-01 - 期刊:
- 影响因子:4.100
- 作者:
James Frey;Todd Tannenbaum;Miron Livny;Ian Foster;Steven Tuecke - 通讯作者:
Steven Tuecke
Foundations of visual metaphors for schema display
- DOI:
10.1007/bf00962239 - 发表时间:
1994-07-01 - 期刊:
- 影响因子:3.400
- 作者:
Eben M. Haber;Yannis E. Ioannidis;Miron Livny - 通讯作者:
Miron Livny
Process hijacking
进程劫持
- DOI:
10.1109/hpdc.1999.805296 - 发表时间:
1999 - 期刊:
- 影响因子:0
- 作者:
Victor C. Zandy;Barton P. Miller;Miron Livny - 通讯作者:
Miron Livny
Multiple Bypass: Interposition Agents for Distributed Computing
- DOI:
10.1023/a:1011412209850 - 发表时间:
2001-03-01 - 期刊:
- 影响因子:4.100
- 作者:
Douglas Thain;Miron Livny - 通讯作者:
Miron Livny
Miron Livny的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Miron Livny', 18)}}的其他基金
Partnership to Advance Throughput Computing (PATh)
合作推进吞吐量计算 (PATH)
- 批准号:
2030508 - 财政年份:2020
- 资助金额:
$ 270万 - 项目类别:
Cooperative Agreement
Accomplisment Based Renewal (ABR) to the award Flight-Worthy Condor: Enabling Scientific Discovery
值得飞行的秃鹰奖的基于成就的更新(ABR):实现科学发现
- 批准号:
1321762 - 财政年份:2013
- 资助金额:
$ 270万 - 项目类别:
Continuing Grant
THE OPEN SCIENCE GRID The Next Five Years: Distributed High Throughput Computing for the Nation's Scientists, Researchers, Educators, and Students
开放科学网格未来五年:为国家科学家、研究人员、教育工作者和学生提供分布式高吞吐量计算
- 批准号:
1148698 - 财政年份:2012
- 资助金额:
$ 270万 - 项目类别:
Cooperative Agreement
Distributed Computing, Multidisciplinary Science and the NSF's Software Insitute Program
分布式计算、多学科科学和 NSF 的软件研究所计划
- 批准号:
1049408 - 财政年份:2010
- 资助金额:
$ 270万 - 项目类别:
Standard Grant
The Open Science Grid Cluster Adoption Program
开放科学网格集群采用计划
- 批准号:
0943688 - 财政年份:2009
- 资助金额:
$ 270万 - 项目类别:
Standard Grant
SDCI NMI Improvement: Metronome - The NMI Build and Test Framework
SDCI NMI 改进:Metronome - NMI 构建和测试框架
- 批准号:
0721684 - 财政年份:2007
- 资助金额:
$ 270万 - 项目类别:
Continuing Grant
The NMI Build and Test Laboratory at the University of Wisconsin-Madison
威斯康星大学麦迪逊分校 NMI 构建和测试实验室
- 批准号:
0726012 - 财政年份:2007
- 资助金额:
$ 270万 - 项目类别:
Standard Grant
MRI: Acquisition of the Second Phase of the Grid Laboratory of Wisconsin (GLOW-II)
MRI:收购威斯康星州网格实验室第二期 (GLOW-II)
- 批准号:
0722936 - 财政年份:2007
- 资助金额:
$ 270万 - 项目类别:
Standard Grant
Sustaining and Extending the Open Science Grid: Science Innovation on a PetaScale Nationwide Facility
维持和扩展开放科学网格:PetaScale 全国设施的科学创新
- 批准号:
0621704 - 财政年份:2006
- 资助金额:
$ 270万 - 项目类别:
Cooperative Agreement
相似海外基金
KARMMA: Mass Mapping Worthy of LSST
KARMMA:值得 LSST 进行的大规模绘图
- 批准号:
2009401 - 财政年份:2020
- 资助金额:
$ 270万 - 项目类别:
Standard Grant
Being costly, seeming worthy: Does authenticity matter for social movement success?
成本高昂,看似有价值:真实性对于社会运动的成功重要吗?
- 批准号:
ES/T008733/1 - 财政年份:2019
- 资助金额:
$ 270万 - 项目类别:
Fellowship
Kings Worthy community solar microgrid with storage
Kings Worthy 社区太阳能微电网(带存储功能)
- 批准号:
971503 - 财政年份:2016
- 资助金额:
$ 270万 - 项目类别:
Small Business Research Initiative
Accomplisment Based Renewal (ABR) to the award Flight-Worthy Condor: Enabling Scientific Discovery
值得飞行的秃鹰奖的基于成就的更新(ABR):实现科学发现
- 批准号:
1321762 - 财政年份:2013
- 资助金额:
$ 270万 - 项目类别:
Continuing Grant
Small dealers and worthy men: the politics of scale from Bryan to Nader
小商人和有价值的人:从布莱恩到纳德的规模政治
- 批准号:
AH/J004103/1 - 财政年份:2012
- 资助金额:
$ 270万 - 项目类别:
Fellowship
U.S.-Ukraine Workshop: Information Technology in Ukraine: From a Worthy Past to a Bright Future
美国-乌克兰研讨会:乌克兰的信息技术:从值得的过去到光明的未来
- 批准号:
0232083 - 财政年份:2002
- 资助金额:
$ 270万 - 项目类别:
Standard Grant