Collaborative Research: Framework: Data: NSCI: HDR: GeoSCIFramework: Scalable Real-Time Streaming Analytics and Machine Learning for Geoscience and Hazards Research
协作研究:框架:数据:NSCI:HDR:GeoSCIFramework:用于地球科学和灾害研究的可扩展实时流分析和机器学习
基本信息
- 批准号:2219975
- 负责人:
- 金额:$ 89.91万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2021
- 资助国家:美国
- 起止时间:2021-10-01 至 2024-08-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
This project develops a real-time processing system capable of handling a large mix of sensor observations. The focus of this system is automation of the detection of natural hazard events using machine learning, as the events are occurring. A four-organization collaboration (UNAVCO, University of Colorado, University of Oregon, and Rutgers University) develops a data framework for generalized real-time streaming analytics and machine learning for geoscience and hazards research. This work will support rapid analysis and understanding of data associated with hazardous events (earthquakes, volcanic eruptions, tsunamis). This project uses a collaboration between computer scientists and geoscientists to develop a data framework for generalized real-time streaming analytics and machine learning for geoscience and hazards research. It focuses on the aggregation and integration of a large number of data streams into a coherent system that supports analysis of the data streams in real-time. The framework will offer machine-learning-based tools designed to detect signals of events, such as earthquakes and tsunamis, that might only be detectable when looking at a broad selection of observational inputs. The architecture sets up a fast data pipeline by combining a group of open source components that make big data applications viable and easier to develop. Data sources for the project draw primarily upon the 1500+ sensors from the EarthScope networks currently managed by UNAVCO and the Incorporated Research Institutions for Seismology (IRIS), as well as the Ocean Observatories Initiative (OOI) cabled array data managed by Rutgers University. Machine learning (ML) algorithms will be researched and applied to the tsunami and earthquake use cases. Initially, the project plans to employ an advanced convolutional neural network method in a multi-data environment. The method has only been applied to seismic waveforms, so the project will explore extending the method to a multi-data environment. The approach is expected to be extensible beyond detection and characterization of earthquakes to include the onset of other geophysical signals such as slow-slip events or magmatic intrusion, expanding the potential for new scientific discoveries. The framework is applied to use cases in the Cascadia subduction zone and Yellowstone: these locations combine the expertise of the science team with locations where EarthScope and OOI have the greatest concentration of instruments. The architecture will be transportable and scalable, running in a Docker environment on laptops, local clusters and the cloud. Integral to the project will be development, documentation and training using collaborative online resources such as GitLab and Jupyter Notebooks, and utilizing NSF XSEDE resources to make larger datasets and computational resources more widely available.This award by the NSF Office of Advanced Cyberinfrastructure is jointly supported by the Cross-Cutting Program and Division of Earth Sciences within the NSF Directorate for Geosciences, the Big Data Science and Engineering Program within the Directorate for Computer and Information Science and Engineering, and the EarthCube Program jointly sponsored by the NSF Directorate for Geosciences and the Office of Advanced Cyberinfrastructure.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
该项目开发了一个实时处理系统,能够处理大量混合的传感器观测。该系统的重点是使用机器学习自动检测自然灾害事件,因为事件正在发生。 四个组织(UNAVCO、科罗拉多大学、俄勒冈州大学和罗格斯大学)合作开发了一个数据框架,用于地球科学和灾害研究的广义实时流分析和机器学习。 这项工作将有助于快速分析和了解与危险事件(地震、火山爆发、海啸)有关的数据。 该项目利用计算机科学家和地球科学家之间的合作,为地球科学和灾害研究开发通用实时流分析和机器学习的数据框架。 它侧重于将大量数据流聚合和集成到一个支持实时数据流分析的连贯系统中。该框架将提供基于机器学习的工具,旨在检测地震和海啸等事件的信号,这些信号只有在观察广泛的观测输入时才能检测到。 该架构通过结合一组开源组件建立了一个快速的数据管道,这些组件使大数据应用程序可行且更易于开发。该项目的数据来源主要来自目前由联合国教科文组织和联合地震研究所管理的EarthScope网络的1500多个传感器,以及罗格斯大学管理的海洋观测站倡议有线阵列数据。 机器学习(ML)算法将被研究并应用于海啸和地震用例。 最初,该项目计划在多数据环境中采用先进的卷积神经网络方法。 该方法仅适用于地震波形,因此该项目将探索将该方法扩展到多数据环境。 该方法预计将扩展到地震的检测和定性之外,包括其他地球物理信号的开始,如缓慢滑动事件或岩浆侵入,扩大新的科学发现的潜力。 该框架适用于卡斯卡迪亚俯冲带和黄石公园的用例:这些地点将科学团队的专业知识与EarthScope和OOI仪器最集中的地点相结合。 该架构将是可移植和可扩展的,在笔记本电脑,本地集群和云上的Docker环境中运行。 该项目的组成部分将是使用协作在线资源(如GitLab和Githyter Notebooks)进行开发、文档编制和培训,并利用NSF XSEDE资源使更大的数据集和计算资源更广泛地可用。NSF高级网络基础设施办公室的这一奖项由NSF地球科学理事会的交叉项目和地球科学部门共同支持,计算机和信息科学与工程局的大数据科学与工程项目,该奖项反映了NSF的法定使命,并通过使用基金会的知识价值和更广泛的影响进行评估,被认为值得支持审查标准。
项目成果
期刊论文数量(2)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Toward Democratizing Access to Facilities Data: A Framework for Intelligent Data Discovery and Delivery
- DOI:10.1109/mcse.2022.3179408
- 发表时间:2021-12
- 期刊:
- 影响因子:2.1
- 作者:Yubo Qin;I. Rodero;M. Parashar
- 通讯作者:Yubo Qin;I. Rodero;M. Parashar
Accelerating Data-Intensive Seismic Research Through Parallel Workflow Optimization and Federated Cyberinfrastructure
通过并行工作流程优化和联合网络基础设施加速数据密集型地震研究
- DOI:10.1145/3624062.3624276
- 发表时间:2023
- 期刊:
- 影响因子:0
- 作者:Adair, Marcus;Rodero, Ivan;Parashar, Manish;Melgar, Diego
- 通讯作者:Melgar, Diego
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Ivan Rodero其他文献
Grid broker selection strategies using aggregated resource information
- DOI:
10.1016/j.future.2009.07.009 - 发表时间:
2010-01-01 - 期刊:
- 影响因子:
- 作者:
Ivan Rodero;Francesc Guim;Julita Corbalan;Liana Fong;S. Masoud Sadjadi - 通讯作者:
S. Masoud Sadjadi
In-situ feature-based objects tracking for data-intensive scientific and enterprise analytics workflows
- DOI:
10.1007/s10586-014-0396-6 - 发表时间:
2014-08-22 - 期刊:
- 影响因子:4.100
- 作者:
Solomon Lasluisa;Fan Zhang;Tong Jin;Ivan Rodero;Hoang Bui;Manish Parashar - 通讯作者:
Manish Parashar
Ivan Rodero的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Ivan Rodero', 18)}}的其他基金
CIF21 DIBBs: EI: Virtual Data Collaboratory: A Regional Cyberinfrastructure for Collaborative Data Intensive Science
CIF21 DIBB:EI:虚拟数据协作:协作数据密集型科学的区域网络基础设施
- 批准号:
2220826 - 财政年份:2021
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: Framework: Data: NSCI: HDR: GeoSCIFramework: Scalable Real-Time Streaming Analytics and Machine Learning for Geoscience and Hazards Research
协作研究:框架:数据:NSCI:HDR:GeoSCIFramework:用于地球科学和灾害研究的可扩展实时流分析和机器学习
- 批准号:
1835692 - 财政年份:2019
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
NSF Large Facilities Cyberinfrastructure Workshop
NSF 大型设施网络基础设施研讨会
- 批准号:
1742969 - 财政年份:2017
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
EAGER: Online Processing of Data in Large Facilities using National Advanced CyberInfrastructure
EAGER:使用国家先进网络基础设施在线处理大型设施中的数据
- 批准号:
1745246 - 财政年份:2017
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
SPX: Collaborative Research: Cross-layer Application-Aware Resilience at Extreme Scale (CAARES)
SPX:协作研究:超大规模跨层应用程序感知弹性 (CAARES)
- 批准号:
1725649 - 财政年份:2017
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
CIF21 DIBBs: EI: Virtual Data Collaboratory: A Regional Cyberinfrastructure for Collaborative Data Intensive Science
CIF21 DIBB:EI:虚拟数据协作:协作数据密集型科学的区域网络基础设施
- 批准号:
1640834 - 财政年份:2016
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
BIGDATA: Collaborative Research: IA: F: Fractured Subsurface Characterization using High Performance Computing and Guided by Big Data
BIGDATA:协作研究:IA:F:使用高性能计算和大数据指导的断裂地下表征
- 批准号:
1546145 - 财政年份:2016
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
CRII: CI: Exploring Advanced Cyber-Infrastructure Co-Design for Big Data Analytics
CRII:CI:探索大数据分析的高级网络基础设施协同设计
- 批准号:
1464317 - 财政年份:2015
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
相似国自然基金
Research on Quantum Field Theory without a Lagrangian Description
- 批准号:24ZR1403900
- 批准年份:2024
- 资助金额:0.0 万元
- 项目类别:省市级项目
Cell Research
- 批准号:31224802
- 批准年份:2012
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research
- 批准号:31024804
- 批准年份:2010
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research (细胞研究)
- 批准号:30824808
- 批准年份:2008
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
- 批准号:10774081
- 批准年份:2007
- 资助金额:45.0 万元
- 项目类别:面上项目
相似海外基金
EAGER/Collaborative Research: An LLM-Powered Framework for G-Code Comprehension and Retrieval
EAGER/协作研究:LLM 支持的 G 代码理解和检索框架
- 批准号:
2347624 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: An Integrated Framework for Learning-Enabled and Communication-Aware Hierarchical Distributed Optimization
协作研究:支持学习和通信感知的分层分布式优化的集成框架
- 批准号:
2331710 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: An Integrated Framework for Learning-Enabled and Communication-Aware Hierarchical Distributed Optimization
协作研究:支持学习和通信感知的分层分布式优化的集成框架
- 批准号:
2331711 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: A Semiconductor Curriculum and Learning Framework for High-Schoolers Using Artificial Intelligence, Game Modules, and Hands-on Experiences
协作研究:利用人工智能、游戏模块和实践经验为高中生提供半导体课程和学习框架
- 批准号:
2342747 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: Dynamic connectivity of river networks as a framework for identifying controls on flux propagation and assessing landscape vulnerability to change
合作研究:河流网络的动态连通性作为识别通量传播控制和评估景观变化脆弱性的框架
- 批准号:
2342936 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Continuing Grant
Collaborative Research: Dynamic connectivity of river networks as a framework for identifying controls on flux propagation and assessing landscape vulnerability to change
合作研究:河流网络的动态连通性作为识别通量传播控制和评估景观变化脆弱性的框架
- 批准号:
2342937 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Continuing Grant
Collaborative Research: NeTS: Small: A Privacy-Aware Human-Centered QoE Assessment Framework for Immersive Videos
协作研究:NetS:小型:一种具有隐私意识、以人为本的沉浸式视频 QoE 评估框架
- 批准号:
2343619 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
EAGER/Collaborative Research: An LLM-Powered Framework for G-Code Comprehension and Retrieval
EAGER/协作研究:LLM 支持的 G 代码理解和检索框架
- 批准号:
2347623 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: Scalable Circuit theoretic Framework for Large Grid Simulations and Optimizations: from Combined T&D Planning to Electromagnetic Transients
协作研究:大型电网仿真和优化的可扩展电路理论框架:来自组合 T
- 批准号:
2330195 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant
Collaborative Research: A Semiconductor Curriculum and Learning Framework for High-Schoolers Using Artificial Intelligence, Game Modules, and Hands-on Experiences
协作研究:利用人工智能、游戏模块和实践经验为高中生提供半导体课程和学习框架
- 批准号:
2342748 - 财政年份:2024
- 资助金额:
$ 89.91万 - 项目类别:
Standard Grant