Algorithms and Tools for Big Data Analysis and Automated Real Time Optimal or Near Optimal Decision Making for Industrial Systems

用于工业系统大数据分析和自动实时最佳或接近最佳决策的算法和工具

• 批准号: RGPIN-2017-05785
• 负责人: Yacout, Soumaya
• 金额: $ 2.04万
• 依托单位: École Polytechnique de Montréal
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2019
• 资助国家: 加拿大
• 起止时间: 2019-01-01 至 2020-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=682076
• 关键词: Algorithms; Tools; Big; Data; Analysis

Data science and data engineering have arguably become some of the most important research fields in this century. These fields are based on fundamental branches of science and engineering, namely, information technology, sensor technology, statistics, operations research, optimization, artificial intelligence, data mining and machine learning.***Along with human centric applications, some of these techniques are now being recommended by researchers in machine centric applications in which data is manufactured by machines and decisions are also made by machines based on Machine to Machine (M2M)' learning.***Presently, an important research question is how to exploit the available Big Data sets since, by definition, they consist of large volumes of data, acquired at high velocity, and in a variety of forms. Traditional data-processing and analysis techniques become inadequate.***The objective of this proposal is to develop algorithms and tools that are designed specifically to analyze and to extract knowledge from Big Data that are obtained from industrial systems. The extracted knowledge should lead to an understanding of how various components of a complex system influence each other and interact with their environment, and how an accurate prediction of the degradation can be obtained in a parallel computing framework.***The proposed methodology is based on an approach called Logical Analysis of Data (LAD), which is a data mining, machine learning approach that is based on Boolean logical reasoning. It extracts knowledge in the form of patterns that distinguish and characterize sets of data, and that identify some phenomena of interest. Different LAD' s algorithms that are used to extract patterns in supervised and unsupervised learning will be considered in parallel computing frameworks; namely, enumeration techniques, mixed integer linear programming, and metaheuristics algorithms, mainly genetic algorithms, and ant colonies. The two parallel frameworks that will be used are Hadoop MapReduce and Spark; both are available in an open source environment, thus they are available to the public.***We intend to present to the scientific community scaled up algorithms in an open source environment. As such, every interested individual can use them, improve upon them and add to them. The impact of this research is the possibility of learning, finding, understanding physical complex phenomena that are not fully understood yet, and the exploitation of this knowledge in decision making. Depending on the specific applications in which these algorithms will be used, this knowledge can lead to an increase in safety and security, energy savings, protection of the environment, and increased efficiency in consuming natural resources. It will also lead to intelligent systems that can make the right decision at the right moment. Eventually, this will lead to self-sustaining and sustainable systems.*****

数据科学和数据工程可以说是本世纪最重要的研究领域之一。这些领域基于科学和工程的基本分支，即信息技术，传感器技术，统计学，运筹学，优化，人工智能，数据挖掘和机器学习。沿着以人为中心的应用，其中一些技术现在被研究人员推荐用于以机器为中心的应用，其中数据由机器制造，决策也由机器基于机器对机器（M2M）的学习做出。目前，一个重要的研究问题是如何利用可用的大数据集，因为根据定义，它们由高速获取的大量数据组成，并且形式多样。传统的数据处理和分析技术已不适用。该提案的目标是开发专门设计用于分析和从工业系统获得的大数据中提取知识的算法和工具。所提取的知识应该导致理解复杂系统的各个组件如何相互影响并与其环境相互作用，以及如何在并行计算框架中获得对退化的准确预测。所提出的方法是基于一种称为逻辑数据分析（LAD）的方法，这是一种基于布尔逻辑推理的数据挖掘，机器学习方法。它 以模式的形式提取知识，这些模式区分和表征数据集，并识别一些感兴趣的现象。在并行计算框架中，将考虑用于在监督和无监督学习中提取模式的不同LAD算法;即枚举技术、混合整数线性规划和元分析算法，主要是遗传算法和蚁群。将使用的两个并行框架是Hadoop MapReduce和Spark;两者都可以在开源环境中使用，因此它们可以向公众提供。我们打算在开源环境中向科学界展示放大的算法。因此，每个感兴趣的人都可以使用它们，改进它们并添加它们。这项研究的影响是学习，发现，理解尚未完全理解的物理复杂现象的可能性，以及在决策中利用这些知识。根据使用这些算法的具体应用，这些知识可以提高安全性和安全性，节约能源，保护环境，并提高消耗自然资源的效率。 它还将导致智能系统能够在正确的时刻做出正确的决定。最终，这将导致自我维持和可持续的系统。