Pattern Mining of Big Data

该计划的目标有三个方面：（1）使用有效的聚类技术和概率推理机制分析大型多层网络的社区检测和链接预测任务，（2）为大数据分析设计准确和可扩展的解决方案，以及（3）为复杂网络分析的多维数据挖掘带来新的贡献。我们将依靠形式概念分析，这是一个理论上健全的框架，知识表示，模式提取和可视化。这意味着，我们将继续为这一领域带来新的贡献，除了还探索其他突出的方法，从数据挖掘，机器学习和概率推理领域。科学的方法为了实现第一个目标，我们将设计新的社区检测和进化算法，无论是结合消息传递为基础的混合密度为基础的聚类，或交错消息传递为基础的聚类和相似性为基础的聚类。新的概率推理算法的链接预测也将被设计。对于第二个目标，我们将依靠分布式数据库理论，机器学习和形式概念分析的理论方法和实用工具来分析大数据问题。这包括数据碎片和分解，并行算法的设计和实现，以及面向用户的模式挖掘。第三个目标，我们将首先丰富我们最近在三元概念分析方面的工作，进一步研究并为多元概念分析及其在复杂网络分析中的应用做出新的贡献。短期和长期目标短期目标包括以下研究活动：（1）继续我们正在进行的工作，定义新的有效算法，用于在三元概念分析中挖掘聚类和关联规则，在数据和格分解中，（2）利用大数据中经常存在的关键结构属性，（社会和生物）网络，研究用于推理和挖掘服务的新的精确和可扩展的概率推理算法，（3）开发用于社交网络中的社区检测的新的有效聚类技术，以及（4）利用大量数据属性来改进学习目的中的推理过程。 中期目标旨在（1）为数据聚类和概率推理导出新的可扩展算法，以及（2）探索工业和商业中的高级案例研究。长期目标是在我们的短期和中期目标的基础上，进一步解决不那么琐碎的问题，并为发现和管理大数据问题的模式开发一个强大而灵活的环境。

OBJECTIVESThe objectives of the proposed program are threefold: (1) analyze large-scale multilayer networks for community detection and link prediction tasks using efficient clustering techniques and probabilistic inference mechanisms, (2) design accurate and scalable solutions for big data analytics, and (3) bring new contributions to multidimensional data mining for complex network analysis. We will rely on Formal Concept Analysis, which is a theoretically sound framework for knowledge representation, pattern extraction, and visualization. This means that we will continue bringing new contributions to this field, besides also exploring other prominent approaches from data mining, machine learning and probabilistic inference fields.SCIENTIFIC APPROACHTo achieve the first objective, we will design new community detection and evolution algorithms by either combining message passing-based with mixture density-based clustering or by interleaving message passing-based and similarity-based clustering. New probabilistic inference algorithms for link prediction will be designed as well. For the second objective, we will rely on theoretical methods and practical tools from distributed database theory, machine learning, and formal concept analysis to analyze big data problems. This includes data fragmentation and decomposition, parallel algorithm design and implementation, and user-oriented pattern mining. For the third objective, we will first enrich our recent work on triadic concept analysis to further study and bring new contributions to polyadic concept analysis with applications in complex network analysis.SHORT AND LONG TERM OBJECTIVESThe short-term objective involves the following research activities: (1) continue our ongoing work on defining new efficient algorithms for mining clusters and association rules in triadic concept analysis, and in data and lattice decomposition, (2) exploit key structural properties that often exist in big (social and biological) networks, to investigate new accurate and scalable probabilistic inference algorithms for reasoning and mining services, (3) develop new efficient clustering techniques for community detection in social networks, and (4) leverage massive data properties to improve inference procedures in learning purposes. The medium-term objective aims at (1) deriving new scalable algorithms for both data clustering and probabilistic inference, and (2) exploring advanced case studies in industry and business. The long-term objective is to build on the results of our short and medium-term objectives to further tackle less trivial issues and develop a robust and flexible environment for the discovery and management of patterns in big data problems.