Mining interesting patterns from big data

在当前的大数据时代，可以轻松地高速生成或收集大量不同准确性的各种有价值的数据(例如，传感器数据和医学实验室测试结果等不精确或不确定的数据，其中内容因遗传测量不准确或采样频率等因素而不确定)。结果，我们淹没在数据中，却渴望获得知识。为了能够理解这些数据，用于大数据管理和大数据挖掘的数据科学解决方案(发现隐含的、以前未知的)是高效、用户友好和强大的数据科学系统，用于从大数据中挖掘有趣的模式。具体地说，我计划(1)使开发的算法考虑到用户的偏好，并将这些用户约束推到挖掘过程中，以便最终得到的算法只输出有趣的模式，而不需要后处理步骤；(2)挖掘(3)进一步提高性能，通过探索其他优化和技术(例如，ApacheSpark，Scala)为用户提供实时响应，并进一步减少对内存的需求(例如，通过适配BigTable)；(4)探索其他定量应用(5)探索现实生活中的应用(例如，挖掘社交网络、Web、电信数据、农业数据、气象数据、新闻提要、推特、博客)，并发现其他有趣的模式，如趋势、序列和(6)开发数据可视化。这反过来帮助用户丰富他们的知识，以便他们能够迅速采取适当的行动或做出最佳的(商业或军事)决策，从而对改善人类生活、对加拿大经济和国防产生重大积极影响

In the current era of big data, high volumes of a wide variety of valuable data of different veracity (e.g., imprecise or uncertain data like sensor data and medical lab test results, in which the contents are uncertain due to factors like inherited measurement inaccuracies or sampling frequency) can be easily generated or collected at a high velocity. Consequently, we are drowning in data but starving for knowledge. In order to be able to make sense of these data, data science solutions for big data management and big data mining (which discovers implicit, previously unknown e efficient, user-friendly, and powerful data science system for mining interesting patterns from big data. Specifically, I plan to (1) adapt the developed algorithms to take into account the user preference and push these user constraints inside the mining process so that the resulting algorithms only output interesting patterns and no post-processing step is needed; (2) mine (3) further improve performance so as to provide users with real-time responses by exploring other optimizations and techniques (e.g., Apache Spark, Scala) and further reduce the memory requirements (e.g., by adapting Bigtable); (4) explore other quantitative (5) explore real-life applications (e.g., mining social networks, Web, telecommunication data, agricultural data, meteorological data, news feed, tweets, blogs) and find other interesting patterns such as trends, sequences and (6) develop data visualization This, in turn, helps users to enrich their knowledge so that they could promptly take appropriate actions or to make the best (business or military) decision, which would consequently have significant positive impacts on the improvement of human life and the benefits to Canadian economy as well as national defense