Studying Human Dynamics at a Massive Scale: The Development and Assessment of a Distributed Approach for Effective Visualization of 100+ Million-Node Social Networks

在线社交网络（OSNs）图——代表社交媒体参与者、他们的关系和互动——是一个越来越受关注和重要研究的领域。这些图形的可视化布局是研究人员在各种领域使用的常用工具，以帮助理解网络的底层结构，形成假设，并传达研究结果。图可以揭示有关网络结构的信息，这些信息可能难以单独通过定量和定性方法确定。由于osn通常非常大，并且随着越来越多的人（和物联网设备）加入各种社交媒体平台而变得越来越大。现有的显示大量OSN数据的布局技术在计算上很昂贵；通常，它们的实现不容易扩展，并且通常需要大量的时间和资源来呈现。在这项工作中，我们将提出并评估一种分布式计算方法，以显着加快社交网络图形可视化的完成时间。

Graphs of Online Social Networks (OSNs) - representing social media participants, their relationships and interactions - are an area of growing interest and significant investigation. Visual layouts of these graphs are a common tool used by researchers in a wide variety of fields to help understand network's underlying structures, form hypotheses, and communicate research results. Graphs can reveal information about the network's structure that may be difficult to determine through quantitative and qualitative methods alone. As OSNs are often very large, and growing ever larger as more people (and IoT devices) join various social media platforms. Existing layout techniques to display massive OSN data are computationally expensive; often, their implementations are not easily scalable and usually require an extraordinary amount of time and resources to render. In this work, we will propose and evaluate a distributed computing method to significantly speed up the completion time of social network graph visualization. Existing literature identifies problems with layout of large networks, and alludes to how distributed computing and other techniques might be possible solutions, but so far little empirical research work has been done to implement and test these suppositions. Currently, scholars who are relying on network visualizations in their data exploration and analysis are using work around such as data reduction and filtering techniques to address the scalability issues of current network visualization tools. Our method will build upon existing graph layout techniques, and will put forward a novel graph partitioning scheme that is better-suited for laying out graphs with small-world, scale-free network properties; properties that are naturally occurring in online social networks. Our method will be implemented and evaluated using a popular distributed system for graph processing -- Spark GraphX. The evaluation phase will be based on large-scale anonymized networks collected from social media platforms including Twitter, Flickr, Reddit, and will include both algorithm- and user-based evaluation. The overarching goal of this initiative is to develop and test a new distributed graph partitioning technique for visualizing networks with 100 million+ nodes, share its machine- and user-driven evaluation, and distribute a ready-to-use open source library that can be used by network scholars in various domains (and not just in the area of social media).