Yardstick: A Benchmark for Minecraft-like Services
Yardstick: A Benchmark for Minecraft-like Services
复制标题
Yardstick：类 Minecraft 服务的基准
DOI：
10.1145/3297663.3310307
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
A. Iosup
中科院分区：
文献类型：
--
作者：
Jerom van der Sar;Jesse Donkervliet;A. Iosup
在线游戏应用程序每天娱乐数亿活跃玩家，并且通常具有非常复杂的架构。在在线游戏中，类似Minecraft的游戏模拟独特的（例如，可修改的）环境，是病毒式流行的，并且越来越多地作为服务提供。然而，Minecraft类服务的性能，特别是它们的可扩展性，还没有得到很好的理解。此外，目前还没有类似Minecraft游戏的基准。为了解决这一知识差距，在这项工作中，我们设计和使用的尺度基准来分析Minecraft类服务的性能。Yardstick基于一个运营模型，该模型捕捉了类似Minecraft的服务的显著特征。作为输入工作负载，Yardstick捕获重要的功能，例如Minecraft社区中使用的最流行的地图。Yardstick捕获系统和应用程序级别的指标，并从中获得服务级别的指标，例如可扩展工作负载下的游戏更新频率。我们实现了Yardstick，并且通过在我们的集群中进行的真实实验，我们探索了流行的Minecraft类服务器的性能和可扩展性，包括官方的vanilla服务器以及社区开发的服务器Spigot和Glowstone。我们的研究结果表明这些服务器的可扩展性限制，Minecraft类服务的并行性很差，Glowstone是测试中最不可行的选择。
Online gaming applications entertain hundreds of millions of daily active players and often feature vastly complex architecture. Among online games, Minecraft-like games simulate unique (e.g., modifiable) environments, are virally popular, and are increasingly provided as a service. However, the performance of Minecraft-like services, and in particular their scalability, is not well understood. Moreover, currently no benchmark exists for Minecraft-like games. Addressing this knowledge gap, in this work we design and use the Yardstick benchmark to analyze the performance of Minecraft-like services. Yardstick is based on an operational model that captures salient characteristics of Minecraft-like services. As input workload, Yardstick captures important features, such as the most-popular maps used within the Minecraft community. Yardstick captures system- and application-level metrics, and derives from them service-level metrics such as frequency of game-updates under scalable workload. We implement Yardstick, and, through real-world experiments in our clusters, we explore the performance and scalability of popular Minecraft-like servers, including the official vanilla server, and the community-developed servers Spigot and Glowstone. Our findings indicate the scalability limits of these servers, that Minecraft-like services are poorly parallelized, and that Glowstone is the least viable option among those tested.