A Comparison of Interactive and Passive Quality Assessment for Gaming Research
A Comparison of Interactive and Passive Quality Assessment for Gaming Research
复制标题
DOI：
10.1109/qomex.2018.8463417
复制
发表时间：
2018-05
期刊：
影响因子：
--
通讯作者：
Steven Schmidt;Sebastian Möller;Saman Zadtootaghaj
中科院分区：
文献类型：
--
作者：
Steven Schmidt;Sebastian Möller;Saman Zadtootaghaj
评估游戏服务体验质量（QoE）的主观测试是必要的，以使服务提供商能够确保其客户的满意度。由于游戏是一种交互式活动，因此通常进行交互式测试以测量玩家体验的全方位。然而，进行这样的测试是昂贵和耗时的。此外，参与者的行为和能力也会影响结果。出于这个原因，它是高度的兴趣，这种互动测试是否可以部分取代被动的视听测试。在本文中，我们提出了一个互动游戏测试与被动测试使用两个不同的持续时间的比较。为了研究测试范例之间的差异，我们评估了游戏的整体质量，视频质量和反应性以及不同帧速率和比特率的其他玩家体验方面。结果表明，一旦满足某些要求，被动测试确实提供了一个有价值的质量评估方法。然而，如果所呈现的视频材料的持续时间太短，则被动测试高估了游戏和视频质量。此外，我们表明，播放器性能对视频质量评级没有影响。
Subjective tests to assess the Quality of Experience (QoE) of gaming services are necessary to enable service providers to ensure the satisfaction of their customers. Since gaming is an interactive activity, interactive tests are typically conducted to measure the full spectrum of the player experience. However, carrying out such tests is expensive and time-consuming. Furthermore, the results can be influenced by the behavior and abilities of participants. For this reason, it is of high interest whether such interactive tests can be partially replaced with passive viewing-and-listening tests. In this paper, we present a comparison of an interactive gaming test with passive tests using two different durations. To investigate the differences between the test paradigms, we assessed the overall quality, the video quality and the reactiveness of the game as well as other player experience aspect for different frame rates and bit rates. Results show that once certain requirements are fulfilled, passive tests offer indeed a valuable quality assessment method. However, if the duration of the presented video material is too short, the passive test overestimated the gaming and video quality. Furthermore, we show that the player performance has no impact on the video quality ratings.