Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and Reuse

Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and Reuse
复制标题

DOI:
10.1145/3490554
复制
发表时间:
2022-03
期刊:
ACM Transactions on Computer-Human Interaction (TOCHI)
影响因子:
--
通讯作者:
F. Putze;Susanne Putze;Merle Sagehorn;C. Micek;E. Solovey
F. Putze;Susanne Putze;Merle Sagehorn;C. Micek;E. Solovey
中科院分区:
其他
文献类型:
--
作者:
F. Putze;Susanne Putze;Merle Sagehorn;C. Micek;E. Solovey

文献摘要

被引文献

相似文献

在人机交互 (HCI) 领域,人们一直在推动开放科学的发展,但迄今为止,由于支持重用和复制的指导方针不明确,利用大脑信号的人机交互研究并没有持续发生这种情况。为了了解该领域的现有实践,本文研究了 110 篇出版物,探讨了领域、应用、模式、心理状态和过程等。该分析揭示了作者报告实验的方式存在差异,这给理解、重现和构建该研究带来了挑战。然后,它描述了一个总体实验模型,该模型为报告大脑信号的人机交互研究提供了正式的结构,包括定义、术语、类别和每个方面的示例。通过因素分析确定了多种不同的报告风格,并将其与不同类型的研究联系起来。本文最后提出了建议并讨论了未来的挑战。这从抽象模型和经验观察中创建了可操作的项目,使大脑信号的人机交互研究更具可重复性和可重用性。
In human-computer interaction (HCI), there has been a push towards open science, but to date, this has not happened consistently for HCI research utilizing brain signals due to unclear guidelines to support reuse and reproduction. To understand existing practices in the field, this paper examines 110 publications, exploring domains, applications, modalities, mental states and processes, and more. This analysis reveals variance in how authors report experiments, which creates challenges to understand, reproduce, and build on that research. It then describes an overarching experiment model that provides a formal structure for reporting HCI research with brain signals, including definitions, terminology, categories, and examples for each aspect. Multiple distinct reporting styles were identified through factor analysis and tied to different types of research. The paper concludes with recommendations and discusses future challenges. This creates actionable items from the abstract model and empirical observations to make HCI research with brain signals more reproducible and reusable.