What is the optimal task difficulty for reinforcement learning of brain self-regulation?
What is the optimal task difficulty for reinforcement learning of brain self-regulation?
复制标题
DOI：
10.1016/j.clinph.2016.06.016
复制
发表时间：
2016-09-01
影响因子：
4.7
通讯作者：
Gharabaghi, Alireza
中科院分区：
文献类型：
--
作者：
Bauer, Robert;Vukelic, Mathias;Gharabaghi, Alireza
目的：神经反馈过程中的行动和奖励之间的平衡可能会影响大脑自我regulation.Methods的强化学习：11名健康志愿者参加了三个运行的运动图像为基础的脑机接口反馈，机器人被动地打开了手特遣队β-波段调制。对于每一次运行，启动手部机器人运动的β-去极化阈值的难度增加（低，中等，和要求）。在这种情况下，学习的动机是通过每一个动作的奖励变化来估计的，操作化为每一个动作开始的奖励持续时间的变化。方差分析揭示了阈值难度与奖励持续时间和运动起始次数之间的关系存在显著的交互作用（p < 0.001），表明低难度的学习动机是负的，而中等难度和高难度的学习动机是正的。不同的阈值在相同的数据集的探索表明，学习激励的峰值高于阈值，导致最大的分类精度。结论：特异性比灵敏度的神经反馈的大脑自我调节的强化学习更重要。意义：学习效率需要足够的挑战，神经反馈干预。(C)2016年国际临床神经生理学联合会。由Elsevier爱尔兰有限公司出版。保留所有权利。
Objective: The balance between action and reward during neurofeedback may influence reinforcement learning of brain self-regulation.Methods: Eleven healthy volunteers participated in three runs of motor imagery-based brain-machine interface feedback where a robot passively opened the hand contingent to beta-band modulation. For each run, the beta-desynchronization threshold to initiate the hand robot movement increased in difficulty (low, moderate, and demanding). In this context, the incentive to learn was estimated by the change of reward per action, operationalized as the change in reward duration per movement onset.Results: Variance analysis revealed a significant interaction between threshold difficulty and the relationship between reward duration and number of movement onsets (p < 0.001), indicating a negative learning incentive for low difficulty, but a positive learning incentive for moderate and demanding runs. Exploration of different thresholds in the same data set indicated that the learning incentive peaked at higher thresholds than the threshold which resulted in maximum classification accuracy.Conclusion: Specificity is more important than sensitivity of neurofeedback for reinforcement learning of brain self-regulation.Significance: Learning efficiency requires adequate challenge by neurofeedback interventions. (C) 2016 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.