Study of brain cognitive computational interface for user's mind reading

为了利用大脑认知过程模型来实现对他人心理内部过程的行为预测，我们构建了一个现实问题中的行为决策模型，并通过行为实验对模型进行了评价。在实验中，我们并行进行了两项研究活动。一种是利用实验室游戏任务进行精确的行为分析，建立工作模型。另一种是分析实际汽车行驶场景对模型进行评价。在前一项研究中，我们使用了一个竞争性游戏“匹配硬币”。我们将被试的行为建模为行动决策策略的动态切换，并将该模型在计算机模拟中的行为与典型被试和ASD被试的实际行为进行了比较。结果表明，在游戏中存在一种大脑过程，它可以根据对手设定行动决策过程的参数。在后一项研究中，我们测量了驾驶员的眼球运动，并给出了日期的标签描述，以便在虚拟驾驶环境中对眼球运动进行计算机模拟。我们尝试在计算机仿真中重建眼球运动行为，并对仿真模型进行迭代改进。因此，我们开发了一个驾驶员内部过程模型，该模型除了包括显著性、目标检测和驾驶计划等传统因素外，还包括风险依赖行为因素。

For the realization of behavior prediction using a model of brain cognitive process that can estimate internal process of other's mind, we constructed a model of action decision in a real world problem and evaluated the model through behavioral experiment. In the experiment, we conducted two research activities in parallel. One is a precise behavioral analysis using a game playing task in the laboratory to establish the working model. Another is an analysis of actual motor car driving scene to evaluate the model.In the former study, we used a competitive game "Matching pennies". We model the subject's behavior as a dynamic switching of action decision strategies, and compared the behavior of the model in a computer simulation with the actual behavior of the typical subjects and the ASD subjects. The results suggested us an existence of brain process that sets a parameter of the action decision process depending the opponents of the game.In the latter study, we measured eye movements of the drivers and gave tag description of the date to enable a computer simulation of the eye movement in a pseudo driving environments. We tried a reconstruction of the eye movement behavior in the computer simulation and iterated improvement of the simulation model. As the result, we developed a model of driver internal process that includes a risk dependent action factor in addition to the conventional factors of saliency, objects detection and driving plan factors.