Integrating optical finger motion tracking with surface touch events.
Integrating optical finger motion tracking with surface touch events.
复制标题
DOI：
10.3389/fpsyg.2015.00702
复制
发表时间：
2015
影响因子：
3.8
通讯作者：
McPherson AP
中科院分区：
文献类型：
--
作者：
MacRitchie J;McPherson AP
本文提出了一种方法，集成两个对比的传感器系统研究人类与机械系统的互动，钢琴演奏作为案例研究。钢琴技巧既要求手指在琴键表面精确的小范围运动，也要求手和手臂有计划的大范围运动。性能的研究往往集中在这些尺度之一，在隔离，本文探讨了它们之间的关系。声学三角钢琴上安装了两个传感器系统：一个单目高速摄像机跟踪手上的油漆标记的位置，电容式触摸传感器连接到键表面，测量手指与键接触的位置。本文重点介绍了一种融合这些系统的数据，包括时间和空间对齐，分割成音符和自动指法标注的方法。三个案例研究证明了多传感器数据的实用性：手指弯曲或伸展的触摸和摄像头标记位置的基础上的分析，定时分析的手指键接触之前和之后的按键，和表征的个人手指运动之间的过渡连续按键。钢琴演奏是本文的重点，但传感器的方法可以同样适用于其他精细运动控制的情况下，与应用程序的人机交互。
This paper presents a method of integrating two contrasting sensor systems for studying human interaction with a mechanical system, using piano performance as the case study. Piano technique requires both precise small-scale motion of fingers on the key surfaces and planned large-scale movement of the hands and arms. Where studies of performance often focus on one of these scales in isolation, this paper investigates the relationship between them. Two sensor systems were installed on an acoustic grand piano: a monocular high-speed camera tracking the position of painted markers on the hands, and capacitive touch sensors attach to the key surfaces which measure the location of finger-key contacts. This paper highlights a method of fusing the data from these systems, including temporal and spatial alignment, segmentation into notes and automatic fingering annotation. Three case studies demonstrate the utility of the multi-sensor data: analysis of finger flexion or extension based on touch and camera marker location, timing analysis of finger-key contact preceding and following key presses, and characterization of individual finger movements in the transitions between successive key presses. Piano performance is the focus of this paper, but the sensor method could equally apply to other fine motor control scenarios, with applications to human-computer interaction.
登录
查看更多内容
影响因子：
2.5
作者：
Furuya, Shinichi;Flanders, Martha;Soechting, John F.
通讯作者：
Soechting, John F.
影响因子：
1.1
作者：
MacRitchie, Jennifer;Bailey, Nicholas J.
通讯作者：
Bailey, Nicholas J.
影响因子：
3.3
作者：
Furuya, S.;Nakamura, A.;Nagata, N.
通讯作者：
Nagata, N.
影响因子：
3.7
作者：
Goebl W;Palmer C
通讯作者：
Palmer C
影响因子：
2.5
作者：
Furuya, Shinichi;Soechting, John F.
通讯作者：
Soechting, John F.