HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users
HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users
复制标题
DOI：
10.1145/3313831.3376758
复制
发表时间：
2020-04
期刊：
影响因子：
--
通讯作者：
D. Jain;Kelly Avery Mack;Akli Amrous;Matt Wright;Steven M. Goodman;Leah Findlater;Jon E. Froehlich
中科院分区：
文献类型：
--
作者：
D. Jain;Kelly Avery Mack;Akli Amrous;Matt Wright;Steven M. Goodman;Leah Findlater;Jon E. Froehlich
我们介绍了HomeSound，这是一个为聋人和重听(DHH)用户提供的家庭声音感知系统。与Echo Show或Nest Hub类似，HomeSound由麦克风和显示器组成，并使用安装在每个家庭中的多个设备。我们迭代开发了两个原型，这两个原型都可以实时感知和可视化声音信息。原型1提供了声音出现的平面图，其中的波形历史描述了响度和音调。在四个DHH家庭中进行的为期三周的部署显示，参与者的家庭意识和自我意识有所增加，但也发现了由于缺乏视线和声音分类而带来的挑战。对于Prototype 2，我们增加了对可穿戴警报的自动声音分类和智能手表支持。在四个家庭的第二次实地部署显示，人们的意识进一步提高，但错误分类和持续的手表振动并不受欢迎。我们讨论了与感知、隐私和显示位置相关的发现，以及对未来家庭声音感知技术的影响。
We introduce HomeSound, an in-home sound awareness system for Deaf and hard of hearing (DHH) users. Similar to the Echo Show or Nest Hub, HomeSound consists of a microphone and display, and uses multiple devices installed in each home. We iteratively developed two prototypes, both of which sense and visualize sound information in real-time. Prototype 1 provided a floorplan view of sound occurrences with waveform histories depicting loudness and pitch. A three-week deployment in four DHH homes showed an increase in participants' home- and self-awareness but also uncovered challenges due to lack of line of sight and sound classification. For Prototype 2, we added automatic sound classification and smartwatch support for wearable alerts. A second field deployment in four homes showed further increases in awareness but misclassifications and constant watch vibrations were not well received. We discuss findings related to awareness, privacy, and display placement and implications for future home sound awareness technology.