I-Corps: Turning a Mobile Device into a Mouse in the Air

由于鼠标的易用性，它已经成为控制图形用户界面的最成功的技术之一。它的吸引力远远超出了计算机领域。目前已经出现了为游戏机和智能电视设计的鼠标。智能电视允许用户运行流行的计算机程序和智能手机应用程序。例如，智能电视用户可能希望使用Web浏览器，并使用鼠标单击某个URL或地图的某个部分。使用按钮输入的传统遥控器已不足以发挥智能电视提供的全部功能。未来越来越多的设备，如谷歌眼镜、婴儿监视器和新一代家用电器，都需要鼠标功能，允许用户从各种各样的选项中进行选择，并轻松点击视图的不同部分。另一方面，传统的鼠标需要一个平坦、光滑的表面来操作，不能满足许多新的使用场景。这个I-Corps团队已经开发出一种准确而简单的跟踪手部运动的方法，并相信这项技术在智能眼镜和物联网方面具有广泛的潜在应用。该团队开发了一种空气鼠标，可以实时准确地跟踪设备的运动。它使任何带有麦克风的移动设备，如智能手机和智能手表，都可以作为鼠标来控制带有扬声器的电子设备。该方法的一个独特之处在于，它使用移动和电子设备中的现有硬件实现了高跟踪精度。该技术的应用包括控制智能电视、智能眼镜和家用电器。所提出的方法以几个选定的频率发送听不见的声音脉冲，并使用频率移位来估计速度和传播距离。人们还开发了一些技术，可以快速校准扬声器之间的距离，并利用其运动轨迹缩小设备的初始位置。根据这些信息，可以实时跟踪设备的新位置。

A mouse has been one of the most successful technologies for controlling the graphic user interface due to its ease of use. Its attraction penetrates well beyond just computers. There already have been mice designed for game consoles and smart TVs. A smart TV allows a user to run popular computer programs and smartphone applications. For example, a smart TV user may want to use a Web browser and click on a certain URL or some part of a map using a mouse. A traditional remote controller, which uses buttons for user input, is no longer sufficient to exploit full functionalities offered by the smart TV. More and more devices in the future, such as Google Glasses, baby monitors, and a new generation of home appliances, all desire mouse functionalities, which allow users to choose from a wide variety of options and easily click on different parts of the view. On the other hand, a traditional mouse, which requires a flat, smooth surface to operate, cannot satisfy many new usage scenarios. This I-Corps team has developed an accurate and easy way of tracking hand movement, and believes this technology has a wide range of potential applications in smart glasses and the Internet of Things.This team has developed an Air Mouse that accurately tracks device movement in real time. It enables any mobile device with a microphone, such as a smart phone and smart watch, to serve as a mouse to control an electronic device with speakers. A unique feature of the proposed approach is that it achieves high tracking accuracy using existing hardware in mobile and electronic devices. Applications of the proposed technology include controlling smart TVs, smart glasses, and home appliances. The proposed approach sends inaudible sound pulses at a few selected frequencies, and uses the frequency shifts to estimate the speed and distance traveled. Techniques have also been developed to quickly calibrate the distance between speakers and narrow down the device's initial position using its movement trajectory. Based on the information, the device's new position in real time can be continuously tracked.