Writing-Life Log: a challenge of camera-pen interface based on image retrieval

信息通过读写在人类用户和外部世界之间交换。在本研究中，我们以写作为重点，挑战实现“写作-生活日志”，即记录行动写作所产生的所有信息。这不仅仅是用文字记录信息；书面信息必须与所写的文件和部分有关。这可以更好地估计用户的偏好，以及学习辅助。为了实现上述功能，我们提出并测试了一种使用安装在笔上的相机来恢复笔迹的方法，以及一种放置恢复笔迹的方法。结果表明，该方法能够准确地还原和定位笔迹。

Information is exchanged between a human user and the external world by reading and writing. In this research, we focus on writing and challenge to implement "writing-life log", which is to record all information generated by the action writing. This is not just a record of information represented by writing; the written information must be related to which document and which part the writing has been done. This allows a better estimation of the user's preference, as well as a learning aid. In order to realize the above functionality, we have proposed and tested a method of recovering a handwriting by using a camera mounted on the pen, as well as a method of placing the recovered handwriting. As a result, it has been shown that the proposed method is capable of recovering and placing the handwriting accurately.