Multimedia User Interface based on Paradigm Integration

本研究的主要目的是在一定的理论基础上，通过使用多种编程范式，提高多媒体用户界面的功能，以便集成一个系统的多媒体用户界面系统。次级目标和研究结果如下所示。(1)基础研究：以理论的方式研究图形、图像和时间的概念。在图像生成领域，研究了层次集合的可视化问题，提出了一种基于约束处理的求解方法。实现了一个原型处理器，并显示了一些可喜的成果。(2)关于时间：时间概念是多媒体数据处理领域中的一个重要概念。引入了“前时间”和“后时间”的新概念，以整合“持续时间”和“实例”。利用这些新概念可以实现基于事件的数据库。(3)连续时间和事件：为了实现事件集成数据库中的复杂查询，发明了一种新的增强正则表达式方案。在这种方案中，字符串中的符号可以被赋予属性值，这些属性值表示由符号符号化的事件的持续时间。该方案中的模式匹配被证明是非常强大的事件集成数据集的搜索。

The main puropose of this research is the advancement of the functionality of multimedia user interfaces, based on some theoretical foundation and by the use of several programming paradigms in order to integrate a systematic multimedia user interface systems. Subgoals and research results are shown below.(1) Basic research : The concepts of figures, images, and time are investigated in a theoretical mannar. For the field of picture creation, the visalization of hierarchical sets are investigated and a solving method based on constraint processing is developed. A prototype processor is implemented and shows some promissing results.(2) About time : The concept of time, which is essentially important in the field of multimedia data Processing, is deeply investigated to construct databases for time-describing data. New concepts of "before-time" and "after-time" are introduced in order to integrate "duration" and "instance". Event-based database can be realized by the use of these new concepts.(3) Continuous Time and Events : In order to realize the complicated and complex searches in events-integrated databases, a new enhanced regular expression scheme is invented. In this scheme, symbols in a string can be given attribute values which represent the duration of the event which is symbolized by the symbol. Pattern matchings in this scheme is shown to be very powerful for the search in the sets of event-integrate data.