Multimedia User Interface based on Paradigm Integration

本研究的主要目的是在一定的理论基础上，运用多种编程范型，对多媒体用户界面的功能进行提升，以期集成一个系统的多媒体用户界面系统。主要研究内容如下：(1)基础研究：对图形、图像、时间等概念进行了理论研究。针对图像创作领域，研究了层次集的可视化问题，提出了一种基于约束处理的求解方法。实现了一个原型处理器，取得了一些令人满意的结果。(2)关于时间：深入研究了多媒体数据处理领域中重要的时间概念，为描述时间的数据建立数据库。引入了“时间之前”和“时间之后”的新概念，以整合“持续时间”和“实例”。利用这些新概念可以实现基于事件的数据库。(3)连续时间和事件：为了在事件集成的数据库中实现复杂和复杂的搜索，提出了一种新的增强正则表达式方案。在该方案中，字符串中的符号可以被赋予表示由该符号符号化的事件的持续时间的属性值。该方案中的模式匹配对于在事件集成数据集中的搜索是非常有效的。

The main puropose of this research is the advancement of the functionality of multimedia user interfaces, based on some theoretical foundation and by the use of several programming paradigms in order to integrate a systematic multimedia user interface systems. Subgoals and research results are shown below.(1) Basic research : The concepts of figures, images, and time are investigated in a theoretical mannar. For the field of picture creation, the visalization of hierarchical sets are investigated and a solving method based on constraint processing is developed. A prototype processor is implemented and shows some promissing results.(2) About time : The concept of time, which is essentially important in the field of multimedia data Processing, is deeply investigated to construct databases for time-describing data. New concepts of "before-time" and "after-time" are introduced in order to integrate "duration" and "instance". Event-based database can be realized by the use of these new concepts.(3) Continuous Time and Events : In order to realize the complicated and complex searches in events-integrated databases, a new enhanced regular expression scheme is invented. In this scheme, symbols in a string can be given attribute values which represent the duration of the event which is symbolized by the symbol. Pattern matchings in this scheme is shown to be very powerful for the search in the sets of event-integrate data.