A Neural Network Model with interaction between Extraneous Information and Internal Memory

在本研究中，我们以人类的记忆系统为研究对象，构建了符号模式的增量学习神经网络模型。该网络模型具有层次化结构，每一层都有神经元块来识别较低层输出模式的局部特征。网络模型进行自底向上的处理，最终将输入的模式识别为局部特征的综合信息。每个神经元模块由学习触发信号控制，可以独立地学习较低层的模式。因此，如果输入模式和学习模式之间存在部分差异，则网络只能增量地学习它们之间的差异。在处理多感知信息的情况下，网络模型只能学习网络模型尚未学习到的部分信息。在研究中，我们构建了增量学习网络模型。并通过仿真验证了该模型的学习能力。在第一项工作中，我们使用26个模式作为模仿字母字符的分布模式来测试该模型。仿真结果表明，该模型能够对所有模式进行增量学习，并在学习过程中对其进行识别。然后，我们使用了200个模仿汉字的图案，这些汉字具有“亨”和“tsukuri”结构。每种输入模式都有“HEN”模式和“Tsukuri”模式的组合，在200个输入模式中，大约有50个“HEN”模式和50个“Tsukuri”模式。作为模拟的结果，该模型可以学习所有的200个模式，并且只学习“HEN”或“Tsukuri”模式之间的部分差异。我们在NC98技术小组的IEICE会议上公布了上述结果(1998年3月)

In this study, we focused on the memory system of the human being and constructed a incremental learning neural network model for the symbolic patterns. The network model has a hierarchical structure and each layer has neuron blocks which recognize local features of the lower layer's output pattern. The network model does bottom-up processing and finally recognize the input pattern as the integrated information of the local features. Each neuron block is controlled by a learning trigger signal and can learn the lower layer's patterns independently. Therefore, if there are partial differences between the input pattern and the learned patterns, the network can learn only the differences between them incrementally. In the case of dealing with multi-sense information, the network model can learn only the partial information which the network model have not learned yet. In the study, we constructed the incremental learning network model. And we showed the learning ability of the model by simulations. In the first work, we tested the model by using 26 patterns as the distributed patterns that imitated the alphabet characters. As the result of the simulation, we showed the model could do incremental learning all of the patterns and recognize them after the learning process. And then, we used 200 patterns imitated the kanji characters which had "hen" and "tsukuri" structures. Each input pattern had a combination of "hen" pattern and "tsukuri" pattern, and there were about 50 "hen" patterns and 50 "tsukuri" patterns in the 200 input patterns. As the result of the simulations, the model could learn all of 200 patterns and learn only the partial differences between the "hen" or "tsukuri" patterns. We presented the above results at the IEICE meetings of technical group NC98 (Mar.1998)