EVIDENCE: computer-assisted interactive extraction of good dictionary examples from large corpora

该项目将汇集计算机科学家和词典编纂者解决词典编纂问题，即从大量语料库示例中识别和提取好的示例。机器学习将被应用于帮助词典编纂者从语料库中选择好的例子，以纳入词典文章。机器学习的应用应该通过根据测量的质量对示例进行排名来促进词典编纂者的任务，从而将词典编纂者的注意力引导到最好的示例上。由于语料库中示例的质量和适当性不是明确定义的特征，因此即使在专业词典编纂者之间也无法实现一致的判断。通过交互式学习，我们计划训练一个关于偏好的自适应机器学习模型，我们假设对于不同的词典编纂者来说，偏好是更加一致的，因为他们更有可能同意示例1比示例2更好，而不是同意两个示例的显式分数。此外，计划获取并整合字典用户（即知情的外行人）对排序好的示例集的判断。该项目的结果将是一个用于提取、分类和语料库示例排序的系统。该系统将首先在DWDS的上下文中进行测试。在那里，它将支持词典编纂者的日常工作。预期最后的系统将为每个词头提供一组很好的例子，这些例子足够多样化，以说明这个词的实际使用的各个方面。此外，它将为非专业词典用户产生额外的价值，因为它还将为尚未得到完整词法处理的关键词提供很好的示例。新系统将允许任何用户对系统用于学习的示例的质量提供反馈。例如，在教学中，学生不再只是消费，而是积极参与词典资源的开发。该项目还将组织讲习班，以获得早期采用者，并收集社区的反馈。因此，所提出的方法及其应用将对其他词典项目有用，因为它们与语言无关，并且易于集成到当前最先进的词典编纂系统中。

The project will bring together computer scientists and lexicographers in solving a lexicographical problem, i.e. the identification and extraction of good examples from a large set of corpus examples. Machine learning will be applied to help lexicographers in selecting good examples from corpora for inclusion in dictionary articles. The application of machine learning should facilitate the task of the lexicographers by ranking the examples according to their measured quality and therefore direct the attention of the lexicographers to the best examples. Since quality and appropriateness of examples from corpora are not well-defined features, unanimous judgment cannot be achieved even among professional lexicographers. With interactive learning, we plan to train an adaptive machine learning model on preferences which we assume are more unanimous for different lexicographers since it is more likely that they agree on example 1 being better than example 2 than agreeing on explicit scores for both examples. Furthermore, it is planned to acquire and integrate the judgment of dictionary users (i.e. informed lay persons) on sets of ranked good examples. The outcome of the project will be a system for the extraction, classification, and ranking of corpus examples. This system will initially be tested in the context of the DWDS. There it will support the lexicographers in their daily work. It is expected that for each headword the final system will present a set of good examples that are sufficiently diverse to illustrate various facets of the real use of this word. Furthermore, it will generate an additional value for non-expert dictionary users, as it will supply good examples also for headwords that have not yet received full lexical treatment. The new system will allow any user to provide feedback on the quality of examples which are used by the system to learn. E.g. in the context of teaching, students no longer only consume, but actively participate in the development of a lexicographic resource. The project will also organize workshops to acquire early adopters and to gather feedback from the community. Thus, the proposed method and its application will be useful for other dictionary projects as they are language independent and easy to integrate into current state-of-the-art systems for lexicography.