History Playground: A Tool for Discovering Temporal Trends in Massive Textual Corpora
History Playground: A Tool for Discovering Temporal Trends in Massive Textual Corpora
复制标题
DOI：
10.1093/llc/fqy077
复制
发表时间：
2018-06
期刊：
影响因子：
--
通讯作者：
Thomas Lansdall-Welfare;N. Cristianini
中科院分区：
文献类型：
--
作者：
Thomas Lansdall-Welfare;N. Cristianini
最近的研究表明，通过分析从大量文本语料库中提取的时间序列，可以发现几个世纪以来连续性和变化的宏观模式。类似的数据驱动方法已经彻底改变了自然科学，人们普遍认为，在目前正在进行的大规模数字化项目的推动下，再加上“天生数字化”的文件数量不断增加，这种方法在人文科学和社会科学领域也具有类似的潜力。因此，需要新的交互式工具来从这些大量的文本数据中发现和提取宏观模式。在这里，我们介绍History Playground，一个交互式的基于网络的工具，用于发现大量文本语料库的趋势。该工具使用可扩展的算法，首先从文本语料库中提取趋势，然后将其用于实时搜索和发现，向用户展示一个探索数据的界面。该工具包括用于标准化、回归、在n-gram的相对频率中检测变化点、多术语指数和跨不同语料库的趋势比较的算法。
Recent studies have shown that macroscopic patterns of continuity and change over the course of centuries can be detected through the analysis of time series extracted from massive textual corpora. Similar data-driven approaches have already revolutionized the natural sciences and are widely believed to hold similar potential for the humanities and social sciences, driven by the mass-digitization projects that are currently under way, and coupled with the ever-increasing number of documents which are ‘born digital’. As such, new interactive tools are required to discover and extract macroscopic patterns from these vast quantities of textual data. Here we present History Playground, an interactive web-based tool for discovering trends in massive textual corpora. The tool makes use of scalable algorithms to first extract trends from textual corpora, before making them available for real-time search and discovery, presenting users with an interface to explore the data. Included in the tool are algorithms for standardization, regression, change-point detection in the relative frequencies of n-grams, multi-term indices, and comparison of trends across different corpora.