EAGER: Automatic Document and Record Disposition and Retention

记录和文档保留（文档处置）已成为组织和个人的严重问题，因为现在创建的大多数文档都是数字化的。数字文件既有问题，也有好处。数字文件易于版本化、复制和传播。因此，重要或相关文件在许多地方可能有几个类似的副本或版本。文档或记录处置可以应用于个人、组织和领域（如法律、科学、政策等），也可以为个人、组织和领域所需。长期有效的信息管理。这个问题是史诗般的比例，并成为一个主要问题，在组织和个人在世界各地的有效记录处置所需的法律或组织或实际限制systems.This探索性的项目研究可能的自动文档处置方法的基础上，文本检查，挖掘和搜索算法。挑战在于找到可扩展的，适应性强的算法，可以在几个，如果不是所有的应用程序域。此外，用户的可变性带来了许多问题。处置方法或程序可以根据用户、组织和域（例如，法律、健康记录等）。该项目中探索的方法将机器学习方法应用并扩展到这些问题，因为这些方法适应数据，区域和领域的变化。使用这种方法，自动化处置方法可以很容易地应用于这些不同的领域，如科学，电子邮件和法律的记录。这项研究奠定了基础，为各种领域的适用性，性能和可扩展性的自适应方法。这个概念验证项目最初集中在公开可用的Enron电子邮件数据集上，并且用于证明该方法的可行性，因为电子邮件可以被认为是文档处置的特殊情况。如果成功，将探索其他处置领域，如科学和政府数据。这项工作将展示开发和应用机器学习方法到一个重要而多样化的问题领域的可行性。 这个探索性项目的结果以及从大规模文档搜索中使用的方法中收集的见解，预计将有助于我们了解如何更好地管理我们的数字过去和快速扩展的数字未来。研究结果有望将这一重要问题介绍给其他研究人员和文档处理专业人员，并促成与行业的合作。数据和研究结果将通过一个公开网站（http：//clgiles.ist.psu.edu/disposeseer/）提供，研究论文将在适当地点发表和介绍。 该项目为研究生和本科生提供研究经验。

Record and document retention (document disposition) has become a serious problem for both organizations and individuals since most documents now created are digital. Digital documents offer both problems and advantages. Digital documents are easily versioned, copied and disseminated. Thus, there can be several similar copies or versions of important or relevant documents in many locations. Document or record disposition can be applied to or is needed by individuals, organizations and domains (such as law, science, policy, etc.) for effective information management over long periods of time. This problem is of epic proportions and is becoming a major problem in organizations and for individuals throughout the world where effective record disposition is either required by law or by the organization or by practical limitations in systems.This exploratory project investigates possible automatic document disposition methods based on algorithms for text inspection, mining, and search. The challenges lie in finding scalable, adaptable algorithms that can be used in several if not all application domains. In addition, variability in users presents many problems. A disposition method or procedure may vary depending on the user, organization and domain (e.g., law, health records, etc.). The approach explored in this project applies and extends machine learning methods to these problems since these methods adapt to variability in data, areas and domains. Using such approaches, automated disposition methods can be readily applied to these different areas such as science, email and legal records. This research lays the groundwork for adaptive methods for a variety of domains in terms of applicability, performance and scalability. this proof-of-concept project initially focuses on the Enron email data set that is publicly available and is be used to demonstrate the feasibility of the approach since email can be considered a special case of document disposition. If successful, other disposition domains such as science and government data will be explored. This work will show the viability of developing and applying machine learning methods to an important and diverse problem domain. The results from this exploratory project together with insights gathered from methods used in large scale document search are expected to yield understanding as to how we can better manage our digital past and the rapidly expanding digital future. The results are expected to introduce this important problem to other researchers and document disposition professionals and lead to collaborations with industry. Data and research results will be made available through a publicly available website (http://clgiles.ist.psu.edu/disposeseer/) and research papers will be published and presented in appropriate venues. The project provides research experience for graduate and undergraduate students.