III: Small: Increasing the Value of Existing Web Archives

网络存档是一项蓬勃发展的活动，但仍处于更大的网络社区的边缘。网络存档经常会遇到两种观点：(1)谁在乎过去？(2)互联网档案馆不是已经解决了这个问题吗？虽然互联网档案馆是网络存档的基石，但要使存档与更大的网络社区保持一致，仍有许多工作要做。私人投资促进机构将调查一系列方法和概念，以加快网络档案的采用和利用。虽然有十多个公开可用的网络档案(包括互联网档案)可以通过Memento协议同时访问，但这些档案大多没有得到充分利用，因为它们缺乏对实时网络更直接使用的API和服务。例如，不是为未存档的页面返回“HTTP404”响应，而是档案可以反思它们的集合以替换或类似的页面。该项目将研究：(1)档案的扩展API；(2)档案质量的模型和方法；(3)探索和理解网络上的时间性的用户工具和技术。这项研究的更广泛影响将包括提高档案馆记录当今社会话语的能力，这种话语主要发生在网络上，往往辅之以印刷或电视。在网上发布数据的能力远远超过了为子孙后代存档数据的能力。有许多公共网络档案馆正在尽其所能地保存材料，但保存只是以后使用的先决条件。大多数情况下，这些存档网页没有得到充分利用，只是因为缺乏从这些档案中提取价值的工具。这个项目将研究和构建工具、基础设施和方法，以更好地利用、理解我们已有的归档材料并与其交互。除了爬行外，档案大多是被动的内容集合，除了对归档页面的请求回答“是”或“否”之外，几乎没有提供什么服务。即使存档率增加(活跃的网络档案数量更多)，对网络档案的分析也很少，以便为收到的请求提供更好的服务。私人投资司将在其以前的API工作的基础上探索网页推荐服务，在这种服务中，即使档案没有所请求的网页，它也可以根据内容和链接分析为替换网页提出建议。这将防止网络档案在没有请求的页面时成为死胡同。投资促进局还将对重建页面的质量问题进行基础研究，这是一个基本上被忽视的问题。特别是，PI关注于检测和解决“时间违规”，即作为历史页面呈现给用户的具有嵌入资源的HTML页面的组合，但事实上，它们从未在实时网络上以这种组合存在。在通过互联网档案馆重播的页面中，至少有5%会出现这种情况。质量研究的另一个方面涉及自动评估存档页面相对于其丢失的嵌入资源的损坏程度。直接的百分比(例如，这个页面缺少57个嵌入资源中的3个)不能说明全部情况，但有一些自动化方法可以用来估计资源对呈现的页面有多重要(即使您没有它)。这样不仅可以对页面进行大规模评估，而且可以在可比较的时间段内对整个档案的执行情况进行评估。最后，个人信息系统将侧重于工具和方法，使用户能够更好地理解存档的网络和一般的时间概念并与之互动。用户对时间概念的理解不是很先进，部分原因是工具不到位，无法让他们更好地理解和构建交互模型。欲了解更多信息，请访问网站：http://ws-dl.cs.odu.edu/.。

Web archiving is a thriving activity, but remains at the fringes of the larger web community. Web archiving often runs into two opinions: (1) who cares about the past? and (2) hasn't the Internet Archive solved this already? While the Internet Archive is the cornerstone of web archiving, there remains much work to be done to align archiving with the larger web community. The PIs will investigate a collection of methods and concepts to accelerate the adoption and utility of web archives. While there are more than a dozen publicly available web archives (including the Internet Archive) that are simultaneously accessible via the Memento protocol, these archives are mostly underutilized because they lack the APIs and services to be of greater immediate use to the live web. For example, rather than returning "HTTP 404" responses for pages that are not archived, the archives can introspect on their collections for replacement or similar pages. This project will research: (1) extended APIs for archives; (2) models and methods for archival quality; and (3) user tools and techniques for exploring and understanding temporality on the web. The broader impacts of this research will include increasing the ability of archives to record today's social discourse, which primarily occurs on the web, oftentimes with print or TV as secondary. The ability to publish data on the web far outstrips the ability to archive it for posterity. There are a number of public web archives that are doing yeoman's work saving as much material as they can, but saving is only a precondition for later use. Mostly these archived web pages are being underutilized, only because the tools for extracting the value from these archives are lacking. This project will research and build the tools, infrastructure, and methods to better utilize, understand, and interact with the archived materials that we already have.Aside from their crawling, archives are mostly passive collections of content that offer little in the way of services other than answering "yes" or "no" to a request for an archived page. Even with the increased rate of archiving (and a greater number of active web archives), there is little analysis on the web archives to provide better services for incoming requests. The PIs will build on their prior API work to explore recommendation services for web pages, where even if an archive does not have the requested web page it can make recommendations for a replacement page based on content and link analysis. This will prevent the web archives from being a dead end if they do not have the requested page. The PIs will also perform fundamental research on the issue of the quality of the reconstructed page, a topic that has been mostly ignored. In particular the PIs are concerned with detecting and resolving "temporal violations," combinations of HTML pages with embedded resources that are presented to the user as an historical page but in fact they never existed in that combination on the live web. This occurs in at least 5% of the pages replayed through the Internet Archive. The other aspect of quality research deals with automatically assessing how damaged an archived page is with respect to its missing embedded resources. Straight percentages (e.g., this page is missing 3 of 57 embedded resources) do not tell the whole tale, but there are automated methods that can be used to estimate how important the resource was (even though you do not have it) to the rendered page. This will allow large-scale assessment not only of pages, but of archive-wide performance for comparable time periods. Lastly, the PIs will focus on tools and methods for allowing users to better understand and interact with the archived web and temporal concepts in general. Users' understanding of temporal concepts is not well advanced, in part because the tools are not in place to allow them to better understand and build models for interaction. For further information see the web site at: http://ws-dl.cs.odu.edu/.