III: Small: Increasing the Value of Existing Web Archives

网络存档是一项蓬勃发展的活动，但仍然处于更大的网络社区的边缘。网络存档经常遇到两种观点：(1)谁在乎过去？(2)互联网档案馆不是已经解决了这个问题吗？虽然Internet Archive是web存档的基石，但要使存档与更大的web社区保持一致，仍有许多工作要做。pi将研究一系列方法和概念，以加速网络档案的采用和利用。虽然有十多个公开可用的网络档案（包括互联网档案）可以通过Memento协议同时访问，但这些档案大多没有得到充分利用，因为它们缺乏api和服务，无法更直接地用于实时网络。例如，对于未存档的页面，存档系统不会返回“HTTP 404”响应，而是可以对其集合进行内省，以查找替换页面或类似页面。本项目将研究：(1)档案扩展api；(2)档案质量的模型和方法；(3)探索和理解网络时间性的用户工具和技术。这项研究的更广泛的影响将包括提高档案记录当今社会话语的能力，这些话语主要发生在网络上，通常是印刷品或电视。在网络上发布数据的能力远远超过为后代保存数据的能力。有许多公共网络档案馆正在尽其所能地保存资料，但保存只是日后使用的先决条件。大多数情况下，这些存档的网页没有得到充分利用，只是因为缺乏从这些存档中提取价值的工具。这个项目将研究和建立工具、基础设施和方法，以更好地利用、理解和与我们已经拥有的存档材料进行交互。除了爬行之外，存档主要是被动的内容集合，除了对存档页面的请求回答“是”或“否”之外，几乎没有提供任何服务。即使归档率提高了（以及活跃的web归档数量增加了），对web归档的分析也很少，无法为传入的请求提供更好的服务。pi将在他们之前的API工作的基础上探索网页的推荐服务，即使一个存档没有被请求的网页，它也可以根据内容和链接分析为替代页面提供推荐。这将防止网络档案成为一个死胡同，如果他们没有请求的页面。pi还将对重建页面的质量问题进行基础研究，这是一个几乎被忽视的话题。特别是pi关注检测和解决“时间违规”，即HTML页面与嵌入资源的组合，这些资源作为历史页面呈现给用户，但实际上它们从未存在于实时web的组合中。通过Internet Archive重播的页面中至少有5%出现这种情况。质量研究的另一个方面涉及自动评估存档页面相对于其丢失的嵌入资源的损坏程度。直接的百分比（例如，这个页面缺少57个嵌入资源中的3个）并不能说明全部情况，但是有一些自动化的方法可以用来估计资源对渲染页面的重要性（即使你没有它）。这不仅可以对页面进行大规模评估，还可以对可比较时间段的整个存档的性能进行大规模评估。最后，pi将集中在工具和方法上，让用户更好地理解和与存档的web和时间概念进行交互。用户对时间概念的理解不是很先进，部分原因是没有适当的工具来允许他们更好地理解和构建交互模型。欲了解更多信息，请访问网站：http://ws-dl.cs.odu.edu/。

Web archiving is a thriving activity, but remains at the fringes of the larger web community. Web archiving often runs into two opinions: (1) who cares about the past? and (2) hasn't the Internet Archive solved this already? While the Internet Archive is the cornerstone of web archiving, there remains much work to be done to align archiving with the larger web community. The PIs will investigate a collection of methods and concepts to accelerate the adoption and utility of web archives. While there are more than a dozen publicly available web archives (including the Internet Archive) that are simultaneously accessible via the Memento protocol, these archives are mostly underutilized because they lack the APIs and services to be of greater immediate use to the live web. For example, rather than returning "HTTP 404" responses for pages that are not archived, the archives can introspect on their collections for replacement or similar pages. This project will research: (1) extended APIs for archives; (2) models and methods for archival quality; and (3) user tools and techniques for exploring and understanding temporality on the web. The broader impacts of this research will include increasing the ability of archives to record today's social discourse, which primarily occurs on the web, oftentimes with print or TV as secondary. The ability to publish data on the web far outstrips the ability to archive it for posterity. There are a number of public web archives that are doing yeoman's work saving as much material as they can, but saving is only a precondition for later use. Mostly these archived web pages are being underutilized, only because the tools for extracting the value from these archives are lacking. This project will research and build the tools, infrastructure, and methods to better utilize, understand, and interact with the archived materials that we already have.Aside from their crawling, archives are mostly passive collections of content that offer little in the way of services other than answering "yes" or "no" to a request for an archived page. Even with the increased rate of archiving (and a greater number of active web archives), there is little analysis on the web archives to provide better services for incoming requests. The PIs will build on their prior API work to explore recommendation services for web pages, where even if an archive does not have the requested web page it can make recommendations for a replacement page based on content and link analysis. This will prevent the web archives from being a dead end if they do not have the requested page. The PIs will also perform fundamental research on the issue of the quality of the reconstructed page, a topic that has been mostly ignored. In particular the PIs are concerned with detecting and resolving "temporal violations," combinations of HTML pages with embedded resources that are presented to the user as an historical page but in fact they never existed in that combination on the live web. This occurs in at least 5% of the pages replayed through the Internet Archive. The other aspect of quality research deals with automatically assessing how damaged an archived page is with respect to its missing embedded resources. Straight percentages (e.g., this page is missing 3 of 57 embedded resources) do not tell the whole tale, but there are automated methods that can be used to estimate how important the resource was (even though you do not have it) to the rendered page. This will allow large-scale assessment not only of pages, but of archive-wide performance for comparable time periods. Lastly, the PIs will focus on tools and methods for allowing users to better understand and interact with the archived web and temporal concepts in general. Users' understanding of temporal concepts is not well advanced, in part because the tools are not in place to allow them to better understand and build models for interaction. For further information see the web site at: http://ws-dl.cs.odu.edu/.