III: Small: Increasing the Value of Existing Web Archives

III：小：增加现有网络档案的价值

• 批准号: 1526700
• 负责人: Michael Nelson
• 金额: $ 48.18万
• 依托单位: Old Dominion University Research Foundation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2019-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1526700&HistoricalAwards=false
• 关键词: III; Small; Increasing; Value; Existing

Web archiving is a thriving activity, but remains at the fringes of the larger web community. Web archiving often runs into two opinions: (1) who cares about the past? and (2) hasn't the Internet Archive solved this already? While the Internet Archive is the cornerstone of web archiving, there remains much work to be done to align archiving with the larger web community. The PIs will investigate a collection of methods and concepts to accelerate the adoption and utility of web archives. While there are more than a dozen publicly available web archives (including the Internet Archive) that are simultaneously accessible via the Memento protocol, these archives are mostly underutilized because they lack the APIs and services to be of greater immediate use to the live web. For example, rather than returning "HTTP 404" responses for pages that are not archived, the archives can introspect on their collections for replacement or similar pages. This project will research: (1) extended APIs for archives; (2) models and methods for archival quality; and (3) user tools and techniques for exploring and understanding temporality on the web. The broader impacts of this research will include increasing the ability of archives to record today's social discourse, which primarily occurs on the web, oftentimes with print or TV as secondary. The ability to publish data on the web far outstrips the ability to archive it for posterity. There are a number of public web archives that are doing yeoman's work saving as much material as they can, but saving is only a precondition for later use. Mostly these archived web pages are being underutilized, only because the tools for extracting the value from these archives are lacking. This project will research and build the tools, infrastructure, and methods to better utilize, understand, and interact with the archived materials that we already have.Aside from their crawling, archives are mostly passive collections of content that offer little in the way of services other than answering "yes" or "no" to a request for an archived page. Even with the increased rate of archiving (and a greater number of active web archives), there is little analysis on the web archives to provide better services for incoming requests. The PIs will build on their prior API work to explore recommendation services for web pages, where even if an archive does not have the requested web page it can make recommendations for a replacement page based on content and link analysis. This will prevent the web archives from being a dead end if they do not have the requested page. The PIs will also perform fundamental research on the issue of the quality of the reconstructed page, a topic that has been mostly ignored. In particular the PIs are concerned with detecting and resolving "temporal violations," combinations of HTML pages with embedded resources that are presented to the user as an historical page but in fact they never existed in that combination on the live web. This occurs in at least 5% of the pages replayed through the Internet Archive. The other aspect of quality research deals with automatically assessing how damaged an archived page is with respect to its missing embedded resources. Straight percentages (e.g., this page is missing 3 of 57 embedded resources) do not tell the whole tale, but there are automated methods that can be used to estimate how important the resource was (even though you do not have it) to the rendered page. This will allow large-scale assessment not only of pages, but of archive-wide performance for comparable time periods. Lastly, the PIs will focus on tools and methods for allowing users to better understand and interact with the archived web and temporal concepts in general. Users' understanding of temporal concepts is not well advanced, in part because the tools are not in place to allow them to better understand and build models for interaction. For further information see the web site at: http://ws-dl.cs.odu.edu/.

网络存档是一项蓬勃发展的活动，但仍然处于更大的网络社区的边缘。 网络存档通常会遇到两种观点：（1）谁在乎过去？ （2）互联网档案馆不是已经解决了这个问题吗？ 虽然互联网档案馆是网络存档的基石，但要使存档与更大的网络社区保持一致，仍有许多工作要做。 PI将调查一系列方法和概念，以加速Web存档的采用和实用性。 虽然有十几个公开的网络档案（包括互联网档案馆）可以通过Memento协议同时访问，但这些档案大多未得到充分利用，因为它们缺乏API和服务，无法立即用于实时网络。 例如，对于未存档的页面，不是返回“HTTP 404”响应，而是存档可以对它们的集合进行自省，以找到替换或类似的页面。 该项目将研究：（1）档案的扩展API;（2）档案质量的模型和方法;（3）探索和理解网络时间性的用户工具和技术。 这项研究的更广泛影响将包括提高档案馆记录当今社会话语的能力，这些话语主要发生在网络上，通常是印刷品或电视作为次要内容。在网络上发布数据的能力远远超过了为子孙后代存档数据的能力。有许多公共网络档案馆正在尽可能多地保存材料，但保存只是以后使用的先决条件。大多数情况下，这些存档的网页没有得到充分利用，只是因为缺乏从这些档案中提取价值的工具。该项目将研究和构建工具、基础设施和方法，以更好地利用、理解和与我们已经拥有的存档材料进行交互。除了抓取之外，存档大多是被动的内容集合，除了回答“是”或“否”之外，几乎没有提供任何服务。即使存档率提高（活跃的网络档案数量增加），也很少对网络档案进行分析，以便为收到的请求提供更好的服务。 PI将建立在他们之前的API工作基础上，探索网页推荐服务，即使存档没有所请求的网页，它也可以根据内容和链接分析为替换页面提供建议。 这将防止网络档案是一个死胡同，如果他们没有所请求的页面。 PI还将对重建页面的质量问题进行基础研究，这是一个大多被忽视的话题。PI特别关注检测和解决“时间违规”，即HTML页面与嵌入式资源的组合，这些资源作为历史页面呈现给用户，但实际上它们从未存在于实时Web上的组合中。通过互联网档案馆重播的页面中至少有5%发生这种情况。质量研究的另一个方面涉及自动评估存档页面的损坏程度与其丢失的嵌入式资源有关。 直接百分比（例如，这个页面缺少了57个嵌入资源中的3个）并不能说明全部情况，但是有一些自动化的方法可以用来估计资源对呈现的页面的重要性（即使你没有它）。这将使人们能够不仅对网页进行大规模评估，而且对可比时期的整个档案的业绩进行大规模评估。最后，PI将侧重于工具和方法，使用户能够更好地理解和与存档的网络和一般的时间概念互动。 用户对时间概念的理解还不够深入，部分原因是工具还不到位，无法让他们更好地理解和构建交互模型。欲了解更多信息，请访问网站：http://ws-dl.cs.odu.edu/。