EAGER: Measuring the Stability of Web Links

日新月异，互联网越来越融入社会。我们在职业和个人生活中对在线网络服务的依赖不断增加。认识到这一点，攻击者利用Web的流行程度发动了广泛的Web应用程序攻击，破坏了系统，并窃取了私人和金融信息。尽管这些攻击的许多类别看似无关，但实际上，它们中的许多都源于网络的无状态性质，在这种性质下，没有安全措施来确保昨天链接的资源与今天访问的资源相同。因此，加强链接完整性有望缓解大量的安全攻击。然而，网络的动态性对链接完整性方案提出了挑战，该方案必须在标记恶意变化的同时应对持续的良性变化。从事这方面的研究需要对网络的安全方面有一个基本的了解--S的动态化本质。由于现有的网络爬行器仅限于检索内容，并且通常不收集对开发链接完整性方案至关重要的元数据，因此目前无法用现有的工具来评估这一性质。该项目旨在通过开发定制的网络爬虫基础设施和工具来量化网络链接的稳定性，这些基础设施和工具将收集有关远程资源的安全相关元数据。收集和随后评估此元数据是证明开发可靠的链接完整性方案的可行性的关键第一步，该方案可用于检测异常内容和基础设施更改(指示正在进行的攻击)，同时将误报保持在最低限度。

With every passing day, the Internet becomes more and more integrated in society. Our reliance on online web services in our professional and personal lives continuously increases. Recognizing this, attackers take advantage of the web's popularity to mount a wide range of web application attacks, compromising systems, and stealing private and financial information. Although many classes of these attacks are seemingly unrelated, in reality, many of them stem from the stateless nature of the web, where no safeguards exist to ensure that a resource that was linked to yesterday is the same resource being accessed today. As a result, enforcing link integrity holds the promise of mitigating a multitude of security attacks.However, the dynamicity of the web poses challenges to link integrity schemes, which must cope with constant benign changes while flagging the malicious ones. Pursuing this line of research requires a fundamental understanding of the security aspects of the web?s dynamic nature. This nature cannot be assessed today with the available tools, because existing web crawlers are limited to retrieving content, and generally do not gather the metadata critical to the development of link integrity schemes. This project aims to quantify the stability of web links by developing a custom web crawler infrastructure and tools that will collect security-related metadata about remote resources. The gathering and subsequent assessing of this metadata is a critical first step to demonstrate the feasibility of developing robust link integrity schemes that can be used to detect abnormal content and infrastructure changes (indicative of an ongoing attack) while keeping false positives to a minimum.