Expert Systems With Applications
Expert Systems With Applications
复制标题
DOI：
10.1016/j.eswa.2017.06.004
复制
发表时间：
2017-11
期刊：
影响因子：
--
通讯作者：
Mahdieh Zabihimayvan;Reza Sadeghi;H. N. Rude;Derek Doran
中科院分区：
文献类型：
--
作者：
Mahdieh Zabihimayvan;Reza Sadeghi;H. N. Rude;Derek Doran
从Web服务器日志中准确检测Web机器人会话对于进行准确的流量级别测量以及保护Web服务器上的性能和信息隐私至关重要。此外，来自恶意机器人的访问的不可挽回的风险，这些机器人故意试图逃避web服务器入侵检测系统，在其http请求数据包中使用虚构的字段来掩盖其访问，这是不可忽视的。为了在实践中将这两种类型的机器人与人类分开，分析师转向启发式方法或最先进的软计算方法，这些方法只针对一种Web服务器的规格进行了调整。注意到Web机器人代理的景观不断变化，并且行为模式和特征在不同的Web服务器上有所不同，这两种选择都缺乏。为了克服这一挑战，本文提出了智能，软计算系统，同时检测良性和恶意类型的机器人代理从Web服务器日志，并能自动适应Web服务器的会话特性。一些访问日志文件服务器的实验结果，每个服务于不同的Web域，展示了所提出的方法的最先进的良性和恶意机器人检测的性能优越。
The accurate detection of web robot sessions from a web server log is essential to take accurate traffic-level measurements and to protect the performance and privacy of information on a Web server. Moreover, the irrecoverable risks of visits from malicious robots that intentionally try to evade web server intrusion detection systems, covering-up their visits with fabricated fields in their http request packets, cannot be ignored. To separate both types of robots from humans in practice, analysts turn to heuristic methods or state-of-the-art soft computing approaches that have only been tuned to the specification of a kind of web server. Noting that the landscape of web robot agents is ever changing, and that behavioral patterns and characteristics vary across different web servers, both options are lacking. To overcome this challenge, this paper presents SMART, a soft computing system that simultaneously detects benign and malicious types of robot agents from web server logs and can automatically adapt to the session characteristics of a web server. The results of experiments over some access log file servers, each servicing different domains of the web, demonstrate outperformance of the proposed method on state-of-the-art ones for benign and malicious robot detection.