Re-Animator: Versatile High-Fidelity Storage-System Tracing and Replaying

Re-Animator: Versatile High-Fidelity Storage-System Tracing and Replaying
复制标题

DOI:
10.1145/3383669.3398276
复制
发表时间:
2020-05
期刊:
Proceedings of the 13th ACM International Systems and Storage Conference
影响因子:
--
通讯作者:
I. Akgun;G. Kuenning;E. Zadok
I. Akgun;G. Kuenning;E. Zadok
中科院分区:
其他
文献类型:
--
作者:
I. Akgun;G. Kuenning;E. Zadok

文献摘要

相似文献

现代应用程序以复杂且常常令人惊讶的方式使用存储系统。跟踪系统调用是了解应用程序行为的常用方法,允许离线分析并在其他环境中重放。但当前的系统调用跟踪工具存在缺陷:(1)它们经常忽略一些完整分析所需的信息,例如原始数据缓冲区; (二)管理费用较高; (3) 他们经常使用不可移植的跟踪格式; (4) 他们可能不提供有用且可扩展的分析和重放工具。我们开发了 Re-Animator,这是一个功能强大的系统调用跟踪工具,专注于与存储相关的调用并收集最大信息,捕获完整的数据缓冲区并以标准 DataSeries 格式写入所有跟踪。我们还创建了一个原型重放器,重点关注与文件系统状态相关的调用。我们在长期运行的服务器应用程序(例如键值存储和数据库)上评估了我们的系统。我们的跟踪器的平均开销仅为 1.8-2.3 倍,但对于 I/O 密集型应用程序来说,开销可以低至 5%。我们的重放器验证其操作是否正确,并忠实地再现原始应用程序生成的逻辑文件系统状态。
Modern applications use storage systems in complex and often surprising ways. Tracing system calls is a common approach to understanding applications' behavior, allowing offline analysis and enabling replay in other environments. But current system-call tracing tools have drawbacks: (1) they often omit some information---such as raw data buffers---needed for full analysis; (2) they have high overheads; (3) they often use non-portable trace formats; and (4) they may not offer useful and scalable analysis and replay tools. We have developed Re-Animator, a powerful system-call tracing tool that focuses on storage-related calls and collects maximal information, capturing complete data buffers and writing all traces in the standard DataSeries format. We also created a prototype replayer that focuses on calls related to file-system state. We evaluated our system on long-running server applications such as key-value stores and databases. Our tracer has an average overhead of only 1.8-2.3×, but the overhead can be as low as 5% for I/O-bound applications. Our replayer verifies that its actions are correct, and faithfully reproduces the logical file system state generated by the original application.