Quality of Information Matters: Recommending Web Services for Performance and Utility
Quality of Information Matters: Recommending Web Services for Performance and Utility
复制标题
DOI：
10.1109/cloudcom55334.2022.00016
复制
发表时间：
2022-12
期刊：
影响因子：
--
通讯作者：
Zheng Song;Owen Rowader;Zheng R. Li;Maryam Tello;E. Tilevich
中科院分区：
文献类型：
--
作者：
Zheng Song;Owen Rowader;Zheng R. Li;Maryam Tello;E. Tilevich
在现代软件系统中广泛使用的Web服务已经成为提供远程资源的标准手段。随着可用Web服务数量的增加，满足相同功能需求的多个服务可以互换使用。给定一组可互换的服务，软件开发人员需要找到一个可以提供最佳性能和实用性的Web服务。然而，Web服务仅基于其与系统相关的性能特征（所谓的QoS，其属性包括延迟、可靠性、可用性等）被推荐，而它们的数据相关性能特性（例如，数据新鲜度、正确性、覆盖率等）往往被忽视。因此，推荐的服务可能最终提供不准确或过时的信息，但性能很高。为了解决这个问题，本文介绍了信息质量（QoI），一个质量度量的QoS的补充，在何种程度上的Web服务满足数据相关的非功能性要求的措施。为了最大限度地减少手动工作所需的调用单个服务的结果进行评估，我们引入了一个比较测试方法的基础上的新概念的对象的兴趣（OI）。通过使用OI，开发人员可以规范化从不同服务获得的相关信息，因此可以自动比较。为了具体实现我们的想法，我们创建了QiSR，这是一个基于QoI指标推荐Web服务的系统。QiSR帮助开发人员确定如何将服务的输入和输出与应用程序数据需求相匹配，以及如何衡量服务的信息质量。为了评估QiSR的有效性，我们在有代表性的手动选择的Web服务上进行了测试。我们的评估表明，服务质量和QoS的基础上推荐表现出更好的综合性能和效用比服务质量单独推荐。
Widely used in modern software systems, web services have become a standard means of provisioning remote resources. As the number of available web services increases, multiple services that satisfy the same functional requirement can be used interchangeably. Given a set of interchangeable services, a software developer needs to find a web service that would provide the best performance and utility. However, web services are recommended based only on their system-related performance characteristics (so called QoS, whose properties include latency, reliability, availability, etc.), while their data-related performance characteristics (e.g., data freshness, correctness, coverage, etc.) are often overlooked. As a consequence, a recommended service may end up delivering information that is inaccurate or outdated, but with high performance. To address this problem, this paper introduces Quality of Information (QoI), a quality metric complementary to QoS, that measures to which degree a web service satisfies data-related non-functional requirements. To minimize the manual effort required to evaluate the results of invoking individual services, we introduce a comparative testing methodology based on the new concept of Objects of Interest (OI). By using OI, developers can normalize the relevant information obtained from dissimilar services, so it can be automatically compared. To concretely realize our ideas, we create QiSR, a system that recommends web services based on their QoI metrics. QiSR helps developers in determining how to match services’ input and output with application data requirements and how to measure the information quality of services. To evaluate the effectiveness of QiSR, we test it on representative manually selected web services. Our evaluation shows that services recommended based on both QoI and QoS exhibit better combined performance and utility than services recommend on QoS alone.