CSR: Small: Collaborative Research: Scalable Fine-Grained Cloud Monitoring for Empowering IoT

我们正处于一个前所未有的互联时代，从计算机、建筑物、车辆、医疗设备到动物，所有的东西都被装备成通过互联网交换数据来相互交流。这个大规模连接的世界，被称为物联网（IoT），将在实现前所未有的计算服务（如自动驾驶汽车和个性化医疗保健）方面发挥至关重要的作用，从而提高生活质量。物联网的一个关键推动因素是云计算模式，该模式已经通过以合理的成本轻松按需访问计算资源和服务，改变了学术界、企业和IT行业的计算。如果没有云计算提供的基础设施作为控制和处理来自物联网网络的数据的大脑，大多数当前和未来的物联网应用程序都无法运行。因此，迫切需要确保支持云服务的数据中心能够满足不断增长的物联网需求，同时保持高质量的服务并满足服务水平协议。为此，本项目旨在承担对快速增长的数据中心的健康和使用统计数据进行收集和详细细粒度监控的基本任务，并解决其中的挑战。细粒度数据中心监控要求云提供商必须获取、传输、存储和处理呈指数级增长的管理和监控数据。随着这种数据量以每天超过100亿条记录的前所未有的速度增加，传统的采集和传输方案不再足以和有效地处理数据海啸。该项目旨在解决高效获取和传输云管理和监控数据的问题。对于数据，它将专注于有效地将数据从数据中心内收集的点移动到需要存储以进行处理的点。成功完成将产生云提供商可以用来监控其数据中心的工具，并获得用于预测和/或定位性能瓶颈的测量结果。最后，该项目的教育和推广目标包括培训下一代计算机科学家，掌握管理和设计创新物联网应用程序和系统的技能。

We are in the age of unprecedented connectivity, where everything from computers, buildings, vehicles, medical devices, to even animals is being equipped to interact with each other by exchanging data over the Internet. This massively connected world, referred to as the Internet of Things (IoT), will play a crucial role in enabling never-before-seen computing services such as self-driving cars and personalized health care, consequently improving the quality of life. A key enabler for IoT is the cloud computing model that is already transforming computing in academia, enterprise, and the IT industry by enabling easy and on-demand access to computing resources and services at reasonable cost. Most current and future IoT applications cannot function without the infrastructure provided by cloud computing serving as the brain for controlling and processing the data from the IoT network. Thus, there is an urgent need for ensuring that the data centers that support the cloud services can sustain the ever-growing IoT needs, while maintaining high quality of services and meeting service level agreements. To this end, this project aims to undertake the fundamental task of collecting and detailed fine-grained monitoring of the health and usage statistics of rapidly growing data centers, and addresses the challenges therein.Fine-grained data center monitoring entails that the cloud providers have to acquire, transport, store, and process exponentially increasing amount of management and monitoring data. With the amount of such data increasing at an unexampled rate of over 10 billion+ records per day, conventional acquisition and transportation schemes are no longer sufficient and efficient to handle the data tsunami. This project aims to address the problem of efficiently acquiring and transporting cloud management and monitoring data. For data it will focus on efficiently moving the data from the points it is collected inside the data center to the points where it needs to be stored for processing. Successful completion will result in tools that cloud providers can use to monitor their data centers and obtain measurements useful to predict and/or localize performance bottlenecks. Finally, the educational and outreach goals of this project include training the next-generation computer scientists with skills to manage and design innovative IoT applications and systems.