Integrated tracing, profiling and debugging for tuning large heterogeneous clusters

用于调整大型异构集群的集成跟踪、分析和调试

• 批准号: 424666-2011
• 负责人: Dagenais, Michel
• 金额: $ 10.64万
• 依托单位: École Polytechnique de Montréal
• 依托单位国家: 加拿大
• 项目类别: Collaborative Research and Development Grants
• 财政年份: 2012
• 资助国家: 加拿大
• 起止时间: 2012-01-01 至 2013-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=498955
• 关键词: Integrated; tracing; profiling; debugging; tuning

The communication and computing infrastructure is rapidly evolving towards mobile clients in different formats (handheld phones, tablets or laptop computers) accessing a large number of servers in the cloud. The complexity of that infrastructure has been increasing exponentially over the last several decades with the processors in the clients, servers and networking nodes now running several processor cores in parallel, often with application specific integrated circuits support, with some of these parts consisting in over one billion logic elements (transistors). Adding to this complexity is the increasing reliance on virtualization, for both computing nodes and networking, for fault tolerance, scalability and resource optimization purposes. As a result, even a simple request as initiating a phone call, or making a Web search, can involve several parallel processors on several servers. Moreover, the same request issued a few seconds later may be served in a different way by different physical servers. Therefore, understanding the performance of these services has become extremely difficult and the tools for that purpose are severely lacking. In this project, existing tools for tracing, profiling and debugging multi-core systems will be extended to cover special purpose processors and support circuits (e.g. network processors) and to extract information at several layers from the hardware to the operating system, virtual machines, middleware and application layers. Moreover, a common modeling framework will be developed to combine the information from tracing, profiling and debugging, model the computation nodes, peripherals, communication links and networking nodes, and make that information available to an extensible set of analysis and visualization modules. As a result, the server cluster designers and operators will have the tools in hand to quickly analyze their system performance, find problems and optimize operations.

通信和计算基础设施正在迅速向不同格式的移动的客户端（手持电话、平板电脑或膝上型计算机）发展，这些客户端访问云中的大量服务器。该基础设施的复杂性在过去几十年中呈指数级增长，客户端、服务器和联网节点中的处理器现在并行运行多个处理器核，通常具有专用集成电路支持，其中这些部分中的一些由超过十亿个逻辑元件（晶体管）组成。增加了这种复杂性的是越来越多地依赖虚拟化，无论是计算节点还是网络，都是为了容错、可扩展性和资源优化。因此，即使是一个简单的请求，如发起电话呼叫或进行Web搜索，也可能涉及多个服务器上的多个并行处理器。此外，几秒钟后发出的相同请求可能会由不同的物理服务器以不同的方式提供服务。因此，了解这些服务的业绩变得极为困难，而且严重缺乏这方面的工具。在这个项目中，现有的用于跟踪、分析和调试多核系统的工具将被扩展，以涵盖特殊用途处理器和支持电路（例如网络处理器），并从硬件到操作系统、虚拟机、中间件和应用程序层的多个层提取信息。此外，还将开发一个通用建模框架，以便将来自跟踪、分析和调试的信息联合收割机结合起来，对计算节点、外围设备、通信链路和联网节点进行建模，并使这些信息可用于一组可扩展的分析和可视化模块。因此，服务器集群设计人员和操作人员将拥有快速分析系统性能、发现问题和优化操作的工具。