Designing Highly Recoverable Cloud Based Software Applications

云计算是一种日益流行的范例，它允许个人和企业通过Internet提供和部署软件应用程序。客户可以租用这些“云”应用程序（又称云应用程序）提供的服务，根据需要增加或减少容量，只需为他们使用的容量付费。云应用通常运行在谷歌App Engine、Windows Azure或OpenStack等云平台上。如今，几乎每个行业都在使用云应用；从金融、零售、教育、通信到制造业、公用事业和交通运输。弗雷斯特研究公司预测，到2016年，云应用的销售额将翻四番（从今年的212亿美元增至928亿美元），占整个软件市场的16%左右。然而，对于供应商和用户来说，云应用的可靠性仍然是一个主要问题。云应用程序的故障通常会导致巨大的经济损失，因为核心业务活动现在依赖于它们。2012年12月24日，亚马逊网络服务的故障导致Netflix云服务中断了19个小时。如今，对高度可靠的云应用程序的需求达到了前所未有的高度。然而，业界仍然没有明确的方法来开发高度可靠的云应用程序。开发人员通常将可靠性问题委托给运行应用程序的云平台。经验法则是跨多个可用区（AZ）复制服务，正如Netflix的策略所总结的那样：“部署在多个可用区，没有额外的实例——目标是自动扩展30-60%，直到你有50%的负载峰值空间。”失去可用分区将导致90%的利用率”。然而，悉尼研究人员进行的压力测试显示，亚马逊、b谷歌和微软等大公司提供的基础设施和平台服务由于服务过载、硬件故障、软件错误和操作人员错误等原因，经常出现性能和可用性问题。发现这些服务的响应时间根据一天中的时间变化了20倍。因此，云应用程序如果要高度可靠，就应该对故障保持健壮。这项研究计划的长期目标是开发技术和工具，以提高云应用程序的可恢复性。通过减少云应用程序的恢复时间，我们将能够提高它们的可靠性，并减少服务停机期间的资金损失。我将通过开发和应用一种由框架支持的新颖创新的方法来实现这一目标，从而将故障恢复机制整合到云应用程序的架构中。云计算的一大资产是不断增加的应用程序编程接口（API），它允许开发人员将多个第三方服务集成到云应用程序中。云API平台的例子包括Apache CloudStack、Amazon Web Services、Eucalyptus、Simple cloud和OpenStack。这些服务级api提供了大量冗余服务，这些服务可以合并到云应用程序中以实现容错。使用Heartbeat或Watchdog等模式，云应用程序可以监视它所依赖的特定服务，并且在该服务失败的情况下，将请求重定向到备份服务并触发恢复机制以保持高可用性。我将提出集成和监控服务的架构模式，以及在云应用架构中集成故障恢复机制的框架。

Cloud computing is an increasingly popular paradigm that allows individuals and enterprises to provision and deploy software applications over the Internet. Customers can lease services provided by these ‘cloud’ applications (a.k.a cloud apps), ramping up or down the capacity as they need and paying only for what they use. Cloud apps typically run on cloud platforms such as Google App Engine, Windows Azure, or OpenStack. Cloud apps are used in about every industry today; from financial, retail, education, and communications, to manufacturing, utilities and transportation. Forrester Research predicts that cloud apps sales will more than quadruple by 2016 (from $21.2 billion this year to $92.8 billion) to account for around 16% of the total software market. However, cloud apps dependability is still a major issue for both providers and users. Failures of cloud apps generally result in big economic losses as core business activities now rely on them. This was the case in December 24, 2012 when a failure of Amazon web services caused an outage of Netflix cloud services for 19 hours. The demand for highly dependable cloud apps has reached unprecedentedly high levels today. Yet, there is still no clear methodology in the industry for developing highly dependable cloud apps. Developers usually delegate dependability issues to the cloud platforms running the apps. A rule of thumb is to replicate services across multiple availability zones (AZ) as summarized by Netflix’s strategy: "Deploy in multiple AZ with no extra instances – target autoscale 30-60% until you have 50% headroom for load spikes. Lose an AZ leads to 90% utilization". Yet, stress tests conducted by Sydney-based researchers have revealed that infrastructure and platform services offered by big players like Amazon, Google, and Microsoft suffer from regular performance and availability issues due to service overload, hardware failures, software errors, and operator errors. The response times of these services was found to vary by a factor of twenty depending on the time of day. Therefore, cloud apps should be robust to failures if they are to be highly dependable. The long-term goal of this research program is to develop techniques and tools to improve the recoverability of cloud apps. By reducing the recovery time of cloud apps, we will be able to improve their dependability and reduce the amount of money lost during service-downtime. I will achieve this goal by developing and applying a novel and innovative methodology supported by a framework to incorporate fault recovery mechanisms in the architecture of cloud apps. One big asset of cloud computing is the constantly increasing number of Application Programming Interfaces (API) that allow developers to integrate multiple third party services into cloud apps. Examples of cloud API platforms include Apache CloudStack, Amazon Web Services, Eucalyptus, Simple Cloud, and OpenStack. These service-level APIs provide a lot of redundant services that can be incorporate in cloud apps to implement fault-tolerance. Using patterns like Heartbeat or Watchdog, a cloud app can monitor a specific service on which it depends and, in case of failure of this service, redirect requests to a backup service and trigger a recovery mechanism to maintain high availability. I will propose architectural patterns to integrate and monitor services, as well as a framework to integrate fault recovery mechanisms in the architecture of cloud apps.