Research on Stochastic Processes and Optimization

对于具有固定服务/路由策略的随机网络，通常很难唯一地刻画标准大数定律和扩散近似标度下的极限。相关的困难出现在其他分析方法中，例如大偏差近似。另一种方法是允许路由/服务决策成为控制变量。在适当的形式下，这些受控随机网络的类似近似往往比它们的固定策略对应具有更好的定性性质。此外，许多近似模型都足够简单，因此闭合形式(或接近闭合形式)的解是可能的。研究人员将在几个密切相关的领域开展研究，这些领域可以利用这些特征：风险敏感控制和排队网络中罕见事件的控制；大数逼近律(也称为流体模型)的稳健最优控制；流体模型控制的高阶修正。每个主题的核心都是具有约束动力学的过程的变分问题(大偏差和流体模型控制的变分或最优控制问题，流体模型稳健控制或罕见事件控制问题的微分对策)。这位研究人员最近展示了在某些情况下，如何将一个涉及约束和受控动态以及相对简单的成本结构的变分问题转化为涉及无约束动态和不同成本的等价问题。然后，后一个问题就被明确地解决了。建议的研究包括将该技术扩展到包括大偏差和约束微分对策中的缓冲区溢出问题。当今应用概率的主要问题之一是随机网络的易处理近似的发展。随机网络在现代计算机、通信和制造系统中普遍存在，但由于其复杂性和细节，分析起来非常困难。因此，大量的努力被投入到数学模型的开发中，这些模型足够忠实于“现实生活”，从而使从中得出的结论可以自信地使用，但这些结论可以通过解析或数值方法来解决。这个项目的目的是开发这样的近似方法以及解决它们的技术。一个新的特征是允许关于路由和服务的决定(例如，在通信网络中应该服务于哪个数据类以及应该将处理的数据发送到哪里)成为可以优化的控制变量。两类特殊的网络问题将得到特别关注。首先是对罕见事件的控制。在许多网络中，有一些事件并不经常发生，但仍是主要关注的问题。一个例子是通信网络中的数据丢失。第二类是网络的鲁棒控制，这意味着对网络的控制，其中网络的某些方面没有被很好地建模或以其他方式不完全知道。

For stochastic networks with a fixed service/routing policy it is often difficult to uniquely characterize limits under standard law of large numbers and diffusion approximation scalings. Related difficulties appear in other methods of analysis, such as large deviation approximations. An alternative approach is to allow the routing/service decisions to be control variables. When properly formulated, the analogous approximations to these controlled stochastic networks frequently possess better qualitative properties than their fixed policy counterparts. In addition, many approximate models are simple enough that closed form (or nearly closed form) solutions are possible. The investigator will carry out research on several closely related areas that can take advantage of these features: risk-sensitive control and the control of rare events in queueing networks; robust optimal control of law of large number approximations (also known as fluid models); higher order corrections to the control of fluid models. At the heart of each of these topics is a variational problem for processes with constrained dynamics (calculus of variations or optimal control problems for large deviations and control of fluid models, differential games for the problems of robust control of fluid models or control of rare events). The investigator has recently shown how in certain cases one can convert a variational problem involving constrained and controlled dynamics and a relatively simple cost structure into an equivalent problem involving unconstrained dynamics and a different cost. The latter problem is then solved explicitly. The proposed research includes extending this technique to include problems of buffer overflow in large deviations and constrained differential games. One of the main concerns of applied probability today is the development of tractable approximations for stochastic networks. Stochastic networks are ubiquitous in modern computer, communication and manufacturing systems, but owing to their complexity and detail are very difficult to analyze. As a consequence, much effort is being put into the development of mathematical models that are faithful enough to "real life" that conclusions drawn from them can be used with confidence, and yet which can be solved by either analytical or numerical means. The purpose of this project is to develop such methods of approximation and also the techniques for their solution. A new feature is to allow decisions on routing and service (e.g., which data class should be served in a communication network and where the processed data should be sent) to be control variables that can be optimized. Two particular classes of network problems will be given special attention. The first is the control of rare events. In many networks there are events that do not occur very often, and yet which are nonetheless the main concern. An example is data loss in a communication network. The second class is the robust control of networks, which means the control of a network in which some aspects of the network are poorly modeled or otherwise imperfectly known.