Discrete-Review Control of Service Processing Networks with Applications to Patient Flow Management in Emergency Departments

常用于服务系统建模和分析的随机混沌网络的控制（例如，医院、联络中心和乘坐/自行车共享系统）在过去一直是广泛研究的主题。文献主要关注连续时间控制，即控制器可以在任何时间点与系统交互。然而，在许多服务设置中，系统管理员只能以离散的且可能长的时间间隔与系统交互。也就是说，尽管相关信息变得可用，但控制器在下一个审查时间开始之前不能行使控制。** 控制对离散时间或离散审查策略的限制往往从根本上改变了最优控制策略的结构，使得相应的连续时间策略（如果已知）不切实际，并且难以解释其中的见解。尽管应用和潜在的好处，然而，离散审查控制的网络仍然是大多未在文献中探讨。** 拟议的研究计划旨在首先提供关于对动态控制策略的性能施加离散审查限制的影响的基本见解，其次，开发实用有效的离散审查策略以控制复杂的网络。特别是，我将考虑两个重要的业务决策，即动态容量分配和容量规划，并研究主要由急诊科（ED）的病人流量管理应用程序的激励模型。通过与两家大型医疗保健提供商（位于安大略省密西索加的氚健康合作伙伴（THP）和位于纽约州纽约的纽约长老会（NYP）医院）的合作，并使用他们的数据，该计划将涉及校准模型，估计拟议政策的性能，并致力于在实践中实施。** 该研究计划的一个重要特点是，它强调实用的政策，并依赖于由真实世界数据提供信息的模型。因此，如果成功的话，研究的结果可以有助于减少加拿大各地急诊室的等待时间，那里的过度拥挤问题越来越令人担忧。此外，虽然所提出的模型主要是由应用程序的病人流量管理的动机，他们捕捉动态和功能，存在于各种服务系统。因此，预计该计划中开发的方法和见解将是有用的，并导致进一步研究其他服务系统的连续时间控制是不可行的，由于人为影响或与系统交互的高成本。

Control of stochastic queueing networks which are often used in modeling and analysis of service systems (e.g., hospitals, contact centers, and ride/bike sharing systems) has been the subject of extensive research in the past. The literature is predominantly concerned with continuous-time control, whereby the controller can interact with the system at any point in time. In many service settings, however, the system manager can only interact with the system at discrete and possibly long time-intervals. That is, although relevant information is becoming available, the controller cannot exercise control before the beginning of the next review time. ******The limitation of control to discrete-time or discrete-review policies often fundamentally changes the structure of the optimal control policy, making the corresponding continuous-time policy (if known) impractical and the insights from it hard to interpret. Despite applications and potential benefits, however, discrete-review control of queueing networks has remained mostly unexplored in the literature. ******The proposed research program aims to first provide fundamental insights on the impact of imposing the discrete-review limitation on the performance of dynamic control policies, and second, to develop practical and effective discrete-review policies for control of complex queueing networks. In particular, I will consider two important operational decisions, namely dynamic capacity allocation and capacity planning, and study queueing models that are mainly motivated by applications to patient flow management in Emergency Departments (EDs). Through collaboration with two large healthcare providers (Tritium Health Partners (THP) in Mississauga, ON, and New York Presbyterian (NYP) hospital in New York, NY) and using their data, the program will involve calibrating the models, estimating the performance of the proposed polices, and working towards their implementation in practice. ******An important characteristic of this research program is that it emphasises practical policies and relies on models that are informed by real-world data. Therefore, if successful, the outcome of the research can contribute to reduction of waiting times in EDs across Canada, where overcrowding is of growing concern. Further, although the proposed models are mainly motivated by applications to patient flow management, they capture dynamics and features that are present in various service systems. Therefore, it is expected that the methods and insights developed in this program will be useful and lead to further research for other service systems where continuous-time control is not feasible, due to either human-effects or high cost of interacting with the system.