Various systems across a broad range of applications contain tandem queues. Strong dependence between the servers has proven to make such networks complicated and difficult to study. Exact analysis is rarely computationally tractable and sometimes not even possible. Nevertheless, as it is most often the case in reality, there are costs associated with running such systems, and therefore, optimizing the control of tandem queues is of main interest from both a theoretical and a practical point of view. Motivated by this, the present paper considers a tandem queueing network with linear holding costs and a startup cost for the second server. In our work, we present a rather intuitive, easy to understand, and at the same time very accurate technique to approximate the optimal decision policy. Extensive numerical experimentation shows that the approximation works extremely well for a wide range of parameter combinations.

Additional Metadata
Keywords Approximation algorithm, MDP, optimal control, startup costs, tandem queue
Persistent URL dx.doi.org/10.1080/15326349.2018.1491314
Journal Stochastic Models
Citation
Hristov, A. V, Bhulai, S, van der Mei, R.D, & Bosman, J.W. (2018). Control of a tandem queue with a startup cost for the second server. Stochastic Models. doi:10.1080/15326349.2018.1491314