Chapter

Whittle's Indexation Approach to and Applications of Bi-Objective Two-State Binary-Action Markov Decision Processes

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

In this chapter we present how the Whittle's indexation approach, originally developed for the restless bandits problem, can be used to address multi-objective stochastic optimization problems. For clarity, we focus on Markov decision processes with two objectives, two states and two actions, and provide an optimal solution in terms of Whittle indices. We then broadly discuss the applications of our solution in optimal scheduling of queueing systems with abandonments and optimal choice of venture capitalists investments. We believe there is a need to develop the Whittle index theory further in order to tackle more general multi-objective problems.

No full-text available

Request Full-text Paper PDF

To read the full-text of this research,
you can request a copy directly from the authors.

ResearchGate has not been able to resolve any citations for this publication.
ResearchGate has not been able to resolve any references for this publication.