Stochastic Optimization for Markov Modulated Networks With Application to Delay Constrained Wireless Scheduling

Download Now Date Added: Dec 2009
Format: PDF

The authors consider a wireless system with a small number of delay constrained users and a larger number of users without delay constraints. They develop a scheduling algorithm that reacts to time varying channels and maximizes throughput (to within a desired proximity), stabilizes all queues, and satisfies the delay constraints. The problem is solved by reducing the constrained optimization to a set of weighted stochastic shortest path problems, which act as natural generalizations of max-weight policies to Markov modulated networks.