Reduced Dimension Policy Iteration for Wireless Network Control Via Multiscale Analysis
A novel framework for the analysis and optimization of wireless networks operations is proposed. The temporal evolution of the state of the network is modeled as the trajectory of the state of a Finite State Machine (FSM). The state space of the FSM and the statistics of state transition are represented as a directed graph. Graph reduction and transform techniques are proposed to reduce the dimension of the graph associated with the FSM and analyze the properties of functions defined on its state space.