Distributed Learning in Multiuser OFDMA Femtocell Networks
This paper elaborates on self-organized and distributed interference management for femtocells that share the available radio resources with macrocells. A multi-agent learning approach is examined, based on distributed Q-learning, where femtocell base stations control their transmit power, such that the femtocell capacity is maximized, while the aggregated downlink interference generated at macro users' receivers is maintained within acceptable limits. The distributed Q-learning algorithm is carried out at the femto nodes, in the way that the interference is controlled at each resource block. This paper is to integrate multi-user scheduling in the operation of the macrocell network, so that instantaneous changes, with 1 ms granularity, are encountered in the perception that the femtocell agents get of the environment under observation.