Date Added: Jun 2010
Cognitive radar is a new framework of radar system proposed by Simon Haykin recently. Adaptive waveform selection is an important problem of intelligent transmitter in cognitive radar. In this paper, the problem of adaptive waveform selection is modeled as stochastic dynamic programming model. Then backward dynamic programming, temporal difference learning and Q-learning are used to solve this problem. Optimal waveform selection algorithm and approximate solutions are proposed respectively. The simulation results demonstrate that the two approximate methods approach the optimal waveform selection scheme and have lower uncertainty of state estimation compared to fixed waveform.