Transmission control in cognitive radio as a Markovian dynamic game: Structural result on randomized threshold policies

Abstract——This paper considers an uplink time division multiple access (TDMA) cognitive radio network where multiple cognitive radios (secondary users) attempt to access a spectrum hole. We assume that each secondary user can access the channel according to a decentralized predened access rule based on the channel quality and the transmission delay of each secondary user. By modeling secondary user block fading channel qualities as a nite state Markov chain, we formulate the transmission rate adaptation problem of each secondary user as a general-sum Markovian dynamic game with a delay constraint. Conditions are given so that the Nash equilibrium transmission policy of each secondary user is a randomized mixture of pure threshold policies. Such threshold policies can be easily implemented. We then present a stochastic approximation algorithm that can adaptively estimate the Nash equilibrium policies and track such policies for non-stationary problems where the statistics of th...

• Type: Journal
• Year: 2010
• Where: TCOM
• Authors: J. Huang, V. Krishnamurthy
• Keywords: Secondary User, TCOM 2010, Threshold Policies, User