Reference:

Joni Pajarinen, Jaakko Peltonen, Mikko A. Uusitalo, and Ari Hottinen. Latent state models of primary user behavior for opportunistic spectrum access. In Proceedings of IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Tokyo, Japan, September 2009.

Abstract:

Opportunistic spectrum access, where cognitive radio devices detect available unused radio channels and exploit them for communication, avoiding collisions with existing users of the channels, is a central topic of research for future wireless communication. When each device has limited resources to sense which channels are available, the task becomes a reinforcement learning problem that has been studied with partially observable Markov decision processes (POMDPs). However, current POMDP solutions are based on simplistic representations where channels are simply on/off (transmitting or idle). We show that more complicated Markov models where on/off states are part of complicated behavior of the channel owner (primary user) yield better POMDPs achieving more successful transmissions and less collisions.

2009 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

Suggested BibTeX entry:

@inproceedings{pajarinen09,
    address = {Tokyo, Japan},
    author = {Joni Pajarinen and Jaakko Peltonen and Mikko A. Uusitalo and Ari Hottinen},
    booktitle = {{Proceedings of IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)}},
    month = {September},
    title = {{Latent state models of primary user behavior for opportunistic spectrum access}},
    year = {2009},
}