Q-learning-based cross-layer Learning Engine design for cognitive radio network

Congbin Liu; Hong Jiang; Yanchao Yang; Jinghui Ma

doi:10.1117/12.2014021

13 March 2013 Q-learning-based cross-layer Learning Engine design for cognitive radio network

Congbin Liu, Hong Jiang, Yanchao Yang, Jinghui Ma

Proceedings Volume 8784, Fifth International Conference on Machine Vision (ICMV 2012): Algorithms, Pattern Recognition, and Basic Technologies; 878419 (2013) https://doi.org/10.1117/12.2014021
Event: Fifth International Conference on Machine Vision (ICMV 12), 2012, Wuhan, China

Abstract

In cognitive radio (CR) networks, Learning Engine has considerable significance on dynamic spectrum access (DSA) and implementation of cognitive function. In this paper, a cross-layer learning engine design scheme is proposed by jointly considering physical-layer dynamic channel selection, modulation and coding scheme, data-link layer frame length in CR networks, with the purpose to maximize system throughput and simultaneously meet heterogeneous Quality of Service (QoS) requirements. The wireless fading channel is modeled as a continuous state space Markov decision process (MDP) and the licensed network activity is abstracted as a finite-state one. We introduce Q-learning algorithm to realize the function of learning from state space and adapt wireless environment. And meanwhile a large scale Qfunction approximator based on support vector machine (SVM) is employed to effectively reduce storage requirement and decrease the operation complexity. A cross-layer learning engine communication platform is realized by using Matlab simulator. the simulation results demonstrate that while lacking system prior knowledge, the learning engine can effectively achieve configuration function by system cross-layer learning approach, and furthermore, it can converge to the best—i.e., realize reconfiguration function in CR networks while meeting users’ QoS.

Citation Download Citation

Congbin Liu, Hong Jiang, Yanchao Yang, and Jinghui Ma "Q-learning-based cross-layer Learning Engine design for cognitive radio network", Proc. SPIE 8784, Fifth International Conference on Machine Vision (ICMV 2012): Algorithms, Pattern Recognition, and Basic Technologies, 878419 (13 March 2013); https://doi.org/10.1117/12.2014021

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available