Open Access Open Access  Restricted Access Subscription Access

QRED: A Q-Learning-based Active Queue Management Scheme

Yuhan Su,
Lianfen Huang,
Chenwei Feng,


The Active Queue Management (AQM) algorithm is one of most important research fields in network congestion control. To adjust the maximum dropping probability (maxp) according to the network situation the maxp calculation based on the RED algorithm is improved using the Q-learning algorithm, and a new algorithm, known as QRED (Q-learning RED), is proposed. The self-adaptive adjustment for the maxp is achieved using the QRED algorithm and the queue length stability in a dynamic network environment is realized. In addition, the QRED algorithm not only avoids the sensitivity of the RED algorithm parameters, but also adapts the packet loss rate according to the specific network service type. Results based on the NS2 simulation show that the QRED algorithm has better stability in complex network environments, and hence, are superior to the RED active queue management algorithm.

Citation Format:
Yuhan Su, Lianfen Huang, Chenwei Feng, "QRED: A Q-Learning-based Active Queue Management Scheme," Journal of Internet Technology, vol. 19, no. 4 , pp. 1169-1178, Jul. 2018.

Full Text:



  • There are currently no refbacks.

Published by Executive Committee, Taiwan Academic Network, Ministry of Education, Taipei, Taiwan, R.O.C
JIT Editorial Office, Library and Information Center, National Dong Hwa University
No. 1, Sec. 2, Da Hsueh Rd. Shoufeng, Hualien 97401, Taiwan, R.O.C.
Tel: +886-3-931-7017  E-mail: