• Login
• Admin

Li, Lincan, Kwong, Chiew Foong, Liu, Qianyu and Wang, Jing (2020) A smart cache content update policy based on deep reinforcement learning. Wireless Communications and Mobile Computing, 2020 . pp. 1-11. ISSN 1530-8669

Preview

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader Available under Licence Creative Commons Attribution. Download (1MB) | Preview

Abstract

This paper proposes a DRL-based cache content update policy in the cache-enabled network to improve the cache hit ratio and reduce the average latency. In contrast to the existing policies, a more practical cache scenario is considered in this work, in which the content requests vary by both time and location. Considering the constraint of the limited cache capacity, the dynamic content update problem is modeled as a Markov decision process (MDP). Besides that, the deep Q-learning network (DQN) algorithm is utilised to solve the MDP problem. Specifically, the neural network is optimised to approximate the Q value where the training data are chosen from the experience replay memory. The DQN agent derives the optimal policy for the cache decision. Compared with the existing policies, the simulation results show that our proposed policy is 56%-64% improved in terms of the cache hit ratio and 56%-59% decreased in terms of the average latency.

Item Type:	Article
Keywords:	cache; deep reinforcement learning (DRL); deep Q-learning network (DQN); content update; cache hit ratio; average latency; spatiotemporally varying
Schools/Departments:	University of Nottingham Ningbo China > Faculty of Science and Engineering > Department of Electrical and Electronic Engineering University of Nottingham Ningbo China > Graduate School
Identification Number:	10.1155/2020/8836592
Depositing User:	Wu, Cocoa
Date Deposited:	18 Dec 2020 08:45
Last Modified:	18 Dec 2020 08:45
URI:	https://eprints.nottingham.ac.uk/id/eprint/64083

Actions (Archive Staff Only)

Edit View