Open AccessQ ‐learning based computation offloading for multi‐UAV‐enabled cloud‐edge computing networks
Author(s) -
Wang Meng,
Shi Shuo,
Gu Shushi,
Gu Xuemai,
Qin Xue
Publication year - 2020
Publication title -
iet communications
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.355
H-Index - 62
eISSN - 1751-8636
pISSN - 1751-8628
DOI - 10.1049/iet-com.2019.1184
Subject(s) - computation offloading , computer science , cloud computing , mobile edge computing , distributed computing , edge computing , server , benchmark (surveying) , flexibility (engineering) , enhanced data rates for gsm evolution , computation , computer network , artificial intelligence , algorithm , operating system , statistics , mathematics , geodesy , geography
Unmanned aerial vehicles (UAVs) have been recently considered as a flying platform to provide wide coverage and relaying services for mobile users (MUs). Mobile edge computing (MEC) is developed as a new paradigm to improve quality of experience of MUs in future networks. Motivated by the high flexibility and controllability of UAVs, in this study, the authors study a multi‐UAV‐enabled MEC system, in which UAVs have computation resources to offer computation offloading opportunities for MUs, aiming to reduce MUs' total consumptions in terms of time and energy. Considering the rich computation resource in the remote cloud centre, they propose the MUs‐Edge‐Cloud three‐layer network architecture, where UAVs play the role of flying edge servers. Based on this framework, they formulate the computation offloading issue as a mixed‐integer non‐linear programming problem, which is difficult to obtain an optimal solution in general. To address this, they propose an efficient Q ‐learning based computation offloading algorithm (QCOA) to reduce the complexity of optimisation problem. Numerical results show that the proposed QCOA outperforms benchmark offloading policies (e.g. random offloading, traversal offloading). Furthermore, the proposed three‐layer network architecture achieves a 5% benefits compared with the traditional two‐layer network architecture in terms of MUs' energy and time consumptions.