Asynchronous FDRL-based low-latency computation offloading for integrated terrestrial and non-terrestrial power IoT

Li, S., Zhang, S., Wang, Z., Zhou, Z., Wang, X., Mumtaz, S. ORCID: 0000-0001-6364-6149, Guizani, M. and Frascolla, V., 2023. Asynchronous FDRL-based low-latency computation offloading for integrated terrestrial and non-terrestrial power IoT. IEEE Network. ISSN 0890-8044

[img]
Preview
Text
1824949_Mumtaz.pdf - Post-print

Download (14MB) | Preview

Abstract

Integrated terrestrial and non-terrestrial power internet of things (IPIoT) has emerged as a paradigm shift to three-dimensional vertical communication networks for power systems in the 6G era. Computation offloading plays key roles in enabling real-time data processing and analysis for electric services. However, computation offloading in IPIoT still faces challenges of coupling between task offloading and computation resource allocation, resource heterogeneity and dynamics, and degraded model training caused by electromagnetic interference (EMI). In this article, we propose an asynchronous federated deep reinforcement learning (AFDRL)-based computation offloading framework for IPIoT, where models are uploaded asynchronously for federated averaging to relieve network congestion and improve global model training. Then, we propose Asynchronous fedeRated deep reinforcemenT learnIng-baSed low-laTency computation offloading algorithm (ARTIST) to realize low-latency computation offloading through joint optimization of task offloading and computation resource allocation. Particularly, ARTIST adopts EMI-aware federated set determination to remove aberrant local models from federated averaging and improve training accuracy. Next, a case study is developed to validate the excellent performance of ARTIST in reducing task offloading and total queuing delays.

Item Type: Journal article
Publication Title: IEEE Network
Creators: Li, S., Zhang, S., Wang, Z., Zhou, Z., Wang, X., Mumtaz, S., Guizani, M. and Frascolla, V.
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Date: 6 October 2023
ISSN: 0890-8044
Identifiers:
NumberType
10.1109/mnet.2023.3320894DOI
1824949Other
Rights: © 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Divisions: Schools > School of Science and Technology
Record created by: Laura Ward
Date Added: 27 Oct 2023 08:40
Last Modified: 27 Oct 2023 08:40
URI: https://irep.ntu.ac.uk/id/eprint/50130

Actions (login required)

Edit View Edit View

Views

Views per month over past year

Downloads

Downloads per month over past year