Federated Reinforcement Learning for Wireless Networks: Fundamentals, Challenges and Future Research Trends

Bibliographic Details
Title: Federated Reinforcement Learning for Wireless Networks: Fundamentals, Challenges and Future Research Trends
Authors: Sree Krishna Das, Ratna Mudi, Md. Siddikur Rahman, Khaled M. Rabie, Xingwang Li
Source: IEEE Open Journal of Vehicular Technology, Vol 5, Pp 1400-1440 (2024)
Publisher Information: IEEE, 2024.
Publication Year: 2024
Collection: LCC:Transportation engineering
LCC:Transportation and communications
Subject Terms: Federated reinforcement learning, power allocation, bandwidth allocation, interference mitigation, communication mode selection, Transportation engineering, TA1001-1280, Transportation and communications, HE1-9990
More Details: The increasing popularity of Internet of Things (IoT)-based wireless services highlights the urgent need to upgrade fifth-generation (5G) wireless networks and beyond to accommodate these services. Although 5G networks currently support a variety of wireless services, they might not fully meet the high computational and communication resource demands of new applications. Issues such as latency, energy consumption, network congestion, signaling overhead, and potential privacy breaches contribute to this limitation. Machine learning (ML) frequently offers solutions to these problems. As a result, sixth-generation (6G) wireless technologies are being developed to address the deficiencies of 5G networks. Traditional ML methods are generally centralized. However, the vast amount of wireless data generated, growing privacy concerns, and the increasing computational capabilities of edge devices have led to a shift towards optimizing system performance in a distributed manner. This paper provides a thorough analysis of distributed learning techniques, including federated learning (FL), multi-agent reinforcement learning (MARL), and the multi-agent federated reinforcement learning (FRL) framework. It explains how these techniques can be effectively and efficiently implemented in wireless networks. These methods offer potential solutions to the challenges faced by current wireless networks, promising to create a more robust, capable, and versatile network that meets the growing demands of IoT and other emerging applications. Implementing the FRL framework can significantly improve the learning efficiency of wireless networks. To tackle the challenges posed by rapidly changing radio channels, we propose a robust FRL framework that enables local users to perform distributed power allocation, bandwidth allocation, interference mitigation, and communication mode selection. Finally, the paper outlines several future research directions aimed at effectively integrating the FRL framework into wireless networks.
Document Type: article
File Description: electronic resource
Language: English
ISSN: 2644-1330
Relation: https://ieeexplore.ieee.org/document/10691666/; https://doaj.org/toc/2644-1330
DOI: 10.1109/OJVT.2024.3466858
Access URL: https://doaj.org/article/12d76ca06a6048b5ae8cb37272243020
Accession Number: edsdoj.12d76ca06a6048b5ae8cb37272243020
Database: Directory of Open Access Journals
More Details
ISSN:26441330
DOI:10.1109/OJVT.2024.3466858
Published in:IEEE Open Journal of Vehicular Technology
Language:English