Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

Bibliographic Details
Title: Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP
Authors: Vo, Phuong L., Nguyen, Nghia T., Luu, Long, Dinh, Canh T., Tran, Nguyen H., Le, Tuan-Anh
Publication Year: 2023
Collection: Computer Science
Subject Terms: Computer Science - Networking and Internet Architecture
More Details: In video streaming over HTTP, the bitrate adaptation selects the quality of video chunks depending on the current network condition. Some previous works have applied deep reinforcement learning (DRL) algorithms to determine the chunk's bitrate from the observed states to maximize the quality-of-experience (QoE). However, to build an intelligent model that can predict in various environments, such as 3G, 4G, Wifi, \textit{etc.}, the states observed from these environments must be sent to a server for training centrally. In this work, we integrate federated learning (FL) to DRL-based rate adaptation to train a model appropriate for different environments. The clients in the proposed framework train their model locally and only update the weights to the server. The simulations show that our federated DRL-based rate adaptations, called FDRLABR with different DRL algorithms, such as deep Q-learning, advantage actor-critic, and proximal policy optimization, yield better performance than the traditional bitrate adaptation methods in various environments.
Comment: 13 pages, 1 column
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2306.15860
Accession Number: edsarx.2306.15860
Database: arXiv
More Details
Description not available.