Minimizing Queue Length Regret for Arbitrarily Varying Channels

Bibliographic Details
Title: Minimizing Queue Length Regret for Arbitrarily Varying Channels
Authors: Krishnakumar, G, Sinha, Abhishek
Publication Year: 2025
Collection: Computer Science
Mathematics
Subject Terms: Computer Science - Information Theory, Computer Science - Machine Learning, Computer Science - Networking and Internet Architecture
More Details: We consider an online channel scheduling problem for a single transmitter-receiver pair equipped with $N$ arbitrarily varying wireless channels. The transmission rates of the channels might be non-stationary and could be controlled by an oblivious adversary. At every slot, incoming data arrives at an infinite-capacity data queue located at the transmitter. A scheduler, which is oblivious to the current channel rates, selects one of the $N$ channels for transmission. At the end of the slot, the scheduler only gets to know the transmission rate of the selected channel. The objective is to minimize the queue length regret, defined as the difference between the queue length at some time $T$ achieved by an online policy and the queue length obtained by always transmitting over the single best channel in hindsight. We propose a weakly adaptive Multi-Armed Bandit (MAB) algorithm for minimizing the queue length regret in this setup. Unlike previous works, we do not make any stability assumptions about the queue or the arrival process. Hence, our result holds even when the queueing process is unstable. Our main observation is that the queue length regret can be upper bounded by the regret of a MAB policy that competes against the best channel in hindsight uniformly over all sub-intervals of $[T]$. As a technical contribution of independent interest, we then propose a weakly adaptive adversarial MAB policy which achieves $\tilde{O}(\sqrt{N}T^{\frac{3}{4}})$ regret with high probability, implying the same bound for queue length regret.
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2501.13551
Accession Number: edsarx.2501.13551
Database: arXiv
More Details
Description not available.