Learn More by Using Less: Distributed Learning with Energy-Constrained Devices

Bibliographic Details
Title: Learn More by Using Less: Distributed Learning with Energy-Constrained Devices
Authors: Pereira, Roberto, Vaca-Rubio, Cristian J., Blanco, Luis
Publication Year: 2024
Collection: Computer Science
Subject Terms: Computer Science - Machine Learning, Computer Science - Distributed, Parallel, and Cluster Computing, Electrical Engineering and Systems Science - Signal Processing
More Details: Federated Learning (FL) has emerged as a solution for distributed model training across decentralized, privacy-preserving devices, but the different energy capacities of participating devices (system heterogeneity) constrain real-world implementations. These energy limitations not only reduce model accuracy but also increase dropout rates, impacting on convergence in practical FL deployments. In this work, we propose LeanFed, an energy-aware FL framework designed to optimize client selection and training workloads on battery-constrained devices. LeanFed leverages adaptive data usage by dynamically adjusting the fraction of local data each device utilizes during training, thereby maximizing device participation across communication rounds while ensuring they do not run out of battery during the process. We rigorously evaluate LeanFed against traditional FedAvg on CIFAR-10 and CIFAR-100 datasets, simulating various levels of data heterogeneity and device participation rates. Results show that LeanFed consistently enhances model accuracy and stability, particularly in settings with high data heterogeneity and limited battery life, by mitigating client dropout and extending device availability. This approach demonstrates the potential of energy-efficient, privacy-preserving FL in real-world, large-scale applications, setting a foundation for robust and sustainable pervasive AI on resource-constrained networks.
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2412.02289
Accession Number: edsarx.2412.02289
Database: arXiv
More Details
Description not available.