Research on constrained policy reinforcement learning based multi-objective optimization of computing power network

Bibliographic Details
Title: Research on constrained policy reinforcement learning based multi-objective optimization of computing power network
Authors: Linjiang SHEN, Chang CAO, Chao CUI, Yan ZHANG
Source: Dianxin kexue, Vol 39, Pp 136-148 (2023)
Publisher Information: Beijing Xintong Media Co., Ltd, 2023.
Publication Year: 2023
Collection: LCC:Telecommunication
LCC:Technology
Subject Terms: computing power network, multi-objective optimization, reinforcement learning, Telecommunication, TK5101-6720, Technology
More Details: The computing power network needs to maximize the system performance index on the basis of meeting user business needs, and the existing methods are mainly based on the multi-objective weighting method, which has problems such as difficult to determine hyperparameters and poor cross-scenario applicability.Based on this, based on the analysis of the characteristics of the computing power network target, the user business requirements were taken as the policy constraints, and the performance indicators of the computing power network was taken as the optimization goal based on constrained policy optimization, and the expectation certainty of user business needs and the optimization of system performance through the value-strategy-hyper-parameter multi-level iterative strategy was realized.At the same time, the multi-scale step length (MSL) method for hyper-parameter optimization was studied, which further improved the stability and accuracy of the system.Simulation results show that the proposed method has good convergence and stability under the conditions of single terminal-single edge server, multi-terminal-multi-edge server and system load change.
Document Type: article
File Description: electronic resource
Language: Chinese
ISSN: 1000-0801
Relation: https://doaj.org/toc/1000-0801
DOI: 10.11959/j.issn.1000-0801.2023165
Access URL: https://doaj.org/article/215557ab731c4d93a1ccc0088f6a734e
Accession Number: edsdoj.215557ab731c4d93a1ccc0088f6a734e
Database: Directory of Open Access Journals
More Details
ISSN:10000801
DOI:10.11959/j.issn.1000-0801.2023165
Published in:Dianxin kexue
Language:Chinese