Show simple item record

dc.contributor.authorVilà Muñoz, Irene
dc.contributor.authorPérez Romero, Jordi
dc.contributor.authorSallent Roig, José Oriol
dc.contributor.authorUmbert Juliana, Anna
dc.contributor.otherUniversitat Politècnica de Catalunya. Doctorat en Teoria del Senyal i Comunicacions
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament de Teoria del Senyal i Comunicacions
dc.date.accessioned2021-11-08T17:10:02Z
dc.date.available2021-11-08T17:10:02Z
dc.date.issued2021-07-27
dc.identifier.citationVila, I. [et al.]. A multi-agent reinforcement learning approach for capacity sharing in multi-tenant scenarios. "IEEE transactions on vehicular technology", 27 Juliol 2021, vol. 70, núm. 9, p. 9450-9465.
dc.identifier.issn0018-9545
dc.identifier.urihttp://hdl.handle.net/2117/355785
dc.description© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
dc.description.abstract5G is envisioned to simultaneously provide diverse service types with heterogeneous needs under very different application scenarios and business models. Therefore, network slicing is included as a key feature of the 5G architecture to allow sharing a common infrastructure among different tenants, such as mobile communication providers, vertical market players, etc. In order to provide the Radio Access Network (RAN) with network slicing capabilities, mechanisms that efficiently distribute the available capacity among the different tenants while satisfying their needs are required. For this purpose, this paper proposes a multi-agent reinforcement learning approach for RAN capacity sharing. It makes use of the Deep Q-Network algorithm in a way that each agent is associated to a different tenant and learns the capacity to be provided to this tenant in each cell while ensuring that the service level agreements are satisfied and that the available radio resources are efficiently used. The consideration of multiple agents contributes to a better scalability and higher learning speed in comparison to single-agent approaches. In this respect, results show that the policy learnt by the agent of one tenant can be generalised and directly applied by other agents, thus reducing the complexity of the training and making the proposed solution easily scalable, e.g., to add new tenants in the system. The proposed approach is well aligned with the on-going 3GPP standardization work and guidelines for the parametrization of the solution are provided, thus enforcing its practical applicability.
dc.description.sponsorshipThis work was supported in part by the Spanish Research Council and FEDER funds under SONAR 5G Grant ref. TEC2017-82651-R, in part by the European Commission’s Horizon 2020 5G-CLARITY project under Grant 871428, and in part by the Secretariat for Universities and Research of the Ministry of Business and Knowledge of the Government of Catalonia under Grant 2020FI_B2 00075.
dc.format.extent16 p.
dc.language.isoeng
dc.publisherInstitute of Electrical and Electronics Engineers (IEEE)
dc.subjectÀrees temàtiques de la UPC::Enginyeria de la telecomunicació
dc.subject.lcshMobile communication systems
dc.subject.otherRAN Slicing
dc.subject.otherCapacity Sharing
dc.subject.otherMulti-Agent Reinforcement Learning
dc.subject.otherDeep Q-Network.
dc.titleA multi-agent reinforcement learning approach for capacity sharing in multi-tenant scenarios
dc.typeArticle
dc.subject.lemacComunicacions mòbils, Sistemes de
dc.contributor.groupUniversitat Politècnica de Catalunya. GRCM - Grup de Recerca en Comunicacions Mòbils
dc.identifier.doi10.1109/TVT.2021.3099557
dc.description.peerreviewedPeer Reviewed
dc.relation.publisherversionhttps://ieeexplore.ieee.org/document/9497684
dc.rights.accessOpen Access
local.identifier.drac31784095
dc.description.versionPostprint (author's final draft)
dc.relation.projectidinfo:eu-repo/grantAgreement/EC/H2020/871428/EU/Beyond 5G multi-tenant private networks integrating Cellular, WiFi, and LiFi, Powered by ARtificial Intelligence and Intent Based PolicY/5G-CLARITY
dc.relation.projectidinfo:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016/TEC2017-82651-R/ES/SOFTWARIZACION Y OPTIMIZACION AUTOMATICA DE REDES DE ACCESO RADIO 5G MULTI-TENANT/
local.citation.authorVila, I.; Perez-Romero, J.; Sallent, J.; Umbert, A.
local.citation.publicationNameIEEE transactions on vehicular technology
local.citation.volume70
local.citation.number9
local.citation.startingPage9450
local.citation.endingPage9465


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record

All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder