Feature engineering for deep reinforcement learning based routing
Visualitza/Obre
Cita com:
hdl:2117/190462
Tipus de documentText en actes de congrés
Data publicació2019
EditorInstitute of Electrical and Electronics Engineers (IEEE)
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
Recent advances in Deep Reinforcement Learning (DRL) techniques are providing a dramatic improvement in decision-making and automated control problems. As a result, we are witnessing a growing number of research works that are proposing ways of applying DRL techniques to network-related problems such as routing. However, such proposals failed to achieve good results, often under-performing traditional routing techniques. We argue that successfully applying DRL-based techniques to networking requires finding good representations of the network parameters: feature engineering. DRL agents need to represent both the state (e.g., link utilization) and the action space (e.g., changes to the routing policy). In this paper, we show that existing approaches use straightforward representations that lead to poor performance. We propose a novel representation of the state and action that outperforms existing ones and that is flexible enough to be applied to many networking use-cases. We test our representation in two different scenarios: (i) routing in optical transport networks and (ii) QoS-aware routing in IP networks. Our results show that the DRL agent achieves significantly better performance compared to existing state/action representations.
CitacióSuarez-varela, J. [et al.]. Feature engineering for deep reinforcement learning based routing. A: IEEE International Conference on Communications. "2019 IEEE International Conference on Communications (ICC): Shanghai, China, 20–24 May 2019: proceedings". Institute of Electrical and Electronics Engineers (IEEE), 2019, p. 1-6.
ISBN978-1-5386-8088-9
Versió de l'editorhttps://ieeexplore.ieee.org/document/8761276
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
Paper_ICC_postprint.pdf | 937,0Kb | Visualitza/Obre |