Reinforcement Learning Based Mobility Load Balancing with the Cell Individual Offset

Asghari M. Z., ÖZTÜRK M., Hamalainen J.

93rd IEEE Vehicular Technology Conference, VTC 2021-Spring, Virtual, Online, 25 - 28 April 2021 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume:
  • Doi Number: 10.1109/vtc2021-spring51267.2021.9448785
  • City: Virtual, Online
  • Keywords: Mobility load balancing, self-organizing networks, 5G, machine learning, reinforcement learning, cell individual offset
  • Ankara Yıldırım Beyazıt University Affiliated: Yes

Abstract

© 2021 IEEE.In this study, we focus on the cell individual offset (CIO) parameter in the handover process, which represents the willingness of a cell to admit the incoming handovers. However, it is challenging to tune the CIO parameter, as any poor implementation can lead to undesired outcomes, such as making the neighboring cells over-loaded while decreasing the traffic load of the cell. In this work, a reinforcement learning-based approach for parameter selection is introduced, since it is quite convenient for dynamically changing environments. In that regard, two different techniques, namely Q-learning and SARSA, are proposed, as they are known for their multi-objective optimization capabilities. Moreover, fixed CIO values are used as a benchmark for the proposed methods for comparison purposes. Results reveal that the reinforcement learning assisted mobility load balancing (MLB) approach can alleviate the burden on the overloaded cells while keeping the neighboring cells at some reasonable load levels. The proposed methods outperform the fixed-parameter solution in terms of the given metric.