Ajou University repository

Quantum Multi-Agent Reinforcement Learning for Autonomous Mobility Cooperationoa mark
  • Park, Soohyun ;
  • Kim, Jae Pyoung ;
  • Park, Chanyoung ;
  • Jung, Soyi ;
  • Kim, Joongheon
Citations

SCOPUS

24

Citation Export

Publication Year
2024-06-01
Publisher
Institute of Electrical and Electronics Engineers Inc.
Citation
IEEE Communications Magazine, Vol.62, pp.106-112
Mesh Keyword
Autonomous mobilitiesConvergenceConvergence difficultyFast convergenceMachine learning algorithmsMobility systemsMulti-agent reinforcement learningProjection valueQuantum ComputingReinforcement learnings
All Science Classification Codes (ASJC)
Computer Science ApplicationsComputer Networks and CommunicationsElectrical and Electronic Engineering
Abstract
For Industry 4.0 Revolution, cooperative autonomous mobility systems are widely used based on multi-agent reinforcement learning (MARL). However, the MARL-based algorithms suffer from huge parameter utilization and convergence difficulties with many agents. To tackle these problems, a quantum MARL (QMARL) algorithm based on the concept of actor-critic network is proposed, which is beneficial in terms of scalability, to deal with the limitations in the noisy intermediate-scale quantum (NISQ) era. Additionally, our QMARL is also beneficial in terms of efficient parameter utilization and fast convergence due to quantum supremacy. Note that the reward in our QMARL is defined as task precision over computation time in multiple agents, thus, multi-agent cooperation can be realized. For further improvement, an additional technique for scalability is proposed, which is called projection value measure (PVM). Based on PVM, our proposed QMARL can achieve the highest reward by reducing the action dimension into a logarithmic-scale. Finally, we can conclude that our proposed QMARL with PVM outperforms the other algorithms in terms of efficient parameter utilization, fast convergence, and scalability.
Language
eng
URI
https://dspace.ajou.ac.kr/dev/handle/2018.oak/33635
DOI
https://doi.org/10.1109/mcom.020.2300199
Fulltext

Type
Article
Funding
This research was funded by the National Research Foundation of Korea (2022R1A2C2004869).
Show full item record

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Jung, Soyi Image
Jung, Soyi정소이
Department of Electrical and Computer Engineering
Read More

Total Views & Downloads

File Download

  • There are no files associated with this item.