Sign in

Paper Video Conference

Subscribe Submit

  • Home
  • Journals
  • Focus
  • Videos
  • Achievement
  • Fronts
  • Contact Us
Journal Home Online First Current Issue Archive For Authors Journal Information 中文版

2023, Volume 21, Issue 2

Outline

Abstract

Keywords

Engineering >> 2023, Volume 21, Issue 2 doi: 10.1016/j.eng.2022.05.017

Toward Human-in-the-loop AI: Enhancing Deep Reinforcement Learning Via Real-time Human Guidance for Autonomous Driving

Show More

School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798, Singapore

Received:2021-10-09 Revised:2022-04-04 Accepted: 2022-05-10 Available online:2022-07-20

Abstract

Due to its limited intelligence and abilities, machine learning is currently unable to handle various situations thus cannot completely replace humans in real-world applications. Because humans exhibit robustness and adaptability in complex scenarios, it is crucial to introduce humans into the training loop of artificial intelligence (AI), leveraging human intelligence to further advance machine learning algorithms. In this study, a real-time human-guidance-based (Hug)-deep reinforcement learning (DRL) method is developed for policy training in an end-to-end autonomous driving case. With our newly designed mechanism for control transfer between humans and automation, humans are able to intervene and correct the agent's unreasonable actions in real time when necessary during the model training process. Based on this human-in-the-loop guidance mechanism, an improved actor-critic architecture with modified policy and value networks is developed. The fast convergence of the proposed Hug-DRL allows real-time human guidance actions to be fused into the agent's training loop, further improving the efficiency and performance of DRL. The developed method is validated by human-in-the-loop experiments with 40 subjects and compared with other state-of-the-art learning approaches. The results suggest that the proposed method can effectively enhance the training efficiency and performance of the DRL algorithm under human guidance without imposing specific requirements on participants' expertise or experience.

Keywords

Human-in-the-loop AI ; Deep reinforcement learning ; Human guidance ; Autonomous driving

Content

关注我们

Website Copyright © 2015 China Engineering Science Press Co., Ltd.

京公网安备 11010502051620号 京ICP备11030251号-2
Follow us
Website Copyright © 2015 China Engineering Science Press Co., Ltd.
京公网安备 11010502051620号 京ICP备11030251号-2