高级检索

人机协同决策的异质多智能体路径规划

Heterogeneous Multi-Agent Path Planning with Human-Machine Collaborative Decision-Making

  • 摘要: 针对路径规划研究中对智能体的异质性和人的经验与认知注入考虑不足的问题,提出一种混合现实场景下的人机协同决策异质多智能体路径规划方法。首先,提出基于危险度引导点和RVO(reciprocal velocity obstacles)局部避障的异质多智能体深度强化学习方法,根据智能体的异质性进行全局引导和局部指导,设计适用于异质智能体的奖励函数,以有效解决稀疏奖励问题;然后,在基于混合现实的虚实智能体交互过程中,融入人的经验以修正智能方法规划的路径,增强人的指导,实现人机协同决策路径规划,弥补了智能方法的不足。在2D、3D和混合现实场景下的实验结果表明,所提方法不仅适用于异质多智能体路径规划,还能在混合现实场景下实现人机协同决策规划,在成功率、收敛性、路径长度、拐点数等评价指标上均优于对比方法。

     

    Abstract: To address the issues of insufficient consideration of agent heterogeneity and the integration of human experience and cognition in path planning research, this paper proposes a human-machine collaborative decision-making heterogeneous multi-agent path planning method in a mixed reality scenario. First, a heterogeneous multi-agent deep reinforcement learning method is introduced, based on danger-guided points and RVO (reciprocal velocity obstacles) for local collision avoidance. This method provides global guidance and local instructions according to agent heterogeneity, with a reward function tailored for heterogeneous agents to address the sparse reward problem. Then, during the virtual-physical agent interaction process in mixed reality, human experience is incorporated to adjust the paths generated by intelligent methods, enhancing human guidance and enabling human-machine collaborative decision-making in path planning to compensate for the limitations of intelligent methods. Experimental results in 2D, 3D, and mixed reality scenarios demonstrate that the proposed method not only applies to heterogeneous multi-agent path planning but also achieves collaborative decision-making planning in mixed reality. It outperforms comparative methods in success rate, convergence, path length, and number of turns.

     

/

返回文章
返回