基于红外与可见光图像匹配的巡检机器人障碍识别与分类

Inspection Robot Obstacle Recognition and Classification Based on Infrared and Visible Light Image Matching

  • 摘要: 在电网、桥梁等较为复杂的工况环境下,巡检机器人可以有效代替人工进行设备的检测与维护。为了实现巡检机器人在复杂环境中的自动避障作业,提出了基于YOLOv5深度学习网络模型的红外与可见光图像匹配识别技术,使机器人能够识别并分类各种障碍物,包括活体和非活体障碍。在实际巡检作业中,机器人同时配置红外相机和普通相机实时监测其前方环境。基于大量数据的训练后的YOLOv5网络模型,机器人能够快速、准确识别并判断前方障碍物并进行分类,平均识别精度高达99.2%。机器人不仅能够识别障碍物的性质,还能采取相应的主动动作来应对不同情况。实验结果充分证明了这种基于多种图像信息的综合避障方法的有效性。机器人能够在不同场景中检测、分类和规避障碍物,从而提高了其自主性和适应性。该技术在自动化巡检、安全监测以及救援任务等领域具有广泛的应用前景,为机器人技术的不断发展提供了有力支持。

     

    Abstract: In complex environments such as power grids and bridges, inspection robots can effectively replace manual inspections and equipment maintenance. To achieve autonomous obstacle avoidance for inspection robots in complex environments, this study proposes an image-matching recognition technique based on the YOLOv5 deep-learning network model, which utilizes both IR and visible-light images. This enables the robot to identify and classify various obstacles, including living and nonliving obstacles. During the inspection operations, the robot is equipped with an IR camera and a regular camera to monitor its environment in real time. With the YOLOv5 network model trained on a large dataset, the robot can quickly and accurately identify and categorize obstacles along its path. The robot not only identifies the nature of obstacles but also performs appropriate proactive actions to address different situations. The average recognition accuracy is approximately 99.2%. Experimental results demonstrate the effectiveness of the comprehensive obstacle avoidance method based on multiple-image information. The robot can detect, classify, and navigate obstacles under various scenarios, thereby enhancing their autonomy and adaptability. This technology has wide applications in areas such as automated inspections, safety monitoring, and rescue missions, providing strong support for the continuous development of robotic technologies.

     

/

返回文章
返回