VISAR: Vision-Based Robotic Arm System for Intelligent Industrial Inspection
VISAR (Vision-based Intelligent System for Automated Robotic Inspection) is an intelligent inspection system that leverages a vision-equipped robotic arm to address key challenges in real-time target detection, dynamic path planning, and precise spatial localization. The system integrates a lightweight YOLOv5-ShuffleNetv2 model for efficient object recognition, combined with Canny edge detector and HSV-based color segmentation for robust target localization. Adaptive path planning is achieved using the A* algorithm, while accurate coordination between the camera and robotic arm is ensured through a nonlinear optimization-based hand-eye calibration. Implemented on the Robot Operating System (ROS) with a QT5-based user interface, the system has been validated through both Gazebo simulations and real-world tests on industrial cabinets. Results demonstrate its high efficiency, accuracy, and reliability in complex environments, showcasing strong potential for advancing automation in industrial inspection and manufacturing applications.
References
- Ma Y. Target tracking and detection based on YOLOv5 algorithm [C]. Proceedings of the 5th International Conference on Computing and Data Science. Haide College, Ocean University of China, 2023:418-428.
- Ma, N, Zhang, X, Zheng, H, Sun, J. ShuffleNet V2: Practical guidelines for efficient CNN architecture design [C]. Proceedings of the European Conference on Computer Vision (ECCV), 2018:116–131.
- Durgadevi P, Akilan T, Pradhan A, Shariff AM, Yadav N, Uppal P. Canny edge detection techniques for image segmentation [C]. 4th International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), Greater Noida, India, 2022:986-989. IEEE.
- Kang M, Fenglei N, Zhaoyang C, et al. A unified calibration method for robot manipulators: hand-eye parameters, kinematic parameters and TCP position calibration [J]. Robotic Intelligence and Automation, 2024, 44(6):897-909.
- Fu X, Huang Z, Zhang G, et al. Research on path planning of mobile robots based on improved A* algorithm [J]. PeerJ. Computer science, 2025, 11e2691.